Commit Graph

77074 Commits

Author SHA1 Message Date
Haomai Wang
584f64e5e4 msg/async/rdma: add atomic and lock protection
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-08-11 10:11:33 +08:00
Alex Mikheev
6b773887a3 msg/async/rdma: fixes crash in fio
fio creates multiple CephContext in a single process.
Crash(es) happen because rdma stack has a global resources that
are still used from one ceph context while have already been destroyed
by another context.

The commit removes global instances of RDMA dispatcher and infiniband
and makes them context (rdma stack) specific.

Signed-off-by: Adir Lev <adirl@mellanox.com>
Signed-off-by: Alex Mikheev <alexm@mellanox.com>
2017-08-11 10:00:01 +08:00
Haomai Wang
25fce20d63 Merge pull request #16980 from ceph/revert-16893-wip-fix-multicct-ib
Revert "msg/async/rdma: fix multi cephcontext confllicting"
2017-08-11 09:58:17 +08:00
Haomai Wang
f8a7e705c5 Revert "msg/async/rdma: fix multi cephcontext confllicting" 2017-08-11 09:57:41 +08:00
David Zafman
96ed4eedc0 Merge pull request #16977 from liewegas/wip-no-pidfile
test/CMakeLists: disable test_pidfile.sh

Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
2017-08-10 18:41:38 -07:00
David Zafman
16ea9b1571 test: Fix and enable test_pidfile.sh
Increase delay so daemonized process can make progress and write/lock pidfile
Add --log_flush_on_exit to ensure log gets flushed for TEST_without_pidfile test

Fixes: http://tracker.ceph.com/issues/20770

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 18:24:29 -07:00
Yanhu Cao
7f336f2366 mgr/DaemonServer.cc: add 'is_valid=false' when decode caps error
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2017-08-11 09:16:19 +08:00
xie xingguo
d792e8d528 crush: "osd crush class rename" support
In 076a6abd80 I killed the 'class rename' command
and thought it was totally useless but I was wrong.

Consider the following user case:
(1) randomly choose some OSDs(e.g., from different hosts) and try to make them for private use only,
    say, by grouping them into 'pool1'
(2) ceph osd crush set-device-class pool1 'OSDs from (1)'
(3) ceph osd crush rule create-replicated rule_for_pool1 default host pool1
(4) ceph osd pool rename pool1 pool2
(5) ceph osd crush class rename pool1 pool2

From the above user case, we need to safely change a pool name without worrying
any risk of data migration. That is why the 'osd crush class rename' command
is still needed here.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-11 08:32:39 +08:00
Sage Weil
ff3de23044 test/CMakeLists: disable test_pidfile.sh
Too flaky, see http://tracker.ceph.com/issues/20975

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 15:41:38 -04:00
David Zafman
e24ac51a82 qa: Fix broken test_activate_osd() due to missing space
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
ae2c5331fb qa: Fix races with waiting for scrubs
The trigger_scrub sets the last_scrub_stamp backwards to
force a scheduled scrub.  In a small window this stamp could get propagated
to the mgr.  A test failure occurred because wait_for_scrub() was confused
by seeing a backward moving date.

The most critical change is having wait_for_scrub() make sure that the
date advances past the previous in value.

A test failed because the random backoff kept delayed triggered scrub, so
set osd_scrub_backoff throughout.

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
dddda523d1 qa: Testing of ceph-helpers.sh, teardown on fail to dump logs, save cores
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
1fe6cb0f02 osd: Avoid confusion over legacy snaps when head_exists corrupt
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
c140457489 osd: Fix Paxos shutdown handling for commit_finish race
Fixes: http://tracker.ceph.com/issues/20921

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:04 -07:00
David Zafman
229de6b71d qa: Add support for core dumps
Save core dumps when running tests locally
Dump logs to output whenever cores seen

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:04 -07:00
Sage Weil
1e606708bc Merge pull request #16918 from liewegas/wip-doc-bluestore-migration
doc/rados/operations/bluestore-migration: document bluestore migration process

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2017-08-10 14:15:31 -05:00
Sage Weil
f7398ddd23 doc/rados/operations/bluestore-migration: document bluestore migration process
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 15:15:03 -04:00
Sage Weil
a60f690144 Merge pull request #16975 from theanalyst/doc-12-1-3-release-notes
doc: 12.1.3 release notes

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 13:30:05 -05:00
Sage Weil
a499f682b1 Merge pull request #16974 from liewegas/wip-release-notes
doc/release-notes: remove mention of crush weight optimization

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-08-10 13:29:25 -05:00
Greg Farnum
c85af7b146 qa: test that "fs new" correctly set the application_metadata
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-08-10 11:09:38 -07:00
Abhishek Lekshmanan
e34d10ae10 doc: 12.1.3 release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-08-10 20:00:19 +02:00
Sage Weil
e9728fc71b doc/release-notes: remove mention of crush weight optimization
It's not there yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 13:36:51 -04:00
Matt Benjamin
1d9a4c47c4 Merge pull request #15330 from guihecheng/rgw_file-fsid-mount
rgw_file: introduce new fsid and rgw_mount
2017-08-10 13:32:27 -04:00
Greg Farnum
435717791e mdsmon: treat the osdmon correctly when doing plugged updates
Make sure it's writeable before invoking changes, and propose_pending()
on it when we're done.
Make the PaxosService::C_RetryMessage public so we can do this from FSCommands.

Maybe-
Fixes: http://tracker.ceph.com/issues/20959

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-08-10 10:28:36 -07:00
Jan Fajerski
020d4ccb59 doc/mgr/plugins: mgr accessor during init causes exception
Currently calling a mgr accessor during a plugins __init__ method causes
a cyclic locking exception.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-08-10 19:01:34 +02:00
Sage Weil
d5c09a9b70 Merge pull request #16648 from ovh/bp-kill-str-conv
osdc, class_api: kill implicit string conversions

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-08-10 11:19:24 -05:00
Sage Weil
886b3c2170 Merge pull request #16850 from liewegas/wip-bluestore-dirty-range
os/bluestore: fix dirty_shard off-by-one

Reviewed-by: Liu-Chunmei <chunmei.liu@intel.com>
2017-08-10 11:17:32 -05:00
Sage Weil
a09b10299d Merge pull request #16872 from markhpc/wip-bluestore-faster_gncb
os/bluestore:  clearer comments, not slower code.

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 11:15:38 -05:00
Sage Weil
3d8b0ffb66 Merge pull request #16941 from jcsp/wip-20956
osd: include front_iface+back_iface in metadata

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 11:14:54 -05:00
Sage Weil
dd2fb6c40b Merge pull request #16944 from liewegas/wip-kraken-x
mon/Elector: force election epoch bump on start

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-10 11:12:43 -05:00
Sage Weil
8338278a01 Merge pull request #16953 from neha-ojha/wip-20798
test/librados: create unique lock names

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 11:12:22 -05:00
Sage Weil
6f189d8ab3 os/bluestore: put StupidAllocator btree into bluestore_alloc mempool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 11:58:40 -04:00
David Zafman
4db5124e1a qa: For FreeBSD skip osd-dup.sh because there is no bluestore
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00
David Zafman
61bfd236ad qa: Raise mon-data-avail-warn to pass tests with less space
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00
David Zafman
574b3cd3d4 qa: Add common generalized inject_eio() to ceph-helpers.sh
Retry for a while to allow pool to appear

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00
David Zafman
3988ebab43 qa: osd-scrub-repair.sh handle older versions of jq
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00
David Zafman
2a679a36de qa: Add support for specifying sub-tests with run-standalone.sh
Fix test-ceph-helpers.sh to pass additional arguments on

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00
David Zafman
69413618a0 qa: ceph-helpers.sh fixes
Add missing teardown to cleanup test directory
Fix pgid due to elimination of initial default pool
Testing could never fail because run_tests return ignored

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00
David Zafman
d99f2a77e9 qa: Skip ceph-helpers.sh which is tested through test-ceph-helpers.sh
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:46 -07:00
Sage Weil
2b6eea80ea os/bluestore: default 'bluefs_allocator = stupid'
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 11:21:32 -04:00
Andrew Schoen
c6c0495d9d Merge pull request #16962 from ceph/wip-bz1479797
ceph-volume: tests add tests for the is_mounted utility

Reviewed-by: Andrew Schoen aschoen@redhat.com
2017-08-10 10:07:27 -05:00
Luo Kexue
50e9ce2201 rbd: fix logically dead code in function list_process_image
Signed-off-by: Luo Kexue <luo.kexue@zte.com.cn>
2017-08-10 18:05:49 +03:00
Yuri Weinstein
013948aa14 Merge pull request #16618 from adamemerson/wip-throttle
common/Throttle: Clean up

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-10 07:45:11 -07:00
Yuri Weinstein
61e0999ee6 Merge pull request #16702 from hjwsm1989/wip-recover-timeout-expired
osd: do not forget pg_stat acks which failed to send

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-08-10 07:43:30 -07:00
Yuri Weinstein
32be0f3cce Merge pull request #16928 from amitkumar50/cov-messages-7
messages: Initializing members in MOSDPGUpdateLogMissing

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-08-10 07:42:00 -07:00
Sage Weil
4f4df4244a doc/release-notes: fix link typo
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 10:35:51 -04:00
Ilya Dryomov
097521477e Merge pull request #16966 from idryomov/wip-krbd-unmap-tests-pool
qa: fix POOL_APP_NOT_ENABLED warning in krbd:unmap suite

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 16:08:58 +02:00
Sage Weil
c46bdf5efd Revert "qa/suites/upgrade/jewel-x/parallel: thrash layout"
This reverts commit 435777dbff.

This test combination is not yet stable.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 09:51:29 -04:00
Sage Weil
a0b9f37dbc qa/suites/upgrade/jewel-x/parallel: no loadgenbig
When we do the thrashing this leads to ENOSPC on smithi.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 09:44:17 -04:00
Sage Weil
ced39aeeef mon/Monitor: use legacy health checks in 'status' output before upgrade completion
This matches what the 'health' command does.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 09:41:05 -04:00