Commit Graph

77033 Commits

Author SHA1 Message Date
Sage Weil
0a1512b023 doc/rados/operations/bluestore-migration: typos and whitespace
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-11 09:36:59 -04:00
Sage Weil
3fd5f40732 Merge pull request #16532 from liupan1111/wip-remove-reb
kv/RocksDBStore: extract common code to a new function

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-11 08:32:12 -05:00
Sage Weil
d73e0b28ad Merge pull request #16594 from wjwithagen/wip-wjw-reduce-info-messages
common: make some message informative, instead of error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-11 08:31:53 -05:00
Sage Weil
02118ffa85 Merge pull request #16964 from kungf/mon_timer
mon: return directly after health_events_cleanup

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-11 08:30:42 -05:00
Yuri Weinstein
466349751c Merge pull request #16936 from TsaiJin/wip-set-polling-thread-name
msg/async/rdma: fix the bug that rdma polling thread uses the same thread name with msg worker

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-08-11 06:20:51 -07:00
Yuri Weinstein
11c57701c6 Merge pull request #16961 from xiexingguo/wip-class-rename
crush: "osd crush class rename" support

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-11 06:18:57 -07:00
amitkuma
406348fdb9 messages: Initialization of member variables
Fixes the coverity issues:

** 717271 Uninitialized scalar field
2. uninit_member: Non-static class member from_mds is not initialized
 in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member dir_rep is not initialized
 in this constructor nor in any functions that it calls.
CID 717271 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
6. uninit_member: Non-static class member discover is not initialized
 in this constructor nor in any functions that it calls.

** 717272 Uninitialized scalar field
2. uninit_member: Non-static class member want_base_dir is not initialized
in this constructor nor in any functions that it calls.
CID 717272 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
4. uninit_member: Non-static class member want_xlocked is not initialized
in this constructor nor in any functions that it calls.

** 717274 Uninitialized scalar field
2. uninit_member: Non-static class member wanted_base_dir is not initialized
 in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member wanted_xlocked is not initialized
 in this constructor nor in any functions that it calls.
6. uninit_member: Non-static class member flag_error_dn is not initialized
 in this constructor nor in any functions that it calls.
8. uninit_member: Non-static class member flag_error_dir is not initialized
 in this constructor nor in any functions that it calls.
10. uninit_member: Non-static class member unsolicited is not initialized
 in this constructor nor in any functions that it calls.
12. uninit_member: Non-static class member dir_auth_hint is not initialized
 in this constructor nor in any functions that it calls.
CID 717274 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
14. uninit_member: Non-static class member starts_with is not initialized
in this constructor nor in any functions that it calls.

** 717275 Uninitialized scalar field
CID 717275 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
2. uninit_member: Non-static class member from is not initialized in this
constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-11 18:05:04 +05:30
John Spray
6ff57ed6f4 Merge pull request #16973 from jan--f/mgr-plugin-doc-accessor-init
doc/mgr/plugins: mgr accessor during init causes exception

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-11 12:23:48 +01:00
Xie Xingguo
14aa04697f Merge pull request #16983 from renhwztetecs/renhw-wip-rados-tool-cleanup
rados/tool: fixup rados stat command hint

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-11 13:29:30 +08:00
Jin Cai
20725ff883 Merge branch 'master' into wip-set-polling-thread-name 2017-08-11 12:55:16 +08:00
huanwen ren
85f3feb912 rados/tool: fixup rados stat command hint
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2017-08-11 10:50:59 +08:00
Sage Weil
d2d9b41275 Merge pull request #16709 from dzafman/wip-standalone
qa/standalone: misc fixes
2017-08-10 21:33:43 -05:00
Sage Weil
22a46aab3c Merge pull request #16954 from gregsfortytwo/wip-20891-pool-metadata
mon: fix "fs new" pool metadata update, tests

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 21:29:37 -05:00
Haomai Wang
02a212c9a3 Merge pull request #16981 from yuyuyu101/wip_rdma_mt_fix
msg/async/rdma: fixes crash for multi rados client within one process
2017-08-11 10:21:07 +08:00
kungf
537f18cbc9 mon: return directly after health_events_cleanup
when mon_health_to_clog was set false, all health events was cleanup,
no need to judge the change of mon_health_to_clog_interval and
mon_health_to_clog_tick_interval.

Signed-off-by: wang yang <yang.wang@easystack.cn>
2017-08-11 10:16:37 +08:00
Haomai Wang
2cf5a75ed1 Merge pull request #16664 from amitkumar50/coverity-1414508-3
rdma: Assign instead of compare

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-08-11 10:16:33 +08:00
Haomai Wang
905528dbcd Merge pull request #16965 from TsaiJin/wip-use-rdtsc-to-get-time
src/msg/async/rdma: decrease cpu usage by rdtsc instruction

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-08-11 10:14:46 +08:00
Haomai Wang
584f64e5e4 msg/async/rdma: add atomic and lock protection
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-08-11 10:11:33 +08:00
Alex Mikheev
6b773887a3 msg/async/rdma: fixes crash in fio
fio creates multiple CephContext in a single process.
Crash(es) happen because rdma stack has a global resources that
are still used from one ceph context while have already been destroyed
by another context.

The commit removes global instances of RDMA dispatcher and infiniband
and makes them context (rdma stack) specific.

Signed-off-by: Adir Lev <adirl@mellanox.com>
Signed-off-by: Alex Mikheev <alexm@mellanox.com>
2017-08-11 10:00:01 +08:00
Haomai Wang
25fce20d63 Merge pull request #16980 from ceph/revert-16893-wip-fix-multicct-ib
Revert "msg/async/rdma: fix multi cephcontext confllicting"
2017-08-11 09:58:17 +08:00
Haomai Wang
f8a7e705c5 Revert "msg/async/rdma: fix multi cephcontext confllicting" 2017-08-11 09:57:41 +08:00
David Zafman
96ed4eedc0 Merge pull request #16977 from liewegas/wip-no-pidfile
test/CMakeLists: disable test_pidfile.sh

Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
2017-08-10 18:41:38 -07:00
Yanhu Cao
7f336f2366 mgr/DaemonServer.cc: add 'is_valid=false' when decode caps error
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2017-08-11 09:16:19 +08:00
xie xingguo
d792e8d528 crush: "osd crush class rename" support
In 076a6abd80 I killed the 'class rename' command
and thought it was totally useless but I was wrong.

Consider the following user case:
(1) randomly choose some OSDs(e.g., from different hosts) and try to make them for private use only,
    say, by grouping them into 'pool1'
(2) ceph osd crush set-device-class pool1 'OSDs from (1)'
(3) ceph osd crush rule create-replicated rule_for_pool1 default host pool1
(4) ceph osd pool rename pool1 pool2
(5) ceph osd crush class rename pool1 pool2

From the above user case, we need to safely change a pool name without worrying
any risk of data migration. That is why the 'osd crush class rename' command
is still needed here.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-11 08:32:39 +08:00
Sage Weil
ff3de23044 test/CMakeLists: disable test_pidfile.sh
Too flaky, see http://tracker.ceph.com/issues/20975

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 15:41:38 -04:00
David Zafman
e24ac51a82 qa: Fix broken test_activate_osd() due to missing space
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
ae2c5331fb qa: Fix races with waiting for scrubs
The trigger_scrub sets the last_scrub_stamp backwards to
force a scheduled scrub.  In a small window this stamp could get propagated
to the mgr.  A test failure occurred because wait_for_scrub() was confused
by seeing a backward moving date.

The most critical change is having wait_for_scrub() make sure that the
date advances past the previous in value.

A test failed because the random backoff kept delayed triggered scrub, so
set osd_scrub_backoff throughout.

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
dddda523d1 qa: Testing of ceph-helpers.sh, teardown on fail to dump logs, save cores
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
1fe6cb0f02 osd: Avoid confusion over legacy snaps when head_exists corrupt
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:05 -07:00
David Zafman
c140457489 osd: Fix Paxos shutdown handling for commit_finish race
Fixes: http://tracker.ceph.com/issues/20921

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:04 -07:00
David Zafman
229de6b71d qa: Add support for core dumps
Save core dumps when running tests locally
Dump logs to output whenever cores seen

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 12:37:04 -07:00
Sage Weil
1e606708bc Merge pull request #16918 from liewegas/wip-doc-bluestore-migration
doc/rados/operations/bluestore-migration: document bluestore migration process

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2017-08-10 14:15:31 -05:00
Sage Weil
f7398ddd23 doc/rados/operations/bluestore-migration: document bluestore migration process
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 15:15:03 -04:00
Sage Weil
a60f690144 Merge pull request #16975 from theanalyst/doc-12-1-3-release-notes
doc: 12.1.3 release notes

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 13:30:05 -05:00
Sage Weil
a499f682b1 Merge pull request #16974 from liewegas/wip-release-notes
doc/release-notes: remove mention of crush weight optimization

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-08-10 13:29:25 -05:00
Greg Farnum
c85af7b146 qa: test that "fs new" correctly set the application_metadata
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-08-10 11:09:38 -07:00
Abhishek Lekshmanan
e34d10ae10 doc: 12.1.3 release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-08-10 20:00:19 +02:00
Sage Weil
e9728fc71b doc/release-notes: remove mention of crush weight optimization
It's not there yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 13:36:51 -04:00
Matt Benjamin
1d9a4c47c4 Merge pull request #15330 from guihecheng/rgw_file-fsid-mount
rgw_file: introduce new fsid and rgw_mount
2017-08-10 13:32:27 -04:00
Greg Farnum
435717791e mdsmon: treat the osdmon correctly when doing plugged updates
Make sure it's writeable before invoking changes, and propose_pending()
on it when we're done.
Make the PaxosService::C_RetryMessage public so we can do this from FSCommands.

Maybe-
Fixes: http://tracker.ceph.com/issues/20959

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-08-10 10:28:36 -07:00
Jan Fajerski
020d4ccb59 doc/mgr/plugins: mgr accessor during init causes exception
Currently calling a mgr accessor during a plugins __init__ method causes
a cyclic locking exception.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-08-10 19:01:34 +02:00
Sage Weil
d5c09a9b70 Merge pull request #16648 from ovh/bp-kill-str-conv
osdc, class_api: kill implicit string conversions

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-08-10 11:19:24 -05:00
Sage Weil
886b3c2170 Merge pull request #16850 from liewegas/wip-bluestore-dirty-range
os/bluestore: fix dirty_shard off-by-one

Reviewed-by: Liu-Chunmei <chunmei.liu@intel.com>
2017-08-10 11:17:32 -05:00
Sage Weil
a09b10299d Merge pull request #16872 from markhpc/wip-bluestore-faster_gncb
os/bluestore:  clearer comments, not slower code.

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 11:15:38 -05:00
Sage Weil
3d8b0ffb66 Merge pull request #16941 from jcsp/wip-20956
osd: include front_iface+back_iface in metadata

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 11:14:54 -05:00
Sage Weil
dd2fb6c40b Merge pull request #16944 from liewegas/wip-kraken-x
mon/Elector: force election epoch bump on start

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-10 11:12:43 -05:00
Sage Weil
8338278a01 Merge pull request #16953 from neha-ojha/wip-20798
test/librados: create unique lock names

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-10 11:12:22 -05:00
Sage Weil
6f189d8ab3 os/bluestore: put StupidAllocator btree into bluestore_alloc mempool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-10 11:58:40 -04:00
David Zafman
4db5124e1a qa: For FreeBSD skip osd-dup.sh because there is no bluestore
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00
David Zafman
61bfd236ad qa: Raise mon-data-avail-warn to pass tests with less space
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-10 08:30:47 -07:00