Commit Graph

80441 Commits

Author SHA1 Message Date
Leeshine
677bd52b4a rgw: add metadata sync related cmd into radosgw-admin help info
+ radosgw-admin metadata sync status
+ radosgw-admin metadata sync init
+ radosgw-admin metadata sync run

Signed-off-by: lvshanchun <lvshanchun@gmail.com>
2017-11-15 10:49:24 -05:00
Kefu Chai
34f17c299e
Merge pull request #18837 from tchaikov/wip-warn-on-old-libstdcxx
cmake: warn if libstdc++ older than 5.1.0 is used

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:36:40 +08:00
Kefu Chai
1d0866af35 cmake: warn if libstdc++ older than 5.1.0 is used
__GLIBCPP__ is used before 3.4.0, and gcc 4.8.0 and up is required to
build c++11 source, hence it's safe to check __GLIBCXX__. for the
versioning of libstdc++, see
https://gcc.gnu.org/onlinedocs/libstdc++/manual/abi.html#abi.versioning,
for the magic number of 20150422ul see
https://gcc.gnu.org/develop.html#timeline.
for the reason why we want to have this warning, see
https://github.com/ceph/ceph/pull/18755#issuecomment-342736554 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:35:15 +08:00
Kefu Chai
6b4f2e8115
Merge pull request #18815 from Liuchang0812/wip-kv-store-crc
tool: misc cleanup of ceph-kvstore-tool

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:30:14 +08:00
Kefu Chai
fa340f6ba9
Merge pull request #18828 from majianpeng/fix-21932
os/bluestore: enlarege aligned_size avoid too many vector(> IOV_MAX)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:26:44 +08:00
Kefu Chai
3eeb632dc0
Merge pull request #18854 from ifed01/wip-ifed-release-alloc-cleanup3
os/bluestore: avoid excessive ops in _txc_release_alloc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-11-13 12:25:51 +08:00
Kefu Chai
e3e39fac96
Merge pull request #18822 from jcsp/wip-22082
mon: clean up cluster logging on mon events

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:24:54 +08:00
Sage Weil
7f0d82d93b
Merge pull request #18826 from liewegas/wip-22090
qa/suite/rados: fix balancer vs firefly tunables failures

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 19:50:14 -06:00
Sage Weil
ef54a059e6
Merge pull request #18805 from liewegas/wip-22039
os/bluestore: fix SharedBlob unregistration

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-11-12 16:50:30 -06:00
Sage Weil
0fd48dddd6
Merge pull request #18878 from liewegas/wip-perf-health
qa/suites/rados/perf: whitelist health warnings
2017-11-12 16:50:08 -06:00
Sage Weil
7e9c888c83
Merge pull request #18884 from liewegas/wip-internal-safe-to-start-threads
common/config: make internal_safe_to_start_threads internal

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 16:49:13 -06:00
Mykola Golub
095ee4ba7d
Merge pull request #18825 from dillaman/wip-release-notes-rbd-caps
doc/release-notes: clarify that you need to keep your existing OSD caps

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-12 17:22:48 +02:00
Sage Weil
9e2fc91d2d common/config: make internal_safe_to_start_threads internal
There is no reason for this to be exposed like a normal config option
(even a legacy one) since it is an internal safety flag.

We do keep the clear_() helper there for the unit test.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 17:25:25 -06:00
Casey Bodley
16e3439423
Merge pull request #18404 from cbodley/wip-vstart-mrgw
rgw: mrgw.sh uses instance name 'client.rgw'

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-10 14:20:26 -05:00
Yuri Weinstein
54b657ec0d
Merge pull request #18821 from prallabh/wip-22084
rgw: Fix swift object expiry not deleting objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 08:04:31 -08:00
Yuri Weinstein
c6d5612063
Merge pull request #18846 from yaozongyou/fix-lifecycle-bug
rgw: check going_down() when lifecycle processing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 08:04:11 -08:00
Sage Weil
c1c81a04f5 qa/suites/rados/perf: whitelist health warnings
We may see these as cluster stabilizes.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 09:00:39 -06:00
Jianpeng Ma
fba63cebba common/buffers: add function parameter to limit buffers size.
Fixes: http://tracker.ceph.com/issues/21932
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-11-10 22:47:41 +08:00
Haomai Wang
39da34bfba
Merge pull request #18877 from Jeegn-Chen/wip-issue-22103
rados: make ceph_perf_msgr_client work for multiple jobs

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-11-10 08:43:13 -06:00
Sage Weil
6455954d29 qa/suites/rados: stop testing firefly tunables
We can't mix the balancer compat-set testing with firefly tunables because
it requires that all buckets be straw2.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 07:10:11 -06:00
Sage Weil
476b2335fd mgr/balancer: fail a bit more gracefully if we can't create a compat weight-set
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 07:10:11 -06:00
Jeegn Chen
5c1a860d61 rados: make ceph_perf_msgr_client work for multiple jobs
Move the invocation of msgr->start() before a client initiates a connection.
So the nonce is probably initialized and the server side is able to differenciate
the connections from different Messengers from the same client.

Fixes: http://tracker.ceph.com/issues/22103
Signed-off-by: Jeegn Chen <jeegnchen@gmail.com>
2017-11-10 20:59:01 +08:00
Abhishek L
f9d8317cbc
Merge pull request #18876 from smithfarm/wip-rn-typos
doc: release notes: fix grammar/style nits

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2017-11-10 13:34:20 +01:00
Nathan Cutler
d12ce99fd4 doc: release notes: fix grammar/style nits
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-11-10 11:49:14 +01:00
John Spray
294fe62fee mon: clean up cluster logging on mon events
These changes come from observing the output
when killing a mon and watching the survivors
form a new quorum.

Fixes: http://tracker.ceph.com/issues/22082
Signed-off-by: John Spray <john.spray@redhat.com>
2017-11-10 09:45:00 +00:00
Haomai Wang
8ccaa64bf1
Merge pull request #18862 from Jeegn-Chen/wip-issue-22100
rados: Copy payload in ceph_perf_msgr_client

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-11-09 21:47:28 -06:00
Jeegn Chen
f1625e8905 rados: Copy payload in ceph_perf_msgr_client
Copy payload in ceph_perf_msgr_client so that payload can keep unchanged

Fixes: http://tracker.ceph.com/issues/22100
Signed-off-by: Jeegn Chen <jeegnchen@gmail.com>
2017-11-10 10:14:50 +08:00
Sage Weil
9ef5f20bf4
Merge pull request #18707 from liewegas/wip-filestore-rocksdb-compression
os/filestore: disable rocksdb compression

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2017-11-09 20:08:04 -06:00
Andrew Schoen
cbf06de900
Merge pull request #18823 from ceph/wip-bz1498200
ceph-volume: support GPT and other deployed OSDs

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-11-09 12:01:12 -06:00
Sage Weil
78a465b90b os/bluestore: fix SharedBlob unregistration
We use the SharedBlobSet remove() in three cases:

- from SharedBlob::put(), we try to remove ourselves from the set, but
  have to deal with a racing lookup, so the removal is conditional on
  nref still being 0.
- from split_cache(), we move the SharedBlob to another collection
- from make_blob_unshared(), we remove the entry when we clear the sbid.

The problem is that the condtiional remove() (for the first case) was being
used for all three cases, and in the second two cases nref is always != 0,
so it doesn't actually happen.  This can lead to a crash during cache
shutdown.

Fix by making two variants: remove() that is unconditional, and
try_remove() that is conditional.

Set the sb->coll pointer after because remove() asserts the parent matches
where we are unregistering.

Fixes: http://tracker.ceph.com/issues/22039
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-09 11:57:13 -06:00
Yuri Weinstein
89c26b9838
Merge pull request #18817 from ZVampirEM77/wip-em-zone-cleanup
rgw cleanup: some unnecessary function called and repeated assignment

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-09 09:36:26 -08:00
Sage Weil
3855d2cbfd
Merge pull request #18683 from tchaikov/wip-erasure-cleanup
erasure-code: refactor the interfaces to hide internals from public

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-09 11:10:27 -06:00
Alfredo Deza
e2f281c115 doc/ceph-volume include the top level systemd.rst in the toctree
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:16 -05:00
Alfredo Deza
ff60592897 ceph-volume simple.activate add --file in help docstring as an example
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:16 -05:00
Alfredo Deza
29913951b7 doc/ceph-volume activate has a --file option for json files
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:16 -05:00
Alfredo Deza
366fb8c43a ceph-volume simple.activate enable the osd when activating
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:16 -05:00
Alfredo Deza
cb470622fd ceph-volume systemd.systemctl always force symlink when masking ceph-disk
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:16 -05:00
Alfredo Deza
c954c91339 ceph-volume simple.activate use the contents of the JSON file, fallback to CLI args
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:15 -05:00
Alfredo Deza
826c2709dd ceph-volume simple.activate only check for missing id and uuid if file is not passed in
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:15 -05:00
Alfredo Deza
bd3498f3ea ceph-volume simple.activate allow to pass a file to activate
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:15 -05:00
Alfredo Deza
d7fc26ab4e ceph-volume tests.util add tests for OSDPath validator
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:15 -05:00
Alfredo Deza
cda47c247b ceph-volume systemd.systemctl masking ceph-disk needs to be done by directly symlinking to dev/null
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:15 -05:00
Alfredo Deza
bad2f62b34 ceph-volume systemd.systemctl masking needs to use systemctl mask, not disable
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:15 -05:00
Alfredo Deza
6b2fc4c0ba ceph-volume simple.scan if mounted device cannot be detected, raise an error
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:14 -05:00
Alfredo Deza
230faf04a1 ceph-volume simple.activate remove str formatting from logging
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:14 -05:00
Alfredo Deza
b5acf4d720 ceph-volume util.arg_validators always convert the path to an absolute path
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-09 12:02:14 -05:00
Pavan Rallabhandi
70adfaae50 rgw: Fix swift object expiry not deleting objects
In cls_timeindex_list() though `to_index` has expired for a timespan, the marker is set for a subsequent index during the time boundary check.
This marker is further returned to RGWObjectExpirer::process_single_shard(), where this out_marker is trimmed from the respective shard,
resulting in a lost removal hint and a leaked object.

Fixes: http://tracker.ceph.com/issues/22084
Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>
2017-11-09 21:40:00 +05:30
linux
65445a4788 os/bluestore: avoid excessive ops in _txc_release_alloc
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2017-11-09 17:00:26 +01:00
Casey Bodley
36d83f16e0
Merge pull request #18781 from iliul/correct-error-messages
rgw/rgw_op.cc: Fix error message in rgw_user_get_all_buckets_stats

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-09 09:48:26 -05:00
Casey Bodley
48d612001a
Merge pull request #18796 from ivancich/wip-fix-fmt-warnings
rgw: address warnings due to incorrect format code

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-09 09:43:33 -05:00