Commit Graph

80640 Commits

Author SHA1 Message Date
Igor Fedotov
9afd8bc880 os/bluestore: remove ineffective BlueFS fnode extent calculation.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2017-11-13 06:23:10 -08:00
Sage Weil
e2cbb4bc7a mgr/balancer: skip CRUSH_ITEM_NONE
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-13 08:16:52 -06:00
Venky Shankar
4a00edf1fe rbd-mirror: image map units tests
Fixes: http://tracker.ceph.com/issues/18786
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Venky Shankar
ef7a57ebfb rbd-mirror: image map class for persisting and processing map updates
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Venky Shankar
7ef3641ca6 rbd-mirror: image policy meta types
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Venky Shankar
441f916f97 rbd-mirror: abstract policy class for mapping images to instance
Also, a "simple" policy implementation that maps M images to
N instances (M/N per rbd mirror daemon instance).

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Bingyin Zhang
cff5537d5f rgw.iam: change '1' to '1ULL' in function print_actions
* IAM has 54 operations corresponding to 54 bits. 1 is a signed integer
* which can cover 31 operations, so we need 1ULL here.

Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
2017-11-13 18:47:46 +08:00
Kefu Chai
1ecc1883d7
Merge pull request #18879 from liewegas/wip-zstd
compressor/zstd: improvements

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-13 16:09:36 +08:00
Kefu Chai
34f17c299e
Merge pull request #18837 from tchaikov/wip-warn-on-old-libstdcxx
cmake: warn if libstdc++ older than 5.1.0 is used

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:36:40 +08:00
Kefu Chai
1d0866af35 cmake: warn if libstdc++ older than 5.1.0 is used
__GLIBCPP__ is used before 3.4.0, and gcc 4.8.0 and up is required to
build c++11 source, hence it's safe to check __GLIBCXX__. for the
versioning of libstdc++, see
https://gcc.gnu.org/onlinedocs/libstdc++/manual/abi.html#abi.versioning,
for the magic number of 20150422ul see
https://gcc.gnu.org/develop.html#timeline.
for the reason why we want to have this warning, see
https://github.com/ceph/ceph/pull/18755#issuecomment-342736554 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:35:15 +08:00
Kefu Chai
6b4f2e8115
Merge pull request #18815 from Liuchang0812/wip-kv-store-crc
tool: misc cleanup of ceph-kvstore-tool

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:30:14 +08:00
Kefu Chai
fa340f6ba9
Merge pull request #18828 from majianpeng/fix-21932
os/bluestore: enlarege aligned_size avoid too many vector(> IOV_MAX)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:26:44 +08:00
Kefu Chai
3eeb632dc0
Merge pull request #18854 from ifed01/wip-ifed-release-alloc-cleanup3
os/bluestore: avoid excessive ops in _txc_release_alloc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-11-13 12:25:51 +08:00
Kefu Chai
e3e39fac96
Merge pull request #18822 from jcsp/wip-22082
mon: clean up cluster logging on mon events

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:24:54 +08:00
wangsongbo
727dde4d3e rgw: optimize the rgw-attr del code logic
Signed-off-by: wangsongbo wangsongbo@cloudin.cn
2017-11-13 11:26:08 +08:00
Sage Weil
ad66461dc0 compressor/zstd: use compress_generic from compression, cleanup
This is based on Yann Collet's changes (but somewhat adapted).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-12 20:00:16 -06:00
Sage Weil
7f0d82d93b
Merge pull request #18826 from liewegas/wip-22090
qa/suite/rados: fix balancer vs firefly tunables failures

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 19:50:14 -06:00
Sage Weil
ef54a059e6
Merge pull request #18805 from liewegas/wip-22039
os/bluestore: fix SharedBlob unregistration

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-11-12 16:50:30 -06:00
Sage Weil
0fd48dddd6
Merge pull request #18878 from liewegas/wip-perf-health
qa/suites/rados/perf: whitelist health warnings
2017-11-12 16:50:08 -06:00
Sage Weil
7e9c888c83
Merge pull request #18884 from liewegas/wip-internal-safe-to-start-threads
common/config: make internal_safe_to_start_threads internal

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 16:49:13 -06:00
Sage Weil
e9c0f05323 compressor/zstd: fix build options
Among other things, pass -O3, so that it goes faster.

Huge thank you to Yann Collet for identifying this as a build issue!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-12 09:54:13 -06:00
Mykola Golub
095ee4ba7d
Merge pull request #18825 from dillaman/wip-release-notes-rbd-caps
doc/release-notes: clarify that you need to keep your existing OSD caps

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-12 17:22:48 +02:00
Kefu Chai
8617ed065f rados: use size_t for max_obj_len
otherwise, on some platforms where size_t is not uint64_t, MacOS for
instance, no matched generate_random_number() can be selected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-12 08:45:43 +08:00
Kefu Chai
67c6f768ad bluestore: print aio in batch
KernelDevice::aio_{submit,write,read}() are critical paths. calling
cct->_conf->subsys.should_gather() multi-times is not optimal. the
downside of this issue is that if the aio is printed, the size of
buffer in PrebufferedStreambuf could be large if the number of iov is
large, that could be a heavy load to the memory subsystem.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-12 00:51:38 +08:00
Kefu Chai
033c408a60 cmake: should add snappy header dir for libceph_snappy
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:25:56 +08:00
Kefu Chai
013e944ed3 test/unittest_compression: fail if factory is not ready
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
Kefu Chai
7dbb4619d5 common/blkdev: should include "blkdev.h"
otherwise `string` and `set` are not declared.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
Kefu Chai
23082fb33e common/PluginRegistry: define PLUGIN_SUFFIX to support osx
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
David Zafman
7ca3ce9309 ceph-objectstore-tool: Fix set-size to clear data_digest if changing disk size
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-11-10 16:12:07 -08:00
Sage Weil
9e2fc91d2d common/config: make internal_safe_to_start_threads internal
There is no reason for this to be exposed like a normal config option
(even a legacy one) since it is an internal safety flag.

We do keep the clear_() helper there for the unit test.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 17:25:25 -06:00
Casey Bodley
16e3439423
Merge pull request #18404 from cbodley/wip-vstart-mrgw
rgw: mrgw.sh uses instance name 'client.rgw'

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-10 14:20:26 -05:00
Alfredo Deza
7d78784955 ceph-volume tests.functional update lvm/tox.ini paths after moving it
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
9b14b96d3b ceph-volume tests.functional move top level tox.ini to lvm/tox.ini
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
00d576d266 ceph-volume tests.functional move xenial to lvm/xenial
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
d5ec7d1c58 ceph-volume tests.functional lvm move xenial/bluestore to xenial/bluestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
c504b8781b ceph-volume tests.functional lvm move xenial/create to xenial/filestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
dc1da3fd0a ceph-volume tests.functional move centos7 to lvm/centos7
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
aec1a80a3e ceph-volume tests.functional lvm move bluestore to bluestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
d6905f3f62 ceph-volume tests.functional lvm move create to filestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Casey Bodley
4d4442168c rgw: more documentation for bilog trim config
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
ada2d108e6 rgw: fix notify timeout for BucketTrimWatcher
from seconds to msec

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
a0c438eefc rgw: curly brace style for bilog trim classes
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
6e4d973503 rgw: BucketTrimWatcher checks handle in stop
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
3a1474031e rgw: hold cr reference in MetadataListCR callback
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
c6d946b3e1 rgw: add comment for bucket in BucketCounter
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
4be7039964 rgw: move shard marker helper into BucketIndexShardsManager
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
fa8a0713de qa/rgw: add kwargs for debug output
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:03 -05:00
Casey Bodley
d9dc58cf2c test/rgw: add test_bucket_index_log_trim()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:02 -05:00
Casey Bodley
916f5995c9 rgw: add TrimComplete to watch/notify api
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:02 -05:00
Casey Bodley
1c50d727b5 rgw: RGWDataSyncSingleEntryCR calls BucketChangeObserver
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 13:23:02 -05:00