Commit Graph

80603 Commits

Author SHA1 Message Date
Yuri Weinstein
dc11821c66
Merge pull request #18875 from yaozongyou/rgw-cleanup
rgw: remove unused disable_signal_fd

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 08:15:36 -08:00
Yuri Weinstein
b28aa2a7cd
Merge pull request #18895 from cooboos/wip-opt-maperase
rgw: optimize the rgw-attr del code logic

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 08:15:19 -08:00
Casey Bodley
ccfc3a2374
Merge pull request #18845 from yaozongyou/wip-lifecycle-log-level
rgw: update life cycle related log level

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 10:34:03 -05:00
Jason Dillaman
90b7ecd8a8 librbd: possible deadlock with synchronous maintenance operations
Fixes: http://tracker.ceph.com/issues/22120
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-14 09:16:34 -05:00
Yao Zongyou
10d2514fb4 ceph-dencoder: adding support for cls_rgw_lc_obj_head
After adding cls_rgw_lc_obj_head, we can using the following command
to look into lc processing related information:
rados -p default.rgw.log getomapheader lc.0 ./header.bin --namespace=lc
ceph-dencoder type cls_rgw_lc_obj_head import ./header.bin decode dump_json

Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
2017-11-14 21:42:25 +08:00
Kefu Chai
e8df19197e
Merge pull request #18873 from tchaikov/wip-bluestore-aio-log
os/bluestore: print aio in batch

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2017-11-14 15:03:56 +08:00
Kefu Chai
75baa10d19
Merge pull request #18888 from tchaikov/wip-osx
common,test,cmake: various changes to re-enable build on osx

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 15:02:33 +08:00
Kefu Chai
800234a96d
Merge pull request #16369 from bspark8/wip_dmc2_client_tracker
dmclock: Delivery of the dmclock delta, rho and phase parameter + Enabling the client service tracker

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-14 14:59:52 +08:00
Kefu Chai
c7df576dd1
Merge pull request #18798 from cbodley/wip-str-list-view
common: add for_each_substr() for cheap string split

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-14 14:58:46 +08:00
songweibin
9d9a27652f librbd: add new API methods and expand the rbd CLI to list trashed images
implement librbd::RBD::list_children2 and rbd_list_children2
methods and expand the rbd CLI to list trashed images

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2017-11-14 14:17:03 +08:00
Dongsheng Yang
bf4e454a22 librbd: limit IO per second by TokenBucketThrottle
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2017-11-14 09:19:00 +08:00
Jason Dillaman
8ed65d24d4
Merge pull request #18663 from dragonylffly/wip-rbd-nbd-fix
rbd-nbd: bug fix when running in container

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-13 14:46:15 -05:00
Sage Weil
a26a693016
Merge pull request #18713 from liewegas/wip-snapset-snaps
osd/PrimaryLogPG: do not pull-up snapc to snapset

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-13 13:27:54 -06:00
Andrew Schoen
8fa17e8ad6
Merge pull request #18882 from ceph/wip-cv-simple-testing
ceph-volume add functional tests for simple, rearrange lvm tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-11-13 11:26:08 -06:00
Jan Fajerski
67a1b66b06 pybind/mgr/prometheus: don't crash when encountering an unknown PG state
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-11-13 17:24:03 +01:00
Kefu Chai
7a9e7ee72c
Merge pull request #18617 from tchaikov/wip-mon-cleanup
mon: remove unused waiting_for_commit

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 22:27:28 +08:00
Igor Fedotov
9afd8bc880 os/bluestore: remove ineffective BlueFS fnode extent calculation.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2017-11-13 06:23:10 -08:00
Sage Weil
e2cbb4bc7a mgr/balancer: skip CRUSH_ITEM_NONE
Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-13 08:16:52 -06:00
Venky Shankar
4a00edf1fe rbd-mirror: image map units tests
Fixes: http://tracker.ceph.com/issues/18786
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Venky Shankar
ef7a57ebfb rbd-mirror: image map class for persisting and processing map updates
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Venky Shankar
7ef3641ca6 rbd-mirror: image policy meta types
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Venky Shankar
441f916f97 rbd-mirror: abstract policy class for mapping images to instance
Also, a "simple" policy implementation that maps M images to
N instances (M/N per rbd mirror daemon instance).

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-13 08:27:43 -05:00
Bingyin Zhang
cff5537d5f rgw.iam: change '1' to '1ULL' in function print_actions
* IAM has 54 operations corresponding to 54 bits. 1 is a signed integer
* which can cover 31 operations, so we need 1ULL here.

Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
2017-11-13 18:47:46 +08:00
Kefu Chai
1ecc1883d7
Merge pull request #18879 from liewegas/wip-zstd
compressor/zstd: improvements

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-13 16:09:36 +08:00
Kefu Chai
34f17c299e
Merge pull request #18837 from tchaikov/wip-warn-on-old-libstdcxx
cmake: warn if libstdc++ older than 5.1.0 is used

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:36:40 +08:00
Kefu Chai
1d0866af35 cmake: warn if libstdc++ older than 5.1.0 is used
__GLIBCPP__ is used before 3.4.0, and gcc 4.8.0 and up is required to
build c++11 source, hence it's safe to check __GLIBCXX__. for the
versioning of libstdc++, see
https://gcc.gnu.org/onlinedocs/libstdc++/manual/abi.html#abi.versioning,
for the magic number of 20150422ul see
https://gcc.gnu.org/develop.html#timeline.
for the reason why we want to have this warning, see
https://github.com/ceph/ceph/pull/18755#issuecomment-342736554 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:35:15 +08:00
Kefu Chai
6b4f2e8115
Merge pull request #18815 from Liuchang0812/wip-kv-store-crc
tool: misc cleanup of ceph-kvstore-tool

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:30:14 +08:00
Kefu Chai
fa340f6ba9
Merge pull request #18828 from majianpeng/fix-21932
os/bluestore: enlarege aligned_size avoid too many vector(> IOV_MAX)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:26:44 +08:00
Kefu Chai
3eeb632dc0
Merge pull request #18854 from ifed01/wip-ifed-release-alloc-cleanup3
os/bluestore: avoid excessive ops in _txc_release_alloc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-11-13 12:25:51 +08:00
Kefu Chai
e3e39fac96
Merge pull request #18822 from jcsp/wip-22082
mon: clean up cluster logging on mon events

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:24:54 +08:00
wangsongbo
727dde4d3e rgw: optimize the rgw-attr del code logic
Signed-off-by: wangsongbo wangsongbo@cloudin.cn
2017-11-13 11:26:08 +08:00
Sage Weil
ad66461dc0 compressor/zstd: use compress_generic from compression, cleanup
This is based on Yann Collet's changes (but somewhat adapted).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-12 20:00:16 -06:00
Sage Weil
7f0d82d93b
Merge pull request #18826 from liewegas/wip-22090
qa/suite/rados: fix balancer vs firefly tunables failures

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 19:50:14 -06:00
Sage Weil
ef54a059e6
Merge pull request #18805 from liewegas/wip-22039
os/bluestore: fix SharedBlob unregistration

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-11-12 16:50:30 -06:00
Sage Weil
0fd48dddd6
Merge pull request #18878 from liewegas/wip-perf-health
qa/suites/rados/perf: whitelist health warnings
2017-11-12 16:50:08 -06:00
Sage Weil
7e9c888c83
Merge pull request #18884 from liewegas/wip-internal-safe-to-start-threads
common/config: make internal_safe_to_start_threads internal

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 16:49:13 -06:00
Sage Weil
e9c0f05323 compressor/zstd: fix build options
Among other things, pass -O3, so that it goes faster.

Huge thank you to Yann Collet for identifying this as a build issue!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-12 09:54:13 -06:00
Mykola Golub
095ee4ba7d
Merge pull request #18825 from dillaman/wip-release-notes-rbd-caps
doc/release-notes: clarify that you need to keep your existing OSD caps

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-12 17:22:48 +02:00
Kefu Chai
8617ed065f rados: use size_t for max_obj_len
otherwise, on some platforms where size_t is not uint64_t, MacOS for
instance, no matched generate_random_number() can be selected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-12 08:45:43 +08:00
Kefu Chai
67c6f768ad bluestore: print aio in batch
KernelDevice::aio_{submit,write,read}() are critical paths. calling
cct->_conf->subsys.should_gather() multi-times is not optimal. the
downside of this issue is that if the aio is printed, the size of
buffer in PrebufferedStreambuf could be large if the number of iov is
large, that could be a heavy load to the memory subsystem.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-12 00:51:38 +08:00
Kefu Chai
033c408a60 cmake: should add snappy header dir for libceph_snappy
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:25:56 +08:00
Kefu Chai
013e944ed3 test/unittest_compression: fail if factory is not ready
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
Kefu Chai
7dbb4619d5 common/blkdev: should include "blkdev.h"
otherwise `string` and `set` are not declared.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
Kefu Chai
23082fb33e common/PluginRegistry: define PLUGIN_SUFFIX to support osx
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
David Zafman
7ca3ce9309 ceph-objectstore-tool: Fix set-size to clear data_digest if changing disk size
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-11-10 16:12:07 -08:00
Sage Weil
9e2fc91d2d common/config: make internal_safe_to_start_threads internal
There is no reason for this to be exposed like a normal config option
(even a legacy one) since it is an internal safety flag.

We do keep the clear_() helper there for the unit test.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 17:25:25 -06:00
Casey Bodley
16e3439423
Merge pull request #18404 from cbodley/wip-vstart-mrgw
rgw: mrgw.sh uses instance name 'client.rgw'

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-10 14:20:26 -05:00
Alfredo Deza
7d78784955 ceph-volume tests.functional update lvm/tox.ini paths after moving it
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
9b14b96d3b ceph-volume tests.functional move top level tox.ini to lvm/tox.ini
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
00d576d266 ceph-volume tests.functional move xenial to lvm/xenial
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00