Commit Graph

80487 Commits

Author SHA1 Message Date
Kefu Chai
e8df19197e
Merge pull request #18873 from tchaikov/wip-bluestore-aio-log
os/bluestore: print aio in batch

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2017-11-14 15:03:56 +08:00
Kefu Chai
75baa10d19
Merge pull request #18888 from tchaikov/wip-osx
common,test,cmake: various changes to re-enable build on osx

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 15:02:33 +08:00
Kefu Chai
800234a96d
Merge pull request #16369 from bspark8/wip_dmc2_client_tracker
dmclock: Delivery of the dmclock delta, rho and phase parameter + Enabling the client service tracker

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-14 14:59:52 +08:00
Kefu Chai
c7df576dd1
Merge pull request #18798 from cbodley/wip-str-list-view
common: add for_each_substr() for cheap string split

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-14 14:58:46 +08:00
Jason Dillaman
8ed65d24d4
Merge pull request #18663 from dragonylffly/wip-rbd-nbd-fix
rbd-nbd: bug fix when running in container

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-13 14:46:15 -05:00
Sage Weil
a26a693016
Merge pull request #18713 from liewegas/wip-snapset-snaps
osd/PrimaryLogPG: do not pull-up snapc to snapset

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-13 13:27:54 -06:00
Andrew Schoen
8fa17e8ad6
Merge pull request #18882 from ceph/wip-cv-simple-testing
ceph-volume add functional tests for simple, rearrange lvm tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-11-13 11:26:08 -06:00
Kefu Chai
7a9e7ee72c
Merge pull request #18617 from tchaikov/wip-mon-cleanup
mon: remove unused waiting_for_commit

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 22:27:28 +08:00
Kefu Chai
1ecc1883d7
Merge pull request #18879 from liewegas/wip-zstd
compressor/zstd: improvements

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-13 16:09:36 +08:00
Kefu Chai
34f17c299e
Merge pull request #18837 from tchaikov/wip-warn-on-old-libstdcxx
cmake: warn if libstdc++ older than 5.1.0 is used

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:36:40 +08:00
Kefu Chai
1d0866af35 cmake: warn if libstdc++ older than 5.1.0 is used
__GLIBCPP__ is used before 3.4.0, and gcc 4.8.0 and up is required to
build c++11 source, hence it's safe to check __GLIBCXX__. for the
versioning of libstdc++, see
https://gcc.gnu.org/onlinedocs/libstdc++/manual/abi.html#abi.versioning,
for the magic number of 20150422ul see
https://gcc.gnu.org/develop.html#timeline.
for the reason why we want to have this warning, see
https://github.com/ceph/ceph/pull/18755#issuecomment-342736554 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:35:15 +08:00
Kefu Chai
6b4f2e8115
Merge pull request #18815 from Liuchang0812/wip-kv-store-crc
tool: misc cleanup of ceph-kvstore-tool

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-13 12:30:14 +08:00
Kefu Chai
fa340f6ba9
Merge pull request #18828 from majianpeng/fix-21932
os/bluestore: enlarege aligned_size avoid too many vector(> IOV_MAX)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:26:44 +08:00
Kefu Chai
3eeb632dc0
Merge pull request #18854 from ifed01/wip-ifed-release-alloc-cleanup3
os/bluestore: avoid excessive ops in _txc_release_alloc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-11-13 12:25:51 +08:00
Kefu Chai
e3e39fac96
Merge pull request #18822 from jcsp/wip-22082
mon: clean up cluster logging on mon events

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 12:24:54 +08:00
Sage Weil
ad66461dc0 compressor/zstd: use compress_generic from compression, cleanup
This is based on Yann Collet's changes (but somewhat adapted).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-12 20:00:16 -06:00
Sage Weil
7f0d82d93b
Merge pull request #18826 from liewegas/wip-22090
qa/suite/rados: fix balancer vs firefly tunables failures

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 19:50:14 -06:00
Sage Weil
ef54a059e6
Merge pull request #18805 from liewegas/wip-22039
os/bluestore: fix SharedBlob unregistration

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-11-12 16:50:30 -06:00
Sage Weil
0fd48dddd6
Merge pull request #18878 from liewegas/wip-perf-health
qa/suites/rados/perf: whitelist health warnings
2017-11-12 16:50:08 -06:00
Sage Weil
7e9c888c83
Merge pull request #18884 from liewegas/wip-internal-safe-to-start-threads
common/config: make internal_safe_to_start_threads internal

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-12 16:49:13 -06:00
Sage Weil
e9c0f05323 compressor/zstd: fix build options
Among other things, pass -O3, so that it goes faster.

Huge thank you to Yann Collet for identifying this as a build issue!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-12 09:54:13 -06:00
Mykola Golub
095ee4ba7d
Merge pull request #18825 from dillaman/wip-release-notes-rbd-caps
doc/release-notes: clarify that you need to keep your existing OSD caps

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-12 17:22:48 +02:00
Kefu Chai
8617ed065f rados: use size_t for max_obj_len
otherwise, on some platforms where size_t is not uint64_t, MacOS for
instance, no matched generate_random_number() can be selected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-12 08:45:43 +08:00
Kefu Chai
67c6f768ad bluestore: print aio in batch
KernelDevice::aio_{submit,write,read}() are critical paths. calling
cct->_conf->subsys.should_gather() multi-times is not optimal. the
downside of this issue is that if the aio is printed, the size of
buffer in PrebufferedStreambuf could be large if the number of iov is
large, that could be a heavy load to the memory subsystem.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-12 00:51:38 +08:00
Kefu Chai
033c408a60 cmake: should add snappy header dir for libceph_snappy
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:25:56 +08:00
Kefu Chai
013e944ed3 test/unittest_compression: fail if factory is not ready
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
Kefu Chai
7dbb4619d5 common/blkdev: should include "blkdev.h"
otherwise `string` and `set` are not declared.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
Kefu Chai
23082fb33e common/PluginRegistry: define PLUGIN_SUFFIX to support osx
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-11 11:09:31 +08:00
Sage Weil
9e2fc91d2d common/config: make internal_safe_to_start_threads internal
There is no reason for this to be exposed like a normal config option
(even a legacy one) since it is an internal safety flag.

We do keep the clear_() helper there for the unit test.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 17:25:25 -06:00
Casey Bodley
16e3439423
Merge pull request #18404 from cbodley/wip-vstart-mrgw
rgw: mrgw.sh uses instance name 'client.rgw'

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-10 14:20:26 -05:00
Alfredo Deza
7d78784955 ceph-volume tests.functional update lvm/tox.ini paths after moving it
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
9b14b96d3b ceph-volume tests.functional move top level tox.ini to lvm/tox.ini
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
00d576d266 ceph-volume tests.functional move xenial to lvm/xenial
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:17 -05:00
Alfredo Deza
d5ec7d1c58 ceph-volume tests.functional lvm move xenial/bluestore to xenial/bluestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
c504b8781b ceph-volume tests.functional lvm move xenial/create to xenial/filestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
dc1da3fd0a ceph-volume tests.functional move centos7 to lvm/centos7
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
aec1a80a3e ceph-volume tests.functional lvm move bluestore to bluestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
d6905f3f62 ceph-volume tests.functional lvm move create to filestore/create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 13:23:16 -05:00
Alfredo Deza
8f0fdc9759 ceph-volume tests.functional simple xenial bluestore scenario
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 12:42:19 -05:00
Alfredo Deza
7452e1b6f9 ceph-volume tests.functional simple xenial filestore scenario
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 12:40:18 -05:00
Alfredo Deza
76ed6a8f2e ceph-volume tests.functional simple tox.ini update for xenial scnearios
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 12:30:34 -05:00
Alfredo Deza
02154e445b ceph-volume tests.functional simple tox.ini addition for bluestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 12:30:34 -05:00
Alfredo Deza
3320f28e79 ceph-volume tests.functional add initial files for simple bluestore activate
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 12:30:34 -05:00
Alfredo Deza
9d18bae52a ceph-volume tests.functional add initial files for simple filestore activate
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-10 12:30:34 -05:00
Stefan Priebe
61107200a5 compressor/zstd: improvements
- static linking #define to get the advanced stuff
- hint src size to compressor
- no flush needed before end
- check for error

It's about twice as 25% faster now for 16KB chunks.

Note that a quick test to use resetCStream and reusing the same stream
did not appear to have any effect.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-11-10 10:43:30 -06:00
Casey Bodley
c4e54b7065 common: get_str_vec and friends use for_each_substr
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 11:06:39 -05:00
Casey Bodley
09448e46ef common: add for_each_substr() for cheap string split
using boost::string_view avoids copies (and potential allocation) of
the substrings

using a callback model avoids baking in the container type, along with
the copies and allocations required for insertion

this interface is ideal for cases where you just want to iterate over
the substrings, and don't actually need to store them in a container

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 11:06:35 -05:00
Casey Bodley
a942dfd4ab test/common: extend str_list tests to include set
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 11:06:00 -05:00
Casey Bodley
0b39e47016 common: add simplified interfaces to get_str_*
the simpler interfaces rely on return value optimization to avoid
copying the result. removing the container from the argument list makes
it easier to provide a default argument for 'delims'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 11:05:45 -05:00
Yuri Weinstein
54b657ec0d
Merge pull request #18821 from prallabh/wip-22084
rgw: Fix swift object expiry not deleting objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-10 08:04:31 -08:00