Commit Graph

83006 Commits

Author SHA1 Message Date
Patrick Donnelly
304efb05c6
Merge PR #20373 into master
* refs/pull/20373/head:
	client: clamp I/O sizes to INT_MAX when we can't return larger values
	test: new testcase for ceph_ll_readv and ceph_ll_writev
	client: hook up ceph_ll_readv and ceph_ll_writev
	client: type safety cleanup for _read and _write codepaths

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 11:36:04 -08:00
Patrick Donnelly
4d2106bfe7
Merge PR #20386 into master
* refs/pull/20386/head:
	mds: optimize getattr file size

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:35:57 -08:00
Gregory Farnum
240b688177
Merge pull request #20147 from smithfarm/wip-15904
tools: rados: make -f be --format for consistency with ceph tool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 09:07:24 -08:00
Kefu Chai
9a0d1517a8
Merge pull request #20422 from cbodley/wip-check-cls-rgw
cmake: 'make check' builds radosgw and its cls dependencies

Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-14 00:35:14 +08:00
Casey Bodley
a029d20b86 cmake: 'make check' builds radosgw and its cls dependencies
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-02-13 10:32:11 -05:00
Sage Weil
13738cd752
Merge pull request #19939 from liewegas/wip-osd-new-class
mon,osd: do not use crush_device_class file to initalize class for new osds

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-12 11:17:14 -06:00
Gregory Farnum
72ad76402c
Merge pull request #20363 from dongbula/e-rados-get-put-command
make rados get/put/append command help txt clear

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-12 08:56:56 -08:00
Jeff Layton
4143c6e972 client: clamp I/O sizes to INT_MAX when we can't return larger values
We have several API functions that allow the caller to request I/Os
larger than INT_MAX bytes, but that return an int. Ensure that we don't
try to do more I/O than we can represent in the return value.

Tracker: http://tracker.ceph.com/issues/22948
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-02-12 07:17:56 -05:00
Jeff Layton
b431d2879a test: new testcase for ceph_ll_readv and ceph_ll_writev
Just copy the PreadvPwritev test and alter accordingly.

Tracker: http://tracker.ceph.com/issues/22948
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-02-12 07:17:56 -05:00
Jeff Layton
4e1f059222 client: hook up ceph_ll_readv and ceph_ll_writev
Break the core of _preadv_pwritev out into a function that takes a Fh.
Make _preadv_pwritev into a wrapper around that.

Then add in plumbing for ceph_ll_readv and ceph_ll_writev.

Tracker: http://tracker.ceph.com/issues/22948
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-02-12 07:17:56 -05:00
Jeff Layton
5579035cfd client: type safety cleanup for _read and _write codepaths
In the read codepath, bl->length() returns an unsigned value, and that
could end up looking negative when cast to int. On the write side,
totalwritten is a uint64_t, which could look negative when cast to int.

Have the underlying layers pass back an int64_t and convert them to
int at a higher level. This prepares the underlying infrastructure for
ceph_ll_readv and ceph_ll_writev support.

Tracker: http://tracker.ceph.com/issues/22948
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-02-12 07:17:51 -05:00
lvshuhua
1bf0696f7d tools/rados: make rados get/put/append command help txt clearer
Fixes: http://tracker.ceph.com/issues/22958

Signed-off-by: lvshuhua <lvshuhua@cmss.chinamobile.com>
2018-02-12 15:30:15 +08:00
Kefu Chai
87e3aa6427
Merge pull request #20392 from adamemerson/wip-clangtastic-voyage
cmake, test/fs, client: fix build with clang

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-12 11:19:39 +08:00
Kefu Chai
4021d2b679
Merge pull request #20379 from tchaikov/wip-test-fix-freebsd
test/librados: s/invoke_result_t/result_of_t/

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-02-12 11:17:22 +08:00
Kefu Chai
ce5226a8e2
Merge pull request #20360 from ifed01/wip-ifed-extents-cleanup
os/bluestore: cleanup around ExtentList, AllocExtent and bluestore_extent_t classes

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-12 11:16:44 +08:00
Kefu Chai
cc2fa37380
Merge pull request #20320 from rzarzynski/wip-common-md_config_cacher_t
common: introduce md_config_cacher_t

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-12 11:15:37 +08:00
Kefu Chai
d73b7f2c2a
Merge pull request #20198 from wido/zabbix-health-checks
mgr/zabbix: Implement health checks

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-12 11:14:41 +08:00
Kefu Chai
511fc9c4b2
Merge pull request #20378 from tchaikov/wip-os-perf-stat-in-ns
osd: check feature bits when encoding objectstore_perf_stat_t

Reviewed-by: John Spray <john.spray@redhat.com>
2018-02-11 09:53:40 +08:00
Kefu Chai
7bb4761d52
Merge pull request #20275 from badone/wip-osdmonitor-unused-function
mon/OSDMonitor: Comment out unused function

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-11 09:52:10 +08:00
Kefu Chai
4c43c67d6d
Merge pull request #20371 from tchaikov/wip-admin_socket_output
test/admin_socket_output: add --vstart=path/to/asok option

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-02-11 09:51:04 +08:00
Kefu Chai
7e36b630a0
Merge pull request #20227 from rzarzynski/wip-bs-final-aiocontexts
os/bluestore: mark derivatives of AioContext as final.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-11 01:24:31 +08:00
Mykola Golub
7a2b56c28a
Merge pull request #20376 from dillaman/wip-22873
librbd: auto-remove trash snapshots when image is deleted

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-10 08:53:35 +02:00
Adam C. Emerson
ba5ce157bd build: Use the right experimental library
Test whether we're building with libstdc++ or libc++.

Use stdc++filesystem if the former and c++experimental if the later.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2018-02-09 19:54:02 -05:00
Adam C. Emerson
b27e40d254 {client,test}: Explicitly initialize empty inode_t
Using an explicit {} initializer. This unbreaks Clang.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2018-02-09 15:59:46 -05:00
Jason Dillaman
82ef376e80 librbd: auto-remove trash snapshots when image is deleted
Fixes: http://tracker.ceph.com/issues/22873
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-09 13:34:55 -05:00
Kefu Chai
df8b1c2bc8 test/librados: s/invoke_result_t/result_of_t/
to workaround buggy libc++ implementation. see
https://cplusplus.github.io/LWG/issue2807 . we should switch to
invoke_result_t once issue2807 is fixed in the latest release of
libc++.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-10 00:06:24 +08:00
Igor Fedotov
2d78999451 os/bluestore: cleanup around ExtentList class.
Also move it out of bluestore_types.h.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-09 18:46:21 +03:00
Igor Fedotov
e0cd948298 os/bluestore: kill AllocExtent[Vector] to simplify code a bit
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-09 18:46:21 +03:00
Igor Fedotov
774773e3ae
Merge pull request #20387 from ifed01/wip-ifed-fio-build-fix
test/fio: fix build failure caused by sequencer replacement.
2018-02-09 18:35:25 +03:00
John Spray
4e2748d3a4
Merge pull request #20043 from Rubab-Syed/configuration_setting_browser
mgr/dashboard: add configuration setting browser

Reviewed-by: John Spray <john.spray@redhat.com>
2018-02-09 15:22:51 +00:00
Jason Dillaman
30aed9f9de
Merge pull request #20389 from trociny/wip-cli_generic
qa/workunits/rbd: fix cli_generic test_purge for rbd default format 1

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-02-09 09:21:57 -05:00
Mykola Golub
57baca0166 qa/workunits/rbd/cli_generic: fix test_purge for rbd default format 1
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-02-09 16:04:43 +02:00
Mykola Golub
8079d23897
Merge pull request #20364 from Songweibin/wip-fix-test-rbd
test/rbd: cli_generic fails if v1 image format or deep-flatten disabled

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-09 14:42:27 +02:00
Igor Fedotov
935a1bdb34 tools/ceph-objectstore-tool: do not fail on lack of OI_ATTR for an
object.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-09 15:00:07 +03:00
Igor Fedotov
7f768dbf62 test/fio: create superblock on mkfs to provide proper tools functioning
E.g. ceph-objectstore-tool requires that

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-09 14:58:15 +03:00
Igor Fedotov
9f8ae668c1 test/fio: fix build failure caused by sequencer replacement.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-09 14:06:15 +03:00
Yan, Zheng
c822b3e257 mds: optimize getattr file size
Fixes: http://tracker.ceph.com/issues/22925
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-02-09 18:46:05 +08:00
John Spray
e654f2832a
Merge pull request #20372 from tchaikov/wip-mgr-doc
doc/mgr: remove non user-facing code from doc

Reviewed-by: John Spray <john.spray@redhat.com>
2018-02-09 10:51:09 +01:00
Wido den Hollander
b7d0cab99e
mgr/zabbix: Implement health checks in Zabbix module
Should make it easier for users to see why the module is failing.

Signed-off-by: Wido den Hollander <wido@42on.com>
2018-02-09 09:57:41 +01:00
songweibin
21c3bc3e69 test/rbd: cli_generic fails if v1 image format or deep-flatten disabled
Fixes: http://tracker.ceph.com/issues/22950

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-02-09 16:17:27 +08:00
Kefu Chai
01d350f388
Merge pull request #20382 from tchaikov/wip-fix-ftbfs-store-test
test/store_test: fix FTBFS as Sequencer is removed

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-02-09 14:39:49 +08:00
Kefu Chai
6e90be1ac9 check feature bits when encoding objectstore_perf_stat_t
OS_PERF_STAT_NS feature bit is added. it's sharing the same bit with
QOS_DMC.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-09 14:31:48 +08:00
Kefu Chai
3a7cac0684 test/store_test: fix FTBFS as Sequencer is removed
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-09 13:05:25 +08:00
Kefu Chai
5757d6f118
Merge pull request #20294 from rzarzynski/wip-bs-drop-std_function
os/bluestore: avoid overhead of std::function in blob_t.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-09 10:45:24 +08:00
Kefu Chai
24d1b2edb4
Merge pull request #19232 from socketpair/precision
mgr: increase time resolution of Commit/Apply OSD latencies.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-09 10:44:27 +08:00
Kefu Chai
34c3af45a5
Merge pull request #18804 from majianpeng/bluestore-collection-prealloc
os/bluestore: Prealloc memory avoid realloc in list_collection.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-09 10:43:24 +08:00
Kefu Chai
7894961e9f
Merge pull request #18494 from ifed01/wip-stupidalloc-fix2
os/bluestore: do not assert if BlueFS rebalance is unable to allocate sufficient space

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-09 10:42:43 +08:00
Kefu Chai
a82cad5839
Merge pull request #18343 from shinobu-x/sk-remove-osdmap
mon/PGMap: Remove unnecessary header

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-09 10:41:50 +08:00
Patrick Donnelly
8c95cc5144
Merge PR #19954 into master
* refs/pull/19954/head:
	test/encoding: refactor to avoid escaping shell magic
	mds: minor refactor of SimpleLock
	mds: track Capability in mempool
	mds: move CInode container members to mempool
	mds: move CDentry container members to mempool
	mds: move CDir container members to mempool
	mds: put MDSCacheObject compact_map in mempool
	common: use size_t for object size
	mds: convert to allocator agnostic string_view
	mds: simplify initialization
	compact_*: support mempool allocated containers

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-02-08 18:17:15 -08:00
Radoslaw Zarzynski
248750fea4 osd: PrimaryLogPG::do_osd_ops() uses md_config_cacher_t.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-02-09 02:46:58 +01:00