Commit Graph

83282 Commits

Author SHA1 Message Date
Patrick Donnelly
0c8ec93af7
mds: convert to allocator agnostic string_view
This is necessary to allow many interfaces to take mempool allocated strings.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-07 06:40:30 -08:00
Andrew Schoen
cf2bc0abcd
Merge pull request #20264 from ceph/wip-rm22620
ceph-volume dmcrypt support for simple

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-07 15:21:04 +01:00
Kefu Chai
2e56224770
Merge pull request #20307 from tchaikov/wip-std-filesystem
test/admin_socket_output: switch to std::experimental::filesystem

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-02-07 21:56:28 +08:00
Kefu Chai
92495add10
Merge pull request #20324 from tchaikov/wip-cmake-build-boost
cmake: fix the include dir for building boost::python

Reviewed-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
2018-02-07 21:53:30 +08:00
xie xingguo
3da5257a67 pybind/mgr/balancer: cancel plan if distribution is already perfect
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-02-07 21:26:34 +08:00
xie xingguo
147625651f pybind/mgr/balancer: allow customized optimization threshold
In practice it is hard to achieve a 100% (perfect) balanced distribution.
This patch introduces a user visiable threshold configuration here, which
allow user to define the minimal deviation to trigger an optimization.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-02-07 21:26:33 +08:00
xie xingguo
3733b94686 pybind/mgr/balancer: be more specific on creating an optimization plan
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-02-07 21:26:33 +08:00
Xie Xingguo
4d8bae0625
Merge pull request #20347 from Songweibin/wip-osd-cleanup
osd: drop redundant comment

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-02-07 15:34:04 +08:00
songweibin
dd07c22a1d osd: drop redundant comment
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-02-07 13:53:21 +08:00
Patrick Donnelly
a33659d604
Merge PR #20288 into master
* refs/pull/20288/head:
	ptl-tool: open githubmap with utf-8 code

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-02-06 20:38:14 -08:00
Patrick Donnelly
7375d027a3
mds: remove extra 0x in ino prints
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-06 16:44:51 -08:00
Sage Weil
c58bd9c1bc test/objectstore/TestObjectStoreState: make objects match collection
- start pool at 1
- make hash fall within pg (just match it for now)

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 14:09:31 -06:00
Sage Weil
ab67958010 os/ObjectStore: remove void *osr from Transaction
No longer used!  (It was only needed for an ugly FileStore hack.)

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 14:09:31 -06:00
Sage Weil
31b5aec88e os/filestore: do not rely on ObjectStore::Transaction::osr
This was used only to name the osr for the purposes of the tracepoint. We
can do that ourselves!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 14:09:30 -06:00
Sage Weil
58e03a9b2f osd: drop explicit calls to osr->flush
These are no longer needed as the implementations do it themselves.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 14:09:30 -06:00
Sage Weil
08eb08a580 osd/PrimaryLogPG: drop unnecessary flush() on shutdown
The ObjectStore implementation should handle this.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 14:09:30 -06:00
Sage Weil
c0c6de3b94 os: make implementation flush before collection_{list,empty}
This takes the (awkward) burden off the caller.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 14:09:30 -06:00
Sage Weil
38d24fefd6 os/ObjectStore: make all read operations CollectionHandle-based
Drop the coll_t shims, and convert the last few that weren't already
handle-based.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 14:09:27 -06:00
Sage Weil
03c8a828ea
Merge pull request #20313 from guzhongyan/fix-22350
osd/OSDMap: misleading message in print_oneline_summary()

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-06 14:01:41 -06:00
Sage Weil
0ebbb1c62c
Merge pull request #20317 from liewegas/wip-pg-scrub-priority
osd/PG: pass scrub priority to replica

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:01:19 -06:00
Sage Weil
b2467f02c5
Merge pull request #20319 from tchaikov/wip-ops_blocked_by_scrub-cleanup
osd: pass ops_blocked_by_scrub() to requeue_scrub()

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-06 14:00:53 -06:00
Igor Fedotov
64abc7ba39 os/bluestore: do not assert on insufficient allocation during bluefs
rebalance

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-06 22:51:14 +03:00
Igor Fedotov
eb0443a103 test/store_test: add test case to for excessive fragmentation
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-06 22:51:14 +03:00
Igor Fedotov
89aeea84f9 os/bluestore: fix lack of extent demotion in StupidAllocator::init_rm_free
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-02-06 22:51:14 +03:00
Andrew Schoen
63046e0d7b ceph-volume: do not test custom cluster names with simple
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-06 11:36:03 -06:00
Sage Weil
3ca0e0c565
Merge pull request #20279 from liewegas/wip-idempotent-sequence
ceph_test_filestore_idempotent_sequence: many fixes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-02-06 10:53:35 -06:00
Andrew Schoen
85b319a2c5 ceph-volume: sleep 2 minutes after reboot in simple tests
This will allow for some time for OSD services to start back up after
reboot. If not we see race conditions where tests fail because they
were run before the OSD finished startup.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-06 10:46:44 -06:00
Sage Weil
abd58ad0b9 os/ObjectStore: combine Sequencer and CollectionImpl in ObjectStore
In practice we have a sequencer per collection. Combine them in the interface
to simplify our lives!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 08:21:29 -06:00
Sage Weil
9c8c66c4c8 ceph_test_objectstore_workloadgen: remove
Stale test code, never run.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 08:21:29 -06:00
Sage Weil
e4e4079636 qa/tasks/recovery_bench: drop recovery_bench task
This relies on smalliobench, which is gone now.  The task could
pretty easily be resurrected if we substitute in another tool.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 08:21:29 -06:00
Sage Weil
8ae0a0169f ceph_xattr_bench: drop
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 08:21:29 -06:00
Sage Weil
5749434ad6 test/bench: remove smallio bench tools
These are stale and superceded by the fio ObjectStore (and other)
backends.  Shed the weight!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 08:21:29 -06:00
Jason Dillaman
7a24713a72 librbd: drop unused variable from flatten state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-06 08:20:42 -05:00
Yan, Zheng
4852de618d client: re-use free snap tag
Fixes: https://tracker.ceph.com/issues/22829
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-02-06 19:26:42 +08:00
Kefu Chai
797b7c0a87
Merge pull request #20267 from liewegas/wip-22847
mon/OSDMonitor: filter out pgs that shouldn't exist from force-create-pg

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:49:35 +08:00
Kefu Chai
12e3cbd13d
Merge pull request #20259 from guzhongyan/rados-cleanup
rados: clean up rados_getxattrs() and rados_striper_getxattrs()

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-06 14:48:42 +08:00
Kefu Chai
221d8a1df2
Merge pull request #20260 from guzhongyan/fix-22042
librados: invalid free() in rados_getxattrs_next()

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:45:03 +08:00
Kefu Chai
ccf99d5e82
Merge pull request #20255 from david-z/wip-fix-kv-max-option
config: Change bluestore_cache_kv_max to type INT64

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:41:11 +08:00
Kefu Chai
5de47e1b63
Merge pull request #20301 from bigclouds/wip-fix-declaration-of-rados-striper-trunc
libradosstriper: fix the function declaration of rados_striper_trunc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:40:28 +08:00
Kefu Chai
439cf82aad
Merge pull request #20233 from cbodley/wip-test-log-nullptr
test/log: fix for crash with libc++

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:35:18 +08:00
Kefu Chai
d4254db9c9
Merge pull request #20223 from Yan-waller/wip-walle-180124cephosd
osd: use existing osd_required variable for messenger policy

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:31:52 +08:00
Kefu Chai
6655648d74
Merge pull request #20201 from majianpeng/mosdrepop-encode-log
osd: avoid encoding the same log entries repeatedly for different peers

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-06 14:29:34 +08:00
Pritha Srivastava
09c1bfe864 rgw: Correct permission evaluation to allow only admin
users to work with Roles.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-02-06 10:14:28 +05:30
shun-s
8d179f7a59 librbd: speed up diskusage and resize
speed up diskusage and resize

Signed-off-by: shun-s <song.shun3@zte.com.cn>
2018-02-06 09:43:46 +08:00
Sage Weil
6f5a952fb7 os/filestore: add replay guards for omap operations
These were not guarded, meaning they could get replayed onto an object
that was cloned or renamed.  Eek!

Fixes: http://tracker.ceph.com/issues/22920
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-05 18:08:28 -06:00
Sage Weil
13af247a92 test/objectstore/run_seed_to_range: stop on first error
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-05 18:08:28 -06:00
Sage Weil
9d0a193ea1 ceph_test_idempotent_sequence: use coll_entry_t
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-05 18:08:28 -06:00
Sage Weil
1c4bb2a52d ceph_filestore_idempotent_sequence: fix up clone, move ops; cleanup
Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-05 18:08:28 -06:00
Sage Weil
135ccf8790 qa/tasks/filestore_idempotent: run failure tests later in sequence
We want to get past the initial colleciton and object creation steps,
which don't include interesting ops.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-05 18:08:28 -06:00
Jason Dillaman
88171d09f3 cls/rbd: store original namespace type within trash snapshot namespace
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-05 19:04:37 -05:00