Commit Graph

71281 Commits

Author SHA1 Message Date
John Spray
f695a0e30f qa: s/REQUIRE_MGRS/MGRS_REQUIRED/ for consistency
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 15:00:31 +01:00
John Spray
636fc40d90 qa: additions to mgr.test_failover
Reproducers for recent fixes:
http://tracker.ceph.com/issues/19407
http://tracker.ceph.com/issues/19258

Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 15:00:31 +01:00
John Spray
8ea98b4cbf qa: fix vstart_runner --create for mgr tests
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 15:00:31 +01:00
John Spray
838f66269f mgr: fix waiting for module shutdown() before destroying
Fixes: http://tracker.ceph.com/issues/19412
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 15:00:30 +01:00
John Spray
4c59fedb48 mgr: fix MgrPyModule destruction
Fixes: http://tracker.ceph.com/issues/19412
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 14:59:50 +01:00
Mykola Golub
99c6958288 rbd-mirror A/A: proxy InstanceReplayer APIs via InstanceWatcher RPC
Fixes: http://tracker.ceph.com/issues/18787
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-20 14:29:14 +02:00
Mykola Golub
f4b96375eb test/librados_test_stub: mock wrapper for aio_notify
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-20 14:29:14 +02:00
Mykola Golub
9365ea07f6 rbd-mirror: possible lockdep false positive
(when InstanceWatcher::remove_instance is called)

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-20 14:29:14 +02:00
Mykola Golub
65e25de51f librbd: race between notify context completion and Notifier destroy
The assert "m_pending_aio_notifies == 0" could fail in the destructor.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-20 14:29:14 +02:00
Mykola Golub
dda32847e8 qa/workunits/rbd: don't use deprecated syntax
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-20 14:29:14 +02:00
Mykola Golub
3cb90ebed4 rbd-mirror: remove recently added public peer image types
They were supposed to be used to pass a list of peer images.
It has turned out unnecessary.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-20 14:29:14 +02:00
Nathan Cutler
210249a8d7 Merge pull request #14638 from dillaman/wip-19692
test: rbd master/slave notify test should test active features

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-04-20 14:12:24 +02:00
John Spray
ad1882350d mds: remove "mds log" config option
This was occasionally useful for establishing a journal-less
performance baseline, but it has two big problems:
* We don't test it, so it's probably broken a lot of the time
* It sounds a lot to a naive user like an option for controlling
  logging.

IMO, anyone who wants this behaviour is in sufficiently advanced
territory that then can hack it in and recompile, we don't need
to leave dangerous things like this in our releases.

Fixes: http://tracker.ceph.com/issues/18816
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 10:02:17 +01:00
John Spray
9264e1c85d Merge pull request #14197 from jcsp/wip-19395-counter
mds: use same inode count in health check as in trim

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-04-20 09:40:37 +01:00
Kefu Chai
f6db83ab2f Merge pull request #14649 from hikycool/master
doc: update packages mentioned by build-doc and related doc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-20 14:45:29 +08:00
Haomai Wang
69904747ce Merge pull request #14650 from optimistyzy/420_1
NVMEDevice: remove unnessary dpdk header file

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-20 14:29:10 +08:00
Kefu Chai
b3075c485c qa/suites: Revert "qa/suites: add mon-reweight-min-pgs-per-osd = 4"
This reverts commit ef7583d717.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-20 14:18:21 +08:00
Kefu Chai
e6a436bb27 qa/tasks/ceph_manager: be able to store options with service type
so we are able to change options for services other than mon while
thrashing.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-20 14:18:21 +08:00
optimistyzy
057fe4b7c5 NVMEDevice: remove unnessary dpdk header file
Signed-off-by: optimistyzy <optimistyzy@gmail.com>
2017-04-20 13:56:11 +08:00
Yu Shengzuo
e97f6eb081 doc: correct the package name in ceph/admin/build-doc
In document, it is called 'libxml2-devel', one of the dependent
package of CentOS/RHEL7. But the 'build-doc' check 'libxml-devel'.
And it id also called 'libxml2-devel' in software of yum repo .
So correct the checked package name in ceph/admin/build-doc.

Signed-off-by: Yu Shengzuo <yu.shengzuo@99cloud.net>
2017-04-20 05:14:29 +00:00
Yu Shengzuo
41c902e532 doc: update dependent packages links and remove a 'important' tip
Some links in document has been deprecated, such as:
http://rpmfind.net/linux/centos/7.0.1406/, So update it;
The 'fc21, fc24, fc26(newest)' rpm 'ditaa' can be used in
CentOS/RHEL7 to build doc. So remove the '...important' tip.

Signed-off-by: Yu Shengzuo <yu.shengzuo@99cloud.net>
2017-04-20 03:39:29 +00:00
Kefu Chai
ee653ba87c Merge pull request #14608 from tchaikov/wip-19594
qa/tasks: assert on pg status with a timeout

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-20 10:49:12 +08:00
Zhiqiang Wang
aab8562eae osd: support dumping historic slow ops
ceph daemon osd.x dump_historic_slow_ops

Signed-off-by: Zhiqiang Wang <zhiqiang@xsky.com>
2017-04-20 10:26:07 +08:00
Zhiqiang Wang
47248f3554 common: support tracking slow op
Add slow op in op tracker history.

Signed-off-by: Zhiqiang Wang <zhiqiang@xsky.com>
2017-04-20 10:22:42 +08:00
Kefu Chai
cc61bb878f mon/OSDMonitor: use inc.modified as the ctime for MOSDPGCreate
so the last_scrub_time of the newly created pg is consistent

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-20 09:35:05 +08:00
Kefu Chai
960032e513 qa/tasks: update tests with helper to wait for pg-stats
and remove unused helpers

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-20 09:35:05 +08:00
Kefu Chai
1207caf3a2 qa/tasks/ceph_manager: add a "wait_for_pg_stats()" decorator
and accompany it with two helpers to access the pg stats in a more
natural way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-20 09:35:04 +08:00
Greg Farnum
3a4d5ec81b osd: pglog: with config, don't assert in the presence of stale divergent_priors
Fixes: http://tracker.ceph.com/issues/17916

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-04-19 17:57:52 -07:00
Josh Durgin
535b2cff57 Merge pull request #14496 from jdurgin/wip-ec-overwrites-cleanup
osd: make ec overwrites ready to use

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-19 17:56:28 -07:00
Josh Durgin
cab2968e8f qa: use bluestore for (k)rbd ec overwrites tests
Only bluestore supports ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:49:11 -07:00
Josh Durgin
f52b9d19f2 qa: use bluestore for cephfs cephtool tests
This lets the tests enable ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:44 -07:00
Josh Durgin
4a7c058183 qa: use 4k stripe_width again for test_rados_tool.sh
The stripe_unit change altered the default stripe_width to depend on k.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:44 -07:00
Josh Durgin
a3e5cba3f1 qa: move ec overwrites tests to a bluestore-only subsuite
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
bad606605a doc: update ec docs for overwrite support
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
25e8e1a08e PendingReleaseNotes: note about ec overwrites
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
4315221179 osd,OSDMonitor: try to protect against ec overwrites with filestore
This isn't perfect, but it's better than nothing. Prevent enabling the
allow_ec_overwrites flag if any of a sample of pgs in the pool map to
osds using filestore. This mainly protects filestore-only clusters
from enabling it.

If a filestore osd is started later, warn in the cluster log when it
gets a pg with ec overwrites enabled.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
3ca750d41d test/osd/osd-scrub-repair.sh: add ec overwrites test cases
Move pool and profile creation into a single function, and
add a 'allow_overwrites' parameter for it so each ec test
can be paramterized by it.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
a219319137 qa/tasks/rados: test sparse reads with ec overwrites
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
6fba80c1fa osd, OSDMonitor, qa: mark ec overwrites non-experimental
Keep the pool flag around so we can distinguish between a pool that
should maintain hashes for each chunk, and a missing one is a bug, vs
an overwrites pool where we rely on bluestore checksums for detecting
corruption.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
930eae214c OSDMonitor: get stripe_width via stripe_unit in ec profile
With bluestore, making the smallest write match min_alloc_size avoids
write amplification. With EC pools this is the stripe unit, or
stripe_width / num_data_chunks. Rather than requiring people to divide
by k to get the smallest ec write, allow it to be specified directly
via stripe_unit. Store it in the ec profile so changing a monitor
config option isn't necessary to set it.

This is particularly important for ec overwrites since they allow random i/o
which should match bluestore's checksum granularity (aka min_alloc_size).

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Sage Weil
5080affedc Merge pull request #14256 from dillaman/wip-19297
osd: new op for calculating an extent checksum

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-19 17:08:35 -05:00
Sage Weil
abd52cb941 Merge pull request #14414 from Adirl/is_ready
msg/async: Postpone bind if network stack is not ready

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-19 17:08:11 -05:00
Sage Weil
4e8dd17ad2 Merge pull request #14486 from dachary/wip-multiweight
crush: weight_set and id remapping

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-19 17:07:19 -05:00
Sage Weil
ee1bb01a54 Merge pull request #14556 from liewegas/wip-pgupmap
osd: pg-remap -> pg-upmap

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-04-19 17:07:01 -05:00
Sage Weil
3ef3e399b8 mon/MgrMonitor: only propose if we updated
Otherwise we generate a new map on every beacon, even
though there is no change.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-19 17:04:53 -04:00
John Spray
b4bd579fdd Merge pull request #14554 from ukernel/wip-19630
mds: fix stray creation/removal notification

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-19 19:24:01 +01:00
Yehuda Sadeh
205a39c8d9 Merge pull request #14433 from cbodley/wip-rgw-multi-py
test/rgw: refactor test_multi.py for use in qa suite

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-04-19 10:22:40 -07:00
Sage Weil
9d463ed9d7 Merge pull request #14623 from liewegas/wip-bluestore-compression
qa/objectstore: test bluestore with aggressive compression
2017-04-19 12:01:00 -05:00
Matt Benjamin
1d73a5764b Merge pull request #14642 from linuxbox2/wip-rgw-poolcreate-erange
rgw: error more verbosely in RGWRados::create_pool
2017-04-19 11:52:52 -04:00
Matt Benjamin
8ea698425a rgw: error more verbosely in RGWRados::create_pool
Adds detail when pool creation fails with ERANGE, which can be
caused by pool settings.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-04-19 10:58:16 -04:00