RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-02-22 02:27:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
71,097 Commits 216 Branches 395 Tags 1.4 GiB
dee4f31cab
Commit Graph

71097 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Dillaman
dee4f31cab Merge pull request #13978 from trociny/wip-18787 
rbd-mirror A/A: proxy InstanceReplayer APIs via InstanceWatcher RPC

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-20 21:52:56 -04:00
David Zafman
daeb4d072c Merge pull request #14647 from dzafman/wip-19698 
Fix full testing in cephtool/test.sh when used by rados suite
Replace using sleep with new wait_for_health() bash function

Reviewed-by: Loic Dachary <ldachary@redhat.com>
 2017-04-20 18:18:16 -07:00
David Zafman
7d579ff12b cephtool.yaml: Add "failsafe" osd error messages to whitelist 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:47:12 -07:00
Willem Jan Withagen
59238fb1db qa/workunits/ceph-helpers.sh: Improve test_mon_pg() by starting healthy 
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2017-04-20 15:47:01 -07:00
Willem Jan Withagen
e07f9ccb13 qa/workunits/ceph-helpers.sh: introduce (and use) wait_for_health 
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:34 -07:00
David Zafman
1810a17e23 mon: Fix incorrect health output and test code to match 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:34 -07:00
David Zafman
86fea9d539 /workunits/cephtool/test.sh: Improve testing of health-output. 
Instead of 9ff401e65b use regex to handle:
       HEALTH_ERR 2 pgs stuck unclean; Full ratio(s) out of order

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:33 -07:00
David Zafman
1474d0f233 test: Fix test_admin_heap_profiler() and enable it 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:33 -07:00
David Zafman
84f2182881 cephtool/test.sh: Get socket for whichever environment this test is running 
Need sudo for qa suite runs

Fixes: http://tracker.ceph.com/issues/19698

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:09 -07:00
Sage Weil
b3cbe4af22 Merge pull request #14689 from liewegas/wip-jewel-x 
qa/suites/upgrade/jewel-x: add mgr.x role
 2017-04-20 17:27:29 -05:00
Sage Weil
0486c63354 Merge pull request #14423 from tchaikov/wip-cmake-crc32-cleanup 
cmake: should not compile crc32c_ppc.c on intel arch.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2017-04-20 15:13:40 -05:00
Sage Weil
adada74873 Merge pull request #14434 from ifed01/wip-bluestore-params 
os/bluestore: make bluestore_max_blob_size parameter hdd/ssd case dependant

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-20 15:13:18 -05:00
Sage Weil
9ddd888382 Merge pull request #14448 from majianpeng/bluestore-kv-queued-lat 
os/bluestore: Record l_bluestore_state_kv_queued_lat for sync_submit_…

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-20 15:12:58 -05:00
Sage Weil
d710e06a1b Merge pull request #14549 from tchaikov/wip-kill-clang-warnings 
misc: kill clang warnings

Reviewed-by: Haomai Wang <haomai@xsky.com>
 2017-04-20 15:12:36 -05:00
Sage Weil
a0a1e66474 Merge pull request #14557 from liewegas/wip-bluefs-balance-interval 
os/bluestore: do not balance bluefs on every kv_sync_thread iteration

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
 2017-04-20 15:12:09 -05:00
Sage Weil
b9dfb3caac qa/suites/upgrade/jewel-x/point-to-point: no xenial 
Avoid conflict with upstream repo having a newer version
than what we're installing.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-20 14:18:59 -04:00
Sage Weil
0ff16f3c57 upgrade/jewel-x/stress-split: not pg import/export tests during upgrade 
These aren't meant to be run on a mixed-version cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-20 14:17:19 -04:00
Matt Benjamin
dcbc28fc46 Merge pull request #11796 from linuxbox2/wip-bucket-size-ck 
rgw: add bucket size limit check to radosgw-admin
 2017-04-20 13:42:03 -04:00
Sage Weil
ab9e8419ec Merge pull request #14690 from ceph/luminous 
build/ops: add 12.0.1 release tag in master
 2017-04-20 11:55:00 -05:00
Sage Weil
1207f8945d qa/suites/upgrade/jewel-x: add mgr.x role 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-20 12:32:59 -04:00
Matt Benjamin
7bc144ce36 rgw: add bucket size limit check to radosgw-admin 
The change adds a new list of all buckets x all users, with
fields for bucket name, tenant name, current num_objects,
current num_shards, current objects per shard, and the
corresponding fill_status--the latter consisting of 'OK',
'WARN <n>%', or 'OVER <n>%.'

The warning check is relative to two new tunables.  The threshold
max objects per shard is set as rgw_bucket_safe_max_objects_per_shard,
which defaults to 100K.  The value rgw_bucket_warning_threshold is
a percent of the current safe max at which to warn (defaults to
90% of full).

From review:

* fix indentation (rgw_admin)
* if user a user_id is provided, check only buckets for that user
* update shard warn pct to be pct-of-fill (not 100 - pct-of-fill)
* print only buckets near or over per-shard limit, if --warnings-only
* s/bucket limitcheck/bucket limit check */
* sanity shard limit should be 90, not 10 (because that changed)
* fixes for memleaks and other points found by cbodley

Fixes: http://tracker.ceph.com/issues/17925

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
 2017-04-20 11:22:50 -04:00
John Spray
f854e3769e Merge pull request #14447 from ukernel/wip-19450 
mds: drop partial entry and adjust write_pos when opening PurgeQueue

Reviewed-by: John Spray <john.spray@redhat.com>
 2017-04-20 15:55:43 +01:00
Mykola Golub
99c6958288 rbd-mirror A/A: proxy InstanceReplayer APIs via InstanceWatcher RPC 
Fixes: http://tracker.ceph.com/issues/18787
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Mykola Golub
f4b96375eb test/librados_test_stub: mock wrapper for aio_notify 
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Mykola Golub
9365ea07f6 rbd-mirror: possible lockdep false positive 
(when InstanceWatcher::remove_instance is called)

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Mykola Golub
65e25de51f librbd: race between notify context completion and Notifier destroy 
The assert "m_pending_aio_notifies == 0" could fail in the destructor.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Mykola Golub
dda32847e8 qa/workunits/rbd: don't use deprecated syntax 
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Mykola Golub
3cb90ebed4 rbd-mirror: remove recently added public peer image types 
They were supposed to be used to pass a list of peer images.
It has turned out unnecessary.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Nathan Cutler
210249a8d7 Merge pull request #14638 from dillaman/wip-19692 
test: rbd master/slave notify test should test active features

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
 2017-04-20 14:12:24 +02:00
John Spray
9264e1c85d Merge pull request #14197 from jcsp/wip-19395-counter 
mds: use same inode count in health check as in trim

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-04-20 09:40:37 +01:00
Kefu Chai
f6db83ab2f Merge pull request #14649 from hikycool/master 
doc: update packages mentioned by build-doc and related doc

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 14:45:29 +08:00
Haomai Wang
69904747ce Merge pull request #14650 from optimistyzy/420_1 
NVMEDevice: remove unnessary dpdk header file

Reviewed-by: Haomai Wang <haomai@xsky.com>
 2017-04-20 14:29:10 +08:00
optimistyzy
057fe4b7c5 NVMEDevice: remove unnessary dpdk header file 
Signed-off-by: optimistyzy <optimistyzy@gmail.com>
 2017-04-20 13:56:11 +08:00
Yu Shengzuo
e97f6eb081 doc: correct the package name in ceph/admin/build-doc 
In document, it is called 'libxml2-devel', one of the dependent
package of CentOS/RHEL7. But the 'build-doc' check 'libxml-devel'.
And it id also called 'libxml2-devel' in software of yum repo .
So correct the checked package name in ceph/admin/build-doc.

Signed-off-by: Yu Shengzuo <yu.shengzuo@99cloud.net>
 2017-04-20 05:14:29 +00:00
Yu Shengzuo
41c902e532 doc: update dependent packages links and remove a 'important' tip 
Some links in document has been deprecated, such as:
http://rpmfind.net/linux/centos/7.0.1406/, So update it;
The 'fc21, fc24, fc26(newest)' rpm 'ditaa' can be used in
CentOS/RHEL7 to build doc. So remove the '...important' tip.

Signed-off-by: Yu Shengzuo <yu.shengzuo@99cloud.net>
 2017-04-20 03:39:29 +00:00
Kefu Chai
ee653ba87c Merge pull request #14608 from tchaikov/wip-19594 
qa/tasks: assert on pg status with a timeout

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-20 10:49:12 +08:00
Kefu Chai
cc61bb878f mon/OSDMonitor: use inc.modified as the ctime for MOSDPGCreate 
so the last_scrub_time of the newly created pg is consistent

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:05 +08:00
Kefu Chai
960032e513 qa/tasks: update tests with helper to wait for pg-stats 
and remove unused helpers

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:05 +08:00
Kefu Chai
1207caf3a2 qa/tasks/ceph_manager: add a "wait_for_pg_stats()" decorator 
and accompany it with two helpers to access the pg stats in a more
natural way

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:04 +08:00
Josh Durgin
535b2cff57 Merge pull request #14496 from jdurgin/wip-ec-overwrites-cleanup 
osd: make ec overwrites ready to use

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-19 17:56:28 -07:00
Josh Durgin
cab2968e8f qa: use bluestore for (k)rbd ec overwrites tests 
Only bluestore supports ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:49:11 -07:00
Josh Durgin
f52b9d19f2 qa: use bluestore for cephfs cephtool tests 
This lets the tests enable ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:44 -07:00
Josh Durgin
4a7c058183 qa: use 4k stripe_width again for test_rados_tool.sh 
The stripe_unit change altered the default stripe_width to depend on k.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:44 -07:00
Josh Durgin
a3e5cba3f1 qa: move ec overwrites tests to a bluestore-only subsuite 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
bad606605a doc: update ec docs for overwrite support 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
25e8e1a08e PendingReleaseNotes: note about ec overwrites 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
4315221179 osd,OSDMonitor: try to protect against ec overwrites with filestore 
This isn't perfect, but it's better than nothing. Prevent enabling the
allow_ec_overwrites flag if any of a sample of pgs in the pool map to
osds using filestore. This mainly protects filestore-only clusters
from enabling it.

If a filestore osd is started later, warn in the cluster log when it
gets a pg with ec overwrites enabled.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
3ca750d41d test/osd/osd-scrub-repair.sh: add ec overwrites test cases 
Move pool and profile creation into a single function, and
add a 'allow_overwrites' parameter for it so each ec test
can be paramterized by it.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
a219319137 qa/tasks/rados: test sparse reads with ec overwrites 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
6fba80c1fa osd, OSDMonitor, qa: mark ec overwrites non-experimental 
Keep the pool flag around so we can distinguish between a pool that
should maintain hashes for each chunk, and a missing one is a bug, vs
an overwrites pool where we rely on bluestore checksums for detecting
corruption.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00