RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-03 17:42:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
71,043 Commits 212 Branches 394 Tags 1.6 GiB
84f2182881
Commit Graph

71043 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
David Zafman
84f2182881 cephtool/test.sh: Get socket for whichever environment this test is running 
Need sudo for qa suite runs

Fixes: http://tracker.ceph.com/issues/19698

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:09 -07:00
Kefu Chai
ee653ba87c Merge pull request #14608 from tchaikov/wip-19594 
qa/tasks: assert on pg status with a timeout

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-20 10:49:12 +08:00
Kefu Chai
cc61bb878f mon/OSDMonitor: use inc.modified as the ctime for MOSDPGCreate 
so the last_scrub_time of the newly created pg is consistent

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:05 +08:00
Kefu Chai
960032e513 qa/tasks: update tests with helper to wait for pg-stats 
and remove unused helpers

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:05 +08:00
Kefu Chai
1207caf3a2 qa/tasks/ceph_manager: add a "wait_for_pg_stats()" decorator 
and accompany it with two helpers to access the pg stats in a more
natural way

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:04 +08:00
Josh Durgin
535b2cff57 Merge pull request #14496 from jdurgin/wip-ec-overwrites-cleanup 
osd: make ec overwrites ready to use

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-19 17:56:28 -07:00
Josh Durgin
cab2968e8f qa: use bluestore for (k)rbd ec overwrites tests 
Only bluestore supports ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:49:11 -07:00
Josh Durgin
f52b9d19f2 qa: use bluestore for cephfs cephtool tests 
This lets the tests enable ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:44 -07:00
Josh Durgin
4a7c058183 qa: use 4k stripe_width again for test_rados_tool.sh 
The stripe_unit change altered the default stripe_width to depend on k.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:44 -07:00
Josh Durgin
a3e5cba3f1 qa: move ec overwrites tests to a bluestore-only subsuite 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
bad606605a doc: update ec docs for overwrite support 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
25e8e1a08e PendingReleaseNotes: note about ec overwrites 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
4315221179 osd,OSDMonitor: try to protect against ec overwrites with filestore 
This isn't perfect, but it's better than nothing. Prevent enabling the
allow_ec_overwrites flag if any of a sample of pgs in the pool map to
osds using filestore. This mainly protects filestore-only clusters
from enabling it.

If a filestore osd is started later, warn in the cluster log when it
gets a pg with ec overwrites enabled.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
3ca750d41d test/osd/osd-scrub-repair.sh: add ec overwrites test cases 
Move pool and profile creation into a single function, and
add a 'allow_overwrites' parameter for it so each ec test
can be paramterized by it.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
a219319137 qa/tasks/rados: test sparse reads with ec overwrites 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
6fba80c1fa osd, OSDMonitor, qa: mark ec overwrites non-experimental 
Keep the pool flag around so we can distinguish between a pool that
should maintain hashes for each chunk, and a missing one is a bug, vs
an overwrites pool where we rely on bluestore checksums for detecting
corruption.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
930eae214c OSDMonitor: get stripe_width via stripe_unit in ec profile 
With bluestore, making the smallest write match min_alloc_size avoids
write amplification. With EC pools this is the stripe unit, or
stripe_width / num_data_chunks. Rather than requiring people to divide
by k to get the smallest ec write, allow it to be specified directly
via stripe_unit. Store it in the ec profile so changing a monitor
config option isn't necessary to set it.

This is particularly important for ec overwrites since they allow random i/o
which should match bluestore's checksum granularity (aka min_alloc_size).

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Sage Weil
5080affedc Merge pull request #14256 from dillaman/wip-19297 
osd: new op for calculating an extent checksum

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-19 17:08:35 -05:00
Sage Weil
abd52cb941 Merge pull request #14414 from Adirl/is_ready 
msg/async: Postpone bind if network stack is not ready

Reviewed-by: Haomai Wang <haomai@xsky.com>
 2017-04-19 17:08:11 -05:00
Sage Weil
4e8dd17ad2 Merge pull request #14486 from dachary/wip-multiweight 
crush: weight_set and id remapping

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-19 17:07:19 -05:00
Sage Weil
ee1bb01a54 Merge pull request #14556 from liewegas/wip-pgupmap 
osd: pg-remap -> pg-upmap

Reviewed-by: David Zafman <dzafman@redhat.com>
 2017-04-19 17:07:01 -05:00
John Spray
b4bd579fdd Merge pull request #14554 from ukernel/wip-19630 
mds: fix stray creation/removal notification

Reviewed-by: John Spray <john.spray@redhat.com>
 2017-04-19 19:24:01 +01:00
Yehuda Sadeh
205a39c8d9 Merge pull request #14433 from cbodley/wip-rgw-multi-py 
test/rgw: refactor test_multi.py for use in qa suite

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-04-19 10:22:40 -07:00
Sage Weil
9d463ed9d7 Merge pull request #14623 from liewegas/wip-bluestore-compression 
qa/objectstore: test bluestore with aggressive compression
 2017-04-19 12:01:00 -05:00
Matt Benjamin
1d73a5764b Merge pull request #14642 from linuxbox2/wip-rgw-poolcreate-erange 
rgw: error more verbosely in RGWRados::create_pool
 2017-04-19 11:52:52 -04:00
Matt Benjamin
8ea698425a rgw: error more verbosely in RGWRados::create_pool 
Adds detail when pool creation fails with ERANGE, which can be
caused by pool settings.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
 2017-04-19 10:58:16 -04:00
Sage Weil
4d18f07b80 Merge pull request #14637 from ovh/bp-test-osd-dup-warn-on-low-limit 
test/osd/osd-dup.sh: warn on low open file limit

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-19 09:46:28 -05:00
Jason Dillaman
ca70fe440a Merge pull request #14631 from idryomov/wip-krbd-data-pool-fix 
qa: krbd_data_pool.sh: account for rbd_info metadata object

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-19 07:30:27 -04:00
Abhishek L
0eae8d37d0 Merge pull request #14385 from smithfarm/wip-release-script-strip-periods 
tools: ceph-release-notes: strip trailing punctuation

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
 2017-04-19 13:08:47 +02:00
Piotr Dałek
2dd7718409 test/osd/osd-dup.sh: warn on low open file limit 
This test fails badly when open file limit is low. Increasing to around
1536 seems to be doing the trick, so warn the user with appropriate
message and try to proceed anyway.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
 2017-04-19 12:57:38 +02:00
Loic Dachary
0011127604 Merge pull request #14599 from smithfarm/wip-crushtool-mappings 
doc: mention --show-mappings in crushtool manpage

Reviewed-by: Loic Dachary <ldachary@redhat.com>
 2017-04-19 11:42:37 +02:00
Kefu Chai
9d5fa6129d Merge pull request #14483 from wjwithagen/wip-wjw-freebsd-ceph-disk-list 
src/ceph-disk/ceph_disk/main.py: Make 'ceph-disk list' work on FreeBSD

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-19 09:23:32 +08:00
Casey Bodley
55f276ba53 test/rgw: rewrite test_multi.py in terms of rgw_multi 
logging changes inspired by Abhishek Lekshmanan <abhishek@suse.com>

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 19:13:40 -04:00
Casey Bodley
87f8c262d6 test/rgw: add tests in rgw_multi/tests.py based on multisite.py 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 19:13:40 -04:00
Casey Bodley
76c96736a7 test/rgw: add rgw_multi/multisite.py 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 19:13:40 -04:00
Sage Weil
1e6531e28a Merge pull request #14614 from wjwithagen/wip-wjw-cephtool-test-mon.sh 
qa/workunits/cephtool/test.sh: Be more liberal in testing health-output.

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:56:37 -05:00
Abhishek L
27c3784f73 Merge pull request #14106 from theanalyst/release/12.0.1 
doc: add 12.0.1 release notes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-18 23:14:18 +02:00
Sage Weil
bac484f225 qa/objecstore/bluestore-comp: test bluestore with compression on 
Enable aggressive compression.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:53:58 -04:00
Sage Weil
fb6cc95ad9 qa/objectstore/bluestore: drop old option 
This test code has been removed.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:53:41 -04:00
Ilya Dryomov
5b2d7f76bb qa: krbd_data_pool.sh: account for rbd_info metadata object 
... added in commit a16beba784 ("librbd: image create validates that
pool supports overwrites").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2017-04-18 21:47:36 +02:00
Casey Bodley
173ee90b27 test/rgw: add skeleton rgw_multi module 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 14:49:18 -04:00
Casey Bodley
f5e2b9fd09 test/rgw: update and fixes for test-rgw-multisite.sh 
the script was incomplete and unused, but it seems useful in itself
to bring up a simple multisite cluster without having to go through
test_multi.py. it's also a good test for functions in the other
test-rgw-*.sh scripts

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 14:49:18 -04:00
Casey Bodley
6be00007b8 test/rgw: test_multi.py uses cluster_id for calls 
this makes the underlying scripts more flexible, because they don't
depend on having a cluster name in the zgX-cY format

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 14:49:18 -04:00
Sage Weil
0e0fc8c205 Merge pull request #14619 from cbodley/wip-rgw-encryption-build-fix 
rgw: remove extra RGWMPObj in rgw_multi.h

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-18 13:17:52 -05:00
Casey Bodley
c17875567f rgw: remove extra RGWMPObj in rgw_multi.h 
two separate PRs had done refactoring around RGWMPObj, and it ended up
in two different places. remove the one in rgw_multi.h, because
rgw_rados.h now depends on its definition

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 14:08:55 -04:00
Sage Weil
c6676a7425 Merge pull request #14418 from songbaisen/m20 
mon: fix synchronise pgmap with others 

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-18 12:43:28 -05:00
Sage Weil
8ded80fb96 Merge pull request #14436 from dachary/wip-19513-ceph-disk-device-class 
ceph-disk,osd: add support for crush device classes

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-18 12:43:04 -05:00
Zack Cerza
28d746bff3 Merge pull request #14464 from ceph/wip-systemd 
qa/tasks: use sudo to check ceph health for systemd test
 2017-04-18 11:34:27 -06:00
Mykola Golub
6b937e384e Merge pull request #14615 from dillaman/wip-19636 
librbd: corrected resize RPC message backwards compatibility

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-18 20:28:01 +03:00
Yuri Weinstein
b0ea1f17fc Merge pull request #14381 from joscollin/wip-cleanup-osdmap-rangefor 
osd: Cleanup-Updated OSDMap.cc with C++11 style range-for loops

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-18 10:08:41 -07:00