Josh Durgin
bad606605a
doc: update ec docs for overwrite support
...
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
25e8e1a08e
PendingReleaseNotes: note about ec overwrites
...
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
4315221179
osd,OSDMonitor: try to protect against ec overwrites with filestore
...
This isn't perfect, but it's better than nothing. Prevent enabling the
allow_ec_overwrites flag if any of a sample of pgs in the pool map to
osds using filestore. This mainly protects filestore-only clusters
from enabling it.
If a filestore osd is started later, warn in the cluster log when it
gets a pg with ec overwrites enabled.
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
3ca750d41d
test/osd/osd-scrub-repair.sh: add ec overwrites test cases
...
Move pool and profile creation into a single function, and
add a 'allow_overwrites' parameter for it so each ec test
can be paramterized by it.
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
a219319137
qa/tasks/rados: test sparse reads with ec overwrites
...
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
6fba80c1fa
osd, OSDMonitor, qa: mark ec overwrites non-experimental
...
Keep the pool flag around so we can distinguish between a pool that
should maintain hashes for each chunk, and a missing one is a bug, vs
an overwrites pool where we rely on bluestore checksums for detecting
corruption.
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
930eae214c
OSDMonitor: get stripe_width via stripe_unit in ec profile
...
With bluestore, making the smallest write match min_alloc_size avoids
write amplification. With EC pools this is the stripe unit, or
stripe_width / num_data_chunks. Rather than requiring people to divide
by k to get the smallest ec write, allow it to be specified directly
via stripe_unit. Store it in the ec profile so changing a monitor
config option isn't necessary to set it.
This is particularly important for ec overwrites since they allow random i/o
which should match bluestore's checksum granularity (aka min_alloc_size).
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Sage Weil
5080affedc
Merge pull request #14256 from dillaman/wip-19297
...
osd: new op for calculating an extent checksum
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-19 17:08:35 -05:00
Sage Weil
abd52cb941
Merge pull request #14414 from Adirl/is_ready
...
msg/async: Postpone bind if network stack is not ready
Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-19 17:08:11 -05:00
Sage Weil
4e8dd17ad2
Merge pull request #14486 from dachary/wip-multiweight
...
crush: weight_set and id remapping
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-19 17:07:19 -05:00
Sage Weil
ee1bb01a54
Merge pull request #14556 from liewegas/wip-pgupmap
...
osd: pg-remap -> pg-upmap
Reviewed-by: David Zafman <dzafman@redhat.com>
2017-04-19 17:07:01 -05:00
John Spray
b4bd579fdd
Merge pull request #14554 from ukernel/wip-19630
...
mds: fix stray creation/removal notification
Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-19 19:24:01 +01:00
Yehuda Sadeh
205a39c8d9
Merge pull request #14433 from cbodley/wip-rgw-multi-py
...
test/rgw: refactor test_multi.py for use in qa suite
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-04-19 10:22:40 -07:00
Sage Weil
9d463ed9d7
Merge pull request #14623 from liewegas/wip-bluestore-compression
...
qa/objectstore: test bluestore with aggressive compression
2017-04-19 12:01:00 -05:00
Matt Benjamin
1d73a5764b
Merge pull request #14642 from linuxbox2/wip-rgw-poolcreate-erange
...
rgw: error more verbosely in RGWRados::create_pool
2017-04-19 11:52:52 -04:00
Matt Benjamin
8ea698425a
rgw: error more verbosely in RGWRados::create_pool
...
Adds detail when pool creation fails with ERANGE, which can be
caused by pool settings.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-04-19 10:58:16 -04:00
Sage Weil
4d18f07b80
Merge pull request #14637 from ovh/bp-test-osd-dup-warn-on-low-limit
...
test/osd/osd-dup.sh: warn on low open file limit
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-19 09:46:28 -05:00
Jason Dillaman
ca70fe440a
Merge pull request #14631 from idryomov/wip-krbd-data-pool-fix
...
qa: krbd_data_pool.sh: account for rbd_info metadata object
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-19 07:30:27 -04:00
Abhishek L
0eae8d37d0
Merge pull request #14385 from smithfarm/wip-release-script-strip-periods
...
tools: ceph-release-notes: strip trailing punctuation
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-04-19 13:08:47 +02:00
Piotr Dałek
2dd7718409
test/osd/osd-dup.sh: warn on low open file limit
...
This test fails badly when open file limit is low. Increasing to around
1536 seems to be doing the trick, so warn the user with appropriate
message and try to proceed anyway.
Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
2017-04-19 12:57:38 +02:00
Loic Dachary
0011127604
Merge pull request #14599 from smithfarm/wip-crushtool-mappings
...
doc: mention --show-mappings in crushtool manpage
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-19 11:42:37 +02:00
Kefu Chai
9d5fa6129d
Merge pull request #14483 from wjwithagen/wip-wjw-freebsd-ceph-disk-list
...
src/ceph-disk/ceph_disk/main.py: Make 'ceph-disk list' work on FreeBSD
Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-19 09:23:32 +08:00
Casey Bodley
55f276ba53
test/rgw: rewrite test_multi.py in terms of rgw_multi
...
logging changes inspired by Abhishek Lekshmanan <abhishek@suse.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 19:13:40 -04:00
Casey Bodley
87f8c262d6
test/rgw: add tests in rgw_multi/tests.py based on multisite.py
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 19:13:40 -04:00
Casey Bodley
76c96736a7
test/rgw: add rgw_multi/multisite.py
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 19:13:40 -04:00
Sage Weil
1e6531e28a
Merge pull request #14614 from wjwithagen/wip-wjw-cephtool-test-mon.sh
...
qa/workunits/cephtool/test.sh: Be more liberal in testing health-output.
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-18 16:56:37 -05:00
Abhishek L
27c3784f73
Merge pull request #14106 from theanalyst/release/12.0.1
...
doc: add 12.0.1 release notes
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-04-18 23:14:18 +02:00
Sage Weil
bac484f225
qa/objecstore/bluestore-comp: test bluestore with compression on
...
Enable aggressive compression.
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-18 16:53:58 -04:00
Sage Weil
fb6cc95ad9
qa/objectstore/bluestore: drop old option
...
This test code has been removed.
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-18 16:53:41 -04:00
Ilya Dryomov
5b2d7f76bb
qa: krbd_data_pool.sh: account for rbd_info metadata object
...
... added in commit a16beba78435 ("librbd: image create validates that
pool supports overwrites").
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-04-18 21:47:36 +02:00
Casey Bodley
173ee90b27
test/rgw: add skeleton rgw_multi module
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 14:49:18 -04:00
Casey Bodley
f5e2b9fd09
test/rgw: update and fixes for test-rgw-multisite.sh
...
the script was incomplete and unused, but it seems useful in itself
to bring up a simple multisite cluster without having to go through
test_multi.py. it's also a good test for functions in the other
test-rgw-*.sh scripts
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 14:49:18 -04:00
Casey Bodley
6be00007b8
test/rgw: test_multi.py uses cluster_id for calls
...
this makes the underlying scripts more flexible, because they don't
depend on having a cluster name in the zgX-cY format
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 14:49:18 -04:00
Sage Weil
0e0fc8c205
Merge pull request #14619 from cbodley/wip-rgw-encryption-build-fix
...
rgw: remove extra RGWMPObj in rgw_multi.h
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-18 13:17:52 -05:00
Casey Bodley
c17875567f
rgw: remove extra RGWMPObj in rgw_multi.h
...
two separate PRs had done refactoring around RGWMPObj, and it ended up
in two different places. remove the one in rgw_multi.h, because
rgw_rados.h now depends on its definition
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 14:08:55 -04:00
Sage Weil
c6676a7425
Merge pull request #14418 from songbaisen/m20
...
mon: fix synchronise pgmap with others
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-18 12:43:28 -05:00
Sage Weil
8ded80fb96
Merge pull request #14436 from dachary/wip-19513-ceph-disk-device-class
...
ceph-disk,osd: add support for crush device classes
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-18 12:43:04 -05:00
Zack Cerza
28d746bff3
Merge pull request #14464 from ceph/wip-systemd
...
qa/tasks: use sudo to check ceph health for systemd test
2017-04-18 11:34:27 -06:00
Mykola Golub
6b937e384e
Merge pull request #14615 from dillaman/wip-19636
...
librbd: corrected resize RPC message backwards compatibility
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-18 20:28:01 +03:00
Yuri Weinstein
b0ea1f17fc
Merge pull request #14381 from joscollin/wip-cleanup-osdmap-rangefor
...
osd: Cleanup-Updated OSDMap.cc with C++11 style range-for loops
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-18 10:08:41 -07:00
Yuri Weinstein
82c0ea7c99
Merge pull request #14431 from liewegas/wip-mgrclient-leak
...
mgr/MgrClient: fix reconnect event leak
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-18 10:04:50 -07:00
Yuri Weinstein
721929d60c
Merge pull request #14507 from tchaikov/wip-19590
...
mgr: always free allocated MgrPyModule
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-18 10:01:47 -07:00
Sage Weil
ce188e8fdf
osd: pg-remap -> pg-upmap
...
'remap' is to non-specific a name. In particular, it
sounds like it is related to the 'remapped' PG state
but in reality it is not related.
'upmap' or 'pg-upmap' is more specific: it maps a pgid
to the 'up' set value (or item)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-18 12:59:40 -04:00
Casey Bodley
da7acc4211
Merge pull request #13597 from cbodley/wip-s3tests-crypto
...
qa/rgw: add configuration for server-side encryption tests
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-18 12:28:37 -04:00
Casey Bodley
6a1e10fdff
Merge pull request #13483 from ceph/wip-rgw-encryption-doc
...
doc: rgw server-side encryption and barbican
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-04-18 12:27:27 -04:00
Casey Bodley
95b3a8a6c3
Merge pull request #11049 from aclamk/wip-rgw-s3-crypto-sse-kms-plugin
...
rgw: s3 server-side encryption (SSE-C, SSE-KMS)
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-04-18 12:25:09 -04:00
Kefu Chai
1b54b5f3f1
Merge pull request #14415 from smithfarm/wip-19556
...
tests: Thrasher: handle "OSD has the store locked" gracefully
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-18 23:18:35 +08:00
Kefu Chai
c1ba579a7c
Merge pull request #14456 from tchaikov/wip-rocksdb-freebsd-build
...
rocksdb: sync with upstream
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-04-18 23:17:03 +08:00
Matt Benjamin
e9aec52028
Merge pull request #14609 from linuxbox2/wip-rgw-file-wattrs
...
rgw_file: pre-compute unix attrs in write_finish()
2017-04-18 11:04:45 -04:00
David Zafman
964ee3aebf
Merge pull request #14488 from dzafman/wip-15789
...
Give requested scrub work a higher priority
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-18 07:54:46 -07:00