Commit Graph

80897 Commits

Author SHA1 Message Date
Alfredo Deza
fbcfb52298 ceph-volume tests.functional add raw data device to xenial bluestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-16 09:00:26 -05:00
Alfredo Deza
d074b53464 ceph-volume tests.functional tox.ini addition of setup playbook for partitions
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-16 09:00:26 -05:00
Alfredo Deza
2d416a849a ceph-volume tests.functional add raw data device to centos7 bluestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-16 09:00:26 -05:00
Alfredo Deza
161fd373d2 ceph-volume tests.functional add setup playbook for centos7 bluestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-16 09:00:26 -05:00
Alfredo Deza
b3bb147298 ceph-volume tests.functional add setup playbook for centos7 filestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-16 09:00:26 -05:00
Alfredo Deza
c5b8d72570 ceph-volume tests.functional add raw device to centos7 filestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-16 09:00:25 -05:00
Alfredo Deza
4df7ea8d83 ceph-volume lvm.common update --data flag to reflect device acceptance
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-16 09:00:25 -05:00
Jason Dillaman
a19239a21d
Merge pull request #18969 from vshankar/rbd-mirror-image-map-state-transition
rbd-mirror: use next transition state to check transition completeness

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 08:36:23 -05:00
Sage Weil
c3a868f77f
Merge pull request #18960 from Liuchang0812/mailmap-update
.mailmap, .organizationmap: update JingChen, ZongyouYao, ShanchunLv's…
2017-11-16 07:15:08 -06:00
Jason Dillaman
4e8b0b60a7 test/librbd: disable compare and write if skipping partial discard
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
0e643fb926 librbd: refactor object write request state machines
Fixes: http://tracker.ceph.com/issues/20789
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
318797f59a librbd: consolidate all object discard-related logic into single state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
7117aa4eca librbd: simplify interface between object IO and copyup state machines
The initial copyup was not receiving a write hint and the
code for hints was duplicated multiple times. Additionally,
the object map state should match the last executed write op.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
f6db9b8027 librbd: copyup state machine needs to handle empty write ops
The compare-and-write object operation cannot be executed
concurrently within a copyup operation since the object might not
exist yet (if not performing a deep-copy).

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
e79c0cf200 librbd: object cacher should re-use read state machine
This adds support for sparse-reads and ensures all object reads
utilize a single, tested code path.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
62c3282b87 librbd: refactor io::ObjectReadRequest
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
ab0e558961 librbd: default template parameter for C_SparseReadRequest
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
284feb6a32 librbd: reduce lock scope when assembling read results
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
35ce1c2d39 librbd: ObjectReadRequest does not require buffer extents
The ReadResult wrapper requires the buffer extents to know
how to properly reconstruct the out buffer.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
654a78fa54 librbd: templatize IO object request state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
c4e5613e4a test/librados_test_stub: mocked remainder of IO ops used by librbd
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Jason Dillaman
4b851ce0fa test/librados_test_stub: simulate set_alloc_hint creating a non-existent file
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-16 07:31:59 -05:00
Stefan Knorr
118b9fe2ae Fix typos in release notes
Signed-off-by: Stefan Knorr <sknorr@suse.de>
2017-11-16 13:08:51 +01:00
Venky Shankar
7faa36b60b rbd-mirror: use next transition state to check transition completeness
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-11-16 07:00:55 -05:00
amitkuma
bd2ea56c49 test: Incorrect conversion to double
Fixes the coverity issue:

CID 1417062 (#1 of 1): Result is not floating-point
(UNINTENDED_INTEGER_DIVISION)
integer_division: Dividing integer expressions 100 and temp
, and then converting the integer quotient to type double.
Any remainder, or fractional part of the quotient, is ignored.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-11-16 17:30:21 +05:30
Mykola Golub
845341ce66
Merge pull request #18952 from dillaman/wip-test-librbd
test/librbd: clean up for several mock function tests

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-16 13:34:28 +02:00
Mykola Golub
3b741bd5c0
Merge pull request #18947 from dillaman/wip-22131
rbd-nbd: certain kernels may not discover resized block devices

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-16 13:32:46 +02:00
Mykola Golub
133785573b
Merge pull request #18909 from dillaman/wip-22120
librbd: possible deadlock with synchronous maintenance operations

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-16 13:30:18 +02:00
Mykola Golub
956f3c8bfe
Merge pull request #18923 from dillaman/wip-21966
librbd: prevent overflow of discard API result code

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-16 13:28:51 +02:00
Aleksei Gutikov
db42e385d2 rgw: fix radosgw-admin bucket rm with --purge-objects and --bypass-gc
Call RGWRados::delete_bucket() from rgw_remove_bucket_bypass_gc()
instead of partial copy of code of RGWRados::delete_bucket().

Fix updating user stats after radosgw-admin bucket rm --purge-objects and --bypass-gc
Due to rgw_user(const std::string& s) was called incorrect version of rgw_bucket_sync_user_stats().

Fixes: http://tracker.ceph.com/issues/22122
Fixes: http://tracker.ceph.com/issues/19959
Signed-off-by: Aleksei Gutikov <aleksey.gutikov@synesis.ru>
2017-11-16 12:20:20 +03:00
Zhi Zhang
a0f8d54ad8 mon: dump servicemap along with MgrStatMonitor dump info
Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
2017-11-16 16:10:07 +08:00
Kefu Chai
bf7e7a7f37 rgw: do not print the leading "{" for Condition
so the parentheses matches.

also add a space before the ending "}", so it looks better.

Reported-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-16 13:08:57 +08:00
Kefu Chai
8b178f28f7 rgw: print dict-like IAM Policy element as a dict
so they are printed like
{ Hello: World, Goodbye: [ Cruel, World ] }
instead of
[ Hello: World, Goodbye: [ Cruel, World ] ]

also, all of the print_dict() caller sites are protected by
`if (!foo.empty())`, so no need to check for empty.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-16 13:08:57 +08:00
Kefu Chai
2a415f60ee rgw: use ostream_joiner to print arrays
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-16 13:08:57 +08:00
Kefu Chai
77a391dcf1 common: add {,make_}ostream_joiner
it's handy to print arrays like containers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-16 13:08:57 +08:00
Jos Collin
407238a42c
Merge pull request #18918 from ZVampirEM77/wip-em-rewrite-cmd
rgw: add rewrite cmd and options into radosgw-admin usage and doc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-11-16 10:25:32 +05:30
Chang Liu
bc20165a42 .mailmap, .organizationmap: update JingChen, ZongyouYao, ShanchunLv's mailmap and affiliation
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2017-11-16 12:09:48 +08:00
Enming Zhang
3cd8511732 rgw: cleanup unused parameters in RGWRados::copy_obj_data
src_obj, max_chunk_size, category and ptag are out
of use in RGWRados::copy_obj_data.

Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
2017-11-16 11:34:09 +08:00
Chang Liu
a39813837c mgr: request daemon's metadata when receiving a report message from an unknown server
Fixes: http://tracker.ceph.com/issues/21687

Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2017-11-16 11:29:46 +08:00
Enming Zhang
cefa401072 rgw: add rewrite related cmd and parameter into radosgw-admin help info
+ radosgw-admin object rewrite
+ radosgw-admin bucket rewrite
+ --min-rewrite-size
+ --max-rewrite-size
+ --min-rewrite-stripe-size

Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
2017-11-16 11:15:40 +08:00
Josh Durgin
e81a7ffcda
Merge pull request #18808 from tchaikov/wip-qa-max-pg-per-osd
qa: do not wait for down/out osd for pg convergence

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-11-15 18:05:58 -08:00
Jason Dillaman
87c1dc5181
Merge pull request #15788 from vshankar/mirror-ha-poolwatcher-policy
rbd-mirror: track images in policy map in support of A/A

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 20:24:32 -05:00
Jeegn Chen
c8827e5017 rgw: AWS v4 authorization work when INIT_MULTIPART is chunked
Add RGW_OP_INIT_MULTIPART as a the single chunk special case
like RGW_OP_COMPLETE_MULTIPART.

Fixes: http://tracker.ceph.com/issues/22129
Signed-off-by: Jeegn Chen <jeegnchen@gmail.com>
2017-11-16 09:12:24 +08:00
Casey Bodley
27791852f8
Merge pull request #18953 from cbodley/wip-22139
common: fix BoundedKeyCounter const_pointer_iterator

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-11-15 18:24:59 -05:00
Casey Bodley
fa034b6998 common: fix BoundedKeyCounter const_pointer_iterator
with libc++, clang fails to compile a call to:

  vector::assign(const_pointer_iterator, const_pointer_iterator)

because const_pointer_iterator does not satisfy the InputIterator
concept. added the necessary typedefs for value_type and reference
to reflect the pointer type

Fixes: http://tracker.ceph.com/issues/22139

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 16:31:27 -05:00
Jason Dillaman
bc231942ba test/librbd: fixed gmock uninteresting function call warnings
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 15:46:24 -05:00
Jason Dillaman
260a4226e4 test/librbd: eliminate sleeps within deep-copy mock tests
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 15:35:22 -05:00
Casey Bodley
297cd6cc4c
Merge pull request #18883 from cbodley/wip-22083+
rgw: set num_shards on 'radosgw-admin data sync init'

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-11-15 14:51:14 -05:00
Casey Bodley
90e860c25b rgw: set num_shards on 'radosgw-admin data sync init'
Fixes: http://tracker.ceph.com/issues/22083

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 14:02:13 -05:00
Casey Bodley
662b02489c dencoder/rgw: expose rgw sync status types
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 14:02:12 -05:00