Commit Graph

98573 Commits

Author SHA1 Message Date
Abhishek Lekshmanan
45e4927a92 doc: add release notes for v13.2.6 mimic
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-06-04 17:32:24 +02:00
Casey Bodley
40ed4f1150
Merge pull request #28243 from cbodley/wip-40022
radosgw-admin: fix syncs_from in 'bucket sync status'

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2019-06-04 08:07:17 -04:00
Casey Bodley
a33b7eb038
Merge pull request #28156 from cbodley/wip-rgw-realm-list-api
rgw: add 'GET /admin/realm?list' api to list realms

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-06-04 08:04:54 -04:00
Casey Bodley
2ade65a6f3
Merge pull request #28345 from tianshan/fix_http_return_check
rgw: fix miss handle curl error return

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-04 08:03:28 -04:00
Casey Bodley
84ee7912c1
Merge pull request #28303 from cbodley/wip-39992
rgw: fetch_remote_obj() compares expected object size

Reviewed-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2019-06-04 08:03:00 -04:00
Casey Bodley
abf2168bb3
Merge pull request #28188 from tianshan/fix_39984
rgw: fix bucket may redundantly list keys after BI_PREFIX_CHAR

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-04 08:00:27 -04:00
Casey Bodley
909ad5e89a
Merge pull request #27993 from liuchang0812/rgw-bucket-tagging
rgw: bucket tagging

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-04 07:53:43 -04:00
Chang Liu
d1ff8218a1 rgw: cleanup bucket tags code
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 14:34:05 +08:00
Chang Liu
371b683a9c rgw: show bucket tagging when user stats bucket
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 14:34:05 +08:00
Casey Bodley
c669cf293f test/rgw: test truncated reads in RGWHTTPManager
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-04 11:40:17 +08:00
Tianshan Qu
9b70258570 rgw: fix miss handle curl error return
if meet tcp packet loss, curl return will be result=18(CURLE_PARTIAL_FILE)
and http_status=200, so sync will continue and cause content miss match.

Fixes: https://tracker.ceph.com/issues/39992

Signed-off-by: Tianshan Qu <tianshan@xsky.com>
2019-06-04 11:33:17 +08:00
Kefu Chai
048ea6eaa0
Merge pull request #28362 from cyx1231st/wip-seastar-fix-random-failure
test/crimson: fix msgr test of ref counter racing

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-04 10:57:12 +08:00
Yingxin Cheng
a2b2941332 test/crimson: fix msgr test of ref counter racing
Foreign-dispatch in crimson-messenger is not implemented yet, and no
need to test this feature now.

Fixes: http://tracker.ceph.com/issues/36405
Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-06-04 16:17:26 +08:00
Chang Liu
c8582ff27a rgw: simplify RGWObjTags dump
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
26e0baec77 doc: bucket tagging is supported now
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
8103ca3b34 rgw: forwards to master and uses gw_bucket_set_attrs
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
5248a81bc5 rgw: make max number of bucket/object tags configurble
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
8eedfddc01 rgw: iam policy about bucket tagging
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
6a93fe0592 rgw: impl put_bucket_tags and delete_bucket_tags
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
e4ab9bf31c rgw: add set_bucket_tags api
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
993d86fad8 rgw: uses 404 http code when there is NoSuchTagSetError
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
56189e2754 rgw: get bucket tagging
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
f7ea2bdbbe rgw: declares bucket tagging op classes
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Chang Liu
25bcddf060 rgw:new op type and error code about bucket tagging
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-06-04 10:36:31 +08:00
Sage Weil
611c8949fa Merge PR #26547 into master
* refs/pull/26547/head:
	Added validation of zabbix_host to support hostnames, IPv4 and IPv6.
	mgr/zabbix: Documentation added.
	mgr/zabbix: Adds possibility to send data to multiple zabbix servers.

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-06-03 15:45:42 -05:00
Sage Weil
097e8d210a Merge PR #27667 into master
* refs/pull/27667/head:
	src/test: fix creating two different objects for testing chunked object

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-03 15:44:11 -05:00
Sage Weil
898d29cb78 Merge PR #28200 into master
* refs/pull/28200/head:
	pybind/mgr: add slash to prometheus illegal metric name characters
	pybind/mgr: fix format for rbd-mirror prometheus metrics

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-03 15:43:33 -05:00
Samuel Just
f1b573c3d4
Merge pull request #28180 from athanatos/sjust/wip-crimson-peering
Integrate PeeringState into crimson, fix related bugs

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-03 13:41:05 -07:00
Casey Bodley
c2cae94c68
Merge pull request #28068 from cbodley/wip-qa-rgw-s3a
qa/rgw: don't use ceph-ansible in s3a-hadoop suite

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2019-06-03 14:29:09 -04:00
Patrick Donnelly
ffda69a4ab
Merge PR #28300 into master
* refs/pull/28300/head:
	doc: cephfs: add section on fsync error reporting to posix.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-03 11:28:47 -07:00
Casey Bodley
8c8a706b6f qa/rgw: add dnsmasq back to s3a-hadoop
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
658e5932fb qa/rgw: rgw task can override --rgw-dns-name on the command line
the value for rgw_dns_name isn't known until a machine is assigned, so
it can't be set via 'override: conf:'. add a per-client config option
to the rgw task so it can add the endpoint's hostname and/or s3website
hostname on the radosgw command line

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
0fc2c8ecee qa/rgw: remove ceph-ansible from s3a-hadoop suite
Fixes: http://tracker.ceph.com/issues/39706

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
3ff5f0c240 qa/rgw: use default ports (80 or 443) unless overridden
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
921faebb72 qa/rgw: allow rgw client config to override port
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
dead71f5f9
Merge pull request #28146 from smanjara/wip-39551
rgw/multisite:RGWListBucketIndexesCR for data full sync pagination

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 12:53:09 -04:00
Casey Bodley
5a2661e48e
Merge pull request #26915 from dvanders/dvanders_doc_heap
doc: describe metadata_heap cleanup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 12:51:13 -04:00
Kefu Chai
cf8c952a9b
Merge pull request #28359 from tchaikov/wip-split-ceph-dencoder
tools/ceph-dencoder: split types.h into smaller pieces

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-06-03 23:51:20 +08:00
Dan van der Ster
e76604224c doc: describe metadata_heap cleanup
Fixes: http://tracker.ceph.com/issues/18174
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2019-06-03 17:14:39 +02:00
Casey Bodley
bdfc3bb92d
Merge pull request #28305 from rzarzynski/wip-bug-38827
qa/valgrind.supp: generalize the whiterule for aes-128-gcm to help rgw suite.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 09:09:24 -04:00
Casey Bodley
088d3ea26c
Merge pull request #25498 from cbodley/wip-27217
rgw: parse_copy_location defers url-decode

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 09:00:13 -04:00
Casey Bodley
62472c0ca3
Merge pull request #16659 from rzarzynski/wip-rgw-20797
rgw: TempURL should not allow PUTs with the X-Object-Manifest.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 08:59:12 -04:00
Casey Bodley
8a0b2c7a67
Merge pull request #12709 from rzarzynski/wip-rgw-18364-dbgs
rgw: improve debugs on the path of RGWRados::cls_bucket_head.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 08:57:37 -04:00
Casey Bodley
eb51579ba4
Merge pull request #12470 from rzarzynski/wip-rgw-18241
rgw: dump s3_code as the Code response element in RGWDeleteMultiObj_ObjStore_S3

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 08:57:13 -04:00
Kefu Chai
ed2ce0efad
Merge pull request #28339 from tchaikov/wip-cmake-asan
cmake/modules: replace ";" with " " in compile flags

Reviewed-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-06-03 12:28:32 +08:00
Kefu Chai
eaaec3d319 tools/ceph-dencoder: split types.h into smaller pieces
instead of putting all types in a single compilation unit, split them
into smaller groups, in hope to reduce the memory footprint of compiler
when compiling ceph_dencoder.cc.

sometimes, GCC just fails to compile this source file.

Fixes: http://tracker.ceph.com/issues/39595
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-01 23:12:16 +08:00
Patrick Donnelly
880468b4bf
Merge PR #28354 into master
* refs/pull/28354/head:
	doc: Add warning that the root directory cannot be fragmented

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-31 19:13:06 -07:00
Samuel Just
6d66072cc4 osd/: clarify rebuilt_missing_with_deletes and set in init
Updates PeeringState::init to set may_include_deletes_in_missing when
possible to avoid needlessly rebuilding the missing set on the next map.
The previous behavior was also subtly wrong as until the the next map
the osd would be possibly adding deletes to the missing set without the
flag having been set in the missing set on disk

This patch also renames the flag to reflect the fact that it simply
denotes wheter the may_include_deletes_in_missing omap entry needs to be
written out.  This may happen during rebuild_missing_set_with_deletes,
but it'll also happen more commonly during init now.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-31 14:08:48 -07:00
Samuel Just
8c86678ba7 crimson: hook PeeringState into pg
This patch:
1) Adds partially implemented stubs for PeeringState::PeeringListener
2) Revamps the message handling to batch the peering events from
   a single message.
3) Replaces the message handling with hand-offs to PeeringState
4) Adds support for MOSDPGCreate2 enabling creation of pgs.
5) Introduces ShardServices for exposing osd machinery to the pgs.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-31 14:05:45 -07:00
Samuel Just
909f4e260e crimson/osd/main: add --debug option
Really, what we need to do is examine the ceph conf and set
the right logger levels based on configured log levels, but
this'll suffice for now.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-31 14:05:45 -07:00