Commit Graph

98504 Commits

Author SHA1 Message Date
Casey Bodley
3ff5f0c240 qa/rgw: use default ports (80 or 443) unless overridden
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
921faebb72 qa/rgw: allow rgw client config to override port
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
dead71f5f9
Merge pull request #28146 from smanjara/wip-39551
rgw/multisite:RGWListBucketIndexesCR for data full sync pagination

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 12:53:09 -04:00
Casey Bodley
5a2661e48e
Merge pull request #26915 from dvanders/dvanders_doc_heap
doc: describe metadata_heap cleanup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 12:51:13 -04:00
Kefu Chai
cf8c952a9b
Merge pull request #28359 from tchaikov/wip-split-ceph-dencoder
tools/ceph-dencoder: split types.h into smaller pieces

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-06-03 23:51:20 +08:00
Dan van der Ster
e76604224c doc: describe metadata_heap cleanup
Fixes: http://tracker.ceph.com/issues/18174
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2019-06-03 17:14:39 +02:00
Casey Bodley
bdfc3bb92d
Merge pull request #28305 from rzarzynski/wip-bug-38827
qa/valgrind.supp: generalize the whiterule for aes-128-gcm to help rgw suite.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 09:09:24 -04:00
Casey Bodley
088d3ea26c
Merge pull request #25498 from cbodley/wip-27217
rgw: parse_copy_location defers url-decode

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 09:00:13 -04:00
Casey Bodley
62472c0ca3
Merge pull request #16659 from rzarzynski/wip-rgw-20797
rgw: TempURL should not allow PUTs with the X-Object-Manifest.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 08:59:12 -04:00
Casey Bodley
8a0b2c7a67
Merge pull request #12709 from rzarzynski/wip-rgw-18364-dbgs
rgw: improve debugs on the path of RGWRados::cls_bucket_head.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 08:57:37 -04:00
Casey Bodley
eb51579ba4
Merge pull request #12470 from rzarzynski/wip-rgw-18241
rgw: dump s3_code as the Code response element in RGWDeleteMultiObj_ObjStore_S3

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-03 08:57:13 -04:00
Kefu Chai
ed2ce0efad
Merge pull request #28339 from tchaikov/wip-cmake-asan
cmake/modules: replace ";" with " " in compile flags

Reviewed-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-06-03 12:28:32 +08:00
Kefu Chai
eaaec3d319 tools/ceph-dencoder: split types.h into smaller pieces
instead of putting all types in a single compilation unit, split them
into smaller groups, in hope to reduce the memory footprint of compiler
when compiling ceph_dencoder.cc.

sometimes, GCC just fails to compile this source file.

Fixes: http://tracker.ceph.com/issues/39595
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-01 23:12:16 +08:00
Patrick Donnelly
880468b4bf
Merge PR #28354 into master
* refs/pull/28354/head:
	doc: Add warning that the root directory cannot be fragmented

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-31 19:13:06 -07:00
Nathan Fish
46a9d1b78c doc: Add warning that the root directory cannot be fragmented
Documents: #39704

Signed-off-by: Nathan Fish <lordcirth@gmail.com>
2019-05-31 16:38:22 -04:00
Patrick Donnelly
d1ae3194d8
Merge PR #28199 into master
* refs/pull/28199/head:
	qa/tasks: upgrade the check for -c sudo option in vstart_runner.py

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-05-31 13:10:18 -07:00
Matt Benjamin
955c832df9
Merge pull request #28108 from linuxbox2/wip-rgwfile-reqid
Wip rgwfile reqid:  absorbs rgw_file: allocate new id for continued request #25664
2019-05-31 13:25:02 -04:00
Mykola Golub
4c5e9267ea
Merge pull request #28135 from dillaman/wip-39946
qa/workunits/rbd: remove 'fast-diff' from dynamic features test

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-31 17:16:46 +03:00
Mykola Golub
fa1bb804bf
Merge pull request #28295 from dillaman/wip-39952
librbd: do not unblock IO prior to growing object map during resize

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-31 15:56:02 +03:00
Jason Dillaman
d23bdb7931
Merge pull request #28296 from mcv21/doc-profile-rbd
doc: note explicitly that "profile rbd" allows blacklisting

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-05-31 08:29:21 -04:00
Kefu Chai
714fbf64ae cmake/modules: replace ";" with " " in compile flags
as the flags should be a string, not a list

tested using

cmake -DCMAKE_LINKER=gold -DWITH_ASAN=ON -DWITH_ASAN_LEAK=ON \
-DCMAKE_BUILD_TYPE=Debug

on ubuntu xenial

without this change, cmake will fail with following warning:

CMake Error at src/CMakeLists.txt:112 (message):
  The compiler /usr/bin/c++ has no C++17 support.

-- Configuring incomplete, errors occurred!

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-31 16:19:08 +08:00
Kefu Chai
f3c9a47d6b
Merge pull request #28328 from tchaikov/wip-fix-ceph-helper-test
qa/standalone/ceph-helpers: resurrect all OSD before waiting for health

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-31 12:23:09 +08:00
Kefu Chai
52cdbfce4d
Merge pull request #28338 from Jing-Scott/dev/modify-scrub-comments
osd: update comment as sub_op_scrub_map has been removed

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-31 11:22:37 +08:00
Jing Wenjun
a1733da2c9 osd: the sub_op_scrub_map has been removed
sub_op_scrub_map replaced by do_replica_scrub_map, sync the comments.

Signed-off-by: Jing Wenjun <jingwenjun@cmss.chinamobile.com>
2019-05-31 10:16:08 +08:00
Kefu Chai
cc1af444d7
Merge pull request #25099 from Thingee/master
doc: Adding US-Mid-West Mirror to docs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-31 09:56:20 +08:00
Patrick Donnelly
744f557106
Merge PR #25530 into master
* refs/pull/25530/head:
	mgr/diskprediction: Add diskprediction local plugin dependencies

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Dan Mick <dmick@redhat.com>
2019-05-30 18:24:39 -07:00
Mike Perez
18048264e5 doc/install/mirrors: Adding US-Mid-West Mirror to docs
Signed-off-by: Mike Perez <thingee@gmail.com>
2019-05-31 09:06:55 +08:00
Casey Bodley
0e2b6f5c1c
Merge pull request #27898 from alimaredia/wip-rgw-thread-yield-context-get-bucket-info
Thread optional yield context through  get_bucket_info call path

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-30 15:48:42 -04:00
Sage Weil
c47b322bd3 Merge PR #27957 into master
* refs/pull/27957/head:
	json: JSONDecoder::err inherits from std::runtime_error
	rgw: RGWXMLDecoder::err inherits from std::runtime_error

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-05-30 12:26:17 -05:00
Kefu Chai
3cf14fcbe0
Merge pull request #28317 from tchaikov/wip-crimson-net-remove-redundant-move
crimson/net: remove redundant std::move()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2019-05-31 01:16:26 +08:00
Kefu Chai
dea8e41930
Merge pull request #28289 from tchaikov/wip-kill-gcc-9-warnings
common,os: address string truncated warnings from GCC-9

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-30 23:56:41 +08:00
Kefu Chai
2953788f2a
Merge pull request #28055 from SUSE/wip-fix-39662
mgr/PyModuleRegistry: log error if we can't find any modules to load

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-05-30 23:56:02 +08:00
Kefu Chai
cdba0f1420 qa/standalone/ceph-helpers: resurrect all OSD before waiting for health
address the regression introduced by e62cfceb
in e62cfceb, we wanted to test the newly introduced TOO_FEW_OSDS
warning, so we increased the number of OSD to the size of pool, so if
the number of OSD is less than pool size, monitor will send a warning
message.

but we need to bring all OSDs back if we are expecting a healthy
cluster. in this change, all OSDs are resurrect before
`wait_for_health_ok`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-30 23:52:36 +08:00
Kefu Chai
e5064b894c qa/run-standalone.sh: s/Makefile/CMakeCache.txt/
as we could use a generator other than Make, for instance ninja.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-30 23:52:36 +08:00
Jason Dillaman
c8ce520870 librbd: do not unblock IO prior to growing object map during resize
This could result in a small race condition where IO is able to write
beyond the current extent of the object map, resulting in an assertion
failure.

Fixes: http://tracker.ceph.com/issues/39952
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-30 10:32:20 -04:00
Casey Bodley
804bb853f1 rgw: parse_copy_location defers url-decode
don't url-decode until after we search for the ?, or we'll truncate
object names that contain a url-encoded ?

Fixes: http://tracker.ceph.com/issues/27217

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-05-30 10:24:14 -04:00
Kefu Chai
b300d60ffb crimson/net: remove redundant std::move()
see https://en.cppreference.com/w/cpp/language/copy_elision

it also silences warning like:

src/crimson/net/ProtocolV2.cc:146:26: warning: redundant move in return
statement [-Wredundant-move]
  146 |       return std::move(bl);
      |                          ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-30 22:06:46 +08:00
Kefu Chai
f6b022bdbe
Merge pull request #27806 from ashitakasam/add-osd-alarm
osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-30 21:28:54 +08:00
Kefu Chai
b2019a164b
Merge pull request #28278 from tchaikov/wip-buffer-remove-advance-size_t
buffer.h: remove list::iterator_impl::advance(size_t)

Reviewed-by: James Page <james.page@ubuntu.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-30 21:26:27 +08:00
Kefu Chai
cca664e795
Merge pull request #28251 from xiexingguo/wip-balancer-new-osd-weight
mgr/balancer: fix initial weight-set value for newly created osds

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-30 21:23:44 +08:00
Kefu Chai
8b1e713254
Merge pull request #28107 from ifed01/wip-ifed-add-devices
os/bluestore: show device name in "osd metadata output"

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-30 21:20:15 +08:00
Kefu Chai
7a0d0f7285
Merge pull request #28277 from javacruft/32bit-compat-fixes
common: avoid use of size_t in options

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-30 21:18:43 +08:00
Jason Dillaman
d760291c2a
Merge pull request #28250 from tchaikov/wip-silence-warnings
mon,test: silence warnings from GCC and test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-05-30 07:42:05 -04:00
Kefu Chai
68c64e59c7
Merge pull request #25729 from the78mole/wip-32-bit-arm-fixes
cmake: boost fixes for ARM 32 bit

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-30 12:50:45 +08:00
Kefu Chai
10683cce90
Merge pull request #28255 from tchaikov/wip-convenience
common: no need to include ceph_assert.h

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-30 11:24:00 +08:00
Kefu Chai
5defdb9238
Merge pull request #28270 from NTmatter/patch-2
blobhash.h: remove extra [[fallthrough]]

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-30 11:22:18 +08:00
Radoslaw Zarzynski
b2007e275f Revert "qa: remove mon valgrind check in rgw verfiy suite"
This reverts commit d25d6ee0af.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-29 23:39:16 +02:00
Radoslaw Zarzynski
af63e3f51f qa/valgrind.supp: fix the name for aes-128-gcm whiterules.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-29 23:39:16 +02:00
Radoslaw Zarzynski
b71ded7b44 qa/valgrind.supp: generalize the whiterule for aes-128-gcm.
Fixes: http://tracker.ceph.com/issues/38827
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-29 23:10:52 +02:00
Sage Weil
5686d1ccd5 Merge PR #27799 into master
* refs/pull/27799/head:
	common/utime: don't pass %z to utime if there is a 'Z'
	test: test json encode/decode of utime_t
	mgr/ssh: parse new datetime
	mgr/devicehealth: parse new datetime
	mgr/crash: parse both old and new timestamp formats
	mgr/telemetry: use cluster-provided timestamp unmolested
	mon/MonMap: dump timestamps in UTC
	qa/tasks/ceph: tolerate 'T' or ' ' as date and time separator
	PendingReleaseNotes: note about change to ISO 8601 throughout
	test/cli: update regexs for timestamps
	log/LogClock: render timestamp in ISO 8601 format
	common/ceph_time: stringify in ISO 8601 format
	unittest_utime: add tests
	common/utime: make parse() handle (our) ISO 8601 output
	include/utime: make default string rendering ISO 8601 conformant
	include/utime: remove unused s[n]printf methods
	include/utime: make gmtime() output conformant ISO 8601

Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-05-29 15:27:52 -05:00