Commit Graph

99104 Commits

Author SHA1 Message Date
Sage Weil
0ddc2dea4c Merge PR #28658 into master
* refs/pull/28658/head:
	qa/suites/rados/thrash: force normal pg log length with cache tiering

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-06-24 13:14:42 -05:00
Sage Weil
537dad90a9 Merge PR #28662 into master
* refs/pull/28662/head:
	osd: share curmap in handle_osd_ping

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-06-24 13:13:48 -05:00
Casey Bodley
b338c649ee
Merge pull request #28430 from cbodley/wip-40187
cls/rgw: keep issuing bilog trim ops after reset

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-06-24 11:46:45 -04:00
Jason Dillaman
c38f385864
Merge pull request #28667 from majianpeng/msg-async-comments
msg/async: add comments for commit 294c41f18a.

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-24 11:34:36 -04:00
Casey Bodley
4b139e57cd
Merge pull request #28704 from joke-lee/sts_assume_policy
rgw: Policy should be url_decode when assume_role

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2019-06-24 10:03:21 -04:00
Jianpeng Ma
0d13ef2f20 msg/async: add comments for commit 294c41f18a.
Consider this case:
    send-thread                                 msg-work
                                            write_event()
                                             r = write_message()
connection->write_lock.lock()
if (.. && !write_in_progress) {
  write_in_progress = true;
  add external_event
}
connection->write_lock.unlock()
                                          connection->write_lock.lock()
                                          if (r > 0)
                                            break;
                                          } while ();
                                          write_in_progress = false;

For this case, we don't add external_event and in write_event we don't
check out_q whether empty rather than break.
This make msg-work never wake up again.
Fortunately, if write_message() > 0, in AsyncConnection::_try_send will
add an EVENT_WRITEABLE to wake up msg-work. So bug can't occur.

I add comment to descript this and hope get the better method to fix
this.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-06-24 20:24:36 +08:00
Kefu Chai
9dd49d7435
Merge pull request #28709 from tchaikov/wip-seastar
seasetar: pick up the latest seastar

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-06-24 16:11:46 +08:00
Kefu Chai
65958bf203 seasetar: pick up the latest seastar
couple noticeable changes

* use dpdk v19.05, please note the older version of dpdk might not
  work, for instance dpdk v18.11 does not compile with the latest
  seastar master HEAD
* future cleanups

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-24 14:49:00 +08:00
Kefu Chai
c871620d16
Merge pull request #28707 from majianpeng/perf-async-msgr-remove-unsued-header
test/crimson/perf_async_msgr: remove unsued header file.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-24 10:58:34 +08:00
Jianpeng Ma
e39134b983 test/crimson/perf_async_msgr: remove unsued header file.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-06-24 08:49:15 +08:00
Kefu Chai
34641e0be2
Merge pull request #28684 from tchaikov/wip-silence-warnings
src/: silence GCC warnings

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-23 10:13:01 +08:00
Kefu Chai
1b0eb21220
Merge pull request #28677 from liewegas/wip-recovery-nvme
osd: add hdd and ssd variants for osd_recovery_max_active

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-06-23 01:56:42 +08:00
yuliyang
ba5caffb1c rgw, Policy should be url_decode when assume_role
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2019-06-22 14:58:31 +08:00
Kefu Chai
90022b35ab
Merge pull request #17619 from liuchang0812/wip-ec-below-min-size
osd: allow EC PGs to do recovery below min_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-22 12:58:55 +08:00
Casey Bodley
fa6733a115
Merge pull request #28697 from cbodley/wip-qa-rgw-swift-skip-client
qa/rgw: fix swift warning message

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-06-21 15:52:36 -04:00
Casey Bodley
9b8be0584d qa/rgw: fix swift warning message
File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/swift.py", line 245, in task
    log.warning('Swift tests cannot run on rhel 7.6+, skipping client {client}'.format(client))
KeyError: 'client'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-21 15:18:59 -04:00
Mykola Golub
62eb1f5b79
Merge pull request #28657 from dillaman/wip-40435
rbd: use the ordered throttle for the export action

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-06-21 20:24:52 +03:00
Sage Weil
00952582dd Merge PR #28567 into master
* refs/pull/28567/head:
	Revert "mon/OSDMonitor: report pg[pgp]_num_target instead of pg[pgp]_num"

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-21 08:38:39 -05:00
Kefu Chai
07e02c47ff
Merge pull request #28674 from tchaikov/wip-doc/crimson
doc/dev: add crimson.rst

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-06-21 19:18:11 +08:00
Kefu Chai
ad639c7977
Merge pull request #28462 from myoungwon/wip-doc-dedup
doc: add a deduplication document

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-21 19:13:44 +08:00
Kefu Chai
d5e89876a3
Merge pull request #26251 from majianpeng/add-new-op-create
os/objectstore: add new op OP_CREATE for create a new object.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-21 16:10:37 +08:00
myoungwon oh
cd41b64460 doc: add a deduplication document
Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2019-06-21 14:23:41 +09:00
Kefu Chai
3ec6dfa289 doc/dev: add crimson.rst
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-21 12:29:07 +08:00
Adam C. Emerson
c7c8e88831 test: Replace deprecated TYPED_TEST_CASE with TYPED_TEST_SUITE
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
6bf5ff1d89 rgw: Fix pessimizing move
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
c393ff1324 client,rbd,mon: Fix signed compare warnings
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
2ddb170320 test/simple_spin: Explicitly wait for futures from async
Rather than count on implicitly blocking destruct.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
6248c40d54 OSD: Initialize pool and recovery_state in the order they are defined
Currently we call get_pool on the PeeringState before the PeeringState
has been initialized.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
975fafed35 rbd: Remove unused capture
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:38:55 +08:00
Adam C. Emerson
d68b5e015c immutable_object_cache: Remove unused capture
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:38:55 +08:00
Adam C. Emerson
0fad6c01ae immutable_object_cache: Remove pessimizing moves
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:38:55 +08:00
Sage Weil
35c0d75888 osd: add hdd and ssd variants for osd_recovery_max_active
Semi-arbitrarily set the SSD max to 10 (instead of 3).  This should be
tuned based on some real data.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-06-20 16:24:51 -05:00
Kefu Chai
790472df84
Merge pull request #28676 from tchaikov/wip-stop.sh-with-crimson
stop.sh: add --crimson option

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-06-21 03:55:05 +08:00
Neha Ojha
bd15824567
Merge pull request #28204 from dzafman/wip-39555
mon: Improve health status for backfill_toofull and recovery_toofull

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-06-20 11:12:10 -07:00
Patrick Donnelly
50fec41094
Merge PR #28663 into master
* refs/pull/28663/head:
	cephfs-shell: use consistent naming for paths
	cephfs-shell: remove unnecessary instances of to_bytes
	cephfs-shell: refactor list_items
	pybind/cephfs: improve user-friendliness of DirResult
	pybind/cephfs: avoid unicode check

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 11:09:37 -07:00
Patrick Donnelly
475f2deaf3
Merge PR #28561 into master
* refs/pull/28561/head:
	vstart_runner: upgrade the check for commands to be run as another user
	vstart_runner: split unicode arguments into lists

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 11:09:01 -07:00
Casey Bodley
51a8f37b5f
Merge pull request #28049 from theanalyst/rgw-lc-bl-fix
rgw_lc: use a new bl while encoding RGW_ATTR_LC

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-20 13:30:51 -04:00
Casey Bodley
bc065cae78
Merge pull request #28276 from liuchang0812/multi-site-request-forward
rgw: forwarded some requests to master zone

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-20 13:23:47 -04:00
Casey Bodley
01104c4d3e
Merge pull request #26167 from yaozongyou/rgw-lc-add-more-check
rgw: check lc objs not empty after fetching

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-06-20 13:15:57 -04:00
Casey Bodley
e796d7ecda
Merge pull request #26538 from zhangsw/feature-rgw-object-lock
rgw: add S3 object lock feature to support object worm

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-20 13:14:51 -04:00
Casey Bodley
d28197e64a
Merge pull request #26351 from linuxbox2/wip-rgw-gcretire
rgw: perfcounters: add gc retire counter

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-06-20 13:13:57 -04:00
Casey Bodley
d4e1a08a2c
Merge pull request #28527 from tianshan/fix_ret
rgw: fix miss get ret in STSService::storeARN

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2019-06-20 13:12:33 -04:00
Casey Bodley
2f7133d0a9
Merge pull request #28327 from linuxbox2/wip-rgw-email
rgw: conditionally allow non-unique email addresses

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-20 13:12:10 -04:00
Casey Bodley
96b0777379
Merge pull request #28308 from joke-lee/usage_dump
rgw: usage dump_unsigned instead dump_int

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-20 13:11:28 -04:00
Casey Bodley
891fc11670
Merge pull request #28172 from joke-lee/rgw-sts-bad-token
rgw: fix rgw crash and set correct error code

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2019-06-20 13:10:31 -04:00
Rishabh Dave
21a1b30a3e vstart_runner: upgrade the check for commands to be run as another user
Rectify the condition that checks if command to be issued as another
user using sudo is issued as a single argument after "-c".

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 21:35:38 +05:30
Mykola Golub
961df6356a
Merge pull request #28539 from dillaman/wip-40072
librbd: improve journal performance to match expected degradation

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-06-20 19:02:14 +03:00
Kefu Chai
c1ef3ff3de stop.sh: add --crimson option
so we can pkill crimson-osd if this option is specified

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-20 22:16:19 +08:00
Casey Bodley
e4114eb9a9
Merge pull request #28655 from dengchj/multisite_doc
doc: fixed --read-only argument value in multisite doc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-20 09:36:34 -04:00
Patrick Donnelly
f26493cc25
Merge PR #28194 into master
* refs/pull/28194/head:
	test_volume_client: declare only one default for python version
	test_volume_client: don't shadow class variable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 06:27:04 -07:00