Commit Graph

99119 Commits

Author SHA1 Message Date
shangdehao1
24d4bcd165 librbd: modify flush interface of RO
Add to journal_tid parameter to flush interface
Delete LibrbdWriteback head file

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
2019-06-24 17:35:40 -04:00
shangdehao1
c25365605d test: add librbd/cache/ParentImageCache UT
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
2019-06-24 17:35:40 -04:00
shangdehao1
a862b4d58a test: add domain socket mock
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
2019-06-24 17:35:40 -04:00
shangdehao1
18ab659ae4 librbd: template CacheClient at RO hook
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
2019-06-24 17:35:40 -04:00
shangdehao1
7b9596bea3 librbd: enable librbd hook for shared RO cache
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2019-06-24 17:35:40 -04:00
Jason Dillaman
95c298b183
Merge pull request #28665 from mikechristie/wip-doc-mikechristie-update-igw-ansible
doc: update ceph ansible iscsi info

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-24 17:33:45 -04:00
Yuri Weinstein
532eee87dc
Merge pull request #28721 from yuriw/wip-yuriw-crontab-master
qa/tests: changed the TO email to 'ceph-qa@ceph.io'
2019-06-24 11:57:27 -07:00
Mike Christie
37c9a96955 doc: Add rbd-target-api ceph iscsi ansible vars
Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-06-24 14:27:53 -04:00
Mike Christie
92bf169c3a doc: Update rbd-target-gw behavior info
The lio setup and teardown functionality was moved from rbd-target-gw to
rbd-target-api in ceph-iscsi.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-06-24 14:27:53 -04:00
Mike Christie
d964fb5962 doc: Update ceph-ansible iscsigws settings
The ceph-ansible ceph-iscsi support does not allow setting up iscsi
objects. It must be done through gwcli like is done in the container
case. This drops the iscsi object related settings and admin info for
it.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-06-24 14:27:53 -04:00
Mike Christie
683b50189b doc: Fix ceph-ansible iscsigws command
Use the more standard --limit iscsigws argument instead of running the
playbook command on the iscsigws.yml file directly.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-06-24 14:27:53 -04:00
Mike Christie
d6fbe68322 doc: Fix igw ceph ansible host group name
The ceph-ansible iscsi group name is iscsigws and not
ceph-iscsi-gws.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-06-24 14:27:53 -04:00
Sage Weil
fe4c5fcb26 Merge PR #28624 into master
* refs/pull/28624/head:
	mgr/zabbix: encode string for Python 3 compatibility

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-24 13:15:16 -05:00
Sage Weil
0ddc2dea4c Merge PR #28658 into master
* refs/pull/28658/head:
	qa/suites/rados/thrash: force normal pg log length with cache tiering

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-06-24 13:14:42 -05:00
Sage Weil
537dad90a9 Merge PR #28662 into master
* refs/pull/28662/head:
	osd: share curmap in handle_osd_ping

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-06-24 13:13:48 -05:00
Casey Bodley
b338c649ee
Merge pull request #28430 from cbodley/wip-40187
cls/rgw: keep issuing bilog trim ops after reset

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-06-24 11:46:45 -04:00
Jason Dillaman
c38f385864
Merge pull request #28667 from majianpeng/msg-async-comments
msg/async: add comments for commit 294c41f18a.

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-06-24 11:34:36 -04:00
Yuri Weinstein
9a437fcdaa qa/tests: changed the TO email to 'ceph-qa@ceph.io'
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-06-24 07:25:15 -07:00
Casey Bodley
4b139e57cd
Merge pull request #28704 from joke-lee/sts_assume_policy
rgw: Policy should be url_decode when assume_role

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2019-06-24 10:03:21 -04:00
Jianpeng Ma
0d13ef2f20 msg/async: add comments for commit 294c41f18a.
Consider this case:
    send-thread                                 msg-work
                                            write_event()
                                             r = write_message()
connection->write_lock.lock()
if (.. && !write_in_progress) {
  write_in_progress = true;
  add external_event
}
connection->write_lock.unlock()
                                          connection->write_lock.lock()
                                          if (r > 0)
                                            break;
                                          } while ();
                                          write_in_progress = false;

For this case, we don't add external_event and in write_event we don't
check out_q whether empty rather than break.
This make msg-work never wake up again.
Fortunately, if write_message() > 0, in AsyncConnection::_try_send will
add an EVENT_WRITEABLE to wake up msg-work. So bug can't occur.

I add comment to descript this and hope get the better method to fix
this.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-06-24 20:24:36 +08:00
Kefu Chai
9dd49d7435
Merge pull request #28709 from tchaikov/wip-seastar
seasetar: pick up the latest seastar

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-06-24 16:11:46 +08:00
Kefu Chai
65958bf203 seasetar: pick up the latest seastar
couple noticeable changes

* use dpdk v19.05, please note the older version of dpdk might not
  work, for instance dpdk v18.11 does not compile with the latest
  seastar master HEAD
* future cleanups

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-24 14:49:00 +08:00
Kefu Chai
c871620d16
Merge pull request #28707 from majianpeng/perf-async-msgr-remove-unsued-header
test/crimson/perf_async_msgr: remove unsued header file.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-24 10:58:34 +08:00
Jianpeng Ma
e39134b983 test/crimson/perf_async_msgr: remove unsued header file.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-06-24 08:49:15 +08:00
Kefu Chai
34641e0be2
Merge pull request #28684 from tchaikov/wip-silence-warnings
src/: silence GCC warnings

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-23 10:13:01 +08:00
Kefu Chai
1b0eb21220
Merge pull request #28677 from liewegas/wip-recovery-nvme
osd: add hdd and ssd variants for osd_recovery_max_active

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-06-23 01:56:42 +08:00
yuliyang
ba5caffb1c rgw, Policy should be url_decode when assume_role
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2019-06-22 14:58:31 +08:00
Kefu Chai
90022b35ab
Merge pull request #17619 from liuchang0812/wip-ec-below-min-size
osd: allow EC PGs to do recovery below min_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-22 12:58:55 +08:00
Casey Bodley
fa6733a115
Merge pull request #28697 from cbodley/wip-qa-rgw-swift-skip-client
qa/rgw: fix swift warning message

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-06-21 15:52:36 -04:00
Casey Bodley
9b8be0584d qa/rgw: fix swift warning message
File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/swift.py", line 245, in task
    log.warning('Swift tests cannot run on rhel 7.6+, skipping client {client}'.format(client))
KeyError: 'client'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-21 15:18:59 -04:00
Mykola Golub
62eb1f5b79
Merge pull request #28657 from dillaman/wip-40435
rbd: use the ordered throttle for the export action

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-06-21 20:24:52 +03:00
Sage Weil
00952582dd Merge PR #28567 into master
* refs/pull/28567/head:
	Revert "mon/OSDMonitor: report pg[pgp]_num_target instead of pg[pgp]_num"

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-21 08:38:39 -05:00
Kefu Chai
07e02c47ff
Merge pull request #28674 from tchaikov/wip-doc/crimson
doc/dev: add crimson.rst

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-06-21 19:18:11 +08:00
Kefu Chai
ad639c7977
Merge pull request #28462 from myoungwon/wip-doc-dedup
doc: add a deduplication document

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-21 19:13:44 +08:00
Kefu Chai
d5e89876a3
Merge pull request #26251 from majianpeng/add-new-op-create
os/objectstore: add new op OP_CREATE for create a new object.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-21 16:10:37 +08:00
myoungwon oh
cd41b64460 doc: add a deduplication document
Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2019-06-21 14:23:41 +09:00
Kefu Chai
3ec6dfa289 doc/dev: add crimson.rst
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-21 12:29:07 +08:00
Adam C. Emerson
c7c8e88831 test: Replace deprecated TYPED_TEST_CASE with TYPED_TEST_SUITE
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
6bf5ff1d89 rgw: Fix pessimizing move
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
c393ff1324 client,rbd,mon: Fix signed compare warnings
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
2ddb170320 test/simple_spin: Explicitly wait for futures from async
Rather than count on implicitly blocking destruct.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
6248c40d54 OSD: Initialize pool and recovery_state in the order they are defined
Currently we call get_pool on the PeeringState before the PeeringState
has been initialized.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:41:16 +08:00
Adam C. Emerson
975fafed35 rbd: Remove unused capture
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:38:55 +08:00
Adam C. Emerson
d68b5e015c immutable_object_cache: Remove unused capture
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:38:55 +08:00
Adam C. Emerson
0fad6c01ae immutable_object_cache: Remove pessimizing moves
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-06-21 11:38:55 +08:00
Sage Weil
35c0d75888 osd: add hdd and ssd variants for osd_recovery_max_active
Semi-arbitrarily set the SSD max to 10 (instead of 3).  This should be
tuned based on some real data.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-06-20 16:24:51 -05:00
Kefu Chai
790472df84
Merge pull request #28676 from tchaikov/wip-stop.sh-with-crimson
stop.sh: add --crimson option

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-06-21 03:55:05 +08:00
Neha Ojha
bd15824567
Merge pull request #28204 from dzafman/wip-39555
mon: Improve health status for backfill_toofull and recovery_toofull

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-06-20 11:12:10 -07:00
Patrick Donnelly
50fec41094
Merge PR #28663 into master
* refs/pull/28663/head:
	cephfs-shell: use consistent naming for paths
	cephfs-shell: remove unnecessary instances of to_bytes
	cephfs-shell: refactor list_items
	pybind/cephfs: improve user-friendliness of DirResult
	pybind/cephfs: avoid unicode check

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 11:09:37 -07:00
Patrick Donnelly
475f2deaf3
Merge PR #28561 into master
* refs/pull/28561/head:
	vstart_runner: upgrade the check for commands to be run as another user
	vstart_runner: split unicode arguments into lists

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 11:09:01 -07:00