Commit Graph

110057 Commits

Author SHA1 Message Date
Casey Bodley
c52cbe212f
Merge pull request #34253 from cbodley/wip-qa-rgw-too-many-shards
qa/rgw: remove 1999-shard tests from rgw/verify

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2020-03-30 10:06:11 -04:00
Casey Bodley
308b6c2c0f
Merge pull request #33557 from yuvalif/add_2pc_cls_queue
cls/queue: add 2-phase-commit queue implementation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-03-30 09:49:19 -04:00
Casey Bodley
804dc5d064
Merge pull request #33933 from cbodley/wip-rgw-doc-reshard-v2
doc/rgw: update multisite reshard design for cross-datalog-shard coordination

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-03-30 09:38:40 -04:00
Sage Weil
07d9231ffb Merge PR #34260 into master
* refs/pull/34260/head:
	Revert "Merge PR #34091 into master"

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-30 08:36:44 -05:00
Sage Weil
803f05f254 Merge PR #34248 into master
* refs/pull/34248/head:
	qa/tasks/cephadm: no need to explicitly reconfig
	qa/tasks/cephadm: fetch final ceph.conf
	qa/tasks/cephadm: distribute ceph.conf and admin keyring to all nodes

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-30 08:24:59 -05:00
Sage Weil
4f4efde17a Merge PR #34266 into master
* refs/pull/34266/head:
	mgr/DaemonServer: fetch metadata for new daemons (e.g., mons)

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-03-30 08:24:47 -05:00
Tiago Melo
c6829da46c mgr/dashboard: Reduce size of component styles
Fixes: https://tracker.ceph.com/issues/44811

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-30 11:21:23 +00:00
Shilpa Jagannath
0a15f54803 rgw: replace RGWBucketInfo's sharding-related fields with BucketLayout
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-03-30 16:31:24 +05:30
Casey Bodley
60af77262a rgw: add BucketLayout to RGWBucketInfo
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-03-30 16:31:24 +05:30
Casey Bodley
d6686816b7 rgw: use qualified encode/decode in putobj processor
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-03-30 16:31:24 +05:30
Laura Paduano
8e64da5334
Merge pull request #34279 from votdev/issue_44805
mgr/dashboard: 'Prometheus / All Alerts' page shows progress bar

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-03-30 11:58:26 +02:00
Brad Hubbard
c9317ea2ae qa/ceph-ansible: CA master requires Ansible 2.9
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-30 19:46:19 +10:00
Volker Theile
1efe1a76da mgr/dashboard: 'Prometheus / All Alerts' page shows progress bar
Fixes: https://tracker.ceph.com/issues/44805

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-03-30 11:08:13 +02:00
Brad Hubbard
a12353815d qa/ceph-ansible: rule_name is required for pool creation
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-30 16:21:14 +10:00
Rishabh Dave
2cc0ee709c qa/vstart_runner: update vstart_runner.LocalRemote.sh
Commit 9f6c764f10 replaces remote.run calls by remote.sh without
updating the definition of vstart_runner.LocalRemote.sh which breaks the
cephfs tests when executed locally.

Fixes: https://tracker.ceph.com/issues/44579
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-03-30 11:46:12 +05:30
Brad Hubbard
c1f3f05011
Merge pull request #34276 from badone/wip-fix-argument-ordering-docker-test
tests: Reinstate "opts" as final argument

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-30 13:23:36 +10:00
Yan, Zheng
107b91d528 qa/cephfs: test case for auto reconnect after blacklisted
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/42085
2020-03-30 10:24:47 +08:00
Yan, Zheng
30dd9d2834 client: add debug output for ll_read result
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
aa9db2ef73 client: invalidate all write mode filp after reconnect
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
27da39ae5d client: auto reconnect using new entity addrs after blacklisted
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
173bb632e8 client: -EIO on read/write if file hander has lost filelocks
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
b87f3cafe0 client: -EIO on filelock operations if inode has lost filelocks
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
0f74020b44 client: purge dirty data when session gets evicted
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
2cf6184e41 client: check sync write error
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
c310d09e21 client: use session state to track if it's rejected by mds
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:47 +08:00
Yan, Zheng
a716bc7f9b msg: add Messenger::client_reset()
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-03-30 10:24:46 +08:00
Brad Hubbard
c951132aee tests: Reinstate "opts" as final argument
a1e8f61cb7 broke the "opts" argument.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-30 12:20:24 +10:00
Kefu Chai
011e7b3736
Merge pull request #34252 from JackSlateur/doc-os-recommendations2
doc/start/os-recommendations.rst: recommend bluestore

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-30 00:26:59 +08:00
Kefu Chai
54185b8042
Merge pull request #34267 from JackSlateur/doc-man-monmaptool
doc/man/8/monmaptool.rst: update synopsis etc with the latest options

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-30 00:23:47 +08:00
Alexandre Bruyelles
400ace85db
doc/man/8/monmaptool.rst: update the page with the latest options
Signed-off-by: Alexandre Bruyelles <jack@jack.fr.eu.org>
2020-03-29 18:00:02 +02:00
Kefu Chai
bd0e885a8a
Merge pull request #34224 from markhpc/wip-bluefs-disable-buffered-io
common/options: Disable bluefs_buffered_io by default again.

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-03-29 22:21:05 +08:00
Kefu Chai
aececeab8b
Merge pull request #33052 from ifed01/wip-ifed-fix-unused2
os/bluestore: fix 'unused' calculation

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2020-03-29 22:19:23 +08:00
Kefu Chai
44842fcd6a
Merge pull request #34203 from majianpeng/bluefs-remove-unused-func
os/bluestore: remove unused func.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-29 22:18:02 +08:00
Sage Weil
48b6cc6182 Merge PR #34061 into master
* refs/pull/34061/head:
	mgr/orch: Add `ceph orch ls --export`
	mgr/dashboard: adapt to new `ServiceDescription.to_json()`
	python-common: add `service_name` to `ServiceSpec.to_json`
	python-common: make ServiceSpec and ServiceDescription compatible
	src/ceph.in: add yaml to known formats
	mgr/orch: add yaml to `orch ls`
	mgr/orch: remove `orch spec dump`
	python-common: reorder RGWSpec arguments
	python-common: prevent ServiceSpec of wrong type
	pybind/mgr: tox.ini: omit cov report
	mgr/cephadm: test describe_service
	mgr/orch: ServiceDescription: change json representation
	mgr/orch: ServiceDescription: Make spec a requirement

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-29 07:17:37 -05:00
Sage Weil
932d152f35 Merge PR #34215 into master
* refs/pull/34215/head:
	cephadm: Fix trucated output of `mgr dump`

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-29 07:16:59 -05:00
Yuval Lifshitz
87a67490de cls/queue: remove error message when queue is not initialized
also remove redundant newlines in the log messages

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-03-29 13:17:32 +03:00
Kefu Chai
260b1a922e
Merge pull request #34268 from poyea/docs-options-1
doc: Fix inconsistency in logging settings

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-29 14:24:09 +08:00
John Law
c2c069f2b4 doc: Fix inconsistency in logging settings
This patch fixes inconsistency in logging settings with options, namely `log_flush_on_exit` and `log_to_stderr`. This patch also adds `log_to_file` to the section.

Signed-off-by: John Law <johnlaw.po@gmail.com>
2020-03-29 03:14:45 +02:00
Sage Weil
ea274a1988 mgr/DaemonServer: fetch metadata for new daemons (e.g., mons)
We fetch metadata for mon/osd/mds daemons on startup.  If a new one comes
along *after* we start up, we need to fetch it on demand.  Otherwise,
notably, we will ignore any new mons added to the cluster:

- mon.a starts
- mgr starts, fetchs a's metadata
- mon.b added
- mon.b tries top open mgr connection, and is rejected each time

This can lead to follow-on badness when the mon tries to proxy mgr
commands or do other things.

Fix by fetching metadata on demand, like we already do in the report
path.

Fixes: https://tracker.ceph.com/issues/44798
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-28 16:56:22 -05:00
Sage Weil
9f3f05c5e5 Merge PR #34062 into master
* refs/pull/34062/head:
	cephadm: update check-host() to return all problems

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-28 09:24:55 -05:00
zhengyin
5f871eda28 test: add test case for children's stripe
Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2020-03-28 11:34:40 +08:00
zhengyin
521327fb51 librbd: children should inherit parent's stripe
If the child does not specify the stripe-unit and stripe-count,
it should inherit parent's stripe.

Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2020-03-28 11:34:40 +08:00
Kefu Chai
0e40f6fb01
Merge pull request #33943 from xxhdx1985126/wip-crimson-alienstore-bugs
crimson: fix bugs that come up when osds go through down/up

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-28 09:53:43 +08:00
Radoslaw Zarzynski
cd46d7a625 crimson/osd: fix method's flag handling on CEPH_OSD_OP_CALL.
This patch fixes a regression introduced in d8d0ab1a and
makes `ClsHello.BadMethods` green again.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-03-28 01:37:45 +01:00
Sebastian Wagner
6a6759eef0 cephadm: Fix trucated output of mgr dump
In case the process has terminated, we
have to make sure to read till EOF, otherwise
we might skip some bytes.

Fixes: https://tracker.ceph.com/issues/44642

Co-authored-by: Tim Serong <tserong@suse.com>
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-28 00:42:34 +01:00
Casey Bodley
01516061ec qa/rgw: remove 1999-shard tests from rgw/verify
causing test failures because the host runs out of disk space

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-03-27 17:43:12 -04:00
Alexandre Bruyelles
ed8cc0ca7f
doc/start/os-recommendations.rst: recommend bluestore
Signed-off-by: Alexandre Bruyelles <jack@jack.fr.eu.org>
2020-03-27 22:00:16 +01:00
Sage Weil
037a68d76e Merge PR #34247 into master
* refs/pull/34247/head:
	mgr/dashboard: do not fail on user creation

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-27 15:20:17 -05:00
Gregory Farnum
60504bd048
Merge pull request #33279 from rishabh-d-dave/fs-move-run_shell-and-related-methods
qa/cephfs: move run_shell to mount.py and add methods for negative testing
2020-03-27 12:59:43 -07:00
Gregory Farnum
d472ab9753
Merge pull request #34021 from lxbsz/deleg_XXX
test/libcephfs: retry and wait for caps when setting the RD deleg
2020-03-27 12:57:20 -07:00