Commit Graph

107142 Commits

Author SHA1 Message Date
Venky Shankar
8d68f1af3a mgr/volumes: add protect/unprotect and snap clone interface
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Venky Shankar
461909be2e mgr/volumes: handle transient subvolume states
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Venky Shankar
7089808bf8 mgr/volumes: interface for creating a cloned subvolume
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Venky Shankar
f02b1e7e54 mgr/volumes: get/set property for subvolume mode/uid/gid
This will be required when creating a clone as the clone would
inherit source subvolumes creation mode and uid/gid.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Venky Shankar
5318779583 mgr/volumes: module to track pending clone operations
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Venky Shankar
46f29bf3b4 mgr/volumes: add operation state machine table
... and fetch creation state from state machine table.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Kefu Chai
90eb6733a4
Merge pull request #33001 from tchaikov/wip-drop-dpdk-submodule
dpdk: drop dpdk submodule

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-31 16:16:39 +08:00
Kefu Chai
1426ddb9c3
Merge pull request #32814 from mty22/au_ceph_branch_correct_docs
docs: Update au.ceph.com maintainers, update README.md.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-31 15:22:40 +08:00
Kefu Chai
8a2088dda9 dpdk: drop dpdk submodule
we are using spdk/dpdk for async msgr's dpdk backend since 01a9f178. so
no need to keep dpdk submodule anymore.

Fixes: http://tracker.ceph.com/issues/24032
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-31 11:59:37 +08:00
Sage Weil
fb9eb720ba Merge PR #32947 into master
* refs/pull/32947/head:
	OSD: Allow 64-char hostname to be added as the "host" in CRUSH

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-30 21:57:04 -06:00
Sage Weil
6e6a21ec1a Merge PR #32974 into master
* refs/pull/32974/head:
	mon: dump json from 'sessions' asok/tell command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 21:56:53 -06:00
Sage Weil
61313e4052 Merge PR #32976 into master
* refs/pull/32976/head:
	cls_hello: fix typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-30 21:56:43 -06:00
Sage Weil
d2e5961ac9 Merge PR #32981 into master
* refs/pull/32981/head:
	mon: elector: return after triggering a new election

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 21:56:18 -06:00
Sage Weil
a7988dfd3f Merge PR #32988 into master
* refs/pull/32988/head:
	qa/tasks/ceph: only re-request scrub on unscrubbed pgs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 21:56:05 -06:00
David Galloway
ec1f29a5fd
Merge pull request #32992 from ceph/wip-revert-dpdk
Revert "dpdk: drop dpdk submodule"
2020-01-30 14:20:29 -05:00
David Galloway
2d3dc03878 Revert "dpdk: drop dpdk submodule"
This reverts commit cb8087dfac.

The seastar submodule's .gitmodules links to `../dpdk` which is no longer present after removing dpdk from ceph.git's .gitmodules.

```
<dwfreed> the ceph/seastar repo uses awful URLs for the submodules
<dwfreed> and those awful URLs are the real reason it's failing
<dwfreed> dgalloway: ^^^
<dwfreed> seastar's .gitmodules references repos in the parent directory, so that when it's checked out as a submodule of ceph, you don't download the repos twice (and git will probably also use references instead of duplicating the local .git); however, ceph doesn't have a submodule for dpdk anymore
<dwfreed> so seastar's referencing a dpdk repo that doesn't exist
<dgalloway> i think i follow.  so you're suggesting revert cb8087dfac ?
<dwfreed> yep
<dwfreed> that'd be one way to fix it
...
<joshd> dgalloway: I'd suggest revert for now, and let the crimson folks figure out the longer term fix when they're back
```

Signed-off-by: David Galloway <dgallowa@redhat.com>
2020-01-30 13:41:28 -05:00
Sage Weil
2954c607b7 Merge PR #32958 into master
* refs/pull/32958/head:
	qa/suites/rados/singleton/all/lost-unfound*: whitelist SLOW_OPS

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 11:01:24 -06:00
Sage Weil
684dfa6a83 Merge PR #32789 into master
* refs/pull/32789/head:
	test: fix unused assert's variable in ceph_test_osd_stale_read.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-30 10:42:45 -06:00
Sage Weil
f10cc22c60 Merge PR #32961 into master
* refs/pull/32961/head:
	qa/standalone/osd/osd-bench: debug bluestore

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:17 -06:00
Sage Weil
32a36f9c75 Merge PR #32968 into master
* refs/pull/32968/head:
	qa/suites/rados/verify: debug monc = 20

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:05 -06:00
Sage Weil
1dc2a8a09e qa/tasks/ceph: only re-request scrub on unscrubbed pgs
If we haven't scrubbed everything, we occasinoally re-request scrub in case
the request was missed by the OSD (this can happen).  But we were
re-requesting scrub on ALL pgs, and if they are done in a
semi-deterministic order and are slow, then we may never get to the final
ones.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 10:22:49 -06:00
Abhishek L
6cb3f9e541
Merge pull request #32771 from xxcs/xxcs07
rgw: fix multipart upload's error response

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-01-30 16:46:15 +01:00
Sage Weil
88af16ccd0 Merge PR #32878 into master
* refs/pull/32878/head:
	cephadm: share code between 'pull' and 'inspect-image'
	mgr/cephadm: upgrade: pull image after upgrade start, and for each host
	cephadm: add inspect-image command

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-30 09:28:38 -06:00
Patrick Donnelly
dc7a069ce8
Merge PR #30969 into master
* refs/pull/30969/head:
	mds : clean up data written to unsafe inodes

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 07:20:43 -08:00
Patrick Donnelly
256b42265a
Merge PR #32397 into master
* refs/pull/32397/head:
	mds: Move StrayManager initializations to its header
	mds: Remove extra spaces in StrayManager header.
	mds: Reorganize structure members in StrayManager header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 07:06:21 -08:00
Sage Weil
88c49d483a Merge PR #32969 into master
* refs/pull/32969/head:
	qa/suites/rados/cephadm: explicitly test many distros

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-01-30 08:28:25 -06:00
Patrick Donnelly
2931433cd1
Merge PR #32854 into master
* refs/pull/32854/head:
	qa: fix testing kernel branch link

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-30 06:25:25 -08:00
Patrick Donnelly
cb7fc37f2c
Merge PR #32801 into master
* refs/pull/32801/head:
	cephfs-shell: Fix ls -l

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-30 05:55:10 -08:00
Lenz Grimmer
bc7502ed7b
mgr/dashboard: Change project name to "Ceph Dashboard" (#32959)
mgr/dashboard: Change project name to "Ceph Dashboard"

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-01-30 13:43:46 +00:00
Kefu Chai
b51ed99091
Merge pull request #32978 from tchaikov/wip-seastar
seastar: pickup change to fix cgroups V2 support

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2020-01-30 21:02:31 +08:00
Sage Weil
68d3c86106 Merge PR #32972 into master
* refs/pull/32972/head:
	python-common/ceph/deployment/translate: use 'prepare' instead of 'batch' for trivial case
	qa/tasks/cephadm: pass short dev name to osd prepare
	mgr/cephadm: fix detection of just-created OSDs
	mgr/cephadm: properly indent raise conditions
	mgr/cephadm: add warning to other orchestrators
	mgr/cephadm: separate acceptance criterias for Devices
	mgr/cephadm: fix typos
	mgr/cephadm: move utils in test/utils.py
	mgr/ssh: increase disk size to 20G
	drivegroups: add support for drivegroups + tests
	mgr/orch_cli: allow multiple drivegroups
	drivegroups: translate disk spec to ceph-volume call

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-01-30 07:01:47 -06:00
Greg Farnum
337d12ba80 mon: elector: return after triggering a new election
When receiving an old propose, we were correctly triggering a new election
but not then returning out of receive_propose(), so we processed the
"should I defer" logic and perhaps sent out a deferal (in the current epoch!).

Fixes: https://tracker.ceph.com/issues/42977

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2020-01-30 04:43:13 -08:00
Gregory Farnum
ff530327a0
Merge pull request #32980 from ceph/gregsfortytwo-doc-rm-hadoop-2
doc: remove the CephFS-Hadoop instructions

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 13:40:58 +01:00
xxcs
8c2a867c4b rgw: fix multipart upload's error response
Fixes: https://tracker.ceph.com/issues/43751
Signed-off-by: GaryHyg <huygbj@inspur.com>
2020-01-30 20:36:28 +08:00
Sebastian Wagner
8be1556bcf
Merge pull request #32967 from rhcs-dashboard/ignore-python-common-build
.gitignore: ignore /src/python-common/build

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-30 12:57:27 +01:00
Abhishek L
a09dff2244
Merge pull request #30777 from GaryHyg/origin/master
rgw: dmclock: wait until the request is handled.

Reviewed-By: Kefu Chai <kchai@redhat.com>
Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-01-30 12:55:11 +01:00
Abhishek L
fd2904774d
Merge pull request #32669 from IlsooByun/rel_cb_arg
rgw: release unused callback argument

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-01-30 12:53:56 +01:00
Abhishek L
58b310925b
Merge pull request #32476 from theanalyst/rgw/multisite/user-policy
rgw: user policy: forward write requests to master zone

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-01-30 12:50:02 +01:00
Gregory Farnum
548fc13549 doc: remove the CephFS-Hadoop instructions
These have not aged gracefully, and in particular include instructions
for setting pool size 1 to let Hadoop control the replication — but I've
heard reports of users setting up multiple size-1 pools and then wondering
where their data went when an OSD dies.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2020-01-30 03:14:45 -08:00
Jan Fajerski
3913835a8f
Merge pull request #32370 from AlexZzz/prometheus_pg_status_bypool
mgr/prometheus: report per-pool pg states
2020-01-30 11:10:34 +01:00
Sage Weil
83edd88d03 Merge PR #32975 into master
* refs/pull/32975/head:
	mon/ConfigMonitor: only propose if leader

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-29 22:11:14 -06:00
Sage Weil
1a32a2a1af Merge PR #32970 into master
* refs/pull/32970/head:
	cephadm: include daemon/unit id in unit name

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-29 21:31:14 -06:00
Kefu Chai
7f79b47b0e seastar: pickup change to fix cgroups V2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-30 10:20:30 +08:00
David Zafman
6bb36f862f
Merge pull request #32945 from dzafman/wip-43864
test: Update pg log test for new trimming behavior

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-29 16:03:44 -08:00
Sage Weil
f7a4885b7f cls_hello: fix typo
This was mostly harmless but this makes the warning go away.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 17:22:36 -06:00
Sage Weil
ab64a220cc mon/ConfigMonitor: only propose if leader
Introduced by 08fcf01c04, which activated
this (broken) code path.

Fixes: https://tracker.ceph.com/issues/43892
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 17:18:04 -06:00
Sage Weil
71a0d8a568 mon: dump json from 'sessions' asok/tell command
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 15:37:03 -06:00
Sage Weil
d8debba782 cephadm: share code between 'pull' and 'inspect-image'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 14:00:39 -06:00
Sage Weil
48526b90c7 Merge PR #32623 into master
* refs/pull/32623/head:
	ceph_release: octopus rc 15.1.0

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-29 13:59:53 -06:00
Sage Weil
b119fc5f18 qa/suites/rados/cephadm: explicitly test many distros
Include _latest.yaml in a few cases here to be a bit future-proof.

cephadm-smoke/ is *just* a cephadm bring-up, and includes el7.  cephadm/
installs packages and runs a real workload.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 13:41:59 -06:00