Commit Graph

107397 Commits

Author SHA1 Message Date
Kefu Chai
90eb6733a4
Merge pull request #33001 from tchaikov/wip-drop-dpdk-submodule
dpdk: drop dpdk submodule

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-31 16:16:39 +08:00
Kefu Chai
1426ddb9c3
Merge pull request #32814 from mty22/au_ceph_branch_correct_docs
docs: Update au.ceph.com maintainers, update README.md.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-31 15:22:40 +08:00
Kefu Chai
8a2088dda9 dpdk: drop dpdk submodule
we are using spdk/dpdk for async msgr's dpdk backend since 01a9f178. so
no need to keep dpdk submodule anymore.

Fixes: http://tracker.ceph.com/issues/24032
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-31 11:59:37 +08:00
Sage Weil
fb9eb720ba Merge PR #32947 into master
* refs/pull/32947/head:
	OSD: Allow 64-char hostname to be added as the "host" in CRUSH

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-30 21:57:04 -06:00
Sage Weil
6e6a21ec1a Merge PR #32974 into master
* refs/pull/32974/head:
	mon: dump json from 'sessions' asok/tell command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 21:56:53 -06:00
Sage Weil
61313e4052 Merge PR #32976 into master
* refs/pull/32976/head:
	cls_hello: fix typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-30 21:56:43 -06:00
Sage Weil
d2e5961ac9 Merge PR #32981 into master
* refs/pull/32981/head:
	mon: elector: return after triggering a new election

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 21:56:18 -06:00
Sage Weil
a7988dfd3f Merge PR #32988 into master
* refs/pull/32988/head:
	qa/tasks/ceph: only re-request scrub on unscrubbed pgs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 21:56:05 -06:00
Sage Weil
6ec6385285 doc/foundation: fix amihan
I misunderstood the status of their foundation membership.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 17:02:43 -06:00
Casey Bodley
39d1ad6713 rgw: MultipartObjectProcessor supports stripe size > chunk size
the head object for a multipart part should contain the entire stripe,
unlike a normal object where the head only contains the first chunk of
data (because it has to be written atomically)

Fixes: https://tracker.ceph.com/issues/42669

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-01-30 15:18:50 -05:00
David Galloway
ec1f29a5fd
Merge pull request #32992 from ceph/wip-revert-dpdk
Revert "dpdk: drop dpdk submodule"
2020-01-30 14:20:29 -05:00
David Galloway
2d3dc03878 Revert "dpdk: drop dpdk submodule"
This reverts commit cb8087dfac.

The seastar submodule's .gitmodules links to `../dpdk` which is no longer present after removing dpdk from ceph.git's .gitmodules.

```
<dwfreed> the ceph/seastar repo uses awful URLs for the submodules
<dwfreed> and those awful URLs are the real reason it's failing
<dwfreed> dgalloway: ^^^
<dwfreed> seastar's .gitmodules references repos in the parent directory, so that when it's checked out as a submodule of ceph, you don't download the repos twice (and git will probably also use references instead of duplicating the local .git); however, ceph doesn't have a submodule for dpdk anymore
<dwfreed> so seastar's referencing a dpdk repo that doesn't exist
<dgalloway> i think i follow.  so you're suggesting revert cb8087dfac ?
<dwfreed> yep
<dwfreed> that'd be one way to fix it
...
<joshd> dgalloway: I'd suggest revert for now, and let the crimson folks figure out the longer term fix when they're back
```

Signed-off-by: David Galloway <dgallowa@redhat.com>
2020-01-30 13:41:28 -05:00
Sage Weil
04f25b26c5 mgr/insights: make 'insights prune-health-history 0' zap current state
The self._health_slot value needs to be updated too if the current key
is removed.

Fixes: https://tracker.ceph.com/issues/43886
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 11:40:48 -06:00
Sage Weil
89ce01f473 mgr/cephadm: fix style of placeholder * services entry
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 11:23:17 -06:00
Sage Weil
8b37c780bf mgr/cephadm: prime cached service state with newly created services
If we create a service, add the expected state to our cache, so that it
immediately appears in the get_services result.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 11:20:59 -06:00
Sage Weil
509f896fa0 mgr/cephadm: by default, return current service state
In the normal case, return whatever state we currently have.

In the serve loop, refresh if the state is old.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 11:12:02 -06:00
Sage Weil
2954c607b7 Merge PR #32958 into master
* refs/pull/32958/head:
	qa/suites/rados/singleton/all/lost-unfound*: whitelist SLOW_OPS

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 11:01:24 -06:00
Sage Weil
684dfa6a83 Merge PR #32789 into master
* refs/pull/32789/head:
	test: fix unused assert's variable in ceph_test_osd_stale_read.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-30 10:42:45 -06:00
Sage Weil
f10cc22c60 Merge PR #32961 into master
* refs/pull/32961/head:
	qa/standalone/osd/osd-bench: debug bluestore

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:17 -06:00
Sage Weil
32a36f9c75 Merge PR #32968 into master
* refs/pull/32968/head:
	qa/suites/rados/verify: debug monc = 20

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:05 -06:00
Sage Weil
8c87110b54 qa/tasks/ceph_manager: add --log-early to raw_cluster_cmd
This is harmless if logging is low, but adds useful info when it is turned
up.

Hunting bug https://tracker.ceph.com/issues/43914

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 10:36:28 -06:00
Sebastian Wagner
8ee0cece70 mgr/progress: Add test_progress.py to tox
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-30 17:23:24 +01:00
Sage Weil
1dc2a8a09e qa/tasks/ceph: only re-request scrub on unscrubbed pgs
If we haven't scrubbed everything, we occasinoally re-request scrub in case
the request was missed by the OSD (this can happen).  But we were
re-requesting scrub on ALL pgs, and if they are done in a
semi-deterministic order and are slow, then we may never get to the final
ones.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 10:22:49 -06:00
Abhishek L
6cb3f9e541
Merge pull request #32771 from xxcs/xxcs07
rgw: fix multipart upload's error response

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-01-30 16:46:15 +01:00
Sage Weil
88af16ccd0 Merge PR #32878 into master
* refs/pull/32878/head:
	cephadm: share code between 'pull' and 'inspect-image'
	mgr/cephadm: upgrade: pull image after upgrade start, and for each host
	cephadm: add inspect-image command

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-30 09:28:38 -06:00
Patrick Donnelly
dc7a069ce8
Merge PR #30969 into master
* refs/pull/30969/head:
	mds : clean up data written to unsafe inodes

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 07:20:43 -08:00
Patrick Donnelly
256b42265a
Merge PR #32397 into master
* refs/pull/32397/head:
	mds: Move StrayManager initializations to its header
	mds: Remove extra spaces in StrayManager header.
	mds: Reorganize structure members in StrayManager header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 07:06:21 -08:00
Sage Weil
7d0a789b1b qa/tasks/ceph_manager: make fix_pgp_num behave when no pool is found
Fixes:

2020-01-30T04:41:24.697 INFO:tasks.thrashosds.thrasher:fixing pg num pool None
2020-01-30T04:41:24.698 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 1070, in wrapper
    return func(self)
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 1200, in _do_thrash
    self.choose_action()()
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 768, in fix_pgp_num
    if self.ceph_manager.set_pool_pgpnum(pool, force):
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 2088, in set_pool_pgpnum
    assert isinstance(pool_name, six.string_types)
AssertionError

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 08:32:56 -06:00
Sage Weil
88c49d483a Merge PR #32969 into master
* refs/pull/32969/head:
	qa/suites/rados/cephadm: explicitly test many distros

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-01-30 08:28:25 -06:00
Patrick Donnelly
2931433cd1
Merge PR #32854 into master
* refs/pull/32854/head:
	qa: fix testing kernel branch link

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-30 06:25:25 -08:00
Patrick Donnelly
cb7fc37f2c
Merge PR #32801 into master
* refs/pull/32801/head:
	cephfs-shell: Fix ls -l

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-30 05:55:10 -08:00
Sebastian Wagner
cb1399e647 mgr/progress: Add module to static type checking
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-30 14:49:26 +01:00
Lenz Grimmer
bc7502ed7b
mgr/dashboard: Change project name to "Ceph Dashboard" (#32959)
mgr/dashboard: Change project name to "Ceph Dashboard"

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-01-30 13:43:46 +00:00
Ricardo Marques
bcb05d0cae mgr/dashboard: Unable to remove an iSCSI gateway that is already in use
Fixes: https://tracker.ceph.com/issues/43900

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2020-01-30 13:19:48 +00:00
Sage Weil
caeb5bff81 mgr/cephadm: tolerate unknown service state
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:13:05 -06:00
Sage Weil
5334dd2824 mgr/cephadm: periodically refresh services in the background
Pass them into check_for_strays to avoid double-work.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:13:05 -06:00
Sage Weil
16db65fee2 mgr/cephadm: periodically check hosts, and warn if the host check fails
If we manually run the check, wake up the serve thread to recheck things.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:13:05 -06:00
Sage Weil
d8817c2615 mgr/cephadm: remove notify hook
We don't want to wake up serve so often.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:11:38 -06:00
Sage Weil
5ea0472d5a mgr/cephadm: fix 'cephadm check-host' error output
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:11:38 -06:00
Sage Weil
6e287da486 mgr/cephadm: fix check-host incancations
Use 'client' as entity to get the global container_image setting.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:11:38 -06:00
Sage Weil
d1fa031e6a mgr/cephadm: cache ssh connections
Instead of opening a fresh connection each time we run a command, keep
a handle for open connections.

- close the connection on any error
- close all connections if the ssh config changes
- close the connection when we remove a host

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:11:38 -06:00
Kefu Chai
b51ed99091
Merge pull request #32978 from tchaikov/wip-seastar
seastar: pickup change to fix cgroups V2 support

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2020-01-30 21:02:31 +08:00
Sage Weil
68d3c86106 Merge PR #32972 into master
* refs/pull/32972/head:
	python-common/ceph/deployment/translate: use 'prepare' instead of 'batch' for trivial case
	qa/tasks/cephadm: pass short dev name to osd prepare
	mgr/cephadm: fix detection of just-created OSDs
	mgr/cephadm: properly indent raise conditions
	mgr/cephadm: add warning to other orchestrators
	mgr/cephadm: separate acceptance criterias for Devices
	mgr/cephadm: fix typos
	mgr/cephadm: move utils in test/utils.py
	mgr/ssh: increase disk size to 20G
	drivegroups: add support for drivegroups + tests
	mgr/orch_cli: allow multiple drivegroups
	drivegroups: translate disk spec to ceph-volume call

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-01-30 07:01:47 -06:00
Greg Farnum
337d12ba80 mon: elector: return after triggering a new election
When receiving an old propose, we were correctly triggering a new election
but not then returning out of receive_propose(), so we processed the
"should I defer" logic and perhaps sent out a deferal (in the current epoch!).

Fixes: https://tracker.ceph.com/issues/42977

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2020-01-30 04:43:13 -08:00
Gregory Farnum
ff530327a0
Merge pull request #32980 from ceph/gregsfortytwo-doc-rm-hadoop-2
doc: remove the CephFS-Hadoop instructions

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-30 13:40:58 +01:00
xxcs
8c2a867c4b rgw: fix multipart upload's error response
Fixes: https://tracker.ceph.com/issues/43751
Signed-off-by: GaryHyg <huygbj@inspur.com>
2020-01-30 20:36:28 +08:00
Sebastian Wagner
8be1556bcf
Merge pull request #32967 from rhcs-dashboard/ignore-python-common-build
.gitignore: ignore /src/python-common/build

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-30 12:57:27 +01:00
Abhishek L
a09dff2244
Merge pull request #30777 from GaryHyg/origin/master
rgw: dmclock: wait until the request is handled.

Reviewed-By: Kefu Chai <kchai@redhat.com>
Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-01-30 12:55:11 +01:00
Abhishek L
fd2904774d
Merge pull request #32669 from IlsooByun/rel_cb_arg
rgw: release unused callback argument

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-01-30 12:53:56 +01:00
Abhishek L
58b310925b
Merge pull request #32476 from theanalyst/rgw/multisite/user-policy
rgw: user policy: forward write requests to master zone

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-01-30 12:50:02 +01:00