Commit Graph

104957 Commits

Author SHA1 Message Date
Sage Weil
ad4d346371 mgr/ssh: return err from _run_ceph_daemon
Sometimes callers will want to see this.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-04 09:23:36 -06:00
Sage Weil
91cb6eb613 ceph-daemon: add check-host and prepare-host
Check for (and/or install/configure):

- podman | docker
- systemctl
- LVM2
- chrony (or ntp or timesyncd)

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-04 09:22:06 -06:00
Sebastian Wagner
1d629923a9
Merge pull request #31967 from sebastian-philipp/ssh-understanding-async
mgr/ssh: HACKING.rst: Add Understanding `AsyncCompletion`

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-04 16:20:01 +01:00
Casey Bodley
18555ad75a
Merge pull request #31972 from clwluvw/patch-1
doc: rgw: Fixed bug on wrong name for user_id for OPA

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-12-04 08:32:00 -05:00
Laura Paduano
c0a409944a
Merge pull request #31906 from s0nea/wip-dashboard-fix-pg-num-warning
mgr/dashboard: fix tests in order to match pg num conventions

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-04 14:20:39 +01:00
Sage Weil
77068f2e47 Merge PR #31797 into master
* refs/pull/31797/head:
	qa: test mgr cephfs mount blacklist
	mgr: forward RADOS client instances for potential blacklist
	mon/MgrMonitor: blacklist previous instance
	mon: set RUNTIME flag on mon_mds_blacklist_interval
	mgr: use more efficient data structure

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-04 07:10:49 -06:00
Mykola Golub
20c721f3f5
Merge pull request #31950 from dillaman/wip-mirror-peer-fsid
rbd-mirror: peer_ping should send the local fsid to the remote

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-12-04 15:08:23 +02:00
Sage Weil
e24f597630 Merge PR #31908 into master
* refs/pull/31908/head:
	ceph-daemon: use uid/gid 0 when creating tempfiles
	ceph-daemon: drop unneeded `mode` during tmpfile create
	ceph-daemon: consolidate NamedTemporaryFile logic
	ceph-daemon: chown uid/gid `ceph-volume` tmpfiles

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-04 07:06:34 -06:00
Sage Weil
c26c1efdd8 Merge PR #31940 into master
* refs/pull/31940/head:
	mgr/ssh: Port raising exceptions from completion handlers to Py2

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2019-12-04 07:06:13 -06:00
Kefu Chai
aaba179533
Merge pull request #31990 from dzafman/wip-43084
tools/osdmaptool.cc: do not use deprecated std::random_shuffle()

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2019-12-04 12:30:11 +08:00
Patrick Donnelly
98e3b7efe8
qa: test mgr cephfs mount blacklist
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-03 17:53:14 -08:00
Patrick Donnelly
df507cde8d
mgr: forward RADOS client instances for potential blacklist
The mgr creates a per-module RADOS client connection for modules which
interact with RADOS (e.g. the volumes module). These clients should also
be blacklisted when the active mgr is failed; we don't want the former
active mgr to continue interacting with RADOS when the new one takes
over. This is particularly impactful for avoiding extraneous
"unresponsive client" warnings from the MDS when the mgr switches
(especially in testing). The MDS will pickup the new OSD blacklists
which include's the old mgr's libcephfs instance and blacklist/evict
that session quietly.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-03 17:53:14 -08:00
Patrick Donnelly
f2986a4400
mon/MgrMonitor: blacklist previous instance
This wasn't realized as necessary early on in the ceph-mgr development
because the mgr didn't interact with RADOS. However, now it is becoming
common for plugins to store data there. It's important that the previous
instance can no longer interact with RADOS while the new mgr takes over.

In particular, this means that the mgr's client sessions with the MDS
are automatically evicted once the MDS receives the new OSDMap. This
avoids a pesky "unresponsive client" warning in the cluster logs.

Fixes: https://tracker.ceph.com/issues/42939
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-03 17:53:13 -08:00
Patrick Donnelly
cc6422af85
mon: set RUNTIME flag on mon_mds_blacklist_interval
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-03 17:53:13 -08:00
Patrick Donnelly
78576c9eec
mgr: use more efficient data structure
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-03 17:53:13 -08:00
Kefu Chai
30dfef208d tools/osdmaptool.cc: do not use deprecated std::random_shuffle()
the use of `std::random_shuffle()` was introduced by
b946308 .

in this change, it is replaced using `std::shuffle()`.

Fixes: https://tracker.ceph.com/issues/43084

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-03 16:06:40 -08:00
Sage Weil
0e0c32ce21 Merge PR #31891 into master
* refs/pull/31891/head:
	qa/suites/rados/ssh: only install ceph-daemon for packaged mode
	tasks/ceph2: add support for packaged ceph-daemon
	qa/tasks/ceph2: make image cluster-private
	qa/tasks/ceph2: add 'shell' command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-03 16:49:28 -06:00
Sage Weil
e58515227a Merge PR #31984 into master
* refs/pull/31984/head:
	mgr/telemetry: fix log typo

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-03 16:11:21 -06:00
Sage Weil
1770270af6 Merge PR #31869 into master
* refs/pull/31869/head:
	ceph-daemon: bootstrap: deploy initial mon via deploy_daemon()
	qa/standalone/test_ceph_daemon.sh: more $SUDO
	ceph-daemon: configure firewalld for new daemon deploys
	ceph-daemon: name mgr the same way mgr/ssh does

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-03 16:00:14 -06:00
Sage Weil
e3bc13de3a Merge PR #31930 into master
* refs/pull/31930/head:
	mgr/orchestrator: add optional "format" param for "orchestrator host ls"

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-03 15:59:16 -06:00
Ilya Dryomov
0632872e07
Merge pull request #31968 from idryomov/wip-krbd-python3
qa: update krbd tests for python3

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-03 21:54:41 +01:00
Sage Weil
462aa8ff95 mgr/telemetry: fix log typo
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-03 13:38:50 -06:00
Sage Weil
5d8ca08924 Merge PR #31983 into master
* refs/pull/31983/head:
	mgr/ssh/tests: fix RGWSpec test

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-03 13:20:16 -06:00
Sage Weil
5f649cff42 mgr/ssh/tests: fix RGWSpec test
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-03 12:14:47 -06:00
Sage Weil
d5f1730025 Merge PR #31973 into master
* refs/pull/31973/head:
	mgr/crash: fix 'crash ls[-new]' sorting

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-03 11:32:55 -06:00
Lenz Grimmer
11a1708e19
mgr/dashboard: grafana charts match time picker selection. (#31964)
mgr/dashboard: grafana charts match time picker selection.

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
2019-12-03 17:09:00 +00:00
Sage Weil
4f29870543 Merge PR #31890 into master
* refs/pull/31890/head:
	mgr/orchestrator: name rgw by client.rgw.$realm.$zone[.$id]

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2019-12-03 10:38:28 -06:00
Sage Weil
729007ba66 Merge PR #31952 into master
* refs/pull/31952/head:
	mgr/ssh: fix remove_osds
	mgr/ssh: fix service_action

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-03 10:33:44 -06:00
Sage Weil
db736e082f ceph-daemon: bootstrap: deploy initial mon via deploy_daemon()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-03 10:13:38 -06:00
Sage Weil
8aadba15bf qa/standalone/test_ceph_daemon.sh: more $SUDO
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-03 10:13:37 -06:00
Sage Weil
7630ac6ae9 ceph-daemon: configure firewalld for new daemon deploys
Note that we only open firewalld ports; we never close them.

We could conceivably do that from rm-cluster, but that might also interfere
with something else on the host...

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-03 10:13:37 -06:00
Seena Fallah
c13cdfd57d Fixed bug on wrong name for user_id
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
2019-12-03 19:37:04 +03:30
Kefu Chai
3719fceb99
Merge pull request #31202 from athanatos/sjust/wip-crimson-obc
crimson, common: Add ephemeral ObjectContext state to crimson

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-04 00:04:20 +08:00
Sebastian Wagner
c162b8345e mgr/ssh: HACKING.rst: Add Understanding AsyncCompletion
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-03 16:27:06 +01:00
Michael Fritch
caf38142d6
ceph-daemon: use uid/gid 0 when creating tempfiles
skip extraction of the uid/gid since `ceph-volume` runs as root

Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-03 07:41:59 -07:00
Kefu Chai
0423dae9be
Merge pull request #31473 from ifed01/wip-ifed-smplify-fsck
os/bluestore: simplify multithreaded shallow fsck.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-03 22:32:25 +08:00
Sebastian Wagner
88636f8bf0
Merge pull request #31969 from sebastian-philipp/mgr-fix-mocking
pybind/mgr: Make it easier to create a Module instance without the mgr

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-03 15:26:23 +01:00
Lenz Grimmer
b12107a553
mgr/dashboard,grafana: remove shortcut menu (#31951)
mgr/dashboard,grafana: remove shortcut menu

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2019-12-03 13:56:00 +00:00
Alfonso Martínez
5ba114330e mgr/dashboard: grafana charts match time picker selection.
Fixes: https://tracker.ceph.com/issues/43097
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-12-03 14:15:10 +01:00
Sage Weil
6e2d917aca mgr/crash: fix 'crash ls[-new]' sorting
Broken by c691f2f876

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-03 07:12:26 -06:00
Kefu Chai
5f4c8d72c8
Merge pull request #31960 from tchaikov/wip-cmake-new-policy
cmake: do not use CMP0093 unless it is supported

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2019-12-03 20:04:28 +08:00
Kefu Chai
f5b2ec5d8f cmake: do not use CMP0093 unless it is supported
CMake CMP0093 was introduced by CMake 3.15, but we only require CMake
v3.10.2. so use the old `Boost_VERSION_MACRO` variable by default,
unless specified otherwise.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-03 20:00:59 +08:00
Sebastian Wagner
fa4650c483 pybind/mgr: Make it easier to create a Module instance without the mgr
Caused by conflict between #30961 and #30262

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-03 12:49:07 +01:00
Nathan Cutler
719bff9f35
Merge pull request #31872 from smithfarm/wip-mimic-v13.2.7-doc2
doc/releases: add mimic v13.2.7 to releases timeline

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-12-03 12:21:11 +01:00
Lenz Grimmer
2fba4da644
mgr/dashboard: Increase max-width of popovers (#31743)
mgr/dashboard: Increase max-width of popovers

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-12-03 09:32:21 +00:00
Laura Paduano
4ad8591fe4
Merge pull request #30961 from rjfd/wip-mgr-module-logging
mgr: module logging infrastructure

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-03 10:29:42 +01:00
Ernesto Puerta
1182073f0c
mgr/dashboard,grafana: remove shortcut menu
Remove shortcut menu (links) and add check in grafana CI script.

Fixes: https://tracker.ceph.com/issues/43091
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-12-03 10:21:35 +01:00
Kefu Chai
21dbb99d57
Merge pull request #31962 from bk201/wip-43095
vstart: fix error when getting CMake variables with the same prefix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-03 15:12:02 +08:00
Kiefer Chang
f4c8cc1293
vstart: fix error when getting CMake variables with the same prefix
The function fails to work when there are multiple variables starts with
the same prefix. e.g.

- WITH_RBD
- WITH_RBD_RGW

Fixes: https://tracker.ceph.com/issues/43095
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-12-03 14:15:33 +08:00
Samuel Just
e5a0499b68 crimson/osd: convert PG::wait_for_active to a blocking_future
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00