Commit Graph

109245 Commits

Author SHA1 Message Date
Sage Weil
6d4ffc675a cephadm: verify the output files' containing directory exists
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-15 10:19:22 -05:00
Sage Weil
bbeefb2c10 Merge PR #33922 into octopus
* refs/pull/33922/head:
	qa/tasks/mgr/test_orchestrator_cli: adapt
	qa/suites/rados/cephadm/upgrade: start from compatible build
	mgr/cephadm: refine log message
	python-common: correctly dictify DriveGroupSpec objects when paths are used
	mgr/cephadm: adapt test_cephadm.sh to new syntax
	mgr/cephadm: adapt qa->test_cephadm.sh
	qa/tasks/cephadm: use 'orch daemon osd add'
	mgr/cephadm: adapt osd deployment to service_apply

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-14 10:52:05 -05:00
Sage Weil
279cfb551f qa/tasks/mgr/test_orchestrator_cli: adapt
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-14 10:18:25 -05:00
Sage Weil
13919b5fed qa/suites/rados/cephadm/upgrade: start from compatible build
The osd create command is changing, so upgrade from something that the
latest cephadm.py task can use.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-14 10:18:25 -05:00
David Galloway
d11d15ece2 Merge remote-tracking branch 'gh/octopus' into octopus 2020-03-13 18:03:42 -04:00
Sage Weil
48cc552c19 Merge PR #33520 into octopus
* refs/pull/33520/head:
	mgr/dashboard: Isolate each RBD component

Reviewed-by: Stephan Müller <smueller@suse.com>
2020-03-13 16:35:41 -05:00
Sage Weil
9ddfd066cb Merge PR #33758 into octopus
* refs/pull/33758/head:
	mgr/dashboard: Replace ng2-tree with angular-tree-component

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-03-13 16:35:27 -05:00
Sage Weil
6901f6888a Merge PR #33941 into octopus
* refs/pull/33941/head:
	mgr/dashboard: hide daemon table when orchestrator is disabled

Reviewed-by: Volker Theile <vtheile@suse.com>
2020-03-13 16:35:16 -05:00
Sage Weil
151bd43354 Merge PR #33948 into octopus
* refs/pull/33948/head:
	python-common: PlacementSpec.from_string: drop `host_pattern:` prefix
	python-common: remove `all_hosts` from `PlacementSpec`

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 16:35:05 -05:00
Sage Weil
bbea2f436d mgr/cephadm: refine log message
Avoid a lot of these

2020-03-13T14:58:38.785360-0500 mgr.x [INF] No data_devices, skipping DriveGroup: osd.all

every time we consider the OSD spec and find nothing to do.  Instead, log
something like this each time we actually have work to do:

2020-03-13T15:04:22.803356-0500 mgr.x [INF] Applying osd.all on host gnit...
2020-03-13T15:04:33.723731-0500 mgr.x [INF] Deploying daemon osd.5 on gnit

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-13 16:33:58 -05:00
Sage Weil
7bc23cb0bd Merge PR #33777 into octopus
* refs/pull/33777/head:
	rgw: svc.config_key_rados: get() warns if potentially insecure connection
	rgw: svc.rados: add clog_warn()
	mon: log monitor: add command level param
	auth registry: helpers for checking secure method/mode

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 15:55:34 -05:00
Sage Weil
491a2b872c Merge PR #33950 into octopus
* refs/pull/33950/head:
	ceph.in: use os._exit when we don't shut down

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-13 15:51:18 -05:00
Sage Weil
98c0d67d46 Merge PR #33951 into octopus
* refs/pull/33951/head:
	mgr/orch: dump service spec by name

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-13 13:29:38 -05:00
Sage Weil
05204881f2 ceph.in: use os._exit when we don't shut down
If we experience a timeout, we don't bother shutting down rados, because
it can't currently handle one thread blocked (or running) library init
at the same time that another thread calls rados_shutdown().  This
behavior was recently introduced by c8f353c50b

However, sys.exit() runs all kinds of shutdown work that will also
interfere with the running librados threads.

Fix by using os._exit instead of sys.exit.

Fixes: https://tracker.ceph.com/issues/44566
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-13 13:29:14 -05:00
Jenkins Build Slave User
4536217610 15.1.1 2020-03-13 17:05:38 +00:00
Michael Fritch
83c8ce55d3
mgr/orch: dump service spec by name
add optional arg to allow a dump by name:
`ceph orch spec dump [svc_name]`

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-03-13 09:25:41 -06:00
Sage Weil
b64db21225 Merge PR #33953 into octopus
* refs/pull/33953/head:
	doc: Move ceph-deploy docs to doc/install/ceph-deploy

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 10:25:40 -05:00
Sebastian Wagner
d231eb90ce doc: Move ceph-deploy docs to doc/install/ceph-deploy
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-13 15:52:41 +01:00
Sage Weil
b3f910da04 Merge PR #33924 into octopus
* refs/pull/33924/head:
	doc/mgr: Enhance placement specs
	doc/cephadm: Fix toc of Drive Groups

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 09:51:32 -05:00
Sage Weil
fcb1fd155f Merge PR #33891 into octopus
* refs/pull/33891/head:
	mgr/cephadm: fix dump output by formatting to json first

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 08:35:30 -05:00
Sage Weil
863a9b1093 Merge PR #33905 into octopus
* refs/pull/33905/head:
	install-deps.sh: remove the workaround to bootstrap a new venv
	install-deps.sh: install additional repo for RHEL8
	install-deps.sh: install rhel-7-server-optional-rpms on el7 only

Reviewed-by: David Galloway <dgallowa@redhat.com>
2020-03-13 08:35:19 -05:00
Joshua Schmid
cddff0a39e
python-common: correctly dictify DriveGroupSpec objects when paths are used
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 14:21:22 +01:00
Kefu Chai
13b74bfccd
Merge pull request #33940 from tchaikov/octopus-release-notes-header
doc: use subsection for representing components in release notes

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 21:02:58 +08:00
Sebastian Wagner
e303fe7eaa doc/mgr: Enhance placement specs
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-13 13:40:15 +01:00
Kefu Chai
26db06cf21 doc/releases: use h3 for rendering subsections in release notes
to highlight the components with subsection header, and allow readers to
navigate through them with TOC.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-13 20:16:18 +08:00
Kefu Chai
e2e9de8b4d doc: overide the default margin for "ul.simple > li"
by default, the user agent's css sets `margin-block-end` of "ul ul" to
"0", which renders the unordered lists in release notes cluttered. as we
are using nested unordered list to present the changes in different
components.

in this change a customized css is added to reset the begin and end
margin of ul to 1em, which is the default value of top level ul.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-13 20:16:18 +08:00
Sebastian Wagner
13ef41dad7 python-common: PlacementSpec.from_string: drop host_pattern: prefix
* `host_pattern` is works as any other host spec.
* Improved type annotations
* Added tests
* `mgr/cephadm/test_scheduling`: Remove tests that don't have a valid spec.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-13 12:13:13 +01:00
Joshua Schmid
096e4a064a mgr/cephadm: adapt test_cephadm.sh to new syntax
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 09:52:13 +01:00
Joshua Schmid
dcc76d36ff mgr/cephadm: adapt qa->test_cephadm.sh
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 09:52:13 +01:00
Sage Weil
d62955bcba qa/tasks/cephadm: use 'orch daemon osd add'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-13 09:52:13 +01:00
Joshua Schmid
cd495823a7 mgr/cephadm: adapt osd deployment to service_apply
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 09:52:13 +01:00
Mykola Golub
465f385562
Merge pull request #33867 from dillaman/wip-43590
librbd: optimize image copy state machine to use fast-diff

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-03-13 10:20:37 +02:00
Kiefer Chang
9587caac41
mgr/dashboard: hide daemon table when orchestrator is disabled
The refresh time of services/daemons is also increased to 1 minute since
they are not updated so frequently.

Fixes: https://tracker.ceph.com/issues/44558
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-13 11:26:41 +08:00
Sage Weil
3b7787f539 Merge PR #33930 into octopus
* refs/pull/33930/head:
	mgr/cephadm: implement pause/resume to suspect non-monitoring background work
	mgr/orch: add pause/resume hooks

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-12 21:56:20 -05:00
Sage Weil
d5cd03207b Merge PR #33868 into octopus
* refs/pull/33868/head:
	mgr/rook: implement remove_daemons()
	mgr/rook: fix mds/fs create/apply/update
	mgr/rook: use ceph_daemon_id label consistently
	mgr/rook: show filesystems in 'orch ls'
	mgr/orch: 'age' -> 'ago' in 'orch ls' output
	mgr/rook: initial pass at 'orch ls'
	mgr/rook: include timestamps in 'orch ps'
	mgr/orch: shorten container_id (hash) in cephadm, not orch ps
	mgr/rook: include container_image_name in 'orch ps'
	mgr/rook: fix list_daemons host arg

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-12 21:55:52 -05:00
Sage Weil
c36406a91b Merge PR #33932 into octopus
* refs/pull/33932/head:
	cephadm: fix datetime regexp to capture at most 6 digits

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-12 21:55:39 -05:00
Tiago Melo
ddf5126d20 mgr/dashboard: Isolate each RBD component
Before when you accessed any RBD component, you were loading all 4 components
at the same time and each was doing frequent requests to the server.

Now it only loads 1 at a time.

Fixes: https://tracker.ceph.com/issues/44278

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-12 23:01:24 -01:00
Jason Dillaman
5cf9cd5d1c
Merge pull request #33900 from dillaman/wip-44459
qa/suites/rbd: removed OpenStack tempest test cases

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-03-12 19:22:22 -04:00
Jason Dillaman
3116c89fea
Merge pull request #33840 from trociny/wip-schedule-optimize-scan
mgr/rbd_support: don't scan pools that don't have schedules

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-03-12 19:21:28 -04:00
Sage Weil
aab64a6ef0 Merge PR #33914 into octopus
* refs/pull/33914/head:
	mgr/orch: Cleanup python imports of the interface
	mgr/orch: Properly handle NotImplementedError
	pybind/mgr: Rm PersistentStoreDict

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-12 17:04:50 -05:00
Sage Weil
bdbeeed680 mgr/rook: implement remove_daemons()
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 18:00:35 -04:00
Tiago Melo
c5ea6c6a5b mgr/dashboard: Replace ng2-tree with angular-tree-component
Fixes: https://tracker.ceph.com/issues/44450

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-12 20:45:54 -01:00
Sage Weil
56cfeb68a4 mgr/rook: fix mds/fs create/apply/update
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:14:10 -04:00
Sage Weil
903c957efe mgr/rook: use ceph_daemon_id label consistently
In particular, for mds's, it's $fsname-$rank for mds.$fsname-$rank,
which is what we want.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
b261e80fa9 mgr/rook: show filesystems in 'orch ls'
The count vs size discrepancy is weird since rook things in terms of
ranks (*2 if standby) vs just a count.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
4360bb729c mgr/orch: 'age' -> 'ago' in 'orch ls' output
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
36da1447fa mgr/rook: initial pass at 'orch ls'
This doesn't cover mds.* or rgw.* yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
68a96122a3 mgr/rook: include timestamps in 'orch ps'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
f32bf931a7 mgr/orch: shorten container_id (hash) in cephadm, not orch ps
This lets us present a longer, human-readable id for rook.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
9e2e7317e6 mgr/rook: include container_image_name in 'orch ps'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00