Commit Graph

109387 Commits

Author SHA1 Message Date
Sage Weil
151bd43354 Merge PR #33948 into octopus
* refs/pull/33948/head:
	python-common: PlacementSpec.from_string: drop `host_pattern:` prefix
	python-common: remove `all_hosts` from `PlacementSpec`

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 16:35:05 -05:00
Sage Weil
bbea2f436d mgr/cephadm: refine log message
Avoid a lot of these

2020-03-13T14:58:38.785360-0500 mgr.x [INF] No data_devices, skipping DriveGroup: osd.all

every time we consider the OSD spec and find nothing to do.  Instead, log
something like this each time we actually have work to do:

2020-03-13T15:04:22.803356-0500 mgr.x [INF] Applying osd.all on host gnit...
2020-03-13T15:04:33.723731-0500 mgr.x [INF] Deploying daemon osd.5 on gnit

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-13 16:33:58 -05:00
Sage Weil
7bc23cb0bd Merge PR #33777 into octopus
* refs/pull/33777/head:
	rgw: svc.config_key_rados: get() warns if potentially insecure connection
	rgw: svc.rados: add clog_warn()
	mon: log monitor: add command level param
	auth registry: helpers for checking secure method/mode

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 15:55:34 -05:00
Sage Weil
491a2b872c Merge PR #33950 into octopus
* refs/pull/33950/head:
	ceph.in: use os._exit when we don't shut down

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-13 15:51:18 -05:00
Sage Weil
98c0d67d46 Merge PR #33951 into octopus
* refs/pull/33951/head:
	mgr/orch: dump service spec by name

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-13 13:29:38 -05:00
Sage Weil
05204881f2 ceph.in: use os._exit when we don't shut down
If we experience a timeout, we don't bother shutting down rados, because
it can't currently handle one thread blocked (or running) library init
at the same time that another thread calls rados_shutdown().  This
behavior was recently introduced by c8f353c50b

However, sys.exit() runs all kinds of shutdown work that will also
interfere with the running librados threads.

Fix by using os._exit instead of sys.exit.

Fixes: https://tracker.ceph.com/issues/44566
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-13 13:29:14 -05:00
Jenkins Build Slave User
4536217610 15.1.1 2020-03-13 17:05:38 +00:00
Michael Fritch
83c8ce55d3
mgr/orch: dump service spec by name
add optional arg to allow a dump by name:
`ceph orch spec dump [svc_name]`

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-03-13 09:25:41 -06:00
Sage Weil
b64db21225 Merge PR #33953 into octopus
* refs/pull/33953/head:
	doc: Move ceph-deploy docs to doc/install/ceph-deploy

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 10:25:40 -05:00
Sebastian Wagner
d231eb90ce doc: Move ceph-deploy docs to doc/install/ceph-deploy
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-13 15:52:41 +01:00
Sage Weil
b3f910da04 Merge PR #33924 into octopus
* refs/pull/33924/head:
	doc/mgr: Enhance placement specs
	doc/cephadm: Fix toc of Drive Groups

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 09:51:32 -05:00
Sage Weil
fcb1fd155f Merge PR #33891 into octopus
* refs/pull/33891/head:
	mgr/cephadm: fix dump output by formatting to json first

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 08:35:30 -05:00
Sage Weil
863a9b1093 Merge PR #33905 into octopus
* refs/pull/33905/head:
	install-deps.sh: remove the workaround to bootstrap a new venv
	install-deps.sh: install additional repo for RHEL8
	install-deps.sh: install rhel-7-server-optional-rpms on el7 only

Reviewed-by: David Galloway <dgallowa@redhat.com>
2020-03-13 08:35:19 -05:00
Joshua Schmid
cddff0a39e
python-common: correctly dictify DriveGroupSpec objects when paths are used
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 14:21:22 +01:00
Kefu Chai
13b74bfccd
Merge pull request #33940 from tchaikov/octopus-release-notes-header
doc: use subsection for representing components in release notes

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 21:02:58 +08:00
Sebastian Wagner
e303fe7eaa doc/mgr: Enhance placement specs
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-13 13:40:15 +01:00
Kefu Chai
26db06cf21 doc/releases: use h3 for rendering subsections in release notes
to highlight the components with subsection header, and allow readers to
navigate through them with TOC.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-13 20:16:18 +08:00
Kefu Chai
e2e9de8b4d doc: overide the default margin for "ul.simple > li"
by default, the user agent's css sets `margin-block-end` of "ul ul" to
"0", which renders the unordered lists in release notes cluttered. as we
are using nested unordered list to present the changes in different
components.

in this change a customized css is added to reset the begin and end
margin of ul to 1em, which is the default value of top level ul.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-13 20:16:18 +08:00
Sebastian Wagner
13ef41dad7 python-common: PlacementSpec.from_string: drop host_pattern: prefix
* `host_pattern` is works as any other host spec.
* Improved type annotations
* Added tests
* `mgr/cephadm/test_scheduling`: Remove tests that don't have a valid spec.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-13 12:13:13 +01:00
Joshua Schmid
096e4a064a mgr/cephadm: adapt test_cephadm.sh to new syntax
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 09:52:13 +01:00
Joshua Schmid
dcc76d36ff mgr/cephadm: adapt qa->test_cephadm.sh
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 09:52:13 +01:00
Sage Weil
d62955bcba qa/tasks/cephadm: use 'orch daemon osd add'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-13 09:52:13 +01:00
Joshua Schmid
cd495823a7 mgr/cephadm: adapt osd deployment to service_apply
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-03-13 09:52:13 +01:00
Mykola Golub
465f385562
Merge pull request #33867 from dillaman/wip-43590
librbd: optimize image copy state machine to use fast-diff

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-03-13 10:20:37 +02:00
Kiefer Chang
9587caac41
mgr/dashboard: hide daemon table when orchestrator is disabled
The refresh time of services/daemons is also increased to 1 minute since
they are not updated so frequently.

Fixes: https://tracker.ceph.com/issues/44558
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-13 11:26:41 +08:00
Sage Weil
3b7787f539 Merge PR #33930 into octopus
* refs/pull/33930/head:
	mgr/cephadm: implement pause/resume to suspect non-monitoring background work
	mgr/orch: add pause/resume hooks

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-12 21:56:20 -05:00
Sage Weil
d5cd03207b Merge PR #33868 into octopus
* refs/pull/33868/head:
	mgr/rook: implement remove_daemons()
	mgr/rook: fix mds/fs create/apply/update
	mgr/rook: use ceph_daemon_id label consistently
	mgr/rook: show filesystems in 'orch ls'
	mgr/orch: 'age' -> 'ago' in 'orch ls' output
	mgr/rook: initial pass at 'orch ls'
	mgr/rook: include timestamps in 'orch ps'
	mgr/orch: shorten container_id (hash) in cephadm, not orch ps
	mgr/rook: include container_image_name in 'orch ps'
	mgr/rook: fix list_daemons host arg

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-12 21:55:52 -05:00
Sage Weil
c36406a91b Merge PR #33932 into octopus
* refs/pull/33932/head:
	cephadm: fix datetime regexp to capture at most 6 digits

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-12 21:55:39 -05:00
Tiago Melo
ddf5126d20 mgr/dashboard: Isolate each RBD component
Before when you accessed any RBD component, you were loading all 4 components
at the same time and each was doing frequent requests to the server.

Now it only loads 1 at a time.

Fixes: https://tracker.ceph.com/issues/44278

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-12 23:01:24 -01:00
Jason Dillaman
5cf9cd5d1c
Merge pull request #33900 from dillaman/wip-44459
qa/suites/rbd: removed OpenStack tempest test cases

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-03-12 19:22:22 -04:00
Jason Dillaman
3116c89fea
Merge pull request #33840 from trociny/wip-schedule-optimize-scan
mgr/rbd_support: don't scan pools that don't have schedules

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-03-12 19:21:28 -04:00
Sage Weil
aab64a6ef0 Merge PR #33914 into octopus
* refs/pull/33914/head:
	mgr/orch: Cleanup python imports of the interface
	mgr/orch: Properly handle NotImplementedError
	pybind/mgr: Rm PersistentStoreDict

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-12 17:04:50 -05:00
Sage Weil
bdbeeed680 mgr/rook: implement remove_daemons()
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 18:00:35 -04:00
Tiago Melo
c5ea6c6a5b mgr/dashboard: Replace ng2-tree with angular-tree-component
Fixes: https://tracker.ceph.com/issues/44450

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-12 20:45:54 -01:00
Sage Weil
56cfeb68a4 mgr/rook: fix mds/fs create/apply/update
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:14:10 -04:00
Sage Weil
903c957efe mgr/rook: use ceph_daemon_id label consistently
In particular, for mds's, it's $fsname-$rank for mds.$fsname-$rank,
which is what we want.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
b261e80fa9 mgr/rook: show filesystems in 'orch ls'
The count vs size discrepancy is weird since rook things in terms of
ranks (*2 if standby) vs just a count.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
4360bb729c mgr/orch: 'age' -> 'ago' in 'orch ls' output
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
36da1447fa mgr/rook: initial pass at 'orch ls'
This doesn't cover mds.* or rgw.* yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
68a96122a3 mgr/rook: include timestamps in 'orch ps'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
f32bf931a7 mgr/orch: shorten container_id (hash) in cephadm, not orch ps
This lets us present a longer, human-readable id for rook.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
9e2e7317e6 mgr/rook: include container_image_name in 'orch ps'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Sage Weil
5f36e141c3 mgr/rook: fix list_daemons host arg
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 17:10:35 -04:00
Michael Fritch
256a99d103
cephadm: fix datetime regexp to capture at most 6 digits
trailing `0` digits are not shown in the precision

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-03-12 13:37:37 -06:00
Lenz Grimmer
588a6dbc78
Merge pull request #33821 from votdev/issue_43446_bucket_lock
mgr/dashboard: Create bucket with x-amz-bucket-object-lock-enabled

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-03-12 20:26:32 +01:00
Lenz Grimmer
69682ab7f9
Merge pull request #31997 from bk201/wip-43062
mgr/dashboard: support removing OSDs in OSDs page

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-03-12 20:24:02 +01:00
Lenz Grimmer
a73dbaf81b
Merge pull request #33920 from LenzGr/update-404-image
mgr/dashboard: Updated octopus image on 404 page

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-03-12 20:12:45 +01:00
Sage Weil
0c62be9275 mgr/cephadm: implement pause/resume to suspect non-monitoring background work
If the user does 'orch pause', suspend all background work that makes
actual changes.

Continue to do read-only operations, like checking host connectivity
and scraping daemon and device status.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 13:13:11 -05:00
Laura Paduano
4981ed03cd
Merge pull request #33858 from tspmelo/wip-use-cd-modal
mgr/dashboard: Use ModalComponent in all modals

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-03-12 19:12:06 +01:00
Sage Weil
3336e498b3 mgr/orch: add pause/resume hooks
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-12 13:05:48 -05:00