Commit Graph

435 Commits

Author SHA1 Message Date
Sage Weil
51b60a212e qa/tasks/mgr/test_orchestrator_cli: adjust placement args
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-06 21:27:48 -06:00
Sage Weil
8a84ddeaa8 Merge PR #33531 into master
* refs/pull/33531/head:
	qa/tasks/mgr/test_orchestrator_cli: fix test_ps* tests
	mgr/test_orchestrator: refactor listing services/daemons
	mgr/dashboard: list services and daemons

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-03-05 13:20:21 -06:00
Alfonso Martínez
eaa0d84a13 mgr/dashboard: fix tasks.mgr.dashboard.test_rgw suite
Fixes: https://tracker.ceph.com/issues/44405
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-03-05 16:22:55 +01:00
Sage Weil
bb126cf9ab qa/tasks/mgr/test_orchestrator_cli: fix test_ps* tests
The ps output names daemons like 'type.foo', e.g., 'mgr.x'.  Now that
the test_orchestrator impl is less bonkers this needs to be adjusted to
match reality.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-05 08:00:42 -06:00
Thomas Bechtold
f5e77561e9 qa: Fix problems detected by mypy
This is a first step to enable mypy on the qa/ directory.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>
2020-03-05 06:53:31 +01:00
Kefu Chai
bd3dccd6fa
Merge pull request #33709 from tchaikov/wip-ceph-py-py3-rados
qa/tasks: py3 compat (tasks exercised by rados suites)

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-04 21:16:21 +08:00
Kefu Chai
00af2eddf5
Merge pull request #33690 from rhcs-dashboard/44237-remove-config-opt-read-from-system-roles
mgr/dashboard: remove 'config-opt: read' perm. from system roles.

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2020-03-04 20:54:42 +08:00
Kyr Shatskyy
eb10276c1c qa/tasks/mgr: get rid of itervalues for py3
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
2020-03-04 13:09:16 +08:00
Kefu Chai
e26a1cdee8 qa/tasks/test_orchestrator_cli: enable test_osd_create exception check
this reverts 9639acfefe, as the test does
make sense. what fails this test is the machinary to marshal/unmarshal
exception fails to handle un-picklable exceptions. the previous commit
is supposed to use a fallback to handle them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-04 01:52:02 +08:00
Alfonso Martínez
ad8dbefff8 mgr/dashboard: remove 'config-opt: read' perm. from system roles.
Fixes: https://tracker.ceph.com/issues/44237
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-03-03 12:34:11 +01:00
Lenz Grimmer
04e2058c6a
Merge pull request #31922 from rhcs-dashboard/42094-bucket-mfa-delete
mgr/dashboard: enable/disable MFA Delete on RGW bucket

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-03-02 13:55:52 +00:00
Kiefer Chang
55adeb93b3 mgr/dashboard: list services and daemons
- Display services and daemons in the cluster/services page.
- Display daemons in the cluster/hosts/host-detail page (Daemons tab).

This PR also partially addresses https://tracker.ceph.com/issues/43165:
The endpoint `/api/orchestrator/service` is removed.

Create new endpoints:
  - `/api/service`: listing all services in the Ceph cluster.
  - `/api/service/<service_name>/daemons`: listing daemons for a
    service. e.g. daemons of OSD.
  - `/api/host/<hostname>/daemons`: listing daemons of a host.

Fixes: https://tracker.ceph.com/issues/44221

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-02 10:20:33 +08:00
Sage Weil
d3305e94d1 Merge PR #33541 into master
* refs/pull/33541/head:
	mgr/test_orchestrator: add daemon_action
	qa/tasksmgr/test_orchestrator_cli: fix test_service_action
	qa/tasks/test_orchestrator_cli: disable test_osd_create exception check
	mgr/test_orchestrator: update_foo -> apply_foo
	mgr/test_orchestrator: add force flag to remove_daemons
	qa/tasks/mgr/test_orchestrator_cli: update
	qa/tasks/mgr/test_orchestrator_cli: fix test_load_data
	mgr/test_orchestrator: fix list_daemons

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-01 16:55:06 -06:00
Sage Weil
114ef48739 qa/tasksmgr/test_orchestrator_cli: fix test_service_action
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-01 12:24:04 -06:00
Sage Weil
9639acfefe qa/tasks/test_orchestrator_cli: disable test_osd_create exception check
I'm not sure what behavior we want here...

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-01 11:15:51 -06:00
Sage Weil
1428f54490 qa/tasks/mgr/test_orchestrator_cli: update
Most of these were broken due to CLI changes weeks ago.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-29 17:37:18 -06:00
Alfonso Martínez
5b6cf814b9 mgr/dashboard: enable/disable MFA Delete on RGW bucket
Fixes: https://tracker.ceph.com/issues/42094
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-02-28 11:35:57 +01:00
Sage Weil
5cf9676199 qa/tasks/mgr/test_orchestrator_cli: fix test_load_data
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-27 17:15:28 -06:00
David Zafman
53158dbdd2
Merge pull request #32554 from dzafman/wip-dump-perf
Improve internal python to c++ interface

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-02-27 13:48:29 -08:00
David Zafman
4841100b4e test: Disable self-test of diskprediction_cloud since it isn't loaded
See qa/packages/packages.yaml

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-02-27 13:12:45 -08:00
Volker Theile
f1f7df3d33 mgr/dashboard: Enhance user create CLI command to force password change
Fixes: https://tracker.ceph.com/issues/44301

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-02-26 15:50:53 +01:00
Sage Weil
52bb5b84ac qa/tasks/mgr/test_orchestrator_cli: fix test_host_ls
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-21 19:16:06 -06:00
Lenz Grimmer
fcfe1da315
Merge pull request #32552 from Devp00l/wip-42617-new-tree
mgr/dashboard: Reload all CephFS directories

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-02-21 15:46:40 +00:00
Lenz Grimmer
54d32ce144
Merge pull request #32680 from votdev/wip-force-pwd
mgr/dashboard: Enforce password change upon first login

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-02-21 15:45:35 +00:00
Alfonso Martínez
7cbee4d725 mgr/dashboard: fix tasks.mgr.dashboard.test_rgw suite
Fixes: https://tracker.ceph.com/issues/44201
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-02-20 10:47:38 +01:00
Sage Weil
7c9efa6bdf mgr/test_orchestrator: describe_service -> list_daemons
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-19 11:01:13 -06:00
Sage Weil
93d53c05b0 qa/tasks/mgr/dashboard/test_orchestrator: disable services test
We need to either fill out the list_daemons APIs in the dashboard and test
that, or redesign and reimplement the services abstractions in the
orchestration layer.  Until then, disable this test.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-19 11:01:13 -06:00
Volker Theile
b37079a6fc mgr/dashboard: Enforce password change upon first login - Part 2
Introduce the following:
- A new layout component for the login pages.
- A new route called /login-change-password.
- A guard that checks if a user must change the password (ChangePasswordGuardService). If this is true, redirect to /login-change-password.
- Added LoginPasswordFormComponent (extends UserPasswordFormComponent) for the password form but (looks similar the login page).

Fixes: tracker.ceph.com/issues/24655

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-02-19 15:54:42 +01:00
Tatjana Dehler
310f787687 mgr/dashboard: Enforce password change upon first login
Fixes: https://tracker.ceph.com/issues/24655
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-02-19 15:54:42 +01:00
Sebastian Wagner
ae5d2c6ab2
Merge pull request #32817 from sebastian-philipp/rename-orchestrator_cli-orchestrator
pybind/mgr: Rename orchestrator_cli to orchestrator

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-18 10:05:30 +01:00
Stephan Müller
e753d987e5 mgr/dashboard: Reload all CephFS directories
Now angular tree is used instead of ng2-tree, as it provides a better
way to dynamically load children and it provides a way to update all
children without losing all track of everything.

The loading icon will rotate now on any fetch.

The tree will detect new directories and removed directories.

It's also now possible to select the root directory of a CephFS in order
to create snapshots of the whole FS.

Fixes: https://tracker.ceph.com/issues/42617
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-02-17 16:35:29 +01:00
Lenz Grimmer
9269f550b3
Merge pull request #33013 from s0nea/wip-dashboard-43912
mgr/dashboard: wait for PG unknown state to be cleared

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
2020-02-17 15:34:11 +00:00
Sebastian Wagner
f2c5472286 mgr/orchestrator_cli: rename to mgr/orchestrator
* Move `mgr/orchestrator.py` to `orchestrator/_interface.py`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-17 10:24:01 +01:00
Kefu Chai
1d22ff29fb
Merge pull request #33347 from tchaikov/wip-orch-addr
mgr/orchestrator: "addr" is optional for constructing InventoryNode

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-15 22:16:50 +08:00
Kefu Chai
e470481d71
Merge pull request #33325 from tchaikov/wip-super-setup
qa/tasks: call super class's setUp()

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-15 18:46:51 +08:00
Kefu Chai
9000afb24b qa/tasks/mgr/orch: s/service ls/ps/
to fix the broken test of "test_load_data". it's a regression introduced
by aacc9a650f

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-15 18:41:18 +08:00
Kefu Chai
7d262db114 qa/tasks: call super class's setUp()
to address the regression introduced by
8729281121

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-15 12:39:08 +08:00
Kefu Chai
87172bcf63 mgr/dashboard: s/fsid/mirror_uuid/
to fix the broken rbd-mirror test. it's a regression introduced by
7b07e3c9dc

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-15 12:29:09 +08:00
Sage Weil
aacc9a650f mgr/orch: service ls -> ps, add DaemonDescription
- We keep ServiceDescription around unmodified (although it will need some
  cleanup later)
- We add DaemonDescription, and clean out the service-related ambiguities
- Add a new list_daemons() method for Orchestrator
- Add a new 'ceph orch ps' command
- In cephadm, drop get_services(), and implement list_daemons()
  - a million changes to make this work
- Adjust health alert and option names

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-12 11:14:17 -06:00
Sage Weil
95ecaad0d5 mgr/orch: split out daemon_action from service_action
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-12 11:14:17 -06:00
Kiefer Chang
9fd1743e1d
qa/tasks/mgr/dashboard/test_orchestrator: support addr attribute in inventory
The missing attribute `addr` causes error when loading dummy data.

Fixes: https://tracker.ceph.com/issues/44054
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-02-11 23:08:29 +08:00
Sage Weil
20205e70c4 mgr/orch: 'ceph orchestrator ...' -> 'ceph orch ...'
Less typing for all!

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 15:39:57 -06:00
Tatjana Dehler
4515ab32fa
Merge pull request #32546 from votdev/issue_43089_passwd_cmplx_config
mgr/dashboard: Make password policy check configurable

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-02-06 09:44:48 +01:00
Kefu Chai
062e0365ea qa/tasks: drop test_cephadm_orchestrator.py
this test will end with a failure like

```
2020-01-30T18:15:15.870 INFO:tasks.ceph.mgr.x.smithi042.stderr:Warning: Permanently added 'smithi042.front.sepia.ceph.com,172.21.15.42' (ECDSA) to the list of known hosts.
2020-01-30T18:15:15.925 INFO:tasks.ceph.mgr.x.smithi042.stderr:Permission denied, please try again.
2020-01-30T18:15:15.932 INFO:tasks.ceph.mgr.x.smithi042.stderr:Permission denied, please try again.
2020-01-30T18:15:15.939 INFO:tasks.ceph.mgr.x.smithi042.stderr:root@smithi042.front.sepia.ceph.com: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
```

because mgr is not able to establish an ssh connection to that host with "root".
please note, the teuthology worker is acting using the "ubuntu" account on the
test node, and by default, "root" does not have its pubkey. and actually
`qa/tasks/cephadm.py` does push the pubkey to all the managed hosts before
testing cephadm.

since `qa/tasks/cephadm.py` is a better test for cephadm, let's just
drop this one.

as suites/rados/cephadm already covers cephadm

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-06 09:53:17 +08:00
Kiefer Chang
c9b12e2b66
qa/tasks/mgr/test_orchestrator_cli: support multiple DriveGroups
create_osds interface in Orchestrator supports multiple named DriveGroups
since https://github.com/ceph/ceph/pull/32972. Adapt the changes in
the test.

Fixes: https://tracker.ceph.com/issues/43945
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-02-04 14:31:21 +08:00
Tatjana Dehler
6ffb3e4097 mgr/dashboard: wait for PG unknown state to be cleared
Give the cluster some time to recover from the unknown
PG state before checking if the OSD is safe to destroy.

Fixes: https://tracker.ceph.com/issues/43912
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-02-03 11:58:10 +01:00
Volker Theile
3684d24a43 mgr/dashboard: Make password policy check configurable
Fixes: https://tracker.ceph.com/issues/43089

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-31 11:28:17 +01:00
Sage Weil
81fc73b24e Merge PR #32788 into master
* refs/pull/32788/head:
	qa/tasks/mgr/dashboard: set pg_num to 32
	mgr/pg_autoscaler: default to pg_num[_min] = 32

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-24 08:32:13 -06:00
Neha
d6e720b29e qa/tasks/mgr/dashboard: set pg_num to 32
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-22 16:38:38 +00:00
Volker Theile
944490f34f mgr/dashboard: Clone an existing user role
Fixes: https://tracker.ceph.com/issues/43603

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-21 14:51:56 +01:00