Commit Graph

476 Commits

Author SHA1 Message Date
Tatjana Dehler
8d91443c8b mgr/telemetry: refactor/enhance CLI commands
1. Move the implementations of the `on` and `off`
command into dedicated methods so that they can
be accessed by other mgr modules via `mgr.remote`.

2. Add a `show-all` command to return the report
and device report at once. Also add a method
`get_report` to make the reports accessible for
other mgr modules as mentioned above.

3. Add two  minor changes and a note where the
gathered data can be found to the Telemetry docu
file.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-04-29 15:08:35 +02:00
Joshua Schmid
cc5bf59413 doc/orchestrator: update docs to new syntax and updated examples
Signed-off-by: Joshua Schmid <jschmid@suse.de>
Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>
2020-04-29 09:47:51 +02:00
Varsha Rao
37bd692075 doc/mgr/orchestrator: Remove duplicate ps from support table
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-04-24 23:32:52 +05:30
Zac Dover
0455c0e608 Add ceph orch zap command
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-04-21 07:43:47 +10:00
Sebastian Wagner
b740ae12e5 doc/mgr/orchestrator: Update Placement by pattern matching
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
bc162005a9 doc/mgr/orchestrator: use yaml syntax highlighting
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
0c6759750a doc/mgr/orchestrator: Add "Service Specification"
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-01 11:34:18 +02:00
Sebastian Wagner
3543aeb84c mgr/orch: Add ceph orch ls --export
* defaults to `--format yaml`
* don't include `status`

```
$  ceph orch ls --export
placement:
  host_pattern: '*'
service_name: crash
service_type: crash
```

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-26 12:02:56 +01:00
Enno Gotthold
db76547c8d
doc/mgr/prometheus: Change images to rbd-enabled pools
Signed-off-by: Enno Gotthold <egotthold@suse.de>
2020-03-26 08:21:30 +01:00
Enno G
6386095e51
doc: Add information on how to enable the rbd-images dashboard
Fixes: https://tracker.ceph.com/issues/44623
Signed-off-by: Enno Gotthold <egotthold@suse.de>

In the previous commit (1c52ee2b) the added dashboard will stay empty
until it is manually enabled to display information.
2020-03-26 08:21:30 +01:00
Michael Fritch
530c62d76d
mgr/cephadm: update docs
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-03-25 16:26:13 -06:00
Sage Weil
49143d6578 python-common: 'all:true' -> '*'
'all:true' is no longer a valid PlacementSpec.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-14 09:52:08 -05:00
Sage Weil
b3f910da04 Merge PR #33924 into octopus
* refs/pull/33924/head:
	doc/mgr: Enhance placement specs
	doc/cephadm: Fix toc of Drive Groups

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-13 09:51:32 -05:00
Sebastian Wagner
e303fe7eaa doc/mgr: Enhance placement specs
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-13 13:40:15 +01:00
Lenz Grimmer
8571ce4fd2 doc: Improved Dashboard installation workflow
Moved the "Accessing the Dashboard" section in front of
the paragraphs that talk about enabling additional services.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2020-03-12 14:21:11 +01:00
Lenz Grimmer
4009e9db90 doc: Updated dashboard feature overview for Octopus
Added new Dashboard features added for the Octopus
release.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2020-03-12 14:19:52 +01:00
Lenz Grimmer
bd337d5186
Merge pull request #32419 from rhcs-dashboard/fix-43419-master
mgr/dashboard: add feature toggle for NFS and fix feature toggles regression

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-03-12 10:17:56 +01:00
Ernesto Puerta
fcb77ee9d6
mgr/dashboard: add feature toggle for NFS
- New NFS feature toggle added.
- Fixed regression which broke FeatureToggles in the main menu.
- Added extensive unit testing to NavigationComponent
- Added ng-mocks to improve test isolation and performance (~7x, 139s to
20s)
- Added ng-bullet package to improve unit testing performance (2x, 20s
to 9s)
- Added Rxjs Schedulers to implement NgZone.runOutsideAngular in a Rxjs
friendly way (based on
    https://stackoverflow.com/questions/43121400/run-ngrx-effect-outside-of-angulars-zone-to-prevent-timeout-in-protractor)

Minor issues found from exhaustive unit testing:
- Missing permissions in Cluster menu:
  - `permissions.log.read` and `permissions.prometheus.read`
- Missing classes:
  - Block -> Images: `tc_submenuitem_block_images`
  - Block -> iSCSI: `tc_submenuitem_block_iscsi`
- Typos:
  - class `tc_submenuitem_hosts` assigned to OSD menu (instead of
      `tc_submenuitem_osd`)
  - `tc_menuitem_cephs` -> `tc_menuitem_cephfs`

Minor changes:
- Previously, Cluster Map -> CRUSH Map required both OSD and Host
permissions. Now it only requires OSD permissions (there are no
references to hosts in CRUSH Map page). Nevertheless, all system roles
setting OSD permission also set Host's, so no impact expected.
- Previously, Cluster -> Monitoring menu was hidden when both Prometheus
or Alertmanager weren't configured. Now it's displayed and when clicked
on it shows the helper banner indicating that further configuration is
required. This change removes the dependency on the PrometheusService.

Fixes: https://tracker.ceph.com/issues/43419
Fixes: https://tracker.ceph.com/issues/43715
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2020-03-11 15:03:58 +01:00
Sebastian Wagner
2c0ff28d45 doc: Move Move ServiceSpec to python-common
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-10 13:28:23 +01:00
Sage Weil
a9bb16b40f Merge PR #33747 into master
* refs/pull/33747/head:
	doc/mgr/telemetry: add 'send' command
	mgr/telemetry: force --license when sending while opted-out

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-07 07:07:41 -06:00
Sage Weil
739c23da1b doc/cephadm/monitoring: document process to set up monitoring with cephadm
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-06 11:30:18 -06:00
Yaarit Hatuka
4308c5d56e doc/mgr/telemetry: add 'send' command
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2020-03-05 12:15:27 -05:00
bk203
52deebaa5c doc: update Zabbix template reference
The old link references a 2017 version of the template, I experienced problems using this version of the template with the latest version of Ceph. Ceph would report "Failed to send data to Zabbix", by importing the newer 2019 version of the template within Zabbix Ceph could again send data (due to changed Zabbix Trapper item keys). Propose to replace the link for a link referencing the master branch of the template so the newest version is always referenced in the docs.

Signed-off-by: Mathijs Smit <m.smit@goldenvalue.nl>
2020-03-03 10:32:57 +08:00
Sage Weil
4ad485d285 Merge PR #33575 into master
* refs/pull/33575/head:
	mgr/telemetry: fix and document proxy usage

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
2020-03-01 19:53:25 -06:00
Sebastian Wagner
424e3b2773
Merge pull request #33044 from jschmid1/drive_group_docs
doc/drivegroups: add docs for DriveGroups with excessive examples

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
2020-02-27 19:57:37 +01:00
Sebastian Wagner
3d782a0e86 doc/mgr/orchestrator: Add CephFS
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-27 12:40:48 +01:00
Sebastian Wagner
4e15f03a63 doc/mgr/orchestrator: Add documentation for plcement specs
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-27 12:40:48 +01:00
Sebastian Wagner
e59eae1c96 doc/mgr: Reordering
* Moved *Configuring the Orchestrator CLI*
* Updated the definitions

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-27 12:40:48 +01:00
Lars Marowsky-Bree
5d7c79b079 mgr/telemetry: fix and document proxy usage
This addresses https://tracker.ceph.com/issues/44320 - fix and document
use of proxies for mgr/telemetry.

Signed-off-by: Lars Marowsky-Bree <lmb@suse.com>
2020-02-27 11:11:01 +01:00
Sage Weil
f83f38a26e Merge PR #33552 into master
* refs/pull/33552/head:
	mgr/dashboard: Enhance user create CLI command to force password change

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2020-02-26 17:13:02 -06:00
Joshua Schmid
044b400f23 doc/drivegroups: add initial write-up
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-02-26 22:53:15 +01:00
Volker Theile
f1f7df3d33 mgr/dashboard: Enhance user create CLI command to force password change
Fixes: https://tracker.ceph.com/issues/44301

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-02-26 15:50:53 +01:00
Sebastian Wagner
4dbe64c658 doc: move cephadm mgr doc to /doc/cephadm
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-26 12:29:37 +01:00
Sebastian Wagner
071e76de4f
Merge pull request #33459 from liewegas/doc-adopt
doc/mgr/cephadm: document adoption process

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-02-26 10:48:49 +01:00
Sage Weil
16a11f795a Merge PR #33113 into master
* refs/pull/33113/head:
	doc/mgr/telemetry: added device channel details

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-24 15:58:57 -06:00
Sage Weil
ba3daedecf doc/mgr/cephadm: document adoption process
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-24 13:47:40 -06:00
Sage Weil
3d01f1b6d0 doc/mgr/cephadm: fix headings, requirements
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-24 13:32:10 -06:00
Sebastian Wagner
163be4e0af doc/orchestrator: Substitute host for node
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-23 12:07:24 -06:00
Lenz Grimmer
54d32ce144
Merge pull request #32680 from votdev/wip-force-pwd
mgr/dashboard: Enforce password change upon first login

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-02-21 15:45:35 +00:00
Yaarit Hatuka
66c41f3d0e doc/mgr/telemetry: added device channel details
Plus details about license agreement.

Fixes: https://tracker.ceph.com/issues/43648
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2020-02-20 10:27:21 -05:00
Kefu Chai
27550242d4 doc/mgr/dashboard.rst: s/plugin/module/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-20 22:15:54 +08:00
Sage Weil
151f88d7f9 Merge PR #32677 into master
* refs/pull/32677/head:
	build/ops: make/install osd_support package
	mgr/osd_support: move docs to docs/mgr/osd_support.rst
	mgr/osd_support: new module for osd utility calls

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-19 14:50:40 -06:00
Volker Theile
b37079a6fc mgr/dashboard: Enforce password change upon first login - Part 2
Introduce the following:
- A new layout component for the login pages.
- A new route called /login-change-password.
- A guard that checks if a user must change the password (ChangePasswordGuardService). If this is true, redirect to /login-change-password.
- Added LoginPasswordFormComponent (extends UserPasswordFormComponent) for the password form but (looks similar the login page).

Fixes: tracker.ceph.com/issues/24655

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-02-19 15:54:42 +01:00
Kai Wagner
1d003f61b6 doc/mgr/orchestrator.rst updated current implementation status
Signed-off-by: Kai Wagner <kwagner@suse.com>
2020-02-19 12:07:50 +01:00
Joshua Schmid
c9b9e57967 mgr/osd_support: move docs to docs/mgr/osd_support.rst
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-02-19 08:58:19 +01:00
Sebastian Wagner
59d54f3df1 doc: rename orchestrator_cli -> orchestrator
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-17 10:24:01 +01:00
Sage Weil
8456ab721e doc/mgr/orchestrator_modules: update docs
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-13 09:43:38 -06:00
Sage Weil
67d72bca89 mgr/orch: move to service_apply; remove update_foo()
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-13 09:00:58 -06:00
Sage Weil
07a74f5705 mgr/orch: remove old remove_{osds,rgw,mds,nfs,...} methods
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-13 07:13:03 -06:00
Sage Weil
aacc9a650f mgr/orch: service ls -> ps, add DaemonDescription
- We keep ServiceDescription around unmodified (although it will need some
  cleanup later)
- We add DaemonDescription, and clean out the service-related ambiguities
- Add a new list_daemons() method for Orchestrator
- Add a new 'ceph orch ps' command
- In cephadm, drop get_services(), and implement list_daemons()
  - a million changes to make this work
- Adjust health alert and option names

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-12 11:14:17 -06:00
Sage Weil
95ecaad0d5 mgr/orch: split out daemon_action from service_action
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-12 11:14:17 -06:00
Sage Weil
02aeeb0dac Merge PR #33175 into master
* refs/pull/33175/head:
	mgr/cephadm: Add some more type annotations
	mgr/orchestrator: unify StatelessServiceSpec and StatefulServiceSpec

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-11 10:42:58 -06:00
Sage Weil
34fae12918 Merge PR #33043 into master
* refs/pull/33043/head:
	doc/releases: octopus draft notes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-10 14:49:35 -06:00
Sage Weil
a216baa83e doc/releases: octopus draft notes
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-10 12:56:13 -06:00
Sebastian Wagner
80a2a70893 mgr/orchestrator: unify StatelessServiceSpec and StatefulServiceSpec
Both classes are essentially equal. Keeping both just makes thigs
more compicated.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-10 12:11:52 +01:00
Sage Weil
20205e70c4 mgr/orch: 'ceph orchestrator ...' -> 'ceph orch ...'
Less typing for all!

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 15:39:57 -06:00
Sage Weil
b5a01b7a3b doc/mgr/orchestrator_cli: update support table
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 09:47:40 -06:00
Sage Weil
2e3ed251a6 mgr/deepsea: remove
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 09:45:36 -06:00
Sage Weil
01c36d9db7 mgr/ansible: remove
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 09:45:12 -06:00
Tatjana Dehler
4515ab32fa
Merge pull request #32546 from votdev/issue_43089_passwd_cmplx_config
mgr/dashboard: Make password policy check configurable

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-02-06 09:44:48 +01:00
Volker Theile
3684d24a43 mgr/dashboard: Make password policy check configurable
Fixes: https://tracker.ceph.com/issues/43089

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-31 11:28:17 +01:00
Sage Weil
16db65fee2 mgr/cephadm: periodically check hosts, and warn if the host check fails
If we manually run the check, wake up the serve thread to recheck things.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 07:13:05 -06:00
Lenz Grimmer
4f4448aa06
mgr/dashboard: extend doc by Grafana setting (#32460)
mgr/dashboard: extend doc by Grafana setting

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2020-01-28 10:06:24 +00:00
Patrick Seidensal
4483ad4317 mgr/dashboard: unify indentation in dashboard.rst
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
2020-01-27 15:56:25 +01:00
Sage Weil
2ff06d75f8 mgr/cephadm: health alert for stray hosts and/or services
Fixes: https://tracker.ceph.com/issues/43714
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 11:13:40 -06:00
Sage Weil
21f2bcf061 mgr/orchestrator_cli: upgrade {start,pause,resume,stop}
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-17 12:22:02 -06:00
Patrick Seidensal
c552e1fbf6 mgr/dashboard: extend doc by Grafana setting
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
2020-01-02 13:21:53 +01:00
Tatjana Dehler
0221241909 mgr/dashboard: add password expiration date
Add a 'pwd_expiration_date' field to the User object to be able
to set password expiration date per user.

There are two options to set a password expiration date for a
user:

1. Set the 'USER_PWD_EXPIRATION_SPAN' setting. If defined
   the expiration date of the password will be calculated
   automatically based on the given value. It will also be
   updated automatically when the user changes the password.
2. Set an expiration date by setting the 'pwdExpirationDate'
   field when creating a user.

Add two more settings in addition: USER_PWD_EXPIRATION_WARNING_1
and USER_PWD_EXPIRATION_WARNING_2. These two settings are
defining the amount of days to notify the user that his password
will expiration soon.

It's not possible to set the 'pwd_expiration_date' field to a
date in the past.

If the password of a user is already expired he is no longer
allowed to log into the dashboard.

Fixes: https://tracker.ceph.com/issues/40329
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-12-13 08:53:05 +01:00
Lenz Grimmer
6bab7c8002
Merge pull request #31920 from ricardoasmarques/fix-sso-certs
mgr/dashboard: Invalid SSO configuration when certificate path does not exist

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-12-12 09:47:12 +00:00
Sage Weil
cd1c05acbb mgr/ssh -> mgr/cephadm
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-11 19:14:24 -06:00
Lenz Grimmer
26f9952671
mgr/dashboard: list configured prometheus alerts (#31937)
mgr/dashboard: list configured prometheus alerts

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-12-05 12:25:33 +00:00
Lenz Grimmer
3bdbf94e44
mgr/dashboard: Check password complexity in Dashboard CLI comm… (#31916)
mgr/dashboard: Check password complexity in Dashboard CLI commands

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-12-05 09:46:14 +00:00
Patrick Seidensal
36421284c3 mgr/dashboard: extend dashboard documentation
by adding the previously added monitoring related features as well as
the newest feature addition. Extends the documentation where necessary
to describe the Prometheus' alert configuration.

Fixes: https://tracker.ceph.com/issues/42877

Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
2019-12-04 12:27:37 +01:00
Laura Paduano
4ad8591fe4
Merge pull request #30961 from rjfd/wip-mgr-module-logging
mgr: module logging infrastructure

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-03 10:29:42 +01:00
Ricardo Marques
cec98a8f90 mgr/dashboard: Invalid SSO configuration when certificate path does not exist
Fixes: https://tracker.ceph.com/issues/43060

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-11-29 15:05:57 +00:00
Volker Theile
6f0b3179b9 mgr/dashboard: Check password complexity in Dashboard CLI commands
- Refactor parts of the existing password complexity code.
- Check password complexity when setting password via Dashboard CLI commands.
- Add ability to force setting a password via CLI. This is useful in vstart environments or wherever it is necessary to disable the password complexity check.

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-11-29 11:12:55 +01:00
Sebastian Wagner
a74d57bcb2 doc/orchestrator: Adapted to new Completions
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-11-27 13:38:20 +01:00
Volker Theile
e047ffd20d mgr/dashboard: Dashboard can't handle self-signed cert on Grafana API
To configure SSL certificate verification use the following command:
$ ceph dashboard set-grafana-api-ssl-verify true|false

Fixes: https://tracker.ceph.com/issues/42445

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-11-18 09:48:11 +01:00
Ricardo Dias
3809044b7c
doc/mgr: update mgr modules' logging instructions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-11-13 16:33:08 +00:00
Sebastian Wagner
f320f02923 mgr/orchestrator: move InventoryDevice to python-common
Adapted:
* `mgr/dashboard`
* `mgr/ansible`
* `mgr/rook`
* `mgr/ssh`
* `mgr/orchestrator_cli`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
Co-authored--by: Kiefer Chang <kiefer.chang@suse.com>
2019-11-11 10:57:05 +01:00
Sage Weil
b0e1ff5efc doc/mgr/orchestrator_cli: remove irrelevant line
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-08 11:25:32 -06:00
Sage Weil
5588b69c29 mgr/ssh: learn to deploy rbd-mirror daemons
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-08 11:25:32 -06:00
Sebastian Wagner
1e9be56d49
Merge pull request #31457 from jschmid1/ssh_orch_dev_env
mgr/ssh: update ssh-orch bootstrap guide (Vagrantfile & docs)

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-11-08 13:20:49 +01:00
Sage Weil
a9b5fa6303 mgr/ssh: implement blink_device_light
On my test box I get as far as

  NO_SUPPORT(153): SCSI VPD page 0x83 is not supported

because my hardware doesn't support this.  The same command works
on another box that does.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-07 07:56:23 -06:00
Joshua Schmid
c068fa1303 mgr/ssh: move and adapt documentation for ssh-orchestrator
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2019-11-07 12:45:50 +01:00
Sage Weil
80f72fa7f3 mgr/ssh: add 'osd rm'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-06 08:26:12 -06:00
Sebastian Wagner
3feda32916
Merge pull request #26768 from sebastian-philipp/upstream-pull-26684
mgr/orchestrator: device lights

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-11-06 11:48:29 +01:00
Sage Weil
f59a40186b mgr/ssh: implement 'rgw update'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-05 08:46:01 -06:00
Sage Weil
5c09643823 mgr/ssh: add 'rgw rm'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-05 08:46:00 -06:00
Sage Weil
06abbd518d mgr/ssh: implement 'rgw add'
Note that this doesn't correctly confine a daemon to a zone.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-05 08:46:00 -06:00
Sebastian Wagner
b14ae26a69 mgr/orchestrator: Add interface and tests to device lights
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-11-05 13:02:29 +01:00
Sage Weil
3507d74336 Merge PR #31353 into master
* refs/pull/31353/head:
	doc/orchestrator: Fix various issues in Orchestrator CLI documentation

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-11-04 10:33:04 -06:00
Sage Weil
a78ece253d doc/mgr/orchestrator_cli: remove extra characters after checkmarks
Not sure what those were.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Sage Weil
3f2f38cee9 doc/mgr/orchestrator_cli: no {stop,start,restart} for all the random svcs
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Sage Weil
dd27ba50f5 mgr/ssh,orchestrator_cli: add 'restart' service action
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Sage Weil
72b4b72824 mgr/ssh: service[-instance] [start|stop]
Note that 'reload' is meaningless for ssh orch...

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Volker Theile
c3c2f600fe doc/orchestrator: Fix various issues in Orchestrator CLI documentation
Signed-off-by: Volker Theile <vtheile@suse.com>
2019-11-04 13:00:12 +01:00
Sage Weil
332daeac35 doc/mgr/orchestrator_cli: 'service ls' works for ssh
See 7fc78b6342 merge commit.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-31 14:25:05 -05:00
Sage Weil
f92b0061dd doc/mgr/orchestrator_cli: we already completed mds ops for rook+ssh
See f5bc2bd74a merge.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-31 14:25:05 -05:00
Tim Serong
ff7b16f60c
Merge pull request #31008 from SUSE/wip-doc-telemetry-default-interval
doc/mgr/telemetry: update default interval
2019-10-21 20:10:19 +11:00
Tim Serong
3c8793c4bd doc/mgr/telemetry: update default interval
Commit 712987d533 changed the default interval to 24h;
updating the docs to match (this also should go to
the Nautilus branch as that commit landed there too
in https://github.com/ceph/ceph/pull/27709)

Signed-off-by: Tim Serong <tserong@suse.com>
2019-10-21 18:18:05 +11:00
Ricardo Dias
994cc103df
Merge pull request #30522 from rhcs-dashboard/fix-41990-master
mgr/dashboard: add debug mode
2019-10-11 14:30:21 +01:00
Ernesto Puerta
928bb30952
doc: new Dashboard Plugin: Debug
Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-10-10 17:01:23 +02:00
Sage Weil
5f15829174 Merge PR #30738 into master
* refs/pull/30738/head:
	mgr/alerts: raise health alert if smtplib has a problem
	mgr/alerts: simple module to send health alerts

Reviewed-by: Tim Serong <tserong@suse.com>
2019-10-09 14:13:40 -05:00
Lenz Grimmer
d1df5cad6b
doc/mgr/dashboard: Fix duplication for NFS-Ganesha (#30700)
doc/mgr/dashboard: Fix duplication for NFS-Ganesha

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
2019-10-07 15:11:04 +00:00
Sage Weil
d7223938f8 mgr/alerts: simple module to send health alerts
Initialy SMTP support is implemented; nothing else.

This is just smart enough for me to get emails from my home cluster when
something goes wrong.  No bells and whistled at this point.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-07 09:04:39 -05:00
Dimitri Savineau
0a49218e23 doc/mgr/dashboard: Fix duplication for NFS-Ganesha
'conventions' is present twice. We can remove the second occurence.

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
2019-10-02 16:23:27 -04:00
Sage Weil
8128045511 do not use 'ceph tell mgr'
This is now for a daemon/asok command, not a module command.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-01 16:30:53 -05:00
Sebastian Wagner
8603e8394c
Merge pull request #29792 from sebastian-philipp/orchestrator-api-replace
mgr/orchestrator: Document OSD replacement

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-09-12 17:46:27 +02:00
Patrick Donnelly
a779766be9
Merge PR #30014 into master
* refs/pull/30014/head:
	doc: update CephFS overview in introductory page
	doc: filesystem to file system

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-09-11 09:59:51 -07:00
Lenz Grimmer
a9c2370ba8
Merge pull request #30292 from Reperator/wip-doc-dashboard-fix-typo
doc: Fixes typo for ceph dashboard command.
2019-09-11 07:17:46 +00:00
Patrick Donnelly
e7a7cf429e
doc: filesystem to file system
"Filesystem" is not a word (although fairly common in use).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-10 08:43:28 -07:00
Fabian Bonk
05935a1211 doc: Fixes typo for ceph dashboard command.
Signed-off-by: Fabian Bonk <fabian.bonk@croit.io>
2019-09-10 15:11:36 +02:00
Sebastian Wagner
0ad89da657 doc/orchestrator: Sync status with reality
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-10 08:48:59 +02:00
Ernesto Puerta
ff4fb0fbbd
mgr/dashboard: fix SAML input argument handling
Currently dashboard provides a Ceph command to specify location or
contents of SAML2 IdP XML (`idp_metadata` argument). This loose
interface is implemented by trying to:
- First, opens HTTPS connection to whatever that argument contains (it
  might be a proper remote URL, a local file or XML contents).
- Then, tries to open the local file
- Finally, assumes the input argument is an XML and proceeds to parse
  it.

However, as the XML can have an undefined length, when fed as a filename
it results in FreeBSD raising a OSError exception (`Max filename length
exceeded`, 1K). This essentially means that this handling results in
unexpected behaviour, as it pushes the validation & error handling to
the underlying methods.

In this fix, some preliminary validation is performed. Especifically:
- Is the input argument a potential filename?
- Is the input argument complying with URL syntax?

Only if the above checks fail, the input argument is fed into the XML
parser.

Additionally, previous syntax is deprecated, so now, `idp_metadata`
enforces 2 syntaxes:
- Raw XML contents
- URL specification (http, https, and file schemas accepted). For local
file, URL 'file://<path>' should be used instead.

Fixes: https://tracker.ceph.com/issues/41358
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-23 14:35:06 +02:00
Sebastian Wagner
f0c36b6c91 mgr/orchestrator: Document OSD replacement
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-08-21 15:30:01 +02:00
Sage Weil
c6eafb7343 Merge PR #29337 into master
* refs/pull/29337/head:
	mon: enable telemetry module by default
	mgr/telemetry: force re-opt-in if the report contents change
	mgr/telemetry: less noise in the log
	mgr/telemetry: wake up serve on config change
	mgr/telemetry: track telemetry report revisions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-05 13:08:53 -05:00
Ricardo Dias
29edead1c6
Merge pull request #29046 from p-na/wip-pna-disable-user
mgr/dashboard: Provide user enable/disable capability

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-02 10:05:21 +01:00
Ricardo Dias
1fb9c64692
Merge pull request #29088 from votdev/issue_24662
mgr/dashboard: Allow disabling redirection on standby Dashboards

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-02 10:02:38 +01:00
Sage Weil
2d62d71cd4 mon: enable telemetry module by default
We already have a robust set of opt-in and opt-out procedures; no need to
require the user to enable the module.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-01 04:55:44 -05:00
Patrick Nawracay
2b76d76904
mgr/dashboard: Provide user enable/disable capability in the backend
Fixes: http://tracker.ceph.com/issues/25229

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2019-08-01 09:34:53 +01:00
Sebastian Wagner
1a3a1d1310
Merge pull request #29063 from sebastian-philipp/orchestrator-get_feature_set
mgr/orchestrator: Split *_stateless_service and add get_feature_set
2019-08-01 09:37:16 +02:00
Sage Weil
9edfc9578f Merge PR #29334 into master
* refs/pull/29334/head:
	qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
	mgr/telemetry: separate out cluster config vs running daemons
	mgr/telemetry: include any config options that are customized

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-31 20:27:27 -05:00
Sebastian Wagner
dc54e77bd6 mgr/orchestrator: Split *_stateless_service and add get_feature_set
Split *_stateless_service, because every orchestrator
did some method dispatching internally anyway.

Also: Added test

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-31 09:44:57 +02:00
Sebastian Wagner
475159ec73
Merge pull request #28915 from sebastian-philipp/python-common-package-2
python-common:  Python common package

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-30 09:31:34 +02:00
Ricardo Marques
9479700df5
Merge pull request #29138 from Reperator/dashboard-pw-hash
mgr/dashboard: support setting password hashes

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-29 15:29:41 +01:00
Sage Weil
fce9fe87df mgr/telemetry: include any config options that are customized
This does not reveal the value of the options, only which options have
been customized.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-26 08:17:58 -05:00
Sebastian Wagner
c4625d86c4 python-common: Reference it in the docs
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-26 12:00:33 +02:00
Sage Weil
9ecfc55ead Merge PR #28847 into master
* refs/pull/28847/head:
	doc/mgr/telemetry: update
	mgr/telemetry: move contact info to an 'ident' channel
	mgr/telemetry: accept channel list to 'telemetry show'
	mgr/telemetry: always generate new report for 'telemetry show'
	mgr/telemetry: add 'device' channel and call out to devicehealth module
	mgr/telemetry: add telemetry channel 'device'
	mgr/telemetry: add separate channels

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-25 20:15:17 -05:00
Sage Weil
9fd65934de doc/mgr/telemetry: update
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 10:47:07 -05:00
Sage Weil
0c0093e450 Merge PR #29034 into master
* refs/pull/29034/head:
	doc/mgr/crash: document missing commands, options
	qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
	qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
	qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
	mgr/telemetry: fix remote into crash do_ls()
	mgr/crash: don't make these methods static
	mgr/BaseMgrModule: handle unicode health detail strings
	mgr/crash: verify timestamp is valid
	qa/suites/mgr: whitelist RECENT_CRASH
	mgr/crash: remove unused var
	mgr/crash: remove unused import 'six'
	qa/workunits/rados/test_crash: health check
	mgr/crash: improve validation on post
	mgr/crash: automatically prune old crashes after a year
	mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
	mgr/crash: add 'crash ls-new'
	mgr/crash: add option and serve infra
	mgr/crash: keep copy of crashes in memory
	mgr/pg_autoscaler: adjust style to match built-in tables
	mgr/crash: make 'crash ls' a nice table with a NEW column
	mgr/crash: nicely format 'crash info' output
	mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-24 17:20:21 -05:00
Sage Weil
1ea7570bb1 doc/mgr/crash: document missing commands, options
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-24 12:57:18 -05:00
Volker Theile
5bb986995a SSL-enabled dashboard does not play nicely with a frontend HAproxy. To fix that issue there are two new configuration options:
1. Disable redirection on standby managers. A HTTP error (500) will be returned instead of a redirection.
   $ ceph config set mgr mgr/dashboard/standby_behaviour "error"

2. Configure the HTTP error status code.
   $ ceph config set mgr mgr/dashboard/standby_error_status_code 503

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-24 08:59:02 +02:00
Fabian Bonk
79b9021805 mgr/dashboard: support setting password hashes
Signed-off-by: Fabian Bonk <fabian.bonk@croit.io>
2019-07-23 11:33:15 +02:00
Sebastian Wagner
d0855cf5e5
Merge pull request #29042 from sebastian-philipp/orchestrator-doc-disable
mgr/orchestrator: Fix disabling the orchestrator

Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-23 09:03:48 +02:00
Sage Weil
bebb1c3100 mgr/crash: add 'crash ls-new'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 09:43:04 -05:00
Sebastian Wagner
0342479835 mgr/mgr_module: Allow resetting module options
Introduced in 4872cc5aa3

`_ceph_set_module_option` also accepts `None`, not just strings.

Fixes: http://tracker.ceph.com/issues/40779

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-17 15:41:45 +02:00
Ricardo Dias
69895dd516
doc/mgr/dashboard: update SSL configuration instructions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-15 15:56:14 +01:00
Sebastian Wagner
5d1ed8867a doc/orchestrator: Disable the orchestrator
Also remove old `service status`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-15 14:24:25 +02:00
Stephan Müller
aa571a226d mgr/dashboard: Silence Alertmanager alerts
Now you can silence alerts through the dashboard. You can now create,
recreate, edit and expire a silence. You can create a silence based on a
selected alert.

The silence form will help you create a silence that silences an alert.
It is provided with functionality to check if the silences, that
you are about to create, will or will not match an active alert or even
a rule.

It also provides help choosing the right values for the right chosen
matcher attribute name, through the use of type ahead values.

The dashboard will now use the Prometheus and the Alertmanager API

Fixes: https://tracker.ceph.com/issues/36722
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-07-04 16:19:26 +02:00
Ricardo Marques
8176ad2c73
Merge pull request #27997 from LenzGr/master-documentation
doc: Added dashboard features, improved wording

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-03 09:23:52 +01:00
Lan Liu
8898bf5370 doc/mgr/ansible.rst: fix typo
Signed-off-by: Lan Liu <liulan@umcloud.com>
2019-07-02 13:59:19 +08:00
Lenz Grimmer
f90c111388 doc: Improved dashboard feature overview
Added some newly added features, improved wording.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-06-27 09:25:25 +02:00
Kefu Chai
286cdeb784
Merge pull request #27512 from jmolmo/tls_auth
mgr/ansible: TLS Mutual Authentication

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-06-08 23:24:53 +08:00
Sage Weil
611c8949fa Merge PR #26547 into master
* refs/pull/26547/head:
	Added validation of zabbix_host to support hostnames, IPv4 and IPv6.
	mgr/zabbix: Documentation added.
	mgr/zabbix: Adds possibility to send data to multiple zabbix servers.

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-06-03 15:45:42 -05:00
Juan Miguel Olmo Martínez
4c6a1c6c68
mgr/ansible: TLS Mutual Authentication
- Changes needed to allow Ansible Orchestrator to use the new authentication strategy used in Ansible Runner Service
- Changes to propagate Ansible playbook errors to the completion result

Addressed changes suggested by the team

- Certificate and key are stored now in the mon KV store
- Option server_url is now server_location
- Using manager Options to have a better mgmt of MODULE_OPTIONS
- Added verbosity to status command to show problems connecting with external orchestrator
- lint problems fixed

Addressed changes suggested by @sebastian-philipp

- Improved messages and documentation

Fix error in documentation

- Fix error in ansible documentation
- Added examples in orchestrator-cli documentation

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-05-29 16:54:56 +02:00
slivik
c5e74c9f29 Added validation of zabbix_host to support hostnames, IPv4 and IPv6.
Changed exception logging.
Doc typo fixed.

Signed-off-by: slivik <jakub.sliva@gmail.com>
2019-05-21 15:53:17 +02:00
Sebastian Wagner
fccbbb55c6 mgr/orchestrator: add progress events to all orchestrators
Now, progress events are part of `WriteCompletion` istead of part of the orchestrator module.

It does not yet provide a way to just show orchestrator events.

Also fixes issue in the SSH orchestrator

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-05-08 11:07:02 +02:00
Gregory Farnum
6dbe49605e
Merge pull request #26152 from noonedeadpunk/mgr/zabbix_discovery
mgr/zabbix Added pools discovery and per-pool statistics

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-05-06 13:15:54 -07:00
Tatjana Dehler
038ef6291d doc: Fix small typo in dashboard documentation
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-04-29 11:56:59 +02:00