Commit Graph

199 Commits

Author SHA1 Message Date
Noah Watkins
cdeb604b10 ssh/orch: add ssh orchestrator
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-02-20 09:45:48 -08:00
Lenz Grimmer
681de1a0f1
Merge pull request #26325 from jtlayton/wip-jlayton-dashboard-orch
mgr/dashboard: use the orchestrator_cli backend setting

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-13 17:08:23 +01:00
Jeff Layton
55422589ce mgr: make orchestrator_cli be always-on
The volumes module has at least a loose dependency on the orchestrator,
and thus also relies on the orchestrator_cli module for the backend
setting. Since the volumes module is always-on, do the same with the
orchestrator_cli module.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-02-12 08:08:18 -05:00
Lenz Grimmer
4431d6d60f
Merge pull request #26102 from rhcs-dashboard/wip-featuretoggles
mgr/dashboard: add Feature Toggles

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-11 15:58:57 +01:00
Ernesto Puerta
ec949ab71d
doc: mgr/orch: Fix remote_host doc reference
The type fix in the remote_host to remove_host has caused a Ceph docs
build failure.

Introduced-By: 05cfa6f
Fixes: http://tracker.ceph.com/issues/38254
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:55:47 +01:00
Ernesto Puerta
ae8e288769
doc: mgr/dashboard: feature-toggles: Fix config
Add '*.inc.rst' to the list of excluded patterns from sphinx-build. This
allows for using '*.inc.rst' as includes, and avoids duplicates. The
benefit of keeping the trailing '.rst' extension is that most IDEs use
that to render reStructured Text files.

Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
7b06daedfc
doc: mgr/dashboard: feature-toggles: Add doc
Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Sebastian Wagner
ad7abc3995
Merge pull request #26314 from sebastian-philipp/orchestrator-host-mon-mgr
mgr/orchestrator: Add host mon mgr management to interface

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-02-11 09:52:53 +01:00
Sebastian Wagner
00e2a7c357 doc/mgr/orchestrator: Add Image
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-07 16:24:00 +01:00
Noah Watkins
394d3d007e mgr/orch: add host, mon, mgr mgmt interfaces
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2019-02-07 10:47:41 +01:00
Lenz Grimmer
2275a41d09
Merge pull request #25918 from rjfd/wip-dashboard-nfs-backend
mgr/dashboard: NFS Ganesha management REST API

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-02-06 16:41:49 +01:00
Sebastian Wagner
38c664b4b9 mgr/orchestrator: fix broken device ls
* Added `InventoryDevice.from_ceph_volume_inventory`
* Improved documentation

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-05 15:23:35 +01:00
Lenz Grimmer
3b3bea991b
doc/mgr/dashboard: NFS management instruction review
Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-01-31 13:39:57 +00:00
Ricardo Dias
ae57d5d537
doc/mgr/dashboard: NFS-Ganesha configuration instructions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-01-31 11:10:10 +00:00
Stephan Müller
8451e8c595 mgr/dashboard: Add the Prometheus alerts
The backend is now capable of receiving alert notifications from
the Prometheus alertmanager and it can get all alerts with all kinds of
parameters from the API of the same.

In the frontend Prometheus alerts can be found in "Cluster > Alerts". Incoming
notifications can be seen as usual in the notifications popover.

To clarify:
Prometheus alerts are received from the alertmanager API.
Prometheus alert notification are send from the alertmanager to the
backend receiver. An alert notification can have multiple alerts, but
these alerts differ from the prometheus alerts.

To clarify that, I've added some models and services.

If one of the methods to get alerts contains changes the user will be
notified.

The documentation explains how to configure the alertmanager to use the
dashboard receiver and how to connect the use of the alertmanager API.
Further it explains where to find the alerts and what happens if they
are configured and something is happening.

Fixes: https://tracker.ceph.com/issues/36721
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-30 16:42:57 +01:00
Lenz Grimmer
d239c2a8b4
Merge pull request #25638 from ricardoasmarques/iscsi-management-w
mgr/dashboard: iSCSI management API

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-01-30 15:56:48 +01:00
Ricardo Marques
7ebc04d696
Merge pull request #26143 from LenzGr/master-documentation
doc: Updated feature list and overview in dashboard.rst

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-30 09:49:35 +00:00
Sebastian Wagner
cfc0141db1 doc/orchestrator: Aligned Documentaiton with specification
Also: add current implementation status
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-01-29 15:51:16 +01:00
Lenz Grimmer
0941f7ba10 doc: Updated feature list and overview in dashboard.rst
Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-01-25 12:34:37 +01:00
Ricardo Marques
b24a7afca2 mgr/dashboard: iSCSI management API
Fixes: https://tracker.ceph.com/issues/35903

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-01-24 09:24:19 +00:00
Sebastian Wagner
33e6f39b2f mgr/orchestrator: Extend DriveGroupSpec
Also: Added tox.

Co-authored-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-01-18 13:30:14 +01:00
Patrick Donnelly
a2b05b8334
Merge PR #25633 into master
* refs/pull/25633/head:
	mgr/rook: allow service describe and service ls to display nfs services
	mgr/rook: add support for adding NFS gateways
	mgr/orchestrator_cli: add support for adding NFS gateways
	mgr/orchestrator_cli: convert service add/rm commands to be type-specific
	mgr/rook: add decorator for add_stateless_service
	mgr/rook: add a context manager instead of open-coding exception handling

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-01-14 11:32:01 -08:00
alfonsomthd
2ac3dc17c5 mgr/dashboard: updated SSO documentation
Added info about SAML request issuer value.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-01-14 14:24:56 +01:00
Jeff Layton
ca972cefbd mgr/orchestrator_cli: add support for adding NFS gateways
Add necessary commands to orchestrator_cli to allow it to deploy a
cluster of NFS servers. Note that we have to be able to specify the pool
and an optional namespace for the recovery backend objects.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-01-14 07:11:41 -05:00
Jeff Layton
d07effa132 mgr/orchestrator_cli: convert service add/rm commands to be type-specific
When adding services, we often need different sets of arguments
depending on the service type. Convert the "service add" and "service
rm" commands into separate commands for each service type.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-01-14 07:11:36 -05:00
Sebastian Wagner
9bb8e2dd20
Merge pull request #25634 from sebastian-philipp/doc-orchestrator-wal
doc/mgr/orchestrator: add `wal` to blink lights

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-09 14:39:37 +01:00
hsiang41
06c40e4b4c mgr/diskprediction Document guide add predictor accuracy
Add local/cloud predictor accuracy value

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-12-28 17:43:07 +08:00
Sebastian Wagner
3ab4f8f92a doc/mgr/orchestrator: add wal to blink lights
Also added: "The output of `osd create` is not specified
  any may vary between orchestrator backends."

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-20 15:44:26 +01:00
Mykola Golub
19d63aca40 doc/mgr/prometheus: document rbd stats options
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-20 08:38:54 +00:00
Sage Weil
3432636b8a pybind/mgr: rename get_option -> get_ceph_option
Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-11 03:54:52 -06:00
Sebastian Wagner
8d459de570
Merge pull request #25391 from SUSE/wip-orchestrator-deepsea-cleanup
mgr/deepsea: check for inflight completions when starting event reader, cleanup logging and comments

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-10 16:04:56 +01:00
Mehdi Abaakouk
2d7ed8ad15 doc: fix typo in mgr ssl setup
Unlike `config set`, `config-key set` does not take the <who>
argument.

This change removes it from mgr ssl setup.

Signed-off-by: Mehdi Abaakouk <sileht@sileht.net>
2018-12-08 15:11:35 +01:00
Igor Fedotov
242ba0cacf pybind/diskprediction: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
71fe9149ac mgr: rename ceph df stat columns for both influx and prometheus.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Tim Serong
0c9dd842d3 mgr/deepsea: mention DeepSea 0.9.9 in docs, cleanup logging & comments
Signed-off-by: Tim Serong <tserong@suse.com>
2018-12-05 16:37:44 +11:00
Juan Miguel Olmo Martínez
526cdcdf01
mgr/ansible: Ansible orchestrator module
A Ceph Manager Orchestrator that uses a external REST API service to execute Ansible playbooks.

get_inventory implementation

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>

Document how to use CLI through Orchestrator CLI

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2018-11-29 14:54:43 +01:00
Jan Fajerski
ed05b163e7
Merge pull request #25182 from jan--f/mgr-prometheus-doc-mention-instance-label
doc/mgr/prometheus: readd section about custom instance labels
2018-11-22 14:29:43 +01:00
Sebastian Wagner
a7f1a24f8e
Merge pull request #25119 from sebastian-philipp/doc-orchestrator-cli-spec
doc/orchestrator: Integrate CLI specification into the documentation

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-11-22 13:59:34 +01:00
Sebastian Wagner
26a7236ab5 doc/orchestrator: Integrate CLI specification into the documentation
Also: Make it clear that the orchestrator is WIP

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-11-21 18:23:51 +01:00
Tim Serong
ec2567e289 mgr/deepsea: DeepSea orchestrator module
This module provides integration between Ceph's orchestrator framework
and DeepSea, a Ceph deployment and management system built upon Salt.

Included so far are implementations of get_inventory() and
describe_service().  This allows `ceph orchestrator device ls`, `ceph
orchestrator service ls` and `ceph orchestrator service status` to
operate correctly.

To test, try:

  # ceph mgr module enable orchestrator_cli
  # ceph mgr module enable deepsea
  # ceph orchestrator set backend deepsea
  # ceph deepsea config-set salt_api_url <salt api url>
  # ceph deepsea config-set salt_api_username <salt api username>
  # ceph deepsea config-set salt_api_password <salt api shared secret>
  # ceph orchestrator device ls
  # ceph orchestrator service ls

Signed-off-by: Tim Serong <tserong@suse.com>
2018-11-21 22:50:55 +11:00
Jan Fajerski
92494c969f doc/mgr/prometheus: readd section about custom instance labels
This section was removed accidentally by
331a826a9f. It offers a helpful configuration
variant to deal with mgr failovers.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-20 12:43:12 +01:00
Sebastian Wagner
b6a58491ee
Merge pull request #24863 from jtlayton/wip-orchestrator
mgr/orchestrator: Add support for "ceph orchestrator service ls"

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2018-11-19 14:55:30 +01:00
hsiang41
9799eb67eb mgr: Separate diskprediction cloud plugin from the diskprediction plugin
Separate diskprediction local cloud from the diskprediction plugin.
Devicehealth invoke device prediction function related on the global
configuration "device_failure_prediction_mode".

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-16 00:15:41 -06:00
Jeff Layton
a516905591 orchestrator: merge the ServiceLocation class into ServiceDescription
The ServiceDescription object just holds a list of ServiceLocation
objects.  Eliminate ServiceLocation and merge it into the
ServiceDescription class. Have describe_service return a list of
ServiceDescriptions.

Suggested-by: Tim Serong <tserong@suse.com>
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 09:02:54 -05:00
Jeff Layton
f396fa1d7f orchestrator_cli: add an orchestrator service ls function
There's currently no way to enumerate the services that the
orchestrator backend knows about. Add a "service ls" command
that will list them with some basic info, subject to filters
given on the command line.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 07:27:51 -05:00
Sage Weil
8f3d7a6d56 Merge PR #24925 into master
* refs/pull/24925/head:
	Avoid import _strptime failed
	Avoid exception if remote plugin not enabled
	Separate diskprediction local plugin from the diskprediction plugin

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-09 08:37:10 -06:00
Ricardo Marques
04f4d5053e mgr/dashboard: SAML 2.0 support
Fixes: https://tracker.ceph.com/issues/24268

Signed-off-by: Ricardo Dias <rdias@suse.com>
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-11-08 15:27:37 +00:00
Volker Theile
22e07ff1a4 mgr/dashboard: Audit REST API calls
Fixes: https://tracker.ceph.com/issues/36193

Enable API auditing with 'ceph dashboard set-audit-api-enabled true' (default is false). If you do not want to log the request payload, then disable it via 'set-audit-api-log-payload false' (default is true).

Example output:
2018-10-08 10:25:21.850994 mgr.x [INF] [DASHBOARD] from='https://[::1]:44410' path='/api/auth' method='POST' user='None' params='{"username": "admin", "password": "***", "stay_signed_in": false}'

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-11-05 10:56:28 +01:00
hsiang41
5581577c83 Separate diskprediction local plugin from the diskprediction plugin
Separate diskprediction local plugin from the diskprediction plugin.
Devicehealth invoke device prediction function related on the global
 configuration "device_failure_prediction_mode".

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-05 14:09:10 +08:00
Jeff Layton
942d4dedc1 orchestrator/rook: allow describe_service to report mgr containers
This label seems to be present in the rook version I've been working
with, so let's wire it in.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-10-31 13:37:34 -04:00