Commit Graph

262 Commits

Author SHA1 Message Date
Patrick Donnelly
e7a7cf429e
doc: filesystem to file system
"Filesystem" is not a word (although fairly common in use).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-10 08:43:28 -07:00
Ernesto Puerta
ff4fb0fbbd
mgr/dashboard: fix SAML input argument handling
Currently dashboard provides a Ceph command to specify location or
contents of SAML2 IdP XML (`idp_metadata` argument). This loose
interface is implemented by trying to:
- First, opens HTTPS connection to whatever that argument contains (it
  might be a proper remote URL, a local file or XML contents).
- Then, tries to open the local file
- Finally, assumes the input argument is an XML and proceeds to parse
  it.

However, as the XML can have an undefined length, when fed as a filename
it results in FreeBSD raising a OSError exception (`Max filename length
exceeded`, 1K). This essentially means that this handling results in
unexpected behaviour, as it pushes the validation & error handling to
the underlying methods.

In this fix, some preliminary validation is performed. Especifically:
- Is the input argument a potential filename?
- Is the input argument complying with URL syntax?

Only if the above checks fail, the input argument is fed into the XML
parser.

Additionally, previous syntax is deprecated, so now, `idp_metadata`
enforces 2 syntaxes:
- Raw XML contents
- URL specification (http, https, and file schemas accepted). For local
file, URL 'file://<path>' should be used instead.

Fixes: https://tracker.ceph.com/issues/41358
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-23 14:35:06 +02:00
Sage Weil
c6eafb7343 Merge PR #29337 into master
* refs/pull/29337/head:
	mon: enable telemetry module by default
	mgr/telemetry: force re-opt-in if the report contents change
	mgr/telemetry: less noise in the log
	mgr/telemetry: wake up serve on config change
	mgr/telemetry: track telemetry report revisions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-05 13:08:53 -05:00
Ricardo Dias
29edead1c6
Merge pull request #29046 from p-na/wip-pna-disable-user
mgr/dashboard: Provide user enable/disable capability

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-02 10:05:21 +01:00
Ricardo Dias
1fb9c64692
Merge pull request #29088 from votdev/issue_24662
mgr/dashboard: Allow disabling redirection on standby Dashboards

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-02 10:02:38 +01:00
Sage Weil
2d62d71cd4 mon: enable telemetry module by default
We already have a robust set of opt-in and opt-out procedures; no need to
require the user to enable the module.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-01 04:55:44 -05:00
Patrick Nawracay
2b76d76904
mgr/dashboard: Provide user enable/disable capability in the backend
Fixes: http://tracker.ceph.com/issues/25229

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2019-08-01 09:34:53 +01:00
Sebastian Wagner
1a3a1d1310
Merge pull request #29063 from sebastian-philipp/orchestrator-get_feature_set
mgr/orchestrator: Split *_stateless_service and add get_feature_set
2019-08-01 09:37:16 +02:00
Sage Weil
9edfc9578f Merge PR #29334 into master
* refs/pull/29334/head:
	qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
	mgr/telemetry: separate out cluster config vs running daemons
	mgr/telemetry: include any config options that are customized

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-31 20:27:27 -05:00
Sebastian Wagner
dc54e77bd6 mgr/orchestrator: Split *_stateless_service and add get_feature_set
Split *_stateless_service, because every orchestrator
did some method dispatching internally anyway.

Also: Added test

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-31 09:44:57 +02:00
Sebastian Wagner
475159ec73
Merge pull request #28915 from sebastian-philipp/python-common-package-2
python-common:  Python common package

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-30 09:31:34 +02:00
Ricardo Marques
9479700df5
Merge pull request #29138 from Reperator/dashboard-pw-hash
mgr/dashboard: support setting password hashes

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-29 15:29:41 +01:00
Sage Weil
fce9fe87df mgr/telemetry: include any config options that are customized
This does not reveal the value of the options, only which options have
been customized.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-26 08:17:58 -05:00
Sebastian Wagner
c4625d86c4 python-common: Reference it in the docs
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-26 12:00:33 +02:00
Sage Weil
9ecfc55ead Merge PR #28847 into master
* refs/pull/28847/head:
	doc/mgr/telemetry: update
	mgr/telemetry: move contact info to an 'ident' channel
	mgr/telemetry: accept channel list to 'telemetry show'
	mgr/telemetry: always generate new report for 'telemetry show'
	mgr/telemetry: add 'device' channel and call out to devicehealth module
	mgr/telemetry: add telemetry channel 'device'
	mgr/telemetry: add separate channels

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-07-25 20:15:17 -05:00
Sage Weil
9fd65934de doc/mgr/telemetry: update
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 10:47:07 -05:00
Sage Weil
0c0093e450 Merge PR #29034 into master
* refs/pull/29034/head:
	doc/mgr/crash: document missing commands, options
	qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
	qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
	qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
	mgr/telemetry: fix remote into crash do_ls()
	mgr/crash: don't make these methods static
	mgr/BaseMgrModule: handle unicode health detail strings
	mgr/crash: verify timestamp is valid
	qa/suites/mgr: whitelist RECENT_CRASH
	mgr/crash: remove unused var
	mgr/crash: remove unused import 'six'
	qa/workunits/rados/test_crash: health check
	mgr/crash: improve validation on post
	mgr/crash: automatically prune old crashes after a year
	mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
	mgr/crash: add 'crash ls-new'
	mgr/crash: add option and serve infra
	mgr/crash: keep copy of crashes in memory
	mgr/pg_autoscaler: adjust style to match built-in tables
	mgr/crash: make 'crash ls' a nice table with a NEW column
	mgr/crash: nicely format 'crash info' output
	mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-24 17:20:21 -05:00
Sage Weil
1ea7570bb1 doc/mgr/crash: document missing commands, options
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-24 12:57:18 -05:00
Volker Theile
5bb986995a SSL-enabled dashboard does not play nicely with a frontend HAproxy. To fix that issue there are two new configuration options:
1. Disable redirection on standby managers. A HTTP error (500) will be returned instead of a redirection.
   $ ceph config set mgr mgr/dashboard/standby_behaviour "error"

2. Configure the HTTP error status code.
   $ ceph config set mgr mgr/dashboard/standby_error_status_code 503

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-24 08:59:02 +02:00
Fabian Bonk
79b9021805 mgr/dashboard: support setting password hashes
Signed-off-by: Fabian Bonk <fabian.bonk@croit.io>
2019-07-23 11:33:15 +02:00
Sebastian Wagner
d0855cf5e5
Merge pull request #29042 from sebastian-philipp/orchestrator-doc-disable
mgr/orchestrator: Fix disabling the orchestrator

Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-23 09:03:48 +02:00
Sage Weil
bebb1c3100 mgr/crash: add 'crash ls-new'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 09:43:04 -05:00
Sebastian Wagner
0342479835 mgr/mgr_module: Allow resetting module options
Introduced in 4872cc5aa3

`_ceph_set_module_option` also accepts `None`, not just strings.

Fixes: http://tracker.ceph.com/issues/40779

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-17 15:41:45 +02:00
Ricardo Dias
69895dd516
doc/mgr/dashboard: update SSL configuration instructions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-15 15:56:14 +01:00
Sebastian Wagner
5d1ed8867a doc/orchestrator: Disable the orchestrator
Also remove old `service status`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-15 14:24:25 +02:00
Stephan Müller
aa571a226d mgr/dashboard: Silence Alertmanager alerts
Now you can silence alerts through the dashboard. You can now create,
recreate, edit and expire a silence. You can create a silence based on a
selected alert.

The silence form will help you create a silence that silences an alert.
It is provided with functionality to check if the silences, that
you are about to create, will or will not match an active alert or even
a rule.

It also provides help choosing the right values for the right chosen
matcher attribute name, through the use of type ahead values.

The dashboard will now use the Prometheus and the Alertmanager API

Fixes: https://tracker.ceph.com/issues/36722
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-07-04 16:19:26 +02:00
Ricardo Marques
8176ad2c73
Merge pull request #27997 from LenzGr/master-documentation
doc: Added dashboard features, improved wording

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-03 09:23:52 +01:00
Lan Liu
8898bf5370 doc/mgr/ansible.rst: fix typo
Signed-off-by: Lan Liu <liulan@umcloud.com>
2019-07-02 13:59:19 +08:00
Lenz Grimmer
f90c111388 doc: Improved dashboard feature overview
Added some newly added features, improved wording.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-06-27 09:25:25 +02:00
Kefu Chai
286cdeb784
Merge pull request #27512 from jmolmo/tls_auth
mgr/ansible: TLS Mutual Authentication

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-06-08 23:24:53 +08:00
Sage Weil
611c8949fa Merge PR #26547 into master
* refs/pull/26547/head:
	Added validation of zabbix_host to support hostnames, IPv4 and IPv6.
	mgr/zabbix: Documentation added.
	mgr/zabbix: Adds possibility to send data to multiple zabbix servers.

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-06-03 15:45:42 -05:00
Juan Miguel Olmo Martínez
4c6a1c6c68
mgr/ansible: TLS Mutual Authentication
- Changes needed to allow Ansible Orchestrator to use the new authentication strategy used in Ansible Runner Service
- Changes to propagate Ansible playbook errors to the completion result

Addressed changes suggested by the team

- Certificate and key are stored now in the mon KV store
- Option server_url is now server_location
- Using manager Options to have a better mgmt of MODULE_OPTIONS
- Added verbosity to status command to show problems connecting with external orchestrator
- lint problems fixed

Addressed changes suggested by @sebastian-philipp

- Improved messages and documentation

Fix error in documentation

- Fix error in ansible documentation
- Added examples in orchestrator-cli documentation

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-05-29 16:54:56 +02:00
slivik
c5e74c9f29 Added validation of zabbix_host to support hostnames, IPv4 and IPv6.
Changed exception logging.
Doc typo fixed.

Signed-off-by: slivik <jakub.sliva@gmail.com>
2019-05-21 15:53:17 +02:00
Sebastian Wagner
fccbbb55c6 mgr/orchestrator: add progress events to all orchestrators
Now, progress events are part of `WriteCompletion` istead of part of the orchestrator module.

It does not yet provide a way to just show orchestrator events.

Also fixes issue in the SSH orchestrator

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-05-08 11:07:02 +02:00
Gregory Farnum
6dbe49605e
Merge pull request #26152 from noonedeadpunk/mgr/zabbix_discovery
mgr/zabbix Added pools discovery and per-pool statistics

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-05-06 13:15:54 -07:00
Tatjana Dehler
038ef6291d doc: Fix small typo in dashboard documentation
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-04-29 11:56:59 +02:00
Lenz Grimmer
70a28a3e47 doc: Improved the dashboard proxy config section
Added paragraph that explains how standby dashboard instances perform
HTTP redirections to the currently active ceph-mgr node.
Added note about current limitations (see Bug#24662 for details).

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-04-16 12:01:42 +02:00
Lenz Grimmer
43c56e1a5a doc: dashboard: refined object gateway configuration
As discussed in BUG#39252, the dashboard currently does not
support all possible RGW configuration possibilities when trying
to obtain hostname and port number. Update the docs to better
reflect this.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-04-16 11:59:53 +02:00
Sebastian Wagner
a1688daf17 doc/mgr/orchestrator_cli: Rook orch supports mon update
Fixes: http://tracker.ceph.com/issues/39137

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-04-08 11:26:14 +02:00
Kefu Chai
736d396ee0
Merge pull request #27121 from sebastian-philipp/orchestrator-doc-cli-fix-service-add
doc/orchestrator: Fix broken bullet points

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-05 13:52:44 +08:00
Kefu Chai
8614b9b81d
Merge pull request #26016 from falcon78921/wip-doc-37957
doc: added section on creating RESTful API user

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-04 14:33:24 +08:00
Jason Dillaman
41d3fdc554
Merge pull request #27074 from LenzGr/master-documentation
doc: Updated dashboard iSCSI configuration, added labels

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-01 09:20:24 -04:00
Lenz Grimmer
71e46887d4 doc: Updated dashboard iSCSI configuration, added labels
Added note about the requirement for the latest ceph-iscsi version
3 to the dashboard documentation. Added some doc references
and replaced some URLs in the iSCSI docs with reST labels instead.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-03-31 13:32:15 -05:00
Patrick Donnelly
91c2317a04
Merge PR #27202 into master
* refs/pull/27202/head:
	doc: Miscellaneous spelling fixes

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-03-28 09:39:07 -07:00
Lenz Grimmer
96a65fbfb7
Merge pull request #26914 from votdev/issue_38331
mgr/dashboard: Add separate option to config SSL port

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-03-28 10:55:27 +01:00
Bryan Stillwell
8d87df48f2 doc: Miscellaneous spelling fixes
While looking over the documentation I found a few words being misspelled.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2019-03-26 14:52:12 -06:00
Sebastian Wagner
b175010dcd doc/orchestrator: Fix broken bullet points
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-03-22 14:11:05 +01:00
Sebastian Wagner
cee38745ea
Merge pull request #26404 from sebastian-philipp/orchestrator-error-handling
mgr/orchestrator: Add error handling to interface

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-03-21 12:30:13 +01:00
Sage Weil
c529925e2f doc/releases/nautilus: final upgrade note updates
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-17 05:29:27 -05:00
Ricardo Marques
65a93cb8f7 mgr/dashboard: Drop iSCSI gateway name parameter
iSCSI gateway name will now be obtained from the
ceph-iscsi `/api/sysinfo/hostname` endpoint

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-03-15 14:05:49 +00:00