Commit Graph

5323 Commits

Author SHA1 Message Date
Yuval Lifshitz
1682e1917e rgw: pubsub update documentation with amqp support
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-02-13 11:19:18 +02:00
Sage Weil
bc7f567467 msg/async/ProtocolV2: refuse incoming reconnect attempt intended for someone else
The same scenario that was possible on client_ident is also possible
for reconnect: on the accepting side we recognized the client_addrs
but the client is trying to reach someone else.  Since the cookie is a
random 64-bit value it is unlikely, but still possible, that we will
match an existing session that is not for the client.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-11 11:02:28 -06:00
Sage Weil
e399fc7514 msg/async/ProtocolV2: refuse incoming connection intended for someone else
If we get a client_ident frame, and they are trying to talk to someone
else, drop the connection.

This is an inelegant workaround to http://tracker.ceph.com/issues/38247.
A nicer fix would be to restructure the protocol so that the client knows
who they connected to before they try to open a session.  That is a bigger
change that can follow...

Fixes: http://tracker.ceph.com/issues/38247
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-11 09:29:30 -06:00
Lenz Grimmer
4431d6d60f
Merge pull request #26102 from rhcs-dashboard/wip-featuretoggles
mgr/dashboard: add Feature Toggles

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-11 15:58:57 +01:00
Ernesto Puerta
ec949ab71d
doc: mgr/orch: Fix remote_host doc reference
The type fix in the remote_host to remove_host has caused a Ceph docs
build failure.

Introduced-By: 05cfa6f
Fixes: http://tracker.ceph.com/issues/38254
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:55:47 +01:00
Ernesto Puerta
ae8e288769
doc: mgr/dashboard: feature-toggles: Fix config
Add '*.inc.rst' to the list of excluded patterns from sphinx-build. This
allows for using '*.inc.rst' as includes, and avoids duplicates. The
benefit of keeping the trailing '.rst' extension is that most IDEs use
that to render reStructured Text files.

Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
7b06daedfc
doc: mgr/dashboard: feature-toggles: Add doc
Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Sebastian Wagner
ad7abc3995
Merge pull request #26314 from sebastian-philipp/orchestrator-host-mon-mgr
mgr/orchestrator: Add host mon mgr management to interface

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-02-11 09:52:53 +01:00
Sage Weil
33582d2290 Merge PR #26327 into master
* refs/pull/26327/head:
	doc/dev/msgr2: bring up to date with new HELLO, different RECONNECT
	msg/async/ProtocolV2: separate IDENT into {CLIENT,SERVER}_IDENT

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-02-09 08:29:18 -06:00
Patrick Donnelly
f9854b522f
Merge PR #26287 into master
* refs/pull/26287/head:
	doc: update doc on new recall config

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2019-02-08 19:38:37 -08:00
Sebastian Wagner
0daae004f0
Merge pull request #26331 from tchaikov/wip-mgr-orchestrator-docstring
doc/mgr/orchestrator: Add Architecture Image

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-08 09:33:05 +01:00
Sage Weil
2e9c61de49 doc/dev/msgr2: bring up to date with new HELLO, different RECONNECT
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 17:05:10 -06:00
Sage Weil
86c99bf023 msg/async/ProtocolV2: separate IDENT into {CLIENT,SERVER}_IDENT
This is less ambiguous and easier to document since the frame payloads
are different.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 17:05:10 -06:00
Sage Weil
d3766916a7 Merge PR #26059 into master
* refs/pull/26059/head:
	mon/MonClient: fix keepalive with v2 auth
	msg/async/ProtocolV2: reject peer_addrs of -
	msg/async/ProtocolV2: clean up feature management
	mon/MonClient: set up rotating_secrets, etc before msgr ready
	msg/async: let client specify preferred order of modes
	msg/async/ProtocolV2: include entity_name, features in reconnect
	msg/async/ProtocolV2: fix write_lock usage around AckFrame
	qa/suites/rados/verify/validator/valgrind: debug refs = 5
	qa/standalone/ceph-helpers: fix health_ok test
	auth/AuthRegistry: only complain about disabling cephx if cephx was enabled
	auth/AuthRegistry: fix locking for get_supported_methods()
	auth: remove AUTH_UNKNOWN weirdness, hardcoded defaults.
	msg/async/ProtocolV2: remove unused get_auth_allowed_methods
	osd: set up messener auth_* before setting dispatcher (and going 'ready')
	mon/AuthMonitor: request max_global_id increase from peon in tick
	mon: prime MgrClient only after messengers are initialized
	qa/suites/rados/workloads/rados_api_tests.yaml: debug mgrc = 20 on mon
	auth: document Auth{Client,Server} interfaces
	auth: future-proof AUTH_MODE_* a bit in case we need to change the encoding byte
	mon/MonClient: request monmap on open instead of ping
	mgr/PyModuleRegistry: add details for MGR_MODULE_{DEPENDENCY,ERROR}
	crimson: fix build
	mon/MonClient: finsih authenticate() only after we get monmap; fix 'tell mgr'
	mon: add auth_lock to protect auth_meta manipulation
	ceph-mon: set up auth before binding
	mon: defer initial connection auth attempts until initial quorum is formed
	mon/MonClient: make MonClientPinger an AuthCleint
	ceph_test_msgr: use DummyAuth
	auth/DummyAuth: dummy auth server and client for test code
	mon/Monitor: fix leak of auth_handler if we error out
	doc/dev/cephx: re-wordwrap
	doc/dev/cephx: document nautilus change to cephx
	vstart.sh: fix --msgr2 option
	msg/async/ProtocolV2: use shared_ptr to manage auth_meta
	auth/Auth{Client,Server}: pass auth_meta in explicitly
	mon/MonClient: behave if authorizer can't be built (yet)
	osd: set_auth_server on client_messenger
	common/ceph_context: get_moduel_type() for seastar cct
	auth: make connection_secret a std::string
	auth,msg/async/ProtocolV2: negotiate connection modes
	auth/AuthRegistry: refactor handling of auth_*_requred options
	osd,mgr,mds: remove unused authorize registries
	switch monc, daemons to use new msgr2 auth frame exchange
	doc/dev/msgr2: update docs to match implementation for auth frames
	auth/AuthClientHandler: add build_initial_request hook
	msg/Messenger: attach auth_client and/or auth_server to each Messenger
	auth: introduce AuthClient and AuthServer handlers
	auth: codify AUTH_MODE_AUTHORIZER
	msg/Connection: track peer_id (id portion of entity_name_t) for msgr2
	auth/AuthAuthorizeHandler: add get_supported_methods()
	auth/AuthAuthorizeHandler: fix args for verify_authorizer()
	auth: constify bufferlist arg to AuthAuthorizer::add_challenge()
	auth/cephx: share all tickets and connection_secret in initial reply
	msg/async,auth: add AuthConnectionMeta to Protocol
	auth/AuthClientHandler: pass in session_key, connection_secret pointers
	auth/AuthServiceHandler: take session_key and connection_secret as args
	auth/cephx: pass more specific type into build_session_auth_info
	mon/Session: separate session creation, peer ident, and registration
	mon/AuthMonitor: bump max_global_id from on_active() and tick()
	mon/AuthMonitor: be more careful with max_global_id
	mon: only all ms_handle_authentication() if auth method says we're done
	mon/AuthMonitor: fix "finished with auth" condition check
	auth: clean up AuthServiceHandler::handle_request() args
	auth: clean up AuthServiceHandler::start_session()
	mon/AuthMonitor: drop unused op arg to assign_global_id()
	msg/async: separate TAG_AUTH_REQUEST_MORE and TAG_AUTH_REPLY_MORE
	msg/async: consolidate authorizer checks
	msg/async: move get_auth_allowed into ProtocolV2.cc
	mon/MonClient: trivial cleanup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-02-07 16:51:39 -06:00
Sage Weil
5e4df2a509 doc/dev/cephx: re-wordwrap
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 12:10:34 -06:00
Sage Weil
c1102f043e doc/dev/cephx: document nautilus change to cephx
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 12:10:33 -06:00
Sage Weil
c7ee66c3e5 auth,msg/async/ProtocolV2: negotiate connection modes
The modes are:

- crc: crc32c checksums to protect against bit errors.  No secrecy or
  authenticity guarantees, so a MITM could alter traffic in flight.
- secure: cryptographic secrecy and authenticity proection (i.e, encrypted
  and signed).

We do not include a 'signed' mode that provides authenticity without
secrecy because the cryptographic protocols appear to be faster than
SHA-2.

New settings:

- ms_cluster_mode  : mode(s list) for intra-cluster connections
- ms_service_mode  : mode(s list) for daemons to allow
- ms_client_mode   : mode(s list) for clients to allow

Also,

- ms_mon_cluster_mode  : mon <-> mon connections
- ms_mon_service_mode  : mon <-> daemon or client connections

The msgr2 protocol is expanded slightly to negotiate a mode.  Client
shares it's allowed/preferred modes, and server picks one as auth finishes.
Negotiation is independent of the authentication, except that the
authentiction mode may precluse certain choices. Specifically, AUTH_NONE
does not support 'secure', only 'crc'.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 12:10:33 -06:00
Sebastian Wagner
00e2a7c357 doc/mgr/orchestrator: Add Image
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-07 16:24:00 +01:00
Abhishek L
c6f171fc6c
Merge pull request #26312 from smithfarm/wip-luminous-cve
doc: mention CVEs in luminous v12.2.11 release notes

Reviewed-By: Sage Weil <sage@redhat.com>
2019-02-07 14:51:43 +01:00
Sage Weil
c1a2d1be52 doc/dev/msgr2: update docs to match implementation for auth frames
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 06:53:03 -06:00
Sage Weil
1c40968bd5 msg/async: separate TAG_AUTH_REQUEST_MORE and TAG_AUTH_REPLY_MORE
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 06:53:03 -06:00
Matt Benjamin
661d108064
Merge pull request #26098 from pritha-srivastava/wip-rgw-awsv4signature
rgw: Correcting logic for signature calculation for non s3 ops.
2019-02-07 07:34:46 -05:00
Matt Benjamin
56e1a9b66a
Merge pull request #24818 from pritha-srivastava/wip-rgw-sts-auth-policy
[DNM] rgw: Controlling STS authentication via a Policy
2019-02-07 07:33:29 -05:00
Nathan Cutler
1da10a02f3 doc: mention CVEs in luminous v12.2.11 release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-02-07 11:04:59 +01:00
Noah Watkins
394d3d007e mgr/orch: add host, mon, mgr mgmt interfaces
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2019-02-07 10:47:41 +01:00
Neha Ojha
4378557c04
Merge pull request #25575 from ThoreKr/doc-pool-stats-master
doc: Add mention of ceph osd pool stats

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-06 15:10:11 -08:00
Lenz Grimmer
2275a41d09
Merge pull request #25918 from rjfd/wip-dashboard-nfs-backend
mgr/dashboard: NFS Ganesha management REST API

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-02-06 16:41:49 +01:00
Patrick Donnelly
35412684b6
doc: update doc on new recall config
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-05 10:08:15 -08:00
Sebastian Wagner
38c664b4b9 mgr/orchestrator: fix broken device ls
* Added `InventoryDevice.from_ceph_volume_inventory`
* Improved documentation

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-05 15:23:35 +01:00
Ilya Dryomov
1d94dcdb43
Merge pull request #26244 from idryomov/wip-krbd-alloc-size
krbd: alloc_size map option and tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-04 15:13:18 +01:00
Tatjana Dehler
6116c96989
Merge pull request #25309 from Devp00l/wip-prometheus-alerting
mgr/dashboard: Prometheus integration

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-04 11:32:41 +01:00
Pritha Srivastava
1e30e37099 rgw: Removing workaround needed to for adding payload hash to request in boto.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2019-02-04 09:28:40 +05:30
James McClune
4b077dd2e5 doc: fixed typo in add-or-rm-mons.rst
Redundant use of the word "monitor"

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-02-01 17:12:24 -05:00
Ilya Dryomov
fa32d97a9f rbd: recognize alloc_size map option
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-01 17:59:38 +01:00
Kefu Chai
5f030b0aa8
Merge pull request #25929 from falcon78921/wip-doc-37880
doc: updated rgw multitenancy link

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-01 17:21:54 +08:00
Pritha Srivastava
512b6d8bd9 rgw: Adding documentation for controlling STS auth via policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2019-02-01 11:26:29 +05:30
Abhishek Lekshmanan
7c677047a6 doc: add release notes for 12.2.11 luminous
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-31 23:32:24 +01:00
Lenz Grimmer
3b3bea991b
doc/mgr/dashboard: NFS management instruction review
Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-01-31 13:39:57 +00:00
Ricardo Dias
ae57d5d537
doc/mgr/dashboard: NFS-Ganesha configuration instructions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-01-31 11:10:10 +00:00
Stephan Müller
8451e8c595 mgr/dashboard: Add the Prometheus alerts
The backend is now capable of receiving alert notifications from
the Prometheus alertmanager and it can get all alerts with all kinds of
parameters from the API of the same.

In the frontend Prometheus alerts can be found in "Cluster > Alerts". Incoming
notifications can be seen as usual in the notifications popover.

To clarify:
Prometheus alerts are received from the alertmanager API.
Prometheus alert notification are send from the alertmanager to the
backend receiver. An alert notification can have multiple alerts, but
these alerts differ from the prometheus alerts.

To clarify that, I've added some models and services.

If one of the methods to get alerts contains changes the user will be
notified.

The documentation explains how to configure the alertmanager to use the
dashboard receiver and how to connect the use of the alertmanager API.
Further it explains where to find the alerts and what happens if they
are configured and something is happening.

Fixes: https://tracker.ceph.com/issues/36721
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-30 16:42:57 +01:00
Lenz Grimmer
d239c2a8b4
Merge pull request #25638 from ricardoasmarques/iscsi-management-w
mgr/dashboard: iSCSI management API

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-01-30 15:56:48 +01:00
Sage Weil
1a9734c970 Merge PR #26142 into master
* refs/pull/26142/head:
	doc/dev/cephx: document current implementation of cephx

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-01-30 07:06:42 -06:00
Ricardo Marques
7ebc04d696
Merge pull request #26143 from LenzGr/master-documentation
doc: Updated feature list and overview in dashboard.rst

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-30 09:49:35 +00:00
Sebastian Wagner
c5dcd0cea9
Merge pull request #25893 from sebastian-philipp/orchestrator-current-status
doc/orchestrator: Aligned Documentation with specification

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-01-30 09:48:11 +01:00
Neha Ojha
023b5f6a21
Merge pull request #25737 from arthurhsliu/patch-1
doc: fix typo in erasure coding example

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 16:11:26 -08:00
Sage Weil
141c305c12 doc/dev/cephx: document current implementation of cephx
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-29 12:28:36 -06:00
Sebastian Wagner
cfc0141db1 doc/orchestrator: Aligned Documentaiton with specification
Also: add current implementation status
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-01-29 15:51:16 +01:00
David Zafman
3e6ff119e2
Merge pull request #25112 from dzafman/wip-scrub-warning
scrub warning check incorrectly uses mon scrub interval

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-28 10:46:18 -08:00
Yehuda Sadeh
a4e3959663
Merge pull request #25137 from yehudasa/wip-archive-zone-3
rgw: archive zone

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-28 09:05:23 -08:00
Kefu Chai
fa6a69288c
Merge pull request #26099 from jdurgin/wip-remove-ms-async-affinity
common/options: remove unused ms async affinity options

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-27 21:41:10 +08:00