Commit Graph

5525 Commits

Author SHA1 Message Date
Sage Weil
bc7f567467 msg/async/ProtocolV2: refuse incoming reconnect attempt intended for someone else
The same scenario that was possible on client_ident is also possible
for reconnect: on the accepting side we recognized the client_addrs
but the client is trying to reach someone else.  Since the cookie is a
random 64-bit value it is unlikely, but still possible, that we will
match an existing session that is not for the client.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-11 11:02:28 -06:00
Sage Weil
e399fc7514 msg/async/ProtocolV2: refuse incoming connection intended for someone else
If we get a client_ident frame, and they are trying to talk to someone
else, drop the connection.

This is an inelegant workaround to http://tracker.ceph.com/issues/38247.
A nicer fix would be to restructure the protocol so that the client knows
who they connected to before they try to open a session.  That is a bigger
change that can follow...

Fixes: http://tracker.ceph.com/issues/38247
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-11 09:29:30 -06:00
Lenz Grimmer
4431d6d60f
Merge pull request #26102 from rhcs-dashboard/wip-featuretoggles
mgr/dashboard: add Feature Toggles

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-11 15:58:57 +01:00
Ernesto Puerta
ec949ab71d
doc: mgr/orch: Fix remote_host doc reference
The type fix in the remote_host to remove_host has caused a Ceph docs
build failure.

Introduced-By: 05cfa6f
Fixes: http://tracker.ceph.com/issues/38254
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:55:47 +01:00
Ernesto Puerta
ae8e288769
doc: mgr/dashboard: feature-toggles: Fix config
Add '*.inc.rst' to the list of excluded patterns from sphinx-build. This
allows for using '*.inc.rst' as includes, and avoids duplicates. The
benefit of keeping the trailing '.rst' extension is that most IDEs use
that to render reStructured Text files.

Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
7b06daedfc
doc: mgr/dashboard: feature-toggles: Add doc
Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Sebastian Wagner
ad7abc3995
Merge pull request #26314 from sebastian-philipp/orchestrator-host-mon-mgr
mgr/orchestrator: Add host mon mgr management to interface

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-02-11 09:52:53 +01:00
Sage Weil
33582d2290 Merge PR #26327 into master
* refs/pull/26327/head:
	doc/dev/msgr2: bring up to date with new HELLO, different RECONNECT
	msg/async/ProtocolV2: separate IDENT into {CLIENT,SERVER}_IDENT

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-02-09 08:29:18 -06:00
Patrick Donnelly
f9854b522f
Merge PR #26287 into master
* refs/pull/26287/head:
	doc: update doc on new recall config

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2019-02-08 19:38:37 -08:00
Josh Durgin
682def2e32 qa, doc: update ec fast read setting
31dd620883bc5114a476f9f37251f139b8abe326 renamed it but did not update the suites or docs

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2019-02-08 17:11:34 -05:00
Sebastian Wagner
0daae004f0
Merge pull request #26331 from tchaikov/wip-mgr-orchestrator-docstring
doc/mgr/orchestrator: Add Architecture Image

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-08 09:33:05 +01:00
Sage Weil
2e9c61de49 doc/dev/msgr2: bring up to date with new HELLO, different RECONNECT
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 17:05:10 -06:00
Sage Weil
86c99bf023 msg/async/ProtocolV2: separate IDENT into {CLIENT,SERVER}_IDENT
This is less ambiguous and easier to document since the frame payloads
are different.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 17:05:10 -06:00
Sage Weil
d3766916a7 Merge PR #26059 into master
* refs/pull/26059/head:
	mon/MonClient: fix keepalive with v2 auth
	msg/async/ProtocolV2: reject peer_addrs of -
	msg/async/ProtocolV2: clean up feature management
	mon/MonClient: set up rotating_secrets, etc before msgr ready
	msg/async: let client specify preferred order of modes
	msg/async/ProtocolV2: include entity_name, features in reconnect
	msg/async/ProtocolV2: fix write_lock usage around AckFrame
	qa/suites/rados/verify/validator/valgrind: debug refs = 5
	qa/standalone/ceph-helpers: fix health_ok test
	auth/AuthRegistry: only complain about disabling cephx if cephx was enabled
	auth/AuthRegistry: fix locking for get_supported_methods()
	auth: remove AUTH_UNKNOWN weirdness, hardcoded defaults.
	msg/async/ProtocolV2: remove unused get_auth_allowed_methods
	osd: set up messener auth_* before setting dispatcher (and going 'ready')
	mon/AuthMonitor: request max_global_id increase from peon in tick
	mon: prime MgrClient only after messengers are initialized
	qa/suites/rados/workloads/rados_api_tests.yaml: debug mgrc = 20 on mon
	auth: document Auth{Client,Server} interfaces
	auth: future-proof AUTH_MODE_* a bit in case we need to change the encoding byte
	mon/MonClient: request monmap on open instead of ping
	mgr/PyModuleRegistry: add details for MGR_MODULE_{DEPENDENCY,ERROR}
	crimson: fix build
	mon/MonClient: finsih authenticate() only after we get monmap; fix 'tell mgr'
	mon: add auth_lock to protect auth_meta manipulation
	ceph-mon: set up auth before binding
	mon: defer initial connection auth attempts until initial quorum is formed
	mon/MonClient: make MonClientPinger an AuthCleint
	ceph_test_msgr: use DummyAuth
	auth/DummyAuth: dummy auth server and client for test code
	mon/Monitor: fix leak of auth_handler if we error out
	doc/dev/cephx: re-wordwrap
	doc/dev/cephx: document nautilus change to cephx
	vstart.sh: fix --msgr2 option
	msg/async/ProtocolV2: use shared_ptr to manage auth_meta
	auth/Auth{Client,Server}: pass auth_meta in explicitly
	mon/MonClient: behave if authorizer can't be built (yet)
	osd: set_auth_server on client_messenger
	common/ceph_context: get_moduel_type() for seastar cct
	auth: make connection_secret a std::string
	auth,msg/async/ProtocolV2: negotiate connection modes
	auth/AuthRegistry: refactor handling of auth_*_requred options
	osd,mgr,mds: remove unused authorize registries
	switch monc, daemons to use new msgr2 auth frame exchange
	doc/dev/msgr2: update docs to match implementation for auth frames
	auth/AuthClientHandler: add build_initial_request hook
	msg/Messenger: attach auth_client and/or auth_server to each Messenger
	auth: introduce AuthClient and AuthServer handlers
	auth: codify AUTH_MODE_AUTHORIZER
	msg/Connection: track peer_id (id portion of entity_name_t) for msgr2
	auth/AuthAuthorizeHandler: add get_supported_methods()
	auth/AuthAuthorizeHandler: fix args for verify_authorizer()
	auth: constify bufferlist arg to AuthAuthorizer::add_challenge()
	auth/cephx: share all tickets and connection_secret in initial reply
	msg/async,auth: add AuthConnectionMeta to Protocol
	auth/AuthClientHandler: pass in session_key, connection_secret pointers
	auth/AuthServiceHandler: take session_key and connection_secret as args
	auth/cephx: pass more specific type into build_session_auth_info
	mon/Session: separate session creation, peer ident, and registration
	mon/AuthMonitor: bump max_global_id from on_active() and tick()
	mon/AuthMonitor: be more careful with max_global_id
	mon: only all ms_handle_authentication() if auth method says we're done
	mon/AuthMonitor: fix "finished with auth" condition check
	auth: clean up AuthServiceHandler::handle_request() args
	auth: clean up AuthServiceHandler::start_session()
	mon/AuthMonitor: drop unused op arg to assign_global_id()
	msg/async: separate TAG_AUTH_REQUEST_MORE and TAG_AUTH_REPLY_MORE
	msg/async: consolidate authorizer checks
	msg/async: move get_auth_allowed into ProtocolV2.cc
	mon/MonClient: trivial cleanup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-02-07 16:51:39 -06:00
Sage Weil
5e4df2a509 doc/dev/cephx: re-wordwrap
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 12:10:34 -06:00
Sage Weil
c1102f043e doc/dev/cephx: document nautilus change to cephx
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 12:10:33 -06:00
Sage Weil
c7ee66c3e5 auth,msg/async/ProtocolV2: negotiate connection modes
The modes are:

- crc: crc32c checksums to protect against bit errors.  No secrecy or
  authenticity guarantees, so a MITM could alter traffic in flight.
- secure: cryptographic secrecy and authenticity proection (i.e, encrypted
  and signed).

We do not include a 'signed' mode that provides authenticity without
secrecy because the cryptographic protocols appear to be faster than
SHA-2.

New settings:

- ms_cluster_mode  : mode(s list) for intra-cluster connections
- ms_service_mode  : mode(s list) for daemons to allow
- ms_client_mode   : mode(s list) for clients to allow

Also,

- ms_mon_cluster_mode  : mon <-> mon connections
- ms_mon_service_mode  : mon <-> daemon or client connections

The msgr2 protocol is expanded slightly to negotiate a mode.  Client
shares it's allowed/preferred modes, and server picks one as auth finishes.
Negotiation is independent of the authentication, except that the
authentiction mode may precluse certain choices. Specifically, AUTH_NONE
does not support 'secure', only 'crc'.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 12:10:33 -06:00
Sebastian Wagner
00e2a7c357 doc/mgr/orchestrator: Add Image
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-07 16:24:00 +01:00
Abhishek L
c6f171fc6c
Merge pull request #26312 from smithfarm/wip-luminous-cve
doc: mention CVEs in luminous v12.2.11 release notes

Reviewed-By: Sage Weil <sage@redhat.com>
2019-02-07 14:51:43 +01:00
Sage Weil
c1a2d1be52 doc/dev/msgr2: update docs to match implementation for auth frames
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 06:53:03 -06:00
Sage Weil
1c40968bd5 msg/async: separate TAG_AUTH_REQUEST_MORE and TAG_AUTH_REPLY_MORE
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-07 06:53:03 -06:00
Matt Benjamin
661d108064
Merge pull request #26098 from pritha-srivastava/wip-rgw-awsv4signature
rgw: Correcting logic for signature calculation for non s3 ops.
2019-02-07 07:34:46 -05:00
Matt Benjamin
56e1a9b66a
Merge pull request #24818 from pritha-srivastava/wip-rgw-sts-auth-policy
[DNM] rgw: Controlling STS authentication via a Policy
2019-02-07 07:33:29 -05:00
Laurent VOULLEMIER
0d0bb1c574 doc/radosgw: update doc with last S3 client
The documentation for the S3 PHP client usage is about an old client. This update the examples to the current S3 PHP client.

Signed-off-by: Laurent VOULLEMIER <laurent.voullemier@gmail.com>
2019-02-07 11:11:25 +01:00
Nathan Cutler
1da10a02f3 doc: mention CVEs in luminous v12.2.11 release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-02-07 11:04:59 +01:00
Noah Watkins
394d3d007e mgr/orch: add host, mon, mgr mgmt interfaces
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2019-02-07 10:47:41 +01:00
Neha Ojha
4378557c04
Merge pull request #25575 from ThoreKr/doc-pool-stats-master
doc: Add mention of ceph osd pool stats

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-06 15:10:11 -08:00
Lenz Grimmer
2275a41d09
Merge pull request #25918 from rjfd/wip-dashboard-nfs-backend
mgr/dashboard: NFS Ganesha management REST API

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-02-06 16:41:49 +01:00
Yuval Lifshitz
6b8b3bc412 rgw: pubsub fix doc issues
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-02-06 16:29:29 +02:00
Patrick Donnelly
35412684b6
doc: update doc on new recall config
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-05 10:08:15 -08:00
Sebastian Wagner
38c664b4b9 mgr/orchestrator: fix broken device ls
* Added `InventoryDevice.from_ceph_volume_inventory`
* Improved documentation

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-05 15:23:35 +01:00
Ilya Dryomov
1d94dcdb43
Merge pull request #26244 from idryomov/wip-krbd-alloc-size
krbd: alloc_size map option and tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-04 15:13:18 +01:00
Tatjana Dehler
6116c96989
Merge pull request #25309 from Devp00l/wip-prometheus-alerting
mgr/dashboard: Prometheus integration

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-04 11:32:41 +01:00
Pritha Srivastava
1e30e37099 rgw: Removing workaround needed to for adding payload hash to request in boto.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2019-02-04 09:28:40 +05:30
James McClune
4b077dd2e5 doc: fixed typo in add-or-rm-mons.rst
Redundant use of the word "monitor"

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-02-01 17:12:24 -05:00
Ilya Dryomov
fa32d97a9f rbd: recognize alloc_size map option
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-01 17:59:38 +01:00
Kefu Chai
5f030b0aa8
Merge pull request #25929 from falcon78921/wip-doc-37880
doc: updated rgw multitenancy link

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-01 17:21:54 +08:00
Pritha Srivastava
512b6d8bd9 rgw: Adding documentation for controlling STS auth via policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2019-02-01 11:26:29 +05:30
Abhishek Lekshmanan
7c677047a6 doc: add release notes for 12.2.11 luminous
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-31 23:32:24 +01:00
Lenz Grimmer
3b3bea991b
doc/mgr/dashboard: NFS management instruction review
Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-01-31 13:39:57 +00:00
Ricardo Dias
ae57d5d537
doc/mgr/dashboard: NFS-Ganesha configuration instructions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-01-31 11:10:10 +00:00
Stephan Müller
8451e8c595 mgr/dashboard: Add the Prometheus alerts
The backend is now capable of receiving alert notifications from
the Prometheus alertmanager and it can get all alerts with all kinds of
parameters from the API of the same.

In the frontend Prometheus alerts can be found in "Cluster > Alerts". Incoming
notifications can be seen as usual in the notifications popover.

To clarify:
Prometheus alerts are received from the alertmanager API.
Prometheus alert notification are send from the alertmanager to the
backend receiver. An alert notification can have multiple alerts, but
these alerts differ from the prometheus alerts.

To clarify that, I've added some models and services.

If one of the methods to get alerts contains changes the user will be
notified.

The documentation explains how to configure the alertmanager to use the
dashboard receiver and how to connect the use of the alertmanager API.
Further it explains where to find the alerts and what happens if they
are configured and something is happening.

Fixes: https://tracker.ceph.com/issues/36721
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-01-30 16:42:57 +01:00
Lenz Grimmer
d239c2a8b4
Merge pull request #25638 from ricardoasmarques/iscsi-management-w
mgr/dashboard: iSCSI management API

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-01-30 15:56:48 +01:00
Sage Weil
1a9734c970 Merge PR #26142 into master
* refs/pull/26142/head:
	doc/dev/cephx: document current implementation of cephx

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-01-30 07:06:42 -06:00
Ricardo Marques
7ebc04d696
Merge pull request #26143 from LenzGr/master-documentation
doc: Updated feature list and overview in dashboard.rst

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-30 09:49:35 +00:00
Sebastian Wagner
c5dcd0cea9
Merge pull request #25893 from sebastian-philipp/orchestrator-current-status
doc/orchestrator: Aligned Documentation with specification

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-01-30 09:48:11 +01:00
Neha Ojha
023b5f6a21
Merge pull request #25737 from arthurhsliu/patch-1
doc: fix typo in erasure coding example

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-29 16:11:26 -08:00
Sage Weil
141c305c12 doc/dev/cephx: document current implementation of cephx
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-29 12:28:36 -06:00
Sebastian Wagner
cfc0141db1 doc/orchestrator: Aligned Documentaiton with specification
Also: add current implementation status
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-01-29 15:51:16 +01:00
David Zafman
3e6ff119e2
Merge pull request #25112 from dzafman/wip-scrub-warning
scrub warning check incorrectly uses mon scrub interval

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-28 10:46:18 -08:00
Yehuda Sadeh
a4e3959663
Merge pull request #25137 from yehudasa/wip-archive-zone-3
rgw: archive zone

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-28 09:05:23 -08:00
Kefu Chai
fa6a69288c
Merge pull request #26099 from jdurgin/wip-remove-ms-async-affinity
common/options: remove unused ms async affinity options

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-27 21:41:10 +08:00
Arthur Liu
8da2291e7d doc: fix typo in erasure coding example
Signed-off-by: Arthur Liu <arthurhsliu@gmail.com>
2019-01-26 08:44:42 +11:00
Lenz Grimmer
0941f7ba10 doc: Updated feature list and overview in dashboard.rst
Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-01-25 12:34:37 +01:00
Yehuda Sadeh
a8eea5210c rgw: fixes following code review
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-24 13:42:11 -08:00
Ilya Dryomov
ae88c63d04 doc/rados/configuration: refresh osdmap section
"osd map cache size" and "osd map message max" were reduced in commit
855955e58e63 ("osd: reduce size of osdmap cache, messages").

"osd map cache bl size" and "osd map cache bl inc size" were removed
six years ago.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-01-24 21:16:30 +01:00
Ricardo Marques
b24a7afca2 mgr/dashboard: iSCSI management API
Fixes: https://tracker.ceph.com/issues/35903

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-01-24 09:24:19 +00:00
Javier M. Mellid
d0a27bfb81 rgw: Add archive sync module doc
Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2019-01-23 20:19:02 -08:00
David Zafman
6a9895b97a mon: Fix scrub health warning handling and change config to a ratio
Make this mon_warn code clearer since it involves 2 values
Code used mon scrub interval instead of pg scrub interval
Rename config values to include _pg_ and ratio to make it more clear
Fix scrub warniing handling use per-pool intervals when specified

Fixes: http://tracker.ceph.com/issues/37264

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-01-23 16:49:33 -08:00
Josh Durgin
62ac23bfdc common/options: remove unused ms async affinity options
These were never implemented. They can be added back if they are
implemented and shown to help performance.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2019-01-23 11:17:41 -05:00
Patrick Donnelly
cae0756639
Merge PR #25973 into master
* refs/pull/25973/head:
	qa: use simpler fs fail to bring fs down
	MDSMonitor: add fs fail command

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2019-01-19 17:18:08 -08:00
Kefu Chai
011dd30934
Merge pull request #25972 from noahdesu/doc-release-ver-sort
doc: sort releases by date and version

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-01-18 22:52:50 +08:00
Sebastian Wagner
ad20b27034
Merge pull request #25912 from sebastian-philipp/orchestrator-drive-group
mgr/orchestrator: Extend DriveGroupSpec
2019-01-18 14:59:48 +01:00
Sebastian Wagner
33e6f39b2f mgr/orchestrator: Extend DriveGroupSpec
Also: Added tox.

Co-authored-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-01-18 13:30:14 +01:00
Sage Weil
b5e5ee6f40 Merge PR #25849 into master
* refs/pull/25849/head:
	qa/suites/rados/upgrade: one mon per node, and enable-msgr2 at end
	qa/rados/thrash-old-clients: avoid msgr2
	mon: make bootstrap rank check more robust
	mon: clean up probe debug output a bit
	msg/async: use v1 for v1 <-> [v2,v1] peers
	msg/async/AsyncMessenger: drop single-use _send_to
	mon/HealthMonitor: raise MON_MSGR2_NOT_ENABLED if mons not bound to msgr2
	doc/rados/operations/health-checks: document MON_* health warnings
	mon/MonMapMonitor: add 'mon enable-msgr2' command
	mon: respawn if rank addr changes
	mon/MonMap: calc_addr_mons() after setting rank addrvec

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-01-17 11:04:30 -06:00
Patrick Donnelly
f8da35cc5b
Merge PR #25975 into master
* refs/pull/25975/head:
	doc: complete documentation for ceph fs administration commands

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-16 10:17:50 -08:00
Patrick Donnelly
5be993d36c
doc: complete documentation for ceph fs administration commands
Fixes: http://tracker.ceph.com/issues/24580

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-16 06:42:08 -08:00
Patrick Donnelly
4c49f165ec
MDSMonitor: add fs fail command
This command sets the fs as not joinable and fails all ranks. This is a simpler
command than the typical sequence: (a) set fs not joinable; (b) iterate through
and fail ranks. It also does this in a single FSMap update.

Fixes: http://tracker.ceph.com/issues/37085

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-15 14:22:48 -08:00
Noah Watkins
adc08c1f99 doc: sort releases by date and version
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2019-01-15 13:15:29 -08:00
Nathan Cutler
0a46fb0f45 doc: add mimic 13.2.3 and 13.2.4 to releases chart
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-01-15 18:40:16 +01:00
Sage Weil
6ba8db68cd mon/HealthMonitor: raise MON_MSGR2_NOT_ENABLED if mons not bound to msgr2
If the ms_bind_msgr2 option is enabled, and all mons are nautilus,
raise a health alert if any mons aren't bound to msgr2 addresses.

Whitelist tests that mon_bind_addrvec=false or mon_bind_msgr2=false.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-15 10:42:29 -06:00
Sage Weil
57c4795c00 doc/rados/operations/health-checks: document MON_* health warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-15 10:42:29 -06:00
James McClune
c44d31167a doc: fixed typo in CRUSH map docs
Fixes: https://tracker.ceph.com/issues/24924
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-01-14 22:16:20 -05:00
Jason Dillaman
0d18c2864d
Merge pull request #24446 from vico-research-and-consulting/master
common: fix for broken rbdmap parameter parsing

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-14 15:42:57 -05:00
Patrick Donnelly
a2b05b8334
Merge PR #25633 into master
* refs/pull/25633/head:
	mgr/rook: allow service describe and service ls to display nfs services
	mgr/rook: add support for adding NFS gateways
	mgr/orchestrator_cli: add support for adding NFS gateways
	mgr/orchestrator_cli: convert service add/rm commands to be type-specific
	mgr/rook: add decorator for add_stateless_service
	mgr/rook: add a context manager instead of open-coding exception handling

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-01-14 11:32:01 -08:00
Marc Schoechlin
fca5ef8aba common: fix for broken rbdmap parameter parsing
This improves the broken parameter parsing discussed in #36327

Test expression for the parsing function:

PARAMS="options='lock_on_read,queue_depth=1024',id=archiv,keyring=/etc/ceph/ceph.client.archiv.keyring"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS="id=archiv,keyring=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024'"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS=""
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS=",keyring=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024',id=archiv,"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS="'keyring'=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024',id=archiv,"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS="--keyring=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024',id=archiv, # a comment"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

Fixes: https://tracker.ceph.com/issues/36327
Signed-off-by: Marc Schoechlin <ms@256bit.org]>
2019-01-14 14:29:59 -05:00
Lenz Grimmer
3623aed68c
Merge pull request #25943 from rhcs-dashboard/update-sso-doc
mgr/dashboard: updated SSO documentation

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-01-14 15:11:18 +01:00
alfonsomthd
2ac3dc17c5 mgr/dashboard: updated SSO documentation
Added info about SAML request issuer value.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-01-14 14:24:56 +01:00
Jeff Layton
ca972cefbd mgr/orchestrator_cli: add support for adding NFS gateways
Add necessary commands to orchestrator_cli to allow it to deploy a
cluster of NFS servers. Note that we have to be able to specify the pool
and an optional namespace for the recovery backend objects.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-01-14 07:11:41 -05:00
Jeff Layton
d07effa132 mgr/orchestrator_cli: convert service add/rm commands to be type-specific
When adding services, we often need different sets of arguments
depending on the service type. Convert the "service add" and "service
rm" commands into separate commands for each service type.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-01-14 07:11:36 -05:00
Abhishek L
f9374b92fb
Merge pull request #23729 from daikk115/master
docs: Fixed swift client authentication fail

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-14 11:00:27 +01:00
Sage Weil
94620be57c Merge PR #25273 into master
* refs/pull/25273/head:
	doc/rados/operations/health-checks: Add LARGE_OMAP_OBJECTS

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-12 05:56:41 -06:00
Ilya Dryomov
fce08ffbab
Merge pull request #25662 from yangdongsheng/abort_on_full
rbd: introduce abort_on_full option for rbd map

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2019-01-12 10:29:56 +01:00
Dongsheng Yang
5639a8b187 rbd: introduce abort_on_full option for rbd map
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2019-01-12 03:42:15 -05:00
James McClune
5ce968eee8 doc: updated rgw multitenancy link
Fixes include:

- Adding :ref: label to rgw multitenancy page
(http://docs.ceph.com/docs/master/radosgw/multitenancy/)
- Updating Multitenancy link for reference
(http://docs.ceph.com/docs/master/radosgw/adminops/#id9)

Fixes: https://tracker.ceph.com/issues/37880
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-01-11 22:15:01 -05:00
Brad Hubbard
522a21ec62 doc/rados/operations/health-checks: Add LARGE_OMAP_OBJECTS
Document LARGE_OMAP_OBJECTS health check

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-01-12 12:16:47 +10:00
Neha Ojha
3659a8c5f6 doc/rados/configuration: add osd scrub {begin,end} week day
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-01-11 12:55:51 -08:00
Casey Bodley
8338de3ee4
Merge pull request #25892 from theanalyst/doc-rgw-usage-fix
doc: rgw: fix the default value of usage log setting

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-01-10 09:37:18 -05:00
Abhishek Lekshmanan
b21c96ec69 doc: rgw: fix the default value of usage log setting
Fixes: http://tracker.ceph.com/issues/37856
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-10 11:13:33 +01:00
Sebastian Wagner
9bb8e2dd20
Merge pull request #25634 from sebastian-philipp/doc-orchestrator-wal
doc/mgr/orchestrator: add `wal` to blink lights

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-01-09 14:39:37 +01:00
Patrick Donnelly
4e4db26c9c
Merge PR #24556 into master
* refs/pull/24556/head:
	tools/cephfs: make 'cephfs-data-scan scan_links' update snaptable
	tools/cephfs: make 'cephfs-data-scan scan_links' update inotable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-08 15:10:28 -08:00
Sage Weil
86d74e9ad7 Merge PR #25818 into master
* refs/pull/25818/head:
	mon: adjust mon sync, extra_probe_peers to use addrvec

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-08 14:15:28 -06:00
Sage Weil
3d34c4ebd2 mon: adjust mon sync, extra_probe_peers to use addrvec
The peer addr stuff via asok is a bit fragile because the user must
provide an exact addrvec matching the mon to avoid some weirdness, but
it's rarely used, and the fix would be some robustness/tolerance in the
messenger that is a bigger project than this.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-08 13:08:31 -06:00
Matt Benjamin
87a1baa8a6
Merge pull request #24714 from pritha-srivastava/wip-rgw-role-doc
rgw: Adding documentation for Roles.
2019-01-08 09:11:26 -05:00
Sage Weil
9badd953f4 doc/dev/msgr2: checksum frame header (tag + length)
Ensure we catch transport errors early (before we, say, try to allocate
a missized payload buffer).

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-07 15:01:21 -06:00
Yan, Zheng
01089652d3 tools/cephfs: make 'cephfs-data-scan scan_links' update inotable
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-01-07 16:49:31 +08:00
Kefu Chai
33a72c1537
Merge pull request #25797 from falcon78921/wip-doc-37793
doc: updated Ceph documentation links

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-07 15:29:08 +08:00
James McClune
7ff2f215a3 doc: updated Ceph documentation links
Fixes include:

- Updating Doxygen link for reference (http://docs.ceph.com/docs/master/dev/documenting/)
- Adding :ref: label for User Management page (http://docs.ceph.com/docs/master/rados/operations/user-management/)
- Update User Management link for reference (http://docs.ceph.com/docs/master/rbd/rbd-snapshot/)

Fixes: https://tracker.ceph.com/issues/37793
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-01-04 16:32:21 -05:00
Sage Weil
6d0f4a6bc0 doc/releases/mimic: v13.2.4
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-04 14:01:11 -06:00
Sage Weil
251f667ef8 Merge PR #25009 into master
* refs/pull/25009/head:
	librbd: stringify locker name with get_legacy_str()
	osdc/Objecter: fix list_watchers addr rendering to match legacy
	test/crimson: disable unittest_seastar_messenger test
	msg/msg_types: encode entity_addr_t TYPE_ANY as TYPE_LEGACY for pre-nautilus
	client: make blacklist detection handle TYPE_ANY entries
	mon/OSDMonitor: maintain compat output for 'blacklist ls'
	client: maintain compat for {inst,addr}_str in status dump
	qa/tasks/ceph_manager: compare osd flush seq #'s as ints
	qa/suites/fs: make use of simple.yaml where appropriate
	qa/msgr: move msgr factet into generic re-usable dir
	crimson: fix monmap build for seastar
	doc/start/ceph.conf: trim the sample ceph.conf file
	doc/rados/operations: only describe --public-{addr,network} method for adding mons
	PendingReleaseNotes: deprecate 'mon addr'
	doc: fix some 'mon addr' references
	doc/rados/configuration: fix some 'mon addr' references
	doc/rados/configuration/network-config-ref: revise network docs somewhat
	doc/rados/configuration/network-config-ref: remove totally obsolete section
	qa/suites/rados: replace mon_seesaw.py task with a small bash script
	qa/suites/fs/upgrade: don't bind to v2 addrs
	qa/tasks/mon_thrash: avoid 'mon addr' in mon section
	mon/MonClient: disable ms_bind_msgr2 if NAUTILUS feature not set
	osd/OSDMap: maintain compat addr fields
	msg/msg_types: add get_legacy_str()
	mds/MDSMap.h: maintain compat addr field
	mon/MgrMap: maintain compat active_addr field
	mon/MonClient: reconnect to mon if it's addrvec appears to have changed
	qa/tasks/ceph.conf.template: increase mon_mgr_mkfs_grace
	msg/async/ProtocolV2: fill in IP for all peer_addrs
	msg/async: print all addrs on debug lines
	mon/MonMap: no noname- mon name prefix when for_mkfs
	ceph-monstore-tool: print initial monmap
	msg/async/ProtocolV2: advertise ourselves as a v2 addr when using v2 protocol
	msg/async: assert existing protocol matches current protocol
	msg/async: add missing modelines
	mon/MonMap: add missing modeline
	vstart.sh: put mon addrs in mon_host, not 'mon addr'
	msg/async: better debug around conn map lookups and updates
	mon/MonClient: dump initial monmap at debug level 10
	qa/standalone/osd/osd-fast-mark-down: use v1 addr w/ simplemessenger
	qa/tasks/ceph: set initial monmap features with using addrvec addrs
	monmaptool: add --enable-all-features option
	qa/tasks/ceph: only use monmaptool --addv if addr has [,:v]
	qa/tasks/ceph_manager: make get_mon_status use mon addr
	qa/tasks/ceph: keep mon addrs in ctx namespace
	mon/OSDMonitor: log all osd addrs on boot
	msg/simple: behave when v2 and v1 addrs are present at target
	mon/MonClient: warn if global_id changes
	msg/Connection: add warning/note on get_peer_global_id
	mds/MDSDaemon: clean up handle_mds_map debug output a bit
	qa/suites/rados/upgrade: debug mds
	mds/MDSRank: improve is_stale_message to handle addrvecs
	msg/async: make loopback detect when sending to one of our many addrs
	qa/suites/rados/upgrade: no aggressive pg num changes
	mon/OSDMonitor: require nautilus mons for require_osd_release=nautilus
	mon/OSDMonitor: require mimic mons for require_osd_release=mimic
	qa/suites/rados/thrash-old-clients: use legacy addr syntax in ceph.conf
	msg/async: preserve peer features when replacing a connection
	qa/tasks/ceph.py: move methods from teuthology.git into ceph.py directly; support mon bind * options
	mon/MonMap: adjust build_initial behavior for mkfs vs probe
	mon/MonMap: improve ambiguous addr behavior
	qa/suites/rados/upgrade: spread mons a bit
	qa/rados/thrash-old-clients: keep mons on separate hosts
	qa/standalone/mon/misc.sh: tweak test to be more robust
	qa/tasks/mon_seesaw: expect v1/v2 prefix in addr
	osd/OSDMap: fix is_blacklisted() check to assume type ANY
	mon/OSDMonitor: use ANY addr type for blacklisting
	mon/msg_types: TYPE_V1ORV2 -> TYPE_ANY
	qa/workunits/cephtool: fix blacklist test
	qa/suites/upgrade: install old version with only v1 addrs
	common/options: by default, bind to both msgr v1 and v2 addresses
	vstart.sh: add --msgr1, --msgr2, --msgr21 options
	msg/async/ProtocolV2: be flexible with server identity check
	msg/msg_types: fix entity_addrvec_t::parse() with null end arg
	qa/suites/rados/basic/msgr: no msgr2 addrs in initial monmaps
	qa/tasks/ceph: add 'mon_bind_addrvec' and 'mon_bind_msgr2' options
	monmaptool: add --addv argument to pass in addrvec directly
	qa/suites/rados/basic/msgr: do not use msgr2 with simplemessenger
	qa/suites/rados/basic/msgr: async is not experimental
	messages/MOSDBoot: fix compat with pre-nautilus
	mon/MonMap: allow v1 or v2 to be explicitly specified along with part
	msg/msg_types: allow parsing of IPs without assuming v1 vs v2
	msg/msg_types: default parse to v2 addrs
	msg: standarize on v1: and v2: prefixes for *all* entity_addr_t's
	vstart.sh: use msgr2 by default
	mon/MonMap: remove get_addr() methods
	ceph-mon: adjust startup/bind/join sequence to use addrs
	mon: use MonMap::get_addrs() (instead of get_addr())
	mon/MonClient: change pending_cons to addrvec-based map
	mon/MonMap: fix set_addr() caller, kill wrapper
	mon/MonMap: remove addr-based add()
	monmaptool: fix --add to do either legacy or msgr2+legacy
	monmaptool: clean up iterator use a bit
	mon/MonMap: handle ambiguous mon addrs by trying both legacy and msgr
	mon/MonMap: take addrvec for set_initial_members
	mon/MonMap: use addrvecs for test instances
	mon: pass addrvec via MMonJoin
	mon/MonmapMonitor: fix 'mon add' to populate addrvec
	mon/MonMap: addr -> addrvec
	msg/async/ProtocolV2: only update socket_addr if we learned our addr
	osd: go active even if mon only accepted our v1 addr
	test/msgr: add test for msgr2 protocol
	msg/async/ProtocolV2: share socket_addr and all addrs during handshake
	msg/async: print socket_addr for the connection
	msg/async: msgr2 protocol placeholder
	msg/async: move ProtocolV1 class to its own source file
	msg/async: keep listen addr in ServerSocket, pass to new connections
	msg/async/AsyncMessenger: fix set_addr_unknowns

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-04 13:42:09 -06:00
Sage Weil
d7ff96e615 Merge PR #25637 into master
* refs/pull/25637/head:
	doc: release notes for 13.2.3 mimic

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2019-01-04 08:25:25 -06:00
Sage Weil
a6b3f53abd Merge PR #25455 into master
* refs/pull/25455/head:
	mgr/diskprediction Document guide add predictor accuracy

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-04 08:17:38 -06:00
Patrick Donnelly
ee7d253494
Merge PR #24635 into master
* refs/pull/24635/head:
	test: add scrub control command tests
	mds: scrub abort/pause/resume/status control commands
	test: switch using "scrub start" tell interface to initiate scrub
	mds: introduce "scrub start" tell interface to initiate scrub
	mds: dump scrub formatted output when context completion
	mds: generate random scrub tag when empty
	mds: introduce C_ExecAndReply context completion class
	mds: use CInode::scrub_is_in_progress() wherever required

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-01-03 10:15:31 -08:00
Sage Weil
b4e292ca9a doc/start/ceph.conf: trim the sample ceph.conf file
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Sage Weil
cdcb05765f doc/rados/operations: only describe --public-{addr,network} method for adding mons
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Sage Weil
8e2fcae16e doc: fix some 'mon addr' references
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Sage Weil
1675cd5096 doc/rados/configuration: fix some 'mon addr' references
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Sage Weil
369dadea44 doc/rados/configuration/network-config-ref: revise network docs somewhat
These still could use a larger rewrite, but this is a bit better.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Sage Weil
bef7c62fe8 doc/rados/configuration/network-config-ref: remove totally obsolete section
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Greg Farnum
71a8605762 doc: warn about how 'rados put' works in the manpage
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2019-01-02 15:00:25 -08:00
Gregory Farnum
8e3da9b2d8
Merge pull request #25705 from joscollin/wip-doc-common
doc: Fix Create a Cluster url in Running Multiple Clusters

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-01-02 14:21:28 -08:00
Venky Shankar
1eb33745a8 test: switch using "scrub start" tell interface to initiate scrub
... and fixup doc too.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-01-02 08:51:00 -05:00
James McClune
6f3100b816 doc: cleanup HTTP Frontends documentation
Added literal block to /etc/ceph/ceph.conf example.

Fixes: https://tracker.ceph.com/issues/37770
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-12-29 12:40:50 -05:00
hsiang41
06c40e4b4c mgr/diskprediction Document guide add predictor accuracy
Add local/cloud predictor accuracy value

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-12-28 17:43:07 +08:00
Jos Collin
a0b3562b24
doc: Fixed double spaces
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-12-26 11:24:48 +05:30
Jos Collin
c1ddc49b2d
doc: Fixed Create a Cluster url
Fixes: http://tracker.ceph.com/issues/37764
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-12-26 11:24:11 +05:30
Jason Dillaman
ce13562a74
Merge pull request #25636 from trociny/wip-prometheus-rbd-ns
pybind/mgr/prometheus: rbd stats namespace support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-22 10:25:32 -05:00
Kefu Chai
28b91c5305
Merge pull request #25661 from joscollin/wip-doc-changing-monitors
doc: fix typo in add-or-rm-mons

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-21 14:46:48 +08:00
Jos Collin
6dba3865c9
doc: fix typo in add-or-rm-mons
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-12-21 10:47:04 +05:30
Jason Dillaman
c84cc4a542
Merge pull request #25655 from gregsfortytwo/wip-rbd-snap-doc
doc: Clean up the snapshot consistency note

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-20 18:07:36 -05:00
Greg Farnum
505025c641 doc: Clean up the snapshot consistency note
The old note made it sound like we weren't crash-consistent, and had a
confusing section about needing to clone before mounting.
You *do* need to clone the snapshot before mounting it, but that has
nothing to do fs freezing or consistency.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2018-12-20 10:33:38 -08:00
Sebastian Wagner
3ab4f8f92a doc/mgr/orchestrator: add wal to blink lights
Also added: "The output of `osd create` is not specified
  any may vary between orchestrator backends."

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-20 15:44:26 +01:00
Mykola Golub
19d63aca40 doc/mgr/prometheus: document rbd stats options
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-20 08:38:54 +00:00
Sage Weil
9f3cf00b79 Merge PR #25360 into master
* refs/pull/25360/head:
	qa/workunits/mon/pg_autoscaler: clean up pools afterwards
	qa/suites/rados/singletone/all/pg-autoscaler: whitelist health warnings
	qa/tasks/ceph: wait for splits/merges before final scrub
	mon/OSDMonitor: be tidy with target_size_ratio and pre-nautilus code
	mgr/pg_autoscaler: simplify conditions
	qa/suites/rados: add simple pg-autoscaler test
	qa/workunits/cephtool/test.sh: pg_autoscale_mode=off while testing pg_num etc
	doc/rados/operations: document autoscaler and its health warnings
	mgr/pg_autoscaler: add pg autoscaler module
	pybind/mgr/mgr_util: move format_ helpers out of status module
	mon/OSDMonitor: accept optional target_size_{bytes,ratio} to 'osd pool create'
	mon/OSDMonitor: remove max_split_count configurable
	osd/osd_types: pool_opts_t: int -> int64_t
	osd/osd_types: pool_opts: fix whitespace
	osd/osd_types: pool_opts_t: make encoding feature-dependent
	mgr/devicehealth: pg_num_min 1 for device_health_metrics pool
	mon/OSDMonitor: accept optional pg_num_min to 'osd pool create'
	mon/OSDMonitor: apply osd_pool_default_pg_autoscale_mode to new pools
	pybind/mgr/mgr_module: some accessors
	mon/MgrMonitor: enable progress module by default
	osd/osd_types: add pool pg_autoscale_mode, pg_num_min, target_size_{bytes,ratio} properties
	osdc/Objecter: revise get_latest_version locking
	os/memstore: ignore OP_COLL_SET_BITS
	qa: generalise REQUIRE_MEMSTORE
	mgr: drop GIL in get_config
	mon: add 'size' arg to `osd pool create`
	mon: use pg_num_target for checks during creation
	mgr: revise locking in getter paths
	common/options: add `mon_target_pg_per_osd`
	mgr: expose OSDMap.pool_raw_used_rate

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-12-19 21:22:35 -06:00
Yehuda Sadeh
b6b2e7f71a
Merge pull request #25056 from fghaas/doc-rgw-openstack
doc: Improve OpenStack integration and multitenancy docs for radosgw

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Kai Wagner <kwagner@suse.com>
Reviewed-by: Maxime Guyot <maxime@root314.com>
2018-12-19 12:28:55 -08:00
Nathan Cutler
fe854ac172 doc: release notes for 13.2.3 mimic
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-12-19 18:00:34 +01:00
Florian Haas
d730820a48 Improve OpenStack integration and multitenancy docs for radosgw
Add explanatory information on:

* "rgw swift account in url" (including the Swift account in the Swift
  API url and Keystone endpoint)
* "rgw swift versioning enabled" (enabling Swift object versioning)
* "rgw s3 auth use keystone" (enabling S3 authentication against
  Keystone)
* "rgw keystone implicit tenants" (multi-tenancy via Keystone, including
  its implications for the Swift and S3 APIs)

Fixes: http://tracker.ceph.com/issues/36765
Signed-off-by: Florian Haas <florian@citynetwork.eu>
2018-12-19 17:46:56 +01:00
Thore Kruess
3b636ff69f doc: Add mention of ceph osd pool stats
Neither  "Show Pool Statistics" nor the suggested options from `ceph osd pool` mention this command.

Signed-off-by: Thore Kruess <thore@kruess.xyz>
2018-12-19 04:54:44 +01:00
Sage Weil
f490fd0130 doc/rados/operations: document autoscaler and its health warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-18 13:30:54 -06:00
Sage Weil
81160bc202 Merge PR #25190 into master
* refs/pull/25190/head:
	mgr/prometheus: adjust to new 'df' fields
	mon/Monitor: fix newline between df section
	doc: update docs for new ceph df output
	mon/PGMap: break down RAW usage by device class
	mon/PGMap: tweak df headers
	mon/PGMap: GLOBAL -> RAW STORAGE in 'df' output
	mon/PGMap: dump_fs_stats -> dump_cluster_stats

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-18 10:47:52 -06:00
Matt Benjamin
2e43a43345
Merge pull request #23298 from yehudasa/wip-rgw-ps-3
rgw: pub-sub
2018-12-14 12:52:39 -05:00
Brad Hubbard
e4e7f3ea6a doc/user-management: Remove obsolete reset caps command
This command has not worked since hammer and makes no sense in an
environment where we do not allow empty caps

Fixes: http://tracker.ceph.com/issues/37663

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-12-14 15:22:15 +10:00
Sage Weil
ce7fed1788 Merge PR #25478 into master
* refs/pull/25478/head:
	README.md: Add note about default do_cmake.sh debug builds.
	doc/install: Add note about default do_cmake.sh debug builds.
	do_cmake: Warn user about slow debug performance by default.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-13 04:12:43 -06:00
Sage Weil
74594b1798 Merge PR #25402 into master
* refs/pull/25402/head:
	pybind/mgr: rename get_option -> get_ceph_option
	pybind/mgr: add get_ceph_option to standby module interface
	ceph.spec.in: add xmlsec1 dependency for dashboard make check
	mgr: rename internal ceph_set_config -> ceph_set_module_option
	pybind/mgr: set_config -> set_module_option
	pybind/mgr: get_config -> get_module_option
	mgr: rename internal get_config -> get_module_option
	pybind/mgr: OPTIONS -> MODULE_OPTIONS

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2018-12-12 14:00:52 -06:00
Mark Nelson
51e2d4c481 doc/install: Add note about default do_cmake.sh debug builds.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2018-12-12 12:09:57 -06:00
Kefu Chai
86646df14b
Merge pull request #25467 from rrmichel/patch-3
doc: Fixed syntax in iscsi initiator windows doc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-11 23:00:31 +08:00
Lenz Grimmer
0bf7fb1dad doc: Added some hints on how to further accelerate builds with ccache
Fixed incorrect note directives and added a section about how to speed
up development/scratch builds with ccache.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-12-11 12:54:54 +01:00
Sage Weil
3432636b8a pybind/mgr: rename get_option -> get_ceph_option
Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-11 03:54:52 -06:00
Yehuda Sadeh
9a64d3bac7 doc: rgw pubsub fixes
following review

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-12-11 01:00:22 -08:00
Yehuda Sadeh
a931e1b020 rgw: pubsub: fix docs
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-12-11 01:00:22 -08:00
Yehuda Sadeh
6b7b023350 docs/rgw: document pubsub
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-12-11 00:10:43 -08:00
Alfredo Deza
1ceef08d07
Merge pull request #25429 from alfredodeza/wip-bz1644847
ceph-volume zap devices associated with an OSD ID and/or OSD FSID

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Reviewed-by: Sebastien Han <shan@redhat.com>
2018-12-10 12:27:37 -05:00
Sebastian Wagner
8d459de570
Merge pull request #25391 from SUSE/wip-orchestrator-deepsea-cleanup
mgr/deepsea: check for inflight completions when starting event reader, cleanup logging and comments

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-10 16:04:56 +01:00
Michel
b911670816
doc: Fixed syntax in iscsi initiator windows docu
Added a empty line which as its need for the correct syntax.

Signed-off-by: Michel Raabe <raabe@b1-systems.de>
2018-12-10 12:24:44 +01:00
Sage Weil
ae2e2eaeb7 doc: update docs for new ceph df output
Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-10 01:11:57 -06:00
Mehdi Abaakouk
2d7ed8ad15 doc: fix typo in mgr ssl setup
Unlike `config set`, `config-key set` does not take the <who>
argument.

This change removes it from mgr ssl setup.

Signed-off-by: Mehdi Abaakouk <sileht@sileht.net>
2018-12-08 15:11:35 +01:00
Jos Collin
6672ffef2b
Merge pull request #25312 from falcon78921/wip-doc-37451
doc: broken link on troubleshooting-mon page

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-12-08 11:12:50 +05:30
James McClune
ca05e45696 doc: broken link on troubleshooting-mon page
Fixes: https://tracker.ceph.com/issues/37451

This fix involves adding :ref: labels to the add-or-rm-mons.rst
page. I also added :ref: labels for other headings within
add-or-rm-mons.rst (for future reference).

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-12-07 23:15:43 -05:00
Alfredo Deza
acbf7c9b2a doc/man/ceph-volume add zapping by osd-id examples
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-12-07 12:30:27 -05:00
Alfredo Deza
f82304f4b5 doc/ceph-volume add zapping by osd-id examples
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-12-07 12:30:27 -05:00
Igor Fedotov
242ba0cacf pybind/diskprediction: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
71fe9149ac mgr: rename ceph df stat columns for both influx and prometheus.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Sage Weil
59d0844c12 Merge PR #23550 into master
* refs/pull/23550/head:
	auth: Kerberos authentication
2018-12-05 13:42:17 -06:00
Kefu Chai
d80000fcf0
Merge pull request #25262 from aclamk/wip-kvstore-tool-dump
ceph-kvstore-tool: dump fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-06 00:13:00 +08:00
Tim Serong
0c9dd842d3 mgr/deepsea: mention DeepSea 0.9.9 in docs, cleanup logging & comments
Signed-off-by: Tim Serong <tserong@suse.com>
2018-12-05 16:37:44 +11:00
Jason Dillaman
c80882919c
Merge pull request #25192 from ProgVal/doc-rbd-features
rbd: Document new RBD feature flags and version support

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-04 09:47:15 -05:00
Adam Kupczyk
b2a8751bf3 bluestore/tools: Add option 'dump' to ceph-kvstore-tool to print both key and values.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2018-12-04 09:19:26 +01:00
oliveiradan
67784065ce auth: Kerberos authentication
Signed-off-by: Daniel Oliveira <doliveira@suse.com> (github: oliveiradan)
2018-12-03 18:55:46 -07:00
Brad Hubbard
84f25f598d
Merge pull request #25361 from badone/wip-add-luminous-12.2.9-and-10
doc/releases: Add luminous releases 12.2.9 and 10

Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2018-12-04 09:16:52 +10:00
Valentin Lorentz
cffa33b80a doc/rbd: Document new RBD feature flags and librbd/krbd version support
Sources:

layering:

* f87c441f68
* krbd: 770eba6e29

striping:

* 2e403ef2c9
* krbd: 770eba6e29

exclusive-lock:

* fa96bb4db4
* krbd: ed95b21a4b

object-map:

* 7e751ce912

fast-diff:

* 16ad44cebc

deep-flatten:

* b556d3173a

journaling:

* 750771c6ff
* not a default: https://github.com/ceph/ceph/blob/1a14963/src/test/cli/rbd/help.t#L229

data-pool:

* c5f2290047
* description: https://tracker.ceph.com/issues/17409
* krbd: 7e97332ea9

operations:

* 209f6fc5a4
* description: e573427a44
* krbd: e573427a44

migrating:

* 2f7c4ae3fc

Signed-off-by: Valentin Lorentz <progval+git@progval.net>
2018-12-03 22:33:40 +01:00
Brad Hubbard
c12deb79fd doc/releases: Add luminous releases 12.2.9 and 10
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-12-01 10:36:55 +10:00
Juan Miguel Olmo Martínez
526cdcdf01
mgr/ansible: Ansible orchestrator module
A Ceph Manager Orchestrator that uses a external REST API service to execute Ansible playbooks.

get_inventory implementation

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>

Document how to use CLI through Orchestrator CLI

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2018-11-29 14:54:43 +01:00
Sage Weil
cdcc5b4521 Merge PR #24502 into master
* refs/pull/24502/head:
	crushtool: implement --rebuild-class-roots command
	crushtool: make --reweight re-sum choose_args weight-sets too
	crushtool: --reweight should only reweight nonshadow roots
	crush/CrushWrapper: reclassify: use default parent for created buckets
	crush/CrushWrapper: reclassify: handle to-be-created buckets that we need twice
	test/cli/crushtool/reclassify: add second gabe test case
	crushtool: add --set-subtree-class; do not set class via --reclassify-root
	test/cli/crushtool/reclassify: add reclassify test cases
	doc/rados/operations/crush*: document reclassify
	doc/rados/operations/crush: remove instructions for separate crush trees for ssd
	crushtool: add --compare command
	crushtool: implement --reclassify
	crush/CrushCompiler: fix id scan to include class ids

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-27 21:32:04 -06:00
Sage Weil
7a80f993f4 crushtool: add --set-subtree-class; do not set class via --reclassify-root
Sometimes we don't want the --reclassify-root to set the class of every
device because a small number of them are (correctly) a different class.
Allow both behaviors by adding a new, separate command to set the class
of all devices beneath a point in the hierarchy and do not implicitly do
that relabeling as part of --reclassify-root.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
505050befd doc/rados/operations/crush*: document reclassify
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Abhishek L
eda51771f2
Merge pull request #25034 from smithfarm/wip-luminous-notes-12.2.10
doc: Luminous v12.2.10 release notes

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Yuri Weinstein <yweinstein@redhat.com>
2018-11-27 13:46:58 +01:00
Jason Dillaman
f664422ff1
Merge pull request #25202 from trociny/wip-doc-rbd-qos
doc: describe RBD QoS settings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
2018-11-22 10:50:54 -05:00
Jan Fajerski
ed05b163e7
Merge pull request #25182 from jan--f/mgr-prometheus-doc-mention-instance-label
doc/mgr/prometheus: readd section about custom instance labels
2018-11-22 14:29:43 +01:00
Sebastian Wagner
a7f1a24f8e
Merge pull request #25119 from sebastian-philipp/doc-orchestrator-cli-spec
doc/orchestrator: Integrate CLI specification into the documentation

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-11-22 13:59:34 +01:00
Neha Ojha
c87e657f4e
Merge pull request #24452 from noahdesu/doc-edit-report
doc: edit on github

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-21 11:48:07 -08:00
Sebastian Wagner
26a7236ab5 doc/orchestrator: Integrate CLI specification into the documentation
Also: Make it clear that the orchestrator is WIP

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-11-21 18:23:51 +01:00
Mykola Golub
d04114c4a8 doc: describe RBD QoS settings
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-21 15:25:17 +02:00
Tim Serong
ec2567e289 mgr/deepsea: DeepSea orchestrator module
This module provides integration between Ceph's orchestrator framework
and DeepSea, a Ceph deployment and management system built upon Salt.

Included so far are implementations of get_inventory() and
describe_service().  This allows `ceph orchestrator device ls`, `ceph
orchestrator service ls` and `ceph orchestrator service status` to
operate correctly.

To test, try:

  # ceph mgr module enable orchestrator_cli
  # ceph mgr module enable deepsea
  # ceph orchestrator set backend deepsea
  # ceph deepsea config-set salt_api_url <salt api url>
  # ceph deepsea config-set salt_api_username <salt api username>
  # ceph deepsea config-set salt_api_password <salt api shared secret>
  # ceph orchestrator device ls
  # ceph orchestrator service ls

Signed-off-by: Tim Serong <tserong@suse.com>
2018-11-21 22:50:55 +11:00
Nathan Cutler
1cbe710509 doc: Luminous v12.2.10 release notes
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-11-21 09:54:18 +01:00
Robin H. Johnson
e63e210679
Merge pull request #22599 from anthonyeleven/patch-2
doc: Tidy up description wording and spelling
2018-11-20 09:44:04 -08:00
Sage Weil
f3c27670c0 Merge PR #24737 into master
* refs/pull/24737/head:
	doc/ceph-bluestore-tool: add help for migrate and new DB/WAL commands.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-20 09:50:04 -06:00
Jan Fajerski
92494c969f doc/mgr/prometheus: readd section about custom instance labels
This section was removed accidentally by
331a826a9f7433812dc5ed789ac7652e00aaaa71. It offers a helpful configuration
variant to deal with mgr failovers.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-20 12:43:12 +01:00
Patrick Donnelly
a8937d987c
Merge PR #25158 into master
* refs/pull/25158/head:
	[doc] Fix typo in luminious release notes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-19 14:17:14 -08:00
Neha Ojha
7ac345044e
Merge pull request #25069 from markhpc/wip-memory-autotune-doc
doc/rados: Add bluestore memory autotuning docs.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-19 22:16:43 +05:30
Maxime
ddadf083ee [doc] Fix typo in luminious release notes
Signed-off-by: Maxime <maxime@root314.com>
2018-11-19 16:36:04 +01:00
Sebastian Wagner
b6a58491ee
Merge pull request #24863 from jtlayton/wip-orchestrator
mgr/orchestrator: Add support for "ceph orchestrator service ls"

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2018-11-19 14:55:30 +01:00
Nathan Cutler
dddf8ded32
Merge pull request #24779 from smithfarm/wip-luminous-release-notes
doc: Luminous v12.2.9 release notes

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2018-11-19 12:50:57 +01:00
Alfredo Deza
9c832fdb37
Merge pull request #25092 from jan--f/c-v-inventory-doc
doc: add ceph-volume inventory sections

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-16 07:52:57 -05:00
Jan Fajerski
dfc0e1d9a6 doc: add ceph-volume inventory sections
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 08:35:56 +01:00
Sage Weil
13d1f62538 Merge PR #24973 into master
* refs/pull/24973/head:
	mgr: Separate diskprediction cloud plugin from the diskprediction plugin
2018-11-16 00:23:14 -06:00
hsiang41
9799eb67eb mgr: Separate diskprediction cloud plugin from the diskprediction plugin
Separate diskprediction local cloud from the diskprediction plugin.
Devicehealth invoke device prediction function related on the global
configuration "device_failure_prediction_mode".

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-16 00:15:41 -06:00
Jeff Layton
a516905591 orchestrator: merge the ServiceLocation class into ServiceDescription
The ServiceDescription object just holds a list of ServiceLocation
objects.  Eliminate ServiceLocation and merge it into the
ServiceDescription class. Have describe_service return a list of
ServiceDescriptions.

Suggested-by: Tim Serong <tserong@suse.com>
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 09:02:54 -05:00
Jeff Layton
f396fa1d7f orchestrator_cli: add an orchestrator service ls function
There's currently no way to enumerate the services that the
orchestrator backend knows about. Add a "service ls" command
that will list them with some basic info, subject to filters
given on the command line.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 07:27:51 -05:00
Kefu Chai
01409a542c
Merge pull request #25060 from mooncak/fix_typos
doc: Fix some typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:29:39 +08:00
Kefu Chai
052b0f4614
Merge pull request #24999 from MrStupnikov/master-docfix-1358
doc: Put command template into literal block

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:14:03 +08:00
Neha Ojha
d46a472915
Merge pull request #24979 from neha-ojha/wip-upgrade-bug
doc/releases/mimic.rst: make note of 13.2.2 upgrade bug

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-14 20:51:55 -08:00
Scoots Hamilton
eec2310e9d doc: Fixed the paragraph and boxes.
Signed-off-by: Scoots Hamilton <scoots@redhat.com>
2018-11-14 10:27:48 -05:00
mooncake
67a44af1a5 doc: Fix some typos
Signed-off-by: mooncake <xcoder@tenxcloud.com>
2018-11-14 19:49:13 +08:00
Neha Ojha
970184cc57 doc/releases/mimic.rst: make note of 13.2.2 upgrade bug
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-11-13 15:29:42 -08:00
Mark Nelson
9e2d1a52ab doc/rados: Add bluestore memory autotuning docs.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2018-11-13 13:19:24 -06:00
Sage Weil
d578d4af1b doc/governance: reference the new Ceph Foundation
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-12 01:32:45 -06:00
Sage Weil
2b38ce9a36 doc/governance: update CLT membership
- Neha is the new RADOS lead, but Josh is sticking around on the CLT
- John is leaving Red Hat and the Ceph project (we will miss him!)
- alphabetize

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-10 10:28:47 -06:00
Nathan Cutler
6fb4132235 doc: Luminous v12.2.9 release notes
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-11-10 14:46:29 +01:00
Sebastian Wagner
e0eb2dbd98 doc/governance: Add Sebastian to CLT
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-11-10 11:59:46 +01:00
Sage Weil
8f3d7a6d56 Merge PR #24925 into master
* refs/pull/24925/head:
	Avoid import _strptime failed
	Avoid exception if remote plugin not enabled
	Separate diskprediction local plugin from the diskprediction plugin

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-09 08:37:10 -06:00
Lenz Grimmer
3ba874004e
Merge pull request #24489 from ricardoasmarques/wip-saml2
mgr/dashboard: SSO - SAML 2.0 support

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-09 13:11:22 +01:00
Alexey Stupnikov
bff5a2122f doc: put command template into literal block
``ceph-deploy osd create --data {device} {ceph-node}`` command
is not displayed properly because of missing double colons.

Signed-off-by: Alexey Stupnikov <aleksey.stupnikov@gmail.com>
2018-11-09 10:48:40 +01:00
Mykola Golub
06ac1a63f1
Merge pull request #24963 from dillaman/wip-ceph-iscsi
doc: tweak RBD iSCSI docs to point to merged tooling repo

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-11-09 09:45:43 +02:00
Anthony D'Atri
7f05626e0d doc: Tidy up description wording and spelling
doc: Tidied up cloud sync module description paragraph wording and spelling.
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2018-11-08 13:35:04 -08:00
Sage Weil
5552971a8b Merge PR #24995 into master
* refs/pull/24995/head:
	doc: use 'proxy' cache mode in "Removing a Writeback Cache" procedure

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-08 12:59:51 -06:00
Kefu Chai
0966f43d98
Merge pull request #24896 from tchaikov/wip-librados-cleanup
librados,rpm,deb: various fixes to address librados3 transition and cleanups in librados

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-08 10:19:57 -08:00
Mykola Golub
ab880ee6ba doc: use 'proxy' cache mode in "Removing a Writeback Cache" procedure
The 'forward' mode is flawed as it allows the reordering of requests.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-08 19:23:12 +02:00
Ricardo Marques
04f4d5053e mgr/dashboard: SAML 2.0 support
Fixes: https://tracker.ceph.com/issues/24268

Signed-off-by: Ricardo Dias <rdias@suse.com>
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-11-08 15:27:37 +00:00
Casey Bodley
b97e471022
Merge pull request #24816 from linuxbox2/wip-rgw-keystone-secret
rgw: move keystone secrets from ceph.conf to files

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:47:37 -05:00
Casey Bodley
f40b6dba9b
Merge pull request #24887 from cbodley/wip-36662
rgw: beast frontend parses ipv6 addrs

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-08 09:45:59 -05:00
Ilya Dryomov
fa65651f90
Merge pull request #24966 from daixiang0/correct-rbytes-description
doc: correct rbytes description

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2018-11-08 14:12:44 +01:00
Xiang Dai
0c2c3e0316 doc: correct rbytes description
The default was changed from on to off in 4.6 because the way rbytes behaves can be surprising and sometimes confuses tools like rsync.

Signed-off-by: Xiang Dai <764524258@qq.com>
2018-11-08 17:56:47 +08:00
Kefu Chai
05c150bfb2
Merge pull request #24964 from Songweibin/wip-doc-rados
doc/rados: correct osd path in troubleshooting-mon.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-07 21:22:33 -08:00
Kefu Chai
0e5bdd9d56 librados: remove rados_tmap_*
we have switched from tmap to omap long ago.

but keep the server side implementation around, in case ancient
client is still using these tmap APIs.

also, tmap_update() is kept, because librbd is using it for v1 image
backward compatibility.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
Matt Benjamin
59db1dc303
Merge pull request #24847 from pritha-srivastava/wip-rgw-assume-role-doc
rgw: Improvements to STS Lite documentation.
2018-11-07 10:39:12 -05:00
songweibin
1965088130 doc/rados: correct osd path in troubleshooting-mon.rst
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-11-07 15:05:41 +08:00
Jason Dillaman
232baf83e3 doc: tweak RBD iSCSI docs to point to merged tooling repo
Also remove all references to the ceph-client test kernel since v4.16 has been
released.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-11-06 18:06:36 -05:00
Matt Benjamin
e636a56c50 rgw: move keystone secrets from ceph.conf to files
Permits setting restrictive permissions on these secrets.

Fixes: http://tracker.ceph.com/issues/36621

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2018-11-05 16:49:06 -05:00
Volker Theile
22e07ff1a4 mgr/dashboard: Audit REST API calls
Fixes: https://tracker.ceph.com/issues/36193

Enable API auditing with 'ceph dashboard set-audit-api-enabled true' (default is false). If you do not want to log the request payload, then disable it via 'set-audit-api-log-payload false' (default is true).

Example output:
2018-10-08 10:25:21.850994 mgr.x [INF] [DASHBOARD] from='https://[::1]:44410' path='/api/auth' method='POST' user='None' params='{"username": "admin", "password": "***", "stay_signed_in": false}'

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-11-05 10:56:28 +01:00
hsiang41
5581577c83 Separate diskprediction local plugin from the diskprediction plugin
Separate diskprediction local plugin from the diskprediction plugin.
Devicehealth invoke device prediction function related on the global
 configuration "device_failure_prediction_mode".

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-05 14:09:10 +08:00
Jason Dillaman
8931f8cd14
Merge pull request #23190 from maxcuttins/master
doc: rewrote the iscsi-target-cli installation

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-11-03 08:48:30 -04:00
Massimiliano Cuttini
6df20fafa8 doc: rewrote the iscsi-target-cli installation
Rewrote the documentation in a step-by-step style, reformatted using RST's
titles instead of bolds, added installation of GIT if needed, added
installation of compilers needed for tcmu-runner

Signed-off-by: Massimiliano Cuttini <massimiliano.cuttini@phoenixweb.it>
2018-11-02 17:52:01 -04:00
Neha Ojha
de30c4d3c5 doc/_templates/page.html: add link to report doc bugs
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-11-02 14:49:15 -07:00
Noah Watkins
bb887b78f8 doc: show edit on github links and version warnings
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2018-11-02 14:49:15 -07:00
Kefu Chai
a7bb772e11
Merge pull request #24616 from tchaikov/wip-wip-librados-3
librados: split C++ and C APIs into different source files

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-11-02 10:44:04 +08:00
Josh Durgin
1d832401f4
Merge pull request #24868 from liewegas/wip-doc-fix
doc/rados/operations/crush-map-edits: fix 'take' syntax

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-01 14:52:24 -07:00
Casey Bodley
a3b4124fd2 rgw: beast frontend parses ipv6 addrs
Fixes: http://tracker.ceph.com/issues/36662

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-01 16:24:37 -04:00
Casey Bodley
9836ee2643 rgw: beast frontend uses default port 443 for ssl_endpoint
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-01 16:24:37 -04:00
Kefu Chai
8c6ec85f43 doc: s/librados2/librados3/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Remy Zandwijk
ce8f531789 doc/rados/operations/crush-map-edits: fix 'take' syntax
Fixes: https://tracker.ceph.com/issues/21496
Signed-off-by: Remy Zandwijk <remy@luckyhands.nl>
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-31 15:42:27 -05:00
Matt Benjamin
1a9f304d2b
Merge pull request #20794 from ghost/wip-nfs-doc-err
doc: replace rgw_namespace_expire_secs with rgw_nfs_namespace_expire_secs
2018-10-31 14:30:02 -04:00
Jeff Layton
942d4dedc1 orchestrator/rook: allow describe_service to report mgr containers
This label seems to be present in the rook version I've been working
with, so let's wire it in.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-10-31 13:37:34 -04:00
Pritha Srivastava
d0acc30173 rgw: Fixes to STS Lite documentation.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2018-10-31 11:22:40 +05:30
Sage Weil
860ad1f61c Merge PR #19142 into master
* refs/pull/19142/head:
	doc/dev/kernel-client-troubleshooting: Add kernel dynamic debuggin

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2018-10-30 17:18:06 -05:00
Sage Weil
c71e993343 Merge PR #19146 into master
* refs/pull/19146/head:
	doc/dev/logs: Removes non-existence file path

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-30 17:17:36 -05:00
Sage Weil
96dd773d13 Merge PR #24755 into master
* refs/pull/24755/head:
	mgr/diskprediction: use global device_failure_prediction_mode setting

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-30 10:20:02 -05:00
Gregory Farnum
636d05e31a
Merge pull request #13925 from nvedant07/bug_fix_1
osdmaptool/cleanup: Completed osdmaptool's usage
2018-10-29 15:16:29 -07:00
Gregory Farnum
888a07fadc
Merge pull request #24791 from falcon78921/wip-docs-demodocs
doc: added demo document changes section

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-10-29 13:45:48 -07:00
Sage Weil
1c081dde77 mgr/diskprediction: use global device_failure_prediction_mode setting
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-29 08:44:17 -05:00
James McClune
3b63679472
doc: fixed minor grammar error
Changed buchket to bucket

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-10-28 02:02:59 -04:00
James McClune
b8317f5e1e
doc: added demo document changes section
Added a brief section about how to demo Ceph documentation
changes. 

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-10-28 01:44:17 -04:00
Kefu Chai
53e1daf177
Merge pull request #24785 from falcon78921/wip-docs-36605
doc: purge subcommand link broken

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-27 13:07:21 +08:00
James McClune
8d41cfd093 doc: used ceph osd command ref label
Referenced purge subcommand info via ceph osd command label.
Fixes: https://tracker.ceph.com/issues/36605

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-10-26 23:32:06 -04:00
Patrick Donnelly
6da295f3cb
Merge PR #24585 into master
* refs/pull/24585/head:
	doc: add developer documentation on new cephfs reclaim interfaces

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-10-26 16:28:43 -07:00
Wido den Hollander
a17177044e
doc: Update mgr/zabbix plugin documentation with link to Zabbix template
Signed-off-by: Wido den Hollander <wido@42on.com>
2018-10-26 13:45:02 +02:00
Jason Dillaman
f2db4bc881
Merge pull request #24720 from gauravsitlani/master
doc: added rbd default features

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-10-25 16:56:05 -04:00
Jeff Layton
2152b9b28a doc: add developer documentation on new cephfs reclaim interfaces
Tracker: http://tracker.ceph.com/issues/36395
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-10-25 15:50:16 -04:00
Gaurav Sitlani
5ea5263d13
doc: added rbd default features
Fixes: https://tracker.ceph.com/issues/15000
Added RBD default features description

Signed-off-by: Gaurav Sitlani <gauravsitlani@riseup.net>
2018-10-26 01:12:31 +05:30
Casey Bodley
86323971a2
Merge pull request #24700 from cbodley/wip-27221
rgw: support server-side encryption when SSL is terminated in a proxy

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-10-25 13:11:37 -04:00
Alfredo Deza
1dddce58f4
Merge pull request #24587 from ceph/wip-rm36363
ceph-volume: adds a --prepare flag to `lvm batch`

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-10-25 11:15:53 -04:00