Commit Graph

5061 Commits

Author SHA1 Message Date
Mykola Golub
ad9fc49776
Merge pull request #23896 from Songweibin/wip-group-snap-rollback
rbd: add group snap rollback method

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-13 19:35:10 +03:00
Jason Dillaman
900e30d1bb doc/rbd: update mirroring to include new peer secret config-key actions
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-13 09:58:34 -04:00
Jason Dillaman
5e768d5d18 mon: added bootstrap-rbd-mirror/rbd-mirror mon profiles
The rbd-mirror daemon will require permission to read config-keys
from the "rbd/mirror/" prefix. These new profiles (and the new
associated bootstrap-rbd-mirror user) provide the required
permissions.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-13 09:58:34 -04:00
Casey Bodley
39f8375aee
Merge pull request #23660 from falcon78921/wip-multisite-docs
doc: updated multisite documentation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-09-13 08:53:59 -04:00
李丙洋 10208981
da96cc919c doc: Fix Spelling Error in Developer Guide
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-13 09:17:46 +08:00
Patrick Donnelly
29f159fdec
Merge PR #24052 into master
* refs/pull/24052/head:
	doc: update mds stat output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-09-12 09:14:28 -07:00
songweibin
dec2ea83cf tools/rbd: support group snap rollback CLI
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-09-12 23:42:15 +08:00
Lenz Grimmer
e03d228ab0
Merge pull request #24030 from LenzGr/mgr-dashboard-documentation
doc: Updated Mgr Dashboard documentation

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-12 16:01:29 +02:00
Jos Collin
1485e86a2c
doc: update mds stat output
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-09-12 10:27:22 +05:30
Patrick Donnelly
e78115ef3b
Merge PR #23728 into master
* refs/pull/23728/head:
	doc: suppored features of kernel client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-11 10:44:04 -07:00
Patrick Donnelly
c4c788db31
Merge PR #23824 into master
* refs/pull/23824/head:
	doc/cephfs: add notes on application best practices

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-11 10:14:20 -07:00
John Spray
0551d0e14b
Merge pull request #23497 from noahdesu/insights
mgr/insights: insights reporting module

Reviewed-by: John Spray <john.spray@redhat.com>
2018-09-11 15:56:10 +01:00
John Spray
34e82cb436
Merge pull request #23464 from wido/influx-optimize
mgr/influx: Use Queue to store points which need to be written

Reviewed-by: John Spray <john.spray@redhat.com>
2018-09-11 15:16:12 +01:00
Lenz Grimmer
44be910c30 doc: Updated Mgr Dashboard documentation
Fixed a typo, added a note about the embedding of Grafana dashboards
still being WIP.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-09-11 15:43:46 +02:00
Yan, Zheng
f7ace59e53 doc: suppored features of kernel client
Fixes: http://tracker.ceph.com/issues/27209
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-09-11 21:40:20 +08:00
Kefu Chai
510d9e1345
Merge pull request #23723 from xiexingguo/wip-list-missing
osd/PrimaryLogPG: rename list_missing -> list_unfound command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-11 20:25:21 +08:00
Lenz Grimmer
4c61c67fa5 doc: Updated Mgr Dashboard feature description, added references
Reworded the description of the user/role management feature, clarified
that it can be configured on both the CLI and the WebUI. Added labels for
referencing the user/role management and SSL configuration sections.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-09-11 14:12:04 +02:00
李丙洋 10208981
53feb4ad4e doc: Fix Spelling Error of Radosgw
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-11 15:30:20 +08:00
John Spray
8279d8713e doc/cephfs: add notes on application best practices
Signed-off-by: John Spray <john.spray@redhat.com>
2018-09-10 15:53:42 +01:00
Sage Weil
3a34c9ee38 Merge PR #23965 into master
* refs/pull/23965/head:
	doc/dev/msgr2: better formatting
	doc/dev/msgr2: clarify padding alignment
	doc/dev/msgr2: tweak message flow handshake
	doc/dev/msgr2: remove stream concept, streamline auth

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-09-10 09:23:32 -05:00
Kefu Chai
69d81c55ce
Merge pull request #23833 from falcon78921/wip-docs-34539
doc/rados: fixed hit set type link

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-10 15:13:20 +08:00
James McClune
f38426a766 doc: fixed hit set type link
Fixed reference link for hit set type value. Restructured wording in description.
Fixes: https://tracker.ceph.com/issues/34539

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-09-09 21:41:08 -04:00
李丙洋 10208981
bf56495b98 doc: Fix Spelling Error of Radosgw
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-10 09:21:31 +08:00
Sage Weil
5eba9ba074 doc/rados/operations/placement-groups: a few minor corrections
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:42 -05:00
Sage Weil
856a01fcfc doc/man/8/ceph: drop enumeration of pg states
This is more maintainable.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:42 -05:00
Sage Weil
5ff6bbf63d doc/dev/placement-groups: drop old 'splitting' reference
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:05 -05:00
Sage Weil
968917bc54 doc/rados/operations/placement-groups: update to describe pg_num reductions too
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:05 -05:00
Sage Weil
513239274e doc/rados/operations: remove reference to lpgs
These were removed years ago.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:05 -05:00
Sage Weil
bbf952125e osd: notify mon when pending PGs are ready to merge
When a PG is in the pending merge state it is >= pg_num_pending and <
pg_num.  When this happens quiesce IO, peer, wait for activate to commit,
and then notify the mon that we are idle and safe to merge.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:08:40 -05:00
Sage Weil
b2240bce41 doc/dev/msgr2: better formatting
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 11:01:33 -05:00
Sage Weil
b24e187b5a doc/dev/msgr2: clarify padding alignment
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 11:01:24 -05:00
Brad Hubbard
b6fdcfc7e3 doc/releases/schedule: Add Luminous 12.2.8
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-09-07 10:01:43 +10:00
Sage Weil
5eb0620f12 doc/dev/msgr2: tweak message flow handshake
- specify entity_name_t in TAG_IDENT instead of every msg
header
- add more notes
- include optional padding before the data segment for a msg

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-06 17:30:25 -05:00
Sage Weil
4b50277666 doc/dev/msgr2: remove stream concept, streamline auth
- Remove stream concept.  it was incompletely/poorly
specified, and we dno't actually want to implement it now. We
can do it later now that we have a banner that advertises
features more clearly.

- Simplify the auth messages a bit: make a MORE message that
isn't a request (or reply), and a final DONE.  DONE comes from
the server, not the client.  Drop the SET_METHOD which can be
rolled into the REQUEST message.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-06 14:29:42 -05:00
Ruben Kerkhof
d05cd1a3e6 doc: remove deprecated 'scrubq' from ceph(8)
The option was removed in a30cbe9ade

Fixes: http://tracker.ceph.com/issues/35813

Signed-off-by: Ruben Kerkhof <ruben@rubenkerkhof.com>
2018-09-06 16:24:16 +02:00
huanwen ren
821b6b486c
Merge pull request #23836 from sepia-liu/wip-cephfuse-doc
doc/cephfs: fixup add/remove mds docs
2018-09-06 18:50:57 +08:00
Xie Xingguo
7a8ed0fe2c
Merge pull request #23948 from libingyang-zte/master
doc: Fix Spelling Error of Radosgw

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-06 12:10:20 +08:00
xie xingguo
85ba2f0a82 osd/PrimaryLogPG: s/list_missing/list_unfound/
Also:
- Do not print **offset** until specified
- Count missing objects correctly (used to be primary's local missing)

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-06 09:52:20 +08:00
Xie Xingguo
42a518317a
Merge pull request #23926 from Gangbiao/lgb-devel
doc: Document correction

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-06 09:30:25 +08:00
李丙洋 10208981
b91d54976f doc: Fix Spelling Error of Radosgw
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-06 08:43:11 +08:00
Patrick Donnelly
a68a827cec
Merge PR #23907 into master
* refs/pull/23907/head:
	doc: Fix Spelling Error of Cephfs Shell

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-09-05 09:41:23 -07:00
Sage Weil
f8d728620f
Merge pull request #23909 from theanalyst/doc/releases/12.2.8
doc: release notes for 12.2.8 luminous
2018-09-05 10:43:26 -05:00
Abhishek Lekshmanan
5b5dbe257b doc: release notes for 12.2.8 luminous
- Add a special note for upgrades from earlier releases
- Add a notable section mentioning the scrub and rgw options

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-09-05 16:38:45 +02:00
Gangbiao Liu
8baf1a219d doc: Document correction
"doc/ceph-volume/lvm/prepare.rst":  Remove duplicated words
    "doc/radosgw/cloud-sync-module.rst": Remove duplicated words

Signed-off-by: Gangbiao Liu <liugangbiao@cmss.chinamobile.com>
2018-09-05 11:05:18 +08:00
Gangbiao Liu
c7f579ad44 doc: Fix Spelling Error In File "ceph.rst" and "rbd.rst"
Signed-off-by: Gangbiao Liu <liugangbiao@cmss.chinamobile.com>
2018-09-05 01:51:27 +08:00
李丙洋 10208981
1b82e61379 doc: Fix Spelling Error of Cephfs Shell
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-04 17:22:17 +08:00
李丙洋 10208981
6ee66cc857 doc: Fix Spelling Error of Rados Operations
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-04 14:01:55 +08:00
李丙洋 10208981
97d1b83dea doc: Fix Spelling Error of Rados Operations
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-04 09:17:28 +08:00
liu wei
a77ca3357c doc/cephfs: fixup add/remove mds docs
Signed-off-by: liu wei <liu.wei8196@zte.com.cn>
2018-09-03 23:13:59 +08:00
李丙洋 10208981
ba7604bdb4 doc: Fix Spelling Error of Rados Operations
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-09-03 09:57:44 +08:00
David Wahler
ebac6e16b9 doc: add note about LVM volumes to ceph-deploy quick start
This commit also fixes some incorrect indentation that was causing
previous steps in the same section to be incorrectly numbered.

Signed-off-by: David Wahler <dwahler@gmail.com>
2018-09-02 10:43:07 -05:00
Sage Weil
487cfabc4f radosgw-admin: remove -a --auth-uid arg
It was already a no-op.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 15:54:58 -05:00
Sage Weil
b700f0fbfd rgw: remove auid member from RGWUserInfo
Unused.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 15:54:58 -05:00
Sage Weil
5df1a2ee9e auth: remove auid member from EntityAuth
Note that for the keyring we still accept (but ignore) auid lines so that
we can parse old keyrings that have them.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 15:54:58 -05:00
Sage Weil
3ebdd47737 doc/dev/cephx_protocol: drop auid reference
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 15:54:58 -05:00
Sage Weil
b83b4d5874 mon/OSDMonitor: remove 'osd pool {get,set} <name> auid ...'
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 15:54:58 -05:00
Sage Weil
1cbca88f83 pybind/rados: drop auid arg to pool_create
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 09:27:36 -05:00
Sage Weil
2c26fb0fe1 rados: drop mkpool, rmpool commands
- mkpool and rmpool users should use the normal cli/mon commands

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 09:27:36 -05:00
Sage Weil
d6def8ba11 ceph-authtool: remove auid options
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 09:26:19 -05:00
Andrew Schoen
8a72f812d5
Merge pull request #23785 from alfredodeza/wip-rm34309
ceph-volume:  update batch documentation to explain filestore strategies

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-08-30 09:14:36 -05:00
Sage Weil
84335576b7 Merge PR #23611 into master
* refs/pull/23611/head:
	mgr/devicehealth: fix exceptions
	doc/mgr/devicehealth: update docs
	mgr/devicehealth: leave health monitoring off by default
	mgr/devicehealth: add 'device monitoring {on,off}' commands
	mgr/devicehealth: 10m wakeup interval is sufficient
	mgr/devicehealth: scrape at scrape_interval intervals
	mgr/devicehealth: UTC everywhere
	mgr/devicehealth: fix sleep_interval configurable
2018-08-30 08:52:39 -05:00
Sage Weil
df71738d79 doc/mgr/devicehealth: update docs
- several new commands weren't documented

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-29 12:30:24 -05:00
Alfredo Deza
28bbcb2baf doc/rados update invalid bash on bluestore migration
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-29 07:26:11 -07:00
Alfredo Deza
f8db9faf98 doc/man/ceph-volume uncomment flags that are now fully supported in batch
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-28 13:34:25 -07:00
Alfredo Deza
188f4ae80f doc/ceph-volume add filestore docs for batch
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-28 13:32:19 -07:00
Alfredo Deza
02652343c8 doc/ceph-volume uncomment section of newly supported batch operations
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-28 13:22:20 -07:00
Jason Dillaman
1b090ca41e
Merge pull request #23765 from chenzhua/master
doc: fix spelling errors in rbd doc

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-08-28 13:02:52 -04:00
Kai Wagner
d7f5c281c8 doc: fixed typo in cephfs snapshots
Signed-off-by: Kai Wagner <kwagner@suse.com>
2018-08-28 08:56:47 +02:00
Chen Zhenghua
f2d1f94322 doc: fix spelling errors in rbd doc
Signed-off-by: Chen Zhenghua <chen.zhenghua@zte.com.cn>
2018-08-28 14:56:16 +08:00
Chen Zhenghua
4108ecdb2c doc: fix cephfs spelling errors
Signed-off-by: Chen Zhenghua <chen.zhenghua@zte.com.cn>
2018-08-28 09:49:36 +08:00
Sage Weil
d08f65e7d8
Merge pull request #23750 from tchaikov/wip-doc-cephx
doc/dev/cephx_protocol: fix couple errors

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-27 10:51:10 -04:00
Casey Bodley
3dc8654f13
Merge pull request #20526 from k0ste/newfeature
docs: radosgw: ldap-auth: fixed option name 'rgw_ldap_searchfilter'

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-27 09:26:21 -04:00
Kefu Chai
d3fcbeeba0 doc/dev/cephx_protocol: fix couple errors
there are 3 phases of authentication and authorization in cephx:

0. proto = CEPH_AUTH_UNKNOWN, for start the session,
   create auth handlers on both sides.
1. GET_AUTH_SESSION_KEY, to get authenticated, the client will
   get the session ticket at the end of this phase. the session ticket,
   is actually also a service ticket for CEPH_ENTITY_TYPE_AUTH.
2. CEPHX_GET_PRINCIPAL_SESSION_KEY, to get authorized, the client
   will get the requested, service tickets at the end of this phase.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-27 17:50:54 +08:00
Xie Xingguo
fceb3bf6ca
Merge pull request #23746 from libingyang-zte/master
doc: Fix Spelling Error of Rados Deployment/Operations

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-27 15:49:10 +08:00
libingyang
ddf43f1d7a doc: Fix Spelling Error of Rados Deployment/Operations
Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>
2018-08-27 13:59:43 +08:00
Chen Zhenghua
8fad5a5810 doc: fix spelling errors of cephfs
Signed-off-by: Chen Zhenghua <chen.zhenghua@zte.com.cn>
2018-08-27 10:56:24 +08:00
Patrick Donnelly
3aa392ca73
Merge PR #23439 into master
* refs/pull/23439/head:
	qa: whitelist cap revoke warning
	doc: document cap revoke non-responders client eviction
	test: validate client eviction for cap revoke non-responders
	mds: add counter for tracking cap non-responding clients
	mds: evict clients that do not respond to cap revoke by MDS
	mds: pass timeout argument for fetching late clients

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-25 13:04:58 -07:00
Konstantin Shalygin
4e1d3d8772 docs: radosgw: ldap-auth: fixed option name 'rgw_ldap_searchfilter'
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2018-08-25 13:04:51 +07:00
Xie Xingguo
2dc05eb3d8
Merge pull request #23705 from chenzhua/master
doc: fix typo and format issues in quick start documentation

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-25 11:19:29 +08:00
Kefu Chai
9bef451aa7
Merge pull request #23719 from bstillwell/config-doc-fixes
doc: Fixed spelling errors in configuration section

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-24 14:15:58 +08:00
Xie Xingguo
13b9758044
Merge pull request #23715 from bstillwell/bluestore-doc-fixes
doc: Spelling fixes in BlueStore config reference

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-24 08:35:23 +08:00
James McClune
aa0c435173 doc: updated multisite docs
Fixed a minor typo in Requirements and Assumptions section.
Added an important note about running a single Ceph storage cluster for
multiple geographic locations.

Fixes: http://tracker.ceph.com/issues/26997

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-23 19:52:08 -04:00
James McClune
bb02216196 doc: used ref label for multisite link
Used the multisite ref label to link the Multi-Site page.
There's no federated config page in the latest docs.
The federated config page seems a little redundant. The multisite page's content
is very similar to the federated config. The multisite page also reflects best practices
when running radosgw's across geographic locations.

Fixes: http://tracker.ceph.com/issues/26997

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-23 19:52:08 -04:00
James McClune
b80485fba4 doc: added ref label for multisite page
Fixes: http://tracker.ceph.com/issues/26997

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-23 19:52:07 -04:00
Bryan Stillwell
2e98517d36 doc: Fixed spelling errors in configuration section
Correct a number of spelling mistakes and word omissions in the cluster
configuration section of the docs.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-23 16:17:08 -06:00
Bryan Stillwell
41ae1d2ecd doc: Spelling fixes in BlueStore config reference
Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-23 15:05:05 -06:00
Chen Zhenghua
1598787c40 doc: fix typo and format issues in quick start documentation
Signed-off-by: Chen Zhenghua <chen.zhenghua@zte.com.cn>
2018-08-23 17:24:07 +08:00
Brad Hubbard
0cc706b573 doc/releases: Mark Jewel EOL
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-08-23 08:45:22 +10:00
Kefu Chai
a68120e884 doc/rados/operations: add balancer.rst to TOC
this helps user to find the balancer feature, and
also addresses the FTBFS of doc like

Warning, treated as error:
/home/jenkins-build/build/workspace/ceph-pr-docs/doc/rados/operations/balancer.rst:document
isn't included in any toctree

this doc was moved from doc/mgr/balancer.rst to
doc/rados/operations/balancer.rst in
a78d600e6b368255096d6f0bbee8e53553307118

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-22 16:08:02 +08:00
Noah Watkins
b693af6b49 doc: clarify use of insights health pruning
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-21 16:48:19 -07:00
Kefu Chai
f7d452e8d1
Merge pull request #23558 from liewegas/wip-mgr-always-on
mgr: keep status, balancer always on
2018-08-22 00:18:30 +08:00
Kefu Chai
cfdaae642e
Merge pull request #23582 from badone/wip-remove-upstart
Remove upstart files and references

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-21 20:17:39 +08:00
Wido den Hollander
25e7d31331
mgr/influx: Use Queue to store points which need to be written
This allows us to multiplex data being send to Influx as we have
a configurable amount of workers sending data to Influx.

The main bottleneck for the performance seems to be fetching all
the perf counters using this code:

    self.get_all_perf_counters()

On a larger cluster, for example 2000 OSDs this can take about 20s
where flushing to Influx only takes 5s.

A 2000 OSD cluster generates about 100k data points on every run,
prior to using a Queue these would all be send to Influx in series
in that took over 15 seconds to complete.

Python Six is being used in the code to make sure it's compatible
with both Python 2 and 3.

Signed-off-by: Wido den Hollander <wido@42on.com>
2018-08-21 14:06:46 +02:00
Venky Shankar
28a52d6fa1 doc: document cap revoke non-responders client eviction
Fixes: http://tracker.ceph.com/issues/25188
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-08-21 01:58:55 -04:00
Patrick Donnelly
84fa8ad720
Merge PR #23543 into master
* refs/pull/23543/head:
	tools/cephfs: make cephfs-data-scan prints the max used ino

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-20 15:11:17 -07:00
Brad Hubbard
2c755cef69 Remove upstart files and references
Nautilus is not supported on any distros still running upstart so these
are redundant.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-08-20 12:59:34 +10:00
Sage Weil
a78d600e6b doc: move mgr/balancer to rados/operations/balancer
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-18 09:25:50 -05:00
Sage Weil
4573c7453a Merge PR #23616 into master
* refs/pull/23616/head:
	doc/releases/schedule: note Jewel EOL date

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-18 09:11:48 -05:00
James McClune
9ee2d6b04c
doc: updated infernalis release reference link
Updated Infernalis reference link with reST label.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:37:54 -04:00
James McClune
a3a5036b10
doc: added ref label for infernalis release notes
Added reference label for Infernalis release notes.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:30:52 -04:00
James McClune
288d9713c2
doc: used reST label for ceph-deploy reference
Updated ceph-deploy man page link with ref label. Fixes
404 error. 

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:17:47 -04:00
James McClune
9fd5dc9cc2
doc: added reference label for ceph-deploy page
Added reST label for ceph-deploy page.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 22:05:20 -04:00
James McClune
d772bd3b5f
doc: updated cross referencing locations link
Updated cross referencing locations link for doc/start/documenting-ceph.rst

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-16 21:58:34 -04:00
Noah Watkins
226bfe7477 doc: add insights module documentation
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-16 15:29:46 -07:00
Nathan Cutler
cb1531dbd7 doc/releases/schedule: note Jewel EOL date
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-08-16 23:32:06 +02:00
Willem Jan Withagen
8e4b277367 doc: fix/cleanup osd disk creation
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-08-16 11:12:36 +02:00
Kefu Chai
4cf9e35cf5
Merge pull request #23564 from falcon78921/wip-docs-links-1
doc: fixed broken urls

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-15 11:46:28 +08:00
Mykola Golub
7f27f19753 rbd: CLI to migrate images
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
James McClune
aab29672e4
doc: added :ref: directive for osdmaptool
Added :ref: directive for osdmaptool utility.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-14 18:04:06 -04:00
James McClune
d1c087c93d
doc: added osdmaptool cross reference
Added osdmaptool cross reference for docs/rados/operations/control.rst.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-14 17:59:09 -04:00
Andrew Schoen
2bec876995
Merge pull request #23532 from alfredodeza/wip-rm24960
ceph-volume:  expand auto engine for single type devices on filestore

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-08-14 20:59:24 +00:00
Ricardo Marques
2a6ce09691
Merge pull request #22457 from p-na/dash-settings
mgr/dashboard: Add backend support for changing dashboard configuration settings via the REST API

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-08-14 09:27:09 +01:00
James McClune
bba0bcdc6f
doc: updated reference link for osdmaptool utility
Reference link for osdmaptool utility was broken (404 error).

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-13 23:39:46 -04:00
James McClune
f8a0e874b5
doc: updated link for submitting patches
Updated link for Submitting Patches (404 error).

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-13 23:29:41 -04:00
Gregory Farnum
2b0ceced42
Merge pull request #23519 from falcon78921/wip-doc-troubleshoot-osds
doc: cleaned up troubleshooting OSDs documentation

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-08-13 13:57:58 -07:00
Sage Weil
8f3560d4ed Merge PR #22879 into master
* refs/pull/22879/head:
	doc/rados/operations/user-management: document 'network' clause of moncap and osdcap
	mds/SessionMap: make Session::connection private
	mds/MDSAuthCaps: parse and enforce network restriction
	mds/MDSAuthCaps: pass addr to is_capable
	mds/SessionMap: track socket_addr for each Session
	osd/OSDCap: enforce network restriction
	osd/OSDCap: take addr arg to is_capable
	osd/OSDCap: parse 'network' clause in grant
	mon: adapt MonCap network checks to addrvecs
	mon/MonCap: enforce network constraint (if present)
	mon/MonCap: take addr for MonCap::is_capable
	mon/MonCap: parse 'network ...' suffix
	osd: add peer_socket_addr to Session
	mon: use addrvec for RoutedRequest and MForward
	msg/Connection: add get_peer_socket_addr()
	common/ipaddr: add network_contains() helper
	common/ipaddr: add parse_network helper
	common/ipaddr: expose netmask_ipv[46]

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-08-13 08:48:14 -05:00
Yan, Zheng
e943ff0b8f tools/cephfs: make cephfs-data-scan prints the max used ino
Fixes: http://tracker.ceph.com/issues/26925
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-13 10:37:21 +08:00
Patrick Donnelly
0b879f4401
Merge PR #23444 into master
* refs/pull/23444/head:
	cephfs-shell: avoid sys.argv modification
	tools/cephfs-shell: added support for batch file processing and to execute commands from arguments.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 18:29:34 -07:00
Sage Weil
d7596a74e1 doc/rados/operations/user-management: document 'network' clause of moncap and osdcap
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-12 17:03:20 -05:00
Patrick Donnelly
aab25e41d9
Merge PR #23513 into master
* refs/pull/23513/head:
	doc: updated contact email for Ceph pull requests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 14:49:05 -07:00
Pavani Rajula
ab70dffdb2 tools/cephfs-shell: added support for batch file processing and to execute commands from arguments.
Fixes:http://tracker.ceph.com/issues/26853
Fixes:http://tracker.ceph.com/issues/26855

Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
2018-08-12 22:08:38 +05:30
James McClune
19aa4b8445
doc: updated troubleshooting OSDs documentation
Restructured OSD event descriptions for better clarification.
Added a link to the write() system call reference.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-10 15:18:19 -04:00
Alfredo Deza
35a48728ae doc/rados update journal size defaults to 5GB
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-10 13:14:30 -04:00
Alfredo Deza
0b63a746ee
Merge pull request #23210 from alfredodeza/wip-bluestore-sizing
doc: document sizing for `block.db`

Reviewed-by: Ben England <bengland@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-10 11:15:29 -04:00
Patrick Nawracay
7340e70d7f mgr/dashboard/backend: API to manage dashboard settings
Enables to change (set/unset) values of settings of the dashboard using
the REST API.

Fixes: https://tracker.ceph.com/issues/24273

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-08-10 11:32:25 +02:00
Kefu Chai
50f7f7e32e
Merge pull request #23496 from bstillwell/crush_doc_fixes
doc: Fix a couple typos and improve diagram formatting

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-10 12:45:29 +08:00
James McClune
1b9f24a5c5
doc: cleaned up troubleshooting OSDs documentation
Fixed grammar in Troubleshooting OSDs documentation. 
Added code markup for debugging slow request commands.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-09 22:43:17 -04:00
Bryan Stillwell
791b00daa1 doc: Multiple spelling fixes
I ran a lot of the docs through aspell and found a number of spelling problems.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-09 14:51:25 -06:00
James McClune
89fc794995
doc: updated contact email for Ceph pull requests
Updated the contact email address for Ceph pull requests (per @johnwilkins' request).

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-09 14:16:49 -04:00
Bryan Stillwell
e6abe89ec6 doc: Fix a couple typos and improve diagram formatting
I found a couple misspelled words in the crush-map documentation, and also
tweaked the formatting of the CRUSH hierarchy diagram to center some of the
entries.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-09 11:00:40 -06:00
John Wilkins
309a3fdb73
Merge pull request #23431 from falcon78921/wip-doc-rados-pool
doc: fixed links in Pools section

Reviewed-by: John Wilkins <jowilkin@redhat.com>
2018-08-08 21:23:28 -07:00
Patrick Donnelly
059d21a370
Merge PR #23462 into master
* refs/pull/23462/head:
	doc: cleanup in cephfs/capabilities

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-08 09:40:21 -07:00
John Spray
7ad61cc032 doc: Rook/orchestrator doc fixes
Signed-off-by: John Spray <john.spray@redhat.com>
2018-08-07 10:13:31 -04:00
Sage Weil
cedeeadf30 Merge PR #23412 into master
* refs/pull/23412/head:
	mgr: add Orchestrator.available method + CLI
	doc: add general documentation on orchestrator
	doc: add page for Rook module
	doc: add development guide for Ceph+Rook in k8s
	script: add kubejacker script
	mgr/rook: Rook orchestrator module
	mgr/orchestrator_cli: module for calling into orchestators
	mgr: introduce `orchestrator` python interface

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-07 08:53:51 -05:00
Jos Collin
0334172770
doc: cleanup in cephfs/capabilities
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-08-07 10:00:04 +05:30
Alfredo Deza
20e556b624 doc/bluestore detail the different sizing strategies for block.db based on cluster workload
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-06 15:57:56 -04:00
Alfredo Deza
2534df34b1 doc/bluestore expand on configuration with fast and slow devices
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-06 15:57:56 -04:00
Andrew Schoen
ef6e10501a
Merge pull request #23443 from alfredodeza/wip-rm24970
ceph-volume: `lvm batch` documentation and man page updates

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-08-06 16:02:58 +00:00
John Spray
d903240eed mgr: add Orchestrator.available method + CLI
The CLI `status` method tells you what backend
is selected, and also gives the backend
an opportunity to complain if something
seems wrong with its configuration.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-08-06 16:22:30 +01:00
John Spray
2e6ac9a43d doc: add general documentation on orchestrator
Signed-off-by: John Spray <john.spray@redhat.com>
2018-08-06 16:22:30 +01:00
John Spray
1fecff0e2d doc: add page for Rook module
This is pretty sparse because users don't really
interact with the module, they interact with other
modules that use it.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-08-06 16:22:30 +01:00
John Spray
751d32c137 doc: add development guide for Ceph+Rook in k8s
Signed-off-by: John Spray <john.spray@redhat.com>
2018-08-06 16:22:30 +01:00
Sage Weil
6090545cc7 Merge PR #22433 into master
* refs/pull/22433/head:
	common/config: Add description to (near)full ratio settings

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-06 08:57:03 -05:00
Alfredo Deza
e00d9bbf53 doc/man/ceph-volume add batch information
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-06 09:43:10 -04:00
Alfredo Deza
d3bad7fa76 doc/ceph-volume include batch doc in the toc tree
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-06 08:39:46 -04:00
Alfredo Deza
f965f9db22 doc/ceph-volume decument batch reporting and bluestore support
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-06 08:25:53 -04:00
Sebastian Wagner
ba363a5cb7
Merge pull request #22735 from votdev/bug_24677
mgr/dashboard: RGW proxy can't handle self-signed SSL certificates

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-08-06 11:06:24 +02:00
Jos Collin
16922bea46
Merge pull request #23310 from joscollin/wip-fix-rbd-doc-urls
doc: fix the broken urls

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-08-06 07:10:49 +05:30
James McClune
321f390010
doc: fixed links in Pools section
Fixed broken links (404 error) in the Pools section of Ceph Storage Cluster.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-08-05 13:49:03 -04:00
Kefu Chai
f83db6e49e
Merge pull request #23423 from ctriple/master
doc/start: fix kube-helm.rst typo: docuiment -> document

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-04 23:22:09 +08:00