Commit Graph

1180 Commits

Author SHA1 Message Date
Sage Weil
81fc73b24e Merge PR #32788 into master
* refs/pull/32788/head:
	qa/tasks/mgr/dashboard: set pg_num to 32
	mgr/pg_autoscaler: default to pg_num[_min] = 32

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-24 08:32:13 -06:00
Neha Ojha
f205d38c2c
Merge pull request #32373 from zdover23/wip-doc-pg-formats-update-dec-2019
doc: update list of formats for --format flag for "ceph pg dump"

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-22 19:10:00 -08:00
Neha
2451b93d10 doc/rados/configuration: document osd_max_pg_log_entries
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-22 19:21:59 +00:00
Neha
75b4707ca9 doc/rados: update osd_min_pg_log_entries
update docs to match 0db140c15c

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-22 19:15:11 +00:00
Neha
0c7991c0e8 mgr/pg_autoscaler: default to pg_num[_min] = 32
78bf924480 increased the default to 16.
Increasing it further to 32 will provide enough parallelism to improve
out of the box performance for new users.

Fixes: https://tracker.ceph.com/issues/43757
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-22 15:21:21 +00:00
David Zafman
b0a1b758d0 mgr: Change default upmap_max_deviation to 5
Fixes: https://tracker.ceph.com/issues/43312

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
621acf8ce7 osdmaptool: Add --upmap-active to simulate active upmap balancing
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
184e9d1ae3 doc: Add upmap options to osdmaptool man page and give example
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
Jos Collin
1033d5b373
doc: mounting CephFS subdirectory and Persistent Mounts cleanup
Fixes: https://tracker.ceph.com/issues/37746
Signed-off-by: Jos Collin <jcollin@redhat.com>
2020-01-06 18:33:26 +05:30
Neha Ojha
bd24ccf90d
Merge pull request #32451 from rs-fabrica/doc_rados_operations_crush-map-edits
doc/rados/operations/crush-map-edits: recompile and set instructions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-03 15:20:33 -08:00
Rodrigo Severo
442878f229 doc/rados/operations/crush-map-edits: including recompile and set crushmapo instructions
Including missing recompile and set crushmap sections in crush-map-edits

Signed-off-by: Rodrigo Severo <rodrigo@fabricadeideias.com>
2019-12-30 18:13:25 -03:00
Zac Dover
8095be48d1 doc: update list of formats for --format flag for "ceph pg dump"
This incorporates Neha's suggestion that the list of formats
be made complete everywhere it appears in the document.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2019-12-23 22:00:39 +10:00
Zac Dover
c6135b2c15 doc: added an "is" where it was needed.
This tiny commit changes "The foregoing functionality
equivalent to" to "The foregoing functionality is
equivalent to".

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2019-12-20 23:08:38 +10:00
Zac Dover
fb4f4acf02 doc: update list of formats for --format flag for "ceph pg dump"
This commit simply adds "json-pretty", "xml", and "xml-pretty" to
the list of formats available to the --format flag in the command
"ceph pg dump".

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2019-12-20 22:32:33 +10:00
Neha Ojha
0852827258
Merge pull request #32226 from neha-ojha/wip-four-percent
doc/rados: Better block.db size recommendations for bluestore

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-12-13 10:23:34 -08:00
Neha
36cdafbcca doc/rados: Better block.db size recommendations for bluestore
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-12-13 17:24:58 +00:00
Patrick Donnelly
2216c63ed5
Merge PR #31729 into master
* refs/pull/31729/head:
	qa: reduce cache size further
	mds: obsoleting 'mds_cache_size'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-11 09:44:27 -08:00
Zac Dover
9c1216cd69 doc: s/achieve/achieves (Fixed a verb disagreement)
This bug changes a clause of the form "When x remains in y status
and never achieve a z status" to a clause of the form "When x remains
in y status and never achieves a  z status".

The change is one of "achieve" to "achieves".

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2019-12-06 02:16:01 +10:00
Ramana Raja
aeaef1b4c5 mds: obsoleting 'mds_cache_size'
Remove last bits of support for 'mds_cache_size'.
'mds_cache_memory_limit' is preferred.

Fixes: https://tracker.ceph.com/issues/41951
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-12-02 14:51:25 +05:30
Neha Ojha
0cd95b9f0f
Merge pull request #31588 from usefulalgorithm/patch-1
doc/rados/operations: OSD_OUT_OF_ORDER_FULL fullness order is wrong

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-11-27 17:33:38 -08:00
Sage Weil
ba01e1e951 Merge PR #31636 into master
* refs/pull/31636/head:
	mgr/pg_autoscaler: default to pg_num[_min] = 16

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-11-23 08:48:47 -06:00
Kefu Chai
1d0579566e
Merge pull request #31541 from BlackLotus/master
added a remark to always use powers of two for pg_num

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-19 09:24:08 +08:00
Sage Weil
78bf924480 mgr/pg_autoscaler: default to pg_num[_min] = 16
4 or 8 PGs doesn't provide much parallelism at baseline.  Start with 16
and set the floor there; that's a more reasonable number of OSDs that
will be put to work on a single pool.

Note that there is no magic number here.  At some point someone has to
tell Ceph if an empty pool should get lots of PGs across lots of devices
to get the full throughput of the cluster.  But this will be a bit less
painful/surprising for users.

Fixes: https://tracker.ceph.com/issues/42509
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-14 13:37:44 -06:00
Tsung-Ju Lii
253cb9903e doc/rados/operations: fix OSD_OUT_OF_ORDER_FULL fullness ordering
Signed-off-by: Tsung-Ju Lii <usefulalgorithm@gmail.com>
2019-11-13 17:43:48 +08:00
Sridhar Seshasayee
8819c3c37a
Merge pull request #31416 from sseshasa/wip-41666-replicaSizeWarn
osd/OSDMap: Show health warning if a pool is configured with size 1

Reviewed-by: Sage Weil <sweil@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-11-12 12:06:46 +05:30
Thomas Schneider
f84ea48b80 doc/rados, sample.ceph.conf: pg_num should always be a power of two
Signed-off-by: Thomas Schneider <thomas@brainfuck.space>
2019-11-11 22:56:35 +01:00
Sridhar Seshasayee
33c647e811 osd/OSDMap: Show health warning if a pool is configured with size 1
Introduce a config option called 'mon_warn_on_pool_no_redundancy' that is
used to show a health warning if any pool in the ceph cluster is
configured with a size of 1. The user can mute/unmute the warning using
'ceph health mute/unmute POOL_NO_REDUNDANCY'.

Add standalone test to verify warning on setting pool size=1. Set the
associated warning to 'false' in ceph.conf.template under qa/tasks so
that existing tests do not break.

Fixes: https://tracker.ceph.com/issues/41666
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2019-11-11 10:36:35 +05:30
Sage Weil
3e9a2d8065 Merge PR #31177 into master
* refs/pull/31177/head:
	doc: update with zone bucket and straw2 addition

Reviewed-by: Sage Weil <sage@redhat.com>
2019-11-08 07:22:05 -06:00
Mykola Golub
1dc0db74d4
Merge pull request #30912 from dillaman/wip-42265
mgr: add 'rbd' profiles to support 'rbd_support' module commands

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-11-01 13:41:28 +02:00
Changcheng Liu
3a691911fc doc: update with osd addition
Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2019-11-01 13:55:41 +08:00
Jason Dillaman
b0d73aed19 mgr: added 'profile rbd/rbd-read-only' cap
These profiles can be further restricted via 'pool' and
'namespace' argument optionals.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-10-29 08:35:03 -04:00
Jason Dillaman
cb534e0049 mgr: support optional arguments for module and profile caps
This allows an optional, arbitrary key/value constraint clauses to
be appended to "profile XYZ" and "allow module XYZ" caps. A module
can then provide additional validatation against these meta-arguments.

Example:
profile rbd pool=rbd
allow module rbd_support with pool=rbd

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-10-29 08:35:03 -04:00
Jason Dillaman
3463613bd4 mgr: add new 'allow module' cap to MgrCap
This allows specific python add-on modules to be whitelisted instead
of manually adding each command exported by the module.

  allow module {module-name} {access-spec}

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-10-29 08:35:03 -04:00
Changcheng Liu
f241095e3a doc: update with zone bucket and straw2 addition
1. zone bucket non-leaf type is added.
2. crush bucket straw2 algorithm is added.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2019-10-27 12:08:12 +08:00
Kefu Chai
659456d36a doc/rados/deployment/ceph-deploy-mon: fix typo
s/comingling/commingling/

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-25 22:38:44 +08:00
Changcheng Liu
909f87a862 doc: fix typo to auto scale pg number
Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2019-10-23 10:53:14 +08:00
zhangdaolong
e5d91c9872 doc, qa:remove invalid option mon_pg_warn_max_per_osd
The older mon_pg_warn_max_per_osd option has been removed in v12.2.1 Luminous
https://ceph.com/releases/v12-2-1-luminous-released/

Fixes: https://tracker.ceph.com/issues/42221

Signed-off-by: zhang daolong <zhangdaolong@fiberhome.com>
2019-10-09 16:09:18 +08:00
Kefu Chai
c2adfb62c6
Merge pull request #30583 from mika/mika/typos
doc: fix typos

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-10-04 16:06:20 +08:00
Xie Xingguo
f1b55e7790
Merge pull request #30632 from xiexingguo/wip-kick-recovery-pri
osd/PrimaryLogPG: always use strict priority ordering for kicked recovery ops

Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-30 16:59:55 +08:00
Kefu Chai
e659e86096
Merge pull request #29236 from liewegas/wip-read-hole-bypg
osd: implement per-pg leases to avoid stale reads

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-09-29 14:39:32 +08:00
xie xingguo
5f22e36b44 Revert "osd: give recovery ops initialized by client op a higher priority"
This reverts commit c0f87e0f91.

The 'osd_op_queue_cut_off' config option determines which level of
high priority ops should use strict priority ordering and may change
from time to time. Since the main strategy of 'osd_kick_recovery_op_priority'
is to simply follow up 'osd_op_queue_cut_off', we can instead make a direct
use of 'osd_op_queue_cut_off' to achieve the same thing explicitly.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-29 13:08:29 +08:00
Sage Weil
9d2325084e doc: document new 'laggy' and 'wait' pg states
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-28 11:51:18 -05:00
Kefu Chai
e741238745
Merge pull request #30441 from anthonyeleven/master
osd: Change osd op queue cut off default to high

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-28 16:05:05 +08:00
Michael Prokop
d98b3e36a9 doc: fix typos
s/amount of times/number of times/
s/assosciated/associated/
s/availabe/available/
s/Commiting/Committing/
s/Containter/Container/
s/dependant/dependent/
s/developement/development/
s/filesytem/filesystem/
s/guarenteed/guaranteed/
s/hiearchy/hierarchy/
s/intance/instance/
s/Interger/Integer/
s/mutiple/multiple/
s/nubmer/number/
s/occured/occurred/
s/overriden/overridden/
s/reseted/reset/
s/sytem/system/
s/unkown/unknown/

Signed-off-by: Michael Prokop <mika@grml.org>
2019-09-26 09:17:07 +02:00
Sage Weil
6e46b1c0e5 osd/OSDMap: health alert for non-power-of-two pg_num
Fixes: https://tracker.ceph.com/issues/41647
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-24 09:26:33 -05:00
Sage Weil
7b988e9fe1 doc: remove all pg_num arguments to 'osd pool create'
Also, update the dicussion about pg_num and pool creation, with a reference
to the autoscaler.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-22 16:58:33 -05:00
Anthony D'Atri
be4582c26a Change osd op queue cut off default to high
Discussion: https://www.mail-archive.com/ceph-users@ceph.io/msg00166.html

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2019-09-18 06:50:27 -07:00
Patrick Donnelly
a779766be9
Merge PR #30014 into master
* refs/pull/30014/head:
	doc: update CephFS overview in introductory page
	doc: filesystem to file system

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-09-11 09:59:51 -07:00
Danny Abukalam
6deba986b3 doc: Update ceph-deploy docs from dumpling to nautilus
Signed-off-by: Danny Abukalam <danny@softiron.co.uk>
2019-09-10 18:53:48 +01:00
Patrick Donnelly
e7a7cf429e
doc: filesystem to file system
"Filesystem" is not a word (although fairly common in use).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-10 08:43:28 -07:00