Commit Graph

1406 Commits

Author SHA1 Message Date
Kyle
a84e4dfd63 Add CLI command to set threshold
Signed-off-by: Kyle McGough <kmcgough@digitalocean.com>
2021-08-12 10:49:38 -07:00
Kyle
0f6184fc3d mgr/pg_autoscaler: add threshold module option
Signed-off-by: Kyle McGough <kmcgough@digitalocean.com>
2021-08-10 15:43:52 -07:00
Josh Durgin
7e2fce5a8c
Merge pull request #42525 from zdover23/wip-doc-rados-config-storage-devices-front-matter-2021-07-28
doc/rados: rewrite storage device front matter

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-08-10 08:11:35 -07:00
Zac Dover
64ac87bf2b doc/rados: rewrite storage device front matter
This PR updates the text in the RADOS Guide
(the Ceph Storage Cluster Guide) that appears
at the beginning of the "Storage Devices"
chapter. I did the following:

- rewrote some of the sentences so that
  they read more like written text than like
  spoken language
- added "Ceph Manager" to the list of daemons
  that a Ceph cluster comprises
- that's about it.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-08-10 22:33:33 +10:00
Neha Ojha
485c3e60b7
Merge pull request #42568 from kamoltat/wip-autoscaler-profile-status-print
pybind/mgr/pg_autoscaler: Added PROFILE to autoscale-status

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-08-09 15:11:19 -07:00
Kamoltat
65fec053e0 doc/rados/operations/placement-groups: added bias + profile
Added documentations on the autoscale profile and bias

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-08-09 13:59:17 +00:00
Zac Dover
413eaa575e doc/rados: rewrite "FileStore" section
This PR makes minor improvements to the
syntax of the sentences in the "FileStore"
material in the Configuration chapter of
the RADOS manual.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-08-05 07:57:24 +10:00
Zac Dover
d604b2e67a doc/rados: rewrite BlueStore material
This PR improves the English text
explaining the BlueStore filesystem
backend.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-08-04 02:25:14 +10:00
Kefu Chai
b148620337
Merge pull request #40337 from ideepika/wip-bugzilla-1857447
mon/PGMap: remove DIRTY field in `ceph df detail` when cache tiering  is not in use

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-07-29 00:21:49 +08:00
Deepika Upadhyay
ba52429897 doc/rados/op: ceph/df show DIRTY field N/A
DIRTY field should only be available if cache tiering is in use.

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-07-27 07:06:29 +05:30
Zac Dover
d27bb21cc1 doc/rados: rewrite index.rst
This PR makes minor alterations to the
text at the beginning of the RADOS Guide.

Most notably, the monitor daemon has been
added to the list of types of daemons that
constitute a Ceph cluster.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-07-27 05:16:41 +10:00
Patrick Donnelly
4b1e101571
Merge PR #42295 into master
* refs/pull/42295/head:
	doc/cephfs: recover file system after recovering

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-21 13:13:43 -07:00
Ramana Raja
ffe5cfb687 doc/cephfs: recover file system after recovering
... monitor stores using OSDs. The steps are valid only to recover
single active MDS file systems.

Partially-fixes: https://tracker.ceph.com/issues/51341
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-07-16 17:20:35 -04:00
Sage Weil
01c006c2de Merge PR #42041 into master
* refs/pull/42041/head:
	mgr/restful: ignore min/max_size
	test/crush: drop min/max_size refs
	qa/workunits/mon/pool_ops: remove test for min/max_size check
	qa: scrub a few remaining mentions of ruleset
	qa/standalone/mon/osd-*: fix tests
	PendingReleaseNotes: note min/max_size removal
	mgr/dashboard: remove max/min_size and ruleset
	mon/OSDMonitor: fix calls to CrushTester
	crush: eliminate min_size and max_size
	test/cli/crushtool: reunumber rulesets in test maps
	crushtool: require min/max or num-rep for --test
	crush: remove last traces of 'ruleset'
	test/cli/crushtool: use 'id' instead of 'ruleset' in crush inputs
	crushtool: take --min-rep and --max-rep explicitly
	crush/CrushTester: drop --ruleset
	doc: scrub 'ruleset' from docs
	src/erasure-code: rule, not ruleset
	mon/OSDMonitor: remove check_crush_rule() callers
	mon/OSDMonitor: rule, not ruleset
	crushtool: remove check for overlapped ruels
	crush/CrushWrapper: get_osd_pool_default_crush_replicated_ruleset -> rule
	crush: remove find_rule()
	mon/OSDMonitor: use pool's crush rule directly
	osd/OSDMap: drop checks for ruleset == ruleid
	osd/OSDMap: use pool's crush rule_id directly
	mon/PGMap: use pool's crush_rule directly
	mon/OSDMonitor: remove crush ruleset->rule rewrite

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2021-07-14 14:38:59 -04:00
Kefu Chai
7a31ae3158
Merge pull request #42176 from tchaikov/wip-doc-option
doc/rados/troubleshooting/log-and-debug: document option using :confval:

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-07 21:58:30 +08:00
Kefu Chai
fd8d6b1a9f doc/rados/troubleshooting/log-and-debug: use ini to highlight code block
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-05 23:57:32 +08:00
Kefu Chai
42fd0ba6b8 doc/rados/troubleshooting/log-and-debug: document option using :confval:
* simpler this way.
* and drop non-existent options.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-05 23:57:32 +08:00
Sharuzzaman Ahmat Raslan
780aa4ea48 doc/rados/configuration: fixing small typo for word "implemebnt"
Signed-off-by: Sharuzzaman Ahmat Raslan <sharuzzaman@gmail.com>
2021-07-05 08:14:31 +08:00
Sage Weil
f95eb04411 crush: eliminate min_size and max_size
We don't use min/max_size for anything any more.  Switch to encoding it
universally as 1 and 100, and ignoring when we decode.  We keep it around
for backward compat when (re)encoding without the SERVER_QUINCY feature.

Drop the crush_rule_mask struct since the only variable piece now is the
type.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-06-28 18:34:31 -04:00
Sage Weil
8976fcf476 doc: scrub 'ruleset' from docs
Signed-off-by: Sage Weil <sage@newdream.net>
2021-06-28 18:34:31 -04:00
Kefu Chai
29064f1bf8
Merge pull request #41937 from liewegas/mgr-crash
mgr: generate crash dumps for Python exceptions in mgr modules

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-26 22:18:14 +08:00
Anthony D'Atri
d6b4734716 doc/rados/operations: Updates pools.rst
Add clarity, change example PG counts to a power of two.

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2021-06-23 10:30:37 -07:00
Sage Weil
24ac3088b6 mgr/crash: separate RECENT_MGR_MODULE_CRASH error for mgr module crashes
Generate a different warning for crashes in mgr module python code, as
they do not mean that the entire mgr daemon crashed.  Document.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-06-23 13:00:49 -04:00
Kefu Chai
6f58a26281
Merge pull request #27465 from tchaikov/wip-38219
ceph-monstore-tool: use a large enough paxos/{first,last}_committed

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-06-16 09:38:45 +08:00
Patrick Donnelly
f5fa58cb1f
doc: document new .mgr pool
And that pool names beginning with `.` are reserved names.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:17 -07:00
Kefu Chai
5d431ce54d doc/rados/troubleshooting: highlight bash script with bash lexer
for better reading experience.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-10 20:29:50 +08:00
Sridhar Seshasayee
76420f9d59 doc: Update mclock-config-ref to reflect automated OSD benchmarking
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2021-06-03 14:45:21 +05:30
luo.runbing
d9315c88d5
doc: add missing crush-device-class={device-class} pair for clay code profile
`crush-device-class` is optional for `ceph osd erasure-code-profile set`,
add it for the sake of completeness

Signed-off-by: luo.runbing <luo.runbing@zte.com.cn>
2021-05-26 11:14:38 +08:00
mflehmig
00225dc531 doc/rados: Fix typo
Signed-off-by: Martin Flehmig <martin.flehmig@tu-dresden.de>
2021-05-17 14:42:12 +08:00
Neha Ojha
859d11fe4e doc/rados/configuration/osd-config-ref: remove osd_command_thread_timeout
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-05-12 19:59:39 +00:00
Kefu Chai
cc43462ab3 doc/rados/operations: s/max_misplaced/target_max_misplaced_ratio/
max_misplaced with replaced by in target_max_misplaced_ratio
edbd592ee4, but the document was not
sync'ed. let's update it accordingly.

Fixes: https://tracker.ceph.com/issues/50745
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-11 12:23:02 +08:00
Kefu Chai
4a4c2fe8c8
Merge pull request #41207 from paulreece42/wip-doc-balancer-options
doc: added doc on more throttling options for the PG balancer module

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-11 12:04:49 +08:00
Paul Reece
eafa979b79 doc: added documentation on additional throttling options for the PG balancer module
Signed-off-by: Paul Reece <paul@reece.cc>
2021-05-06 14:09:34 -04:00
Kefu Chai
bb351842bc doc/rados/configuration/general-config-ref: use describe to define non-options
max_open_files is not generated from yaml files, so define it using
"describe" directive instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-06 22:21:43 +08:00
Sridhar Seshasayee
0ad2b2c8ee
Merge pull request #41004 from sseshasa/wip-mclock-max-backfill-misc-fix
osd: Override recovery, backfill and sleep related config options during OSD and mclock scheduler initialization.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-04-30 22:58:21 +05:30
Zac Dover
87a1ae7a44 doc/rados: rename "Running Multiple Clusters"
This PR corrects a title so that the title
more accurately describes the content in the
section it names.

Fixes: https://tracker.ceph.com/issues/50517 (partially)
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-28 22:45:30 +10:00
Sridhar Seshasayee
8876d27f38 osd: Override recovery/backfill/sleep options with mclock scheduler.
Make the osd_*_sleep options modifiable during runtime and add them
to the set of tracked conf keys. This is to ensure that the sleep
options can be disabled/overridden during OSD bring-up if mclock
scheduler is employed.

Introduce OSD::maybe_override_options_for_qos():
  This method does the following if the mclock scheduler is enabled:
  - overrides the "recovery_max_active" to a high limit of 1000,
  - overrides "osd_max_backfills" option to a high limit of 1000 and
    sets the corresponding Async local and remote reserver objects also
    to the same value (1000),
  - disables osd_*_sleep options so that appropriate QoS may be
    provided with the mclock scheduler.

The above method is called in the following scenarios:
- After all the op shards are brought up during OSD initialization.
- In OSD::handle_conf_change() to override any settings related to
  QoS that the user intended to change.

Modify the mclock config reference to accurately reflect what options
can be changed when using mclock's "custom" profile and clean up
some whitespaces.

Fixes: https://tracker.ceph.com/issues/50501
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2021-04-27 11:11:58 +05:30
Kefu Chai
ecb8e5e9c7 doc/rados/operations/pools: define pool settings using "describe"
better readability and more structured this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
4e27388ba7 doc/rados/configuration: reference options using :confval:
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
c34cc03684 doc/rados/configuration/mon-config-ref: link by ref instead of relative hyperlink
the latter is more fragile.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-22 12:08:54 +08:00
Kefu Chai
ae5f2b2ca3 doc/rados/configuration/mon-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-22 12:08:54 +08:00
Kefu Chai
be07a5b407 doc/rados/configuration: add missing options
and link to them when appropriate

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-22 12:08:54 +08:00
Kefu Chai
52a5655296 doc/rados/configuration/mon-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-21 12:37:03 +08:00
Kefu Chai
4481f4ac75 doc/rados/configuration/general-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-21 12:33:19 +08:00
Kefu Chai
4a4dc9f5a1 doc/rados/configuration/osd-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-21 12:33:19 +08:00
Kefu Chai
d72fb1f3e6 doc/rados/configuration/osd-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-20 22:49:20 +08:00
Kefu Chai
8e0158a047 doc/rados/configuration/mon-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 22:03:45 +08:00
Kefu Chai
e5722a46e1 doc/rados/configuration/auth-config-ref: drop section of keyrings
as per Sage, the caps are out of date (should be based on profiles) and
the keyring locations aren't useful information

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 21:45:07 +08:00
Kefu Chai
cdd059b3e4 doc/rados/configuration/mon-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 17:35:31 +08:00
Kefu Chai
536f096055 doc/rados/configuration/msgr2: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 17:08:46 +08:00