Commit Graph

120 Commits

Author SHA1 Message Date
Sage Weil
c7244e7aad misc language changes: whitelist -> ignore etc
Signed-off-by: Sage Weil <sage@newdream.net>
2020-08-24 19:53:08 +00:00
myoungwon oh
942c73bf07
Merge pull request #35338 from myoungwon/wip-doc-manifet-snap
doc/dev/osd_internals/manifest.rst: add information about clone snap refcounting

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-07-08 18:57:13 +09:00
Jakub Wilk
e3cc60e631 doc/dev/osd_internals: fix typos
Signed-off-by: Jakub Wilk <jwilk@jwilk.net>
2020-07-01 11:56:25 +02:00
Samuel Just
bf156a08a6 doc/dev/osd_internals/manifest.rst: add information about clone snap refcounting
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-06-01 07:56:22 -04:00
Samuel Just
d8269b0819 doc/dev/osd_internals:manifest.rst: clarification for manifest design and future steps
I've added a few significant changes:
* TIER_PROMOTE purely ensures that data is resident in the base pool
* Add EVICT_CHUNK to permit a tiering agent to selectively cold space
  from HEAD/snapshots independently of SET_CHUNK.
* Avoid using DIRTY entirely for dedup targets.
* Instead of modifying clone_range when updating clone manifests, simply
  update ReplicatedBackend::calc_*_subsets to also consider the clone
  obc manifest.

I've also added sections on how tiering agents are rbd/rgw are meant
to interact as well as on testing.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-05-19 21:59:45 -07:00
myoungwon oh
59cab79b21 doc: more information on future work for manifest tiering
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-05-19 21:59:08 -07:00
Samuel Just
ac7af27ffc doc: more information on status and future work for manifest tiering
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-05-19 21:59:08 -07:00
Samuel Just
be4093a61e doc: add more information for manifest tiering
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-05-19 21:59:04 -07:00
myoungwon oh
c873a7af08 doc: break deduplication.rst int several files
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2020-04-21 23:23:07 -04:00
Radoslaw Zarzynski
a4ec060ad5 doc/dev/log_based_pg.rst: fix names of configurables.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-02-27 16:50:58 +01:00
Kefu Chai
c2adfb62c6
Merge pull request #30583 from mika/mika/typos
doc: fix typos

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-10-04 16:06:20 +08:00
Sage Weil
8be0106d42 doc: stale reads notes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-28 11:51:18 -05:00
Michael Prokop
d98b3e36a9 doc: fix typos
s/amount of times/number of times/
s/assosciated/associated/
s/availabe/available/
s/Commiting/Committing/
s/Containter/Container/
s/dependant/dependent/
s/developement/development/
s/filesytem/filesystem/
s/guarenteed/guaranteed/
s/hiearchy/hierarchy/
s/intance/instance/
s/Interger/Integer/
s/mutiple/multiple/
s/nubmer/number/
s/occured/occurred/
s/overriden/overridden/
s/reseted/reset/
s/sytem/system/
s/unkown/unknown/

Signed-off-by: Michael Prokop <mika@grml.org>
2019-09-26 09:17:07 +02:00
Sage Weil
7b988e9fe1 doc: remove all pg_num arguments to 'osd pool create'
Also, update the dicussion about pg_num and pool creation, with a reference
to the autoscaler.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-22 16:58:33 -05:00
David Zafman
81bfdf6d0f
Merge pull request #30192 from dzafman/wip-41669
Make dumping of reservation info congruent between scrub and recovery

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-09-11 14:20:24 -07:00
David Zafman
b3e1c58b0e osd: Replace active/pending scrub tracking for local/remote
This is similar to how recovery reservations are split between
local and remote.

It was the case that scrubs_pending was used for reservations at
the replicas as well as at the primary while requesting reservations
from the replicas.  There was no need for scrubs_pending to turn
into scrubs_active at the primary as nothing treated that value
as special.  scrubber.active = true when scrubbing is
actually going.

Now scurbber.local_reserved indicates scrubs_local incremented
Now scrubber.remote_reserved indicates scrubs_remote incremented

Fixes: https://tracker.ceph.com/issues/41669

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-09-10 13:33:27 -07:00
David Zafman
b98950e707 osd: Rename dump_reservations to dump_recovery_reservations
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-09-10 13:32:29 -07:00
Patrick Donnelly
e7a7cf429e
doc: filesystem to file system
"Filesystem" is not a word (although fairly common in use).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-10 08:43:28 -07:00
Jos Collin
f48760a280 doc: fix typo
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-07-05 08:54:49 +05:30
Neha Ojha
de5c5d8468
Merge pull request #21722 from mslovy/wip-parial-recovery
osd: partial recovery strategy based on PGLog

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-10 11:48:23 -07:00
Neha Ojha
984073e44d doc/dev/osd_internals/async_recovery: update cost calculation
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-05-08 20:19:32 -07:00
letterwuyu
7148dda076 osd: supplement doc
Signed-off-by: lishuhao <lishuhao@unitedstack.com>
2019-05-06 20:17:43 +08:00
lishuhao
20e26e8395 osd: partial recovery add doc
Signed-off-by: Ning Yao <yaoning@unitedstack.com>
Signed-off-by: lishuhao <lishuhao@unitedstack.com>
2019-05-06 15:30:35 +08:00
David Zafman
bc300055e7 doc: Describe recovery and backfill prioritizations
Fixes: http://tracker.ceph.com/issues/39011

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-02 21:58:44 -07:00
Samuel Just
5e36acdb6f osd/: mechanically rename RecoveryMachine/State/Ctx to Peering*
I'm going to extract this logic and reuse it in crimson.  Recovery* has
always been a confusing name as it implements neither log-based recovery
nor backfill.  Rather, it's mainly the buisiness logic for agreeing on
an authoritative log and some ancillary things such as scrub/backfill
reservation.

$ for i in $(git grep -l 'RecoveryMachine'); do sed -i 's/RecoveryMachine/PeeringMachine/g' $i; done
$ for i in $(git grep -l 'RecoveryState'); do sed -i 's/RecoveryState/PeeringState/g' $i; done
$ for i in $(git grep -l 'RecoveryCtx'); do sed -i 's/RecoveryCtx/PeeringCtx/g' $i; done

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-05-01 11:22:11 -07:00
Joao Eduardo Luis
a20ce5f427 osdmap: map versions to releases
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2019-03-02 11:36:23 +00:00
James McClune
0dc5000124 doc: updated reference link for log based PG
Added :ref: label to Log Based PG page. Referenced <log-based-pg>
label on Asynchronous Recovery page.

Fixes: https://tracker.ceph.com/issues/38465
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-02-24 16:08:44 -05:00
Kefu Chai
01409a542c
Merge pull request #25060 from mooncak/fix_typos
doc: Fix some typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:29:39 +08:00
mooncake
67a44af1a5 doc: Fix some typos
Signed-off-by: mooncake <xcoder@tenxcloud.com>
2018-11-14 19:49:13 +08:00
Shiyang Ruan
99ce7cf48b common: fix typos in BackoffThrottle
Signed-off-by: Shiyang Ruan <ruansy.fnst@cn.fujitsu.com>
2018-10-22 13:09:20 +08:00
Kefu Chai
5ee1fd2c32 doc: fix typos
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:41:42 +08:00
Kefu Chai
f710466995
Merge pull request #21077 from Ashid6/master
doc: typo fix

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-28 19:04:29 +08:00
Ashita Dashottar
1e8d753876 doc: typo fix
Signed-off-by: Ashita Dashottar <AshitaDashottar6@gmail.com>
2018-03-28 16:15:00 +05:30
Neha Ojha
5cc9252784 doc: dev description of async recovery
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-27 15:01:17 -07:00
Kefu Chai
127d25ccbd doc: fix warning reported by "build-doc linkcheck"
all the HTTP 301 (moved permanently) should be killed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 15:58:48 +08:00
Sage Weil
dc7a2aaf7a erasure-code: ruleset-* -> crush-*
1) ruleset is an obsolete term, and
2) crush-{rule,failure-domain,...} is more descriptive.

Note that we are changing the names of the erasure code profile keys
from ruleset-* to crush-*.  We will update this on upgrade when the
luminous flag is set, but that means that during mon upgrade you cannot
create EC pools that use these fields.

When the upgrade completes (users sets require_osd_release = luminous)
existing ec profiles are updated automatically.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-06 15:01:03 -04:00
Sage Weil
0346998b5a doc: recommend against btrfs
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-30 13:54:18 -04:00
liuchang0812
998ee1d190 doc: kill some broken links
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-06-07 16:13:45 +08:00
David Zafman
27e14504f6 osd: Add PG state and flag for too full for recovery
New state machine state NotRecovering
New PG state PG_STATE_RECOVERY_TOOFULL

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
a5731076ad osd: Handle backfillfull_ratio just like nearfull and full
Add BACKFILLFULL as a local OSD cur_state
Notify monitor of this new fullness state

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
Kefu Chai
1f975d78a8 doc: add :orphan: to orphaned docs
we should remove the deprecated ones once it's safe to remove them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-16 16:39:40 +08:00
Kefu Chai
68ec0b2c29 doc/dev/osd_internals: fix sphinx warnings
silence following warnings:

erasure_coding.rst:77: WARNING: toctree contains reference to
nonexisting document u'dev/osd_internals/erasure_coding/pgbackend'

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-16 16:39:40 +08:00
Kefu Chai
425b468ad0 doc/dev/osd_internals: fix sphinx warnings
silences errors like

erasure_coding/proposals.rst:236: ERROR: Unexpected indentation.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-16 16:34:53 +08:00
Greg Farnum
bde8222932 doc: update osd snap trimming with a little more detail
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-01-25 16:09:41 -08:00
liuchang0812
5fa0a015fc doc/dev: update log_based_pg.rst, fix some display problem
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-01-03 13:11:27 +08:00
Samuel Just
e2b3095554 Merge pull request #12500 from badone/wip-doc-PGPool
doc/dev/osd_internals: add pgpool.rst

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-12-15 14:00:22 -08:00
Brad Hubbard
0f6be4c98c doc/dev/osd_internals: add pgpool.rst
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-16 05:35:09 +10:00
Samuel Just
6f8e4b3810 src: rename ReplicatedPG to PrimaryLogPG
It's been confusing for a long time that EC pools are implemented by
ReplicatedPG.  What PG/ReplicatedPG really implement is the concept
of a PG where consistency is managed by the primary via a log.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-12-14 10:18:27 -08:00
Samuel Just
4740fe46ec doc/dev/osd_internals: add some docs for ECBackend
Also, clean up some old ones.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-17 10:41:34 -08:00
Kefu Chai
7dedce8a6e Merge pull request #9083 from badone/wip-doc-last_epoch_started
doc/dev: Fix missing code section due to no lexer for "none"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-07 14:23:56 +08:00