mirror of
https://github.com/ceph/ceph
synced 2024-12-22 19:34:30 +00:00
238a303cff
Based on a dialog with Sam ( as published at http://dachary.org/?p=2320 ). * Remove PGBackend-h.rst because PGBackend.h is now in master. * Fix typos caught by ispell * Update recovery links to point to PGBackend recover methods * Workaround formating warning developer_notes.rst:3: WARNING: Duplicate explicit target name: "erasurecodepluginexample" which should be legitimate. Signed-off-by: Loic Dachary <loic@dachary.org>
69 lines
2.8 KiB
ReStructuredText
69 lines
2.8 KiB
ReStructuredText
==============================
|
|
Erasure Coded Placement Groups
|
|
==============================
|
|
|
|
The documentation of the erasure coding implementation in Ceph was
|
|
created in July 2013. It is included in Ceph even before erasure coded
|
|
pools are available because it drives a number of architectural
|
|
changes. It is meant to be updated to reflect the `progress of these
|
|
architectural changes <http://tracker.ceph.com/issues/4929>`_, up to
|
|
the point where it becomes a reference of the erasure coding
|
|
implementation itself.
|
|
|
|
Glossary
|
|
--------
|
|
|
|
*chunk*
|
|
when the encoding function is called, it returns chunks of the same
|
|
size. Data chunks which can be concated to reconstruct the original
|
|
object and coding chunks which can be used to rebuild a lost chunk.
|
|
|
|
*chunk rank*
|
|
the index of a chunk when returned by the encoding function. The
|
|
rank of the first chunk is 0, the rank of the second chunk is 1
|
|
etc.
|
|
|
|
*stripe*
|
|
when an object is too large to be encoded with a single call,
|
|
each set of chunks created by a call to the encoding function is
|
|
called a stripe.
|
|
|
|
*shard|strip*
|
|
an ordered sequence of chunks of the same rank from the same
|
|
object. For a given placement group, each OSD contains shards of
|
|
the same rank. When dealing with objects that are encoded with a
|
|
single operation, *chunk* is sometime used instead of *shard*
|
|
because the shard is made of a single chunk.
|
|
|
|
The definitions are illustrated as follows:
|
|
::
|
|
|
|
OSD 40 OSD 33
|
|
+-------------------------+ +-------------------------+
|
|
| shard 0 - PG 10 | | shard 1 - PG 10 |
|
|
|+------ object O -------+| |+------ object O -------+|
|
|
||+---------------------+|| ||+---------------------+||
|
|
stripe||| chunk 0 ||| ||| chunk 1 ||| ...
|
|
0 ||| [0,+N) ||| ||| [0,+N) |||
|
|
||+---------------------+|| ||+---------------------+||
|
|
||+---------------------+|| ||+---------------------+||
|
|
stripe||| chunk 0 ||| ||| chunk 1 ||| ...
|
|
1 ||| [N,+N) ||| ||| [N,+N) |||
|
|
||+---------------------+|| ||+---------------------+||
|
|
||+---------------------+|| ||+---------------------+||
|
|
stripe||| chunk 0 [N*2,+len) ||| ||| chunk 1 [N*2,+len) ||| ...
|
|
2 ||+---------------------+|| ||+---------------------+||
|
|
|+-----------------------+| |+-----------------------+|
|
|
| ... | | ... |
|
|
+-------------------------+ +-------------------------+
|
|
|
|
Table of content
|
|
----------------
|
|
|
|
.. toctree::
|
|
:maxdepth: 1
|
|
|
|
Developer notes <erasure_coding/developer_notes>
|
|
Jerasure plugin <erasure_coding/jerasure>
|
|
High level design document <erasure_coding/pgbackend>
|