Ceph is a distributed object, block, and file storage platform
Go to file
Samuel Just 4843fd510b ReplicatedPG:start_flush send a second delete
Suppose we start with the following in the cache pool:

30:[29,21,20,15,10,4]:[22(21), 15(15,10), 4(4)]+head

The object doesn't exist at 29 or 20.

First, we flush 4 leaving the backing pool with:

3:[]+head

Then, we begin to flush 15 with a delete with snapc 4:[4] leaving the
backing pool with:

4:[4]:[4(4)]

Then, we finish flushing 15 with snapc 9:[4] with leaving the backing
pool with:

9:[4]:[4(4)]+head

Next, snaps 10 and 15 are removed causing clone 10 to be removed leaving
the cache with:

30:[29,21,20,4]:[22(21),4(4)]+head

We next begin to flush 22 by sending a delete with snapc 4(4) since
prev_snapc is 4 <---------- here is the bug

The backing pool ignores this request since 4 < 9 (ORDERSNAP) leaving it
with:

9:[4]:[4(4)]

Then, we complete flushing 22 with snapc 19:[4] leaving the backing pool
with:

19:[4]:[4(4)]+head

Then, we begin to flush head by deleting with snapc 22:[21,20,4] leaving
the backing pool with:

22[21,20,4]:[22(21,20), 4(4)]

Finally, we flush head leaving the backing pool with:

30:[29,21,20,4]:[22(21*,20*),4(4)]+head

When we go to flush clone 22, all we know is that 22 is dirty, has snaps
[21], and 4 is clean. As part of flushing 22, we need to do two things:
1) Ensure that the current head is cloned as cloneid 4 with snaps [4] by
sending a delete at snapc 4:[4].
2) Flush the data at snap sequence < 21 by sending a copyfrom with snapc
20:[20,4].

Unfortunately, it is possible that 1, 1&2, or 1 and part of the flush
process for some other now non-existent clone have already been
performed.  Because of that, between 1) and 2), we need to send
a second delete ensuring that the object does not exist at 20.

Fixes: #9054
Backport: firefly
Related: 66c7439ea0
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-09-09 12:37:41 -07:00
admin
ceph-object-corpus@bb3cee6b85
debian debian: only B-R yasm on amd64 2014-09-08 12:49:58 -07:00
doc doc: Fixed broken links and clarified terms for new authentication docs. 2014-09-08 14:04:33 -07:00
examples
fusetrace
keys
m4
man
qa qa: scripts to help test ceph-qa-suite 2014-09-05 17:49:40 +02:00
rpm
share
src ReplicatedPG:start_flush send a second delete 2014-09-09 12:37:41 -07:00
systemd
udev
.gitignore
.gitmodule_mirrors
.gitmodules
.mailmap mailmap: M Ranga Swami Reddy affiliation 2014-09-09 12:05:21 +05:30
.organizationmap mailmap: M Ranga Swami Reddy affiliation 2014-09-09 12:05:21 +05:30
.peoplemap mailmap: add .peoplemap 2014-08-31 22:08:56 +02:00
AUTHORS
autogen.sh
ceph.spec.in Merge pull request #2332 from ceph/wip-8231-forreview 2014-08-28 16:37:37 -07:00
ChangeLog
CodingStyle
configure.ac configure: do not try yasm on x32 2014-09-08 15:51:58 -07:00
CONTRIBUTING.rst doc: Add a contributing file at the root of repo 2014-09-06 00:23:24 +05:30
COPYING
COPYING-LGPL2.1
deps.deb.txt
deps.rpm.txt
do_autogen.sh
doc_deps.deb.txt
Doxyfile
INSTALL
Makefile.am
NEWS
PendingReleaseNotes doc/release-notes: v0.85 2014-09-08 12:19:34 -07:00
pom.xml
README
README.md
SubmittingPatches

============================================ Ceph - a scalable distributed storage system

Please see http://ceph.com/ for current info.

Contributing Code

Most of Ceph is licensed under the LGPL version 2.1. Some miscellaneous code is under BSD-style license or is public domain. The documentation is licensed under Creative Commons Attribution-ShareAlike (CC BY-SA). There are a handful of headers included here that are licensed under the GPL. Please see the file COPYING for a full inventory of licenses by file.

Code contributions must include a valid "Signed-off-by" acknowledging the license for the modified or contributed file. Please see the file SubmittingPatches for details on what that means and on how to generate and submit patches.

We do not require assignment of copyright to contribute code; code is contributed under the terms of the applicable license.

Build Prerequisites

debian-based

The list of debian package dependencies can be found in deps.deb.txt:

sudo apt-get install `cat deps.deb.txt`

Note: libsnappy-dev and libleveldb-dev are not available upstream for natty, oneiric, and squeeze. Backports for Ceph can be found at ceph.com/debian-leveldb.

rpm-based

The list of RPM package dependencies can be found in deps.rpm.txt:

sudo yum install `cat deps.rpm.txt`

Building Ceph

Developers, please refer to the Developer Guide for more information, otherwise, you can build the server daemons, and FUSE client, by executing the following:

./autogen.sh
./configure
make

(Note that the FUSE client will only be built if libfuse is present.)

Dependencies

The configure script will complain about any missing dependencies as it goes. You can also refer to debian/control or ceph.spec.in for the package build dependencies on those platforms. In many cases, dependencies can be avoided with --with-foo or --without-bar switches. For example,

./configure --with-nss         # use libnss instead of libcrypto++
./configure --without-radosgw  # do not build radosgw
./configure --without-tcmalloc # avoid google-perftools dependency

Building packages

You can build packages for Debian or Debian-derived (e.g., Ubuntu) systems with

sudo apt-get install dpkg-dev
dpkg-checkbuilddeps        # make sure we have all dependencies
dpkg-buildpackage

For RPM-based systems (Red Hat, SUSE, etc.),

rpmbuild

Building the Documentation

Prerequisites

The list of package dependencies for building the documentation can be found in doc_deps.deb.txt:

sudo apt-get install `cat doc_deps.deb.txt`

Building the Documentation

To build the documentation, ensure that you are in the top-level `/ceph directory, and execute the build script. For example:

admin/build-doc