Ceph is a distributed object, block, and file storage platform
Go to file
Samuel Just a525bf3190 ReplicatedPG:start_flush send a second delete
Suppose we start with the following in the cache pool:

30:[29,21,20,15,10,4]:[22(21), 15(15,10), 4(4)]+head

The object doesn't exist at 29 or 20.

First, we flush 4 leaving the backing pool with:

3:[]+head

Then, we begin to flush 15 with a delete with snapc 4:[4] leaving the
backing pool with:

4:[4]:[4(4)]

Then, we finish flushing 15 with snapc 9:[4] with leaving the backing
pool with:

9:[4]:[4(4)]+head

Next, snaps 10 and 15 are removed causing clone 10 to be removed leaving
the cache with:

30:[29,21,20,4]:[22(21),4(4)]+head

We next begin to flush 22 by sending a delete with snapc 4(4) since
prev_snapc is 4 <---------- here is the bug

The backing pool ignores this request since 4 < 9 (ORDERSNAP) leaving it
with:

9:[4]:[4(4)]

Then, we complete flushing 22 with snapc 19:[4] leaving the backing pool
with:

19:[4]:[4(4)]+head

Then, we begin to flush head by deleting with snapc 22:[21,20,4] leaving
the backing pool with:

22[21,20,4]:[22(21,20), 4(4)]

Finally, we flush head leaving the backing pool with:

30:[29,21,20,4]:[22(21*,20*),4(4)]+head

When we go to flush clone 22, all we know is that 22 is dirty, has snaps
[21], and 4 is clean. As part of flushing 22, we need to do two things:
1) Ensure that the current head is cloned as cloneid 4 with snaps [4] by
sending a delete at snapc 4:[4].
2) Flush the data at snap sequence < 21 by sending a copyfrom with snapc
20:[20,4].

Unfortunately, it is possible that 1, 1&2, or 1 and part of the flush
process for some other now non-existent clone have already been
performed.  Because of that, between 1) and 2), we need to send
a second delete ensuring that the object does not exist at 20.

Fixes: #9054
Backport: firefly
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-08-26 14:13:57 -07:00
admin
ceph-object-corpus@bb3cee6b85
debian Merge remote-tracking branch 'gh/next' 2014-08-18 21:10:32 -07:00
doc doc: Removed quick guide and wireshark from top-level IA. 2014-08-18 14:29:09 -07:00
examples/librados
fusetrace
keys
m4 configure: verify c++11 is present for rocksdb 2014-07-31 21:11:24 -07:00
man Merge pull request #2074 from onlyjob/docs 2014-07-07 09:07:04 -07:00
qa qa/workunits/rbd/qemu-iotests: touch common.env 2014-08-18 08:47:36 -07:00
share
src ReplicatedPG:start_flush send a second delete 2014-08-26 14:13:57 -07:00
systemd init: add systemd service files 2014-07-22 11:30:55 -04:00
udev
.gitignore
.gitmodule_mirrors add rocksdb submodule 2014-07-29 21:45:25 -07:00
.gitmodules add rocksdb submodule 2014-07-29 21:45:25 -07:00
.mailmap mailmap: sort entries 2014-08-04 08:52:03 +02:00
.organizationmap mailmap: sort entries 2014-08-04 08:52:03 +02:00
AUTHORS AUTHORS 2014-07-17 21:33:22 -07:00
autogen.sh autogen.sh: debug with -x 2014-07-31 21:11:25 -07:00
ceph.spec.in debian, rpm: build rocksdb statically if we can 2014-07-31 21:11:25 -07:00
ChangeLog
CodingStyle
configure.ac Merge remote-tracking branch 'gh/next' 2014-08-18 21:10:32 -07:00
COPYING erasure-code: HTML display of benchmark results 2014-08-04 11:42:05 +02:00
COPYING-LGPL2.1
deps.deb.txt add rocksdb bz2 dep 2014-07-31 21:11:24 -07:00
deps.rpm.txt add rocksdb bz2 dep 2014-07-31 21:11:24 -07:00
do_autogen.sh do_autogen.sh: build with static librocksdb 2014-07-31 21:11:24 -07:00
doc_deps.deb.txt
Doxyfile
INSTALL
Makefile.am
NEWS
PendingReleaseNotes doc/release-notes: v0.84 2014-08-18 11:57:59 -07:00
README README: symlink from README.md 2014-08-06 08:15:35 -07:00
README.md README.md: word wrap 2014-08-06 08:16:21 -07:00
SubmittingPatches

============================================ Ceph - a scalable distributed storage system

Please see http://ceph.com/ for current info.

Contributing Code

Most of Ceph is licensed under the LGPL version 2.1. Some miscellaneous code is under BSD-style license or is public domain. The documentation is licensed under Creative Commons Attribution-ShareAlike (CC BY-SA). There are a handful of headers included here that are licensed under the GPL. Please see the file COPYING for a full inventory of licenses by file.

Code contributions must include a valid "Signed-off-by" acknowledging the license for the modified or contributed file. Please see the file SubmittingPatches for details on what that means and on how to generate and submit patches.

We do not require assignment of copyright to contribute code; code is contributed under the terms of the applicable license.

Build Prerequisites

debian-based

The list of debian package dependencies can be found in deps.deb.txt:

sudo apt-get install `cat deps.deb.txt`

Note: libsnappy-dev and libleveldb-dev are not available upstream for natty, oneiric, and squeeze. Backports for Ceph can be found at ceph.com/debian-leveldb.

rpm-based

The list of RPM package dependencies can be found in deps.rpm.txt:

sudo yum install `cat deps.rpm.txt`

Building Ceph

Developers, please refer to the Developer Guide for more information, otherwise, you can build the server daemons, and FUSE client, by executing the following:

./autogen.sh
./configure
make

(Note that the FUSE client will only be built if libfuse is present.)

Dependencies

The configure script will complain about any missing dependencies as it goes. You can also refer to debian/control or ceph.spec.in for the package build dependencies on those platforms. In many cases, dependencies can be avoided with --with-foo or --without-bar switches. For example,

./configure --with-nss         # use libnss instead of libcrypto++
./configure --without-radosgw  # do not build radosgw
./configure --without-tcmalloc # avoid google-perftools dependency

Building packages

You can build packages for Debian or Debian-derived (e.g., Ubuntu) systems with

sudo apt-get install dpkg-dev
dpkg-checkbuilddeps        # make sure we have all dependencies
dpkg-buildpackage

For RPM-based systems (Red Hat, SUSE, etc.),

rpmbuild

Building the Documentation

Prerequisites

The list of package dependencies for building the documentation can be found in doc_deps.deb.txt:

sudo apt-get install `cat doc_deps.deb.txt`

Building the Documentation

To build the documentation, ensure that you are in the top-level `/ceph directory, and execute the build script. For example:

admin/build-doc