Commit Graph

39866 Commits

Author SHA1 Message Date
Josh Durgin
f4d8d16fbb librbd: clarify md_lock usage
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:34 -08:00
Josh Durgin
01dc05b931 test_librbd: add simple test for object map snapshot consistency
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:34 -08:00
Josh Durgin
85825008bc librbd: use snap_lock to protect ImageCtx->size
Since this is often looked up by snap_id anyway, snap_lock
is easy to use for this.

This lets us avoid taking md_lock in many places.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:34 -08:00
Josh Durgin
7fed0a366d librbd: hold snap_lock while reading parent info in diff_iterate
Caught be the re-added assertions in ImageCtx::get_parent_info()

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:34 -08:00
Josh Durgin
df42fd3833 test_librbd: close ioctx after imagectx
There's no need to explicitly close the ioctx. Doing so may cause
problems when the Images using it are destroyed afterwards.  Just let
normal cleanup at the end of the block take care of it in the correct
order.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:33 -08:00
Josh Durgin
06e5a3979f rbd: fix --image-feature parsing
Need to use _witharg(), not _flag()

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:33 -08:00
Josh Durgin
eef7466a5c librbd: apply flag read failure to all snaps
Don't check just the features of head, since it may be possible to
disable object map in the future.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:33 -08:00
Josh Durgin
6ac8139b25 librbd: make ImageCtx->object_map always present
This simplifies locking by obviating the NULL checks.  We no longer
need md_lock to protect these acceses. We can use object_map_lock
instead, to make sure no one reads an object map while its being
updated.

Keep track of whether the object map is enabled for a given snapshot
internally. In each public method, check this state, and automatically
set it correctly when refreshing the object map. During snapshot
removal, unconditionally try to remove the object map object, to
protect against bugs leaking objects, and to be consistent with image
removal.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 17:27:33 -08:00
Jason Dillaman
d611121ad7 tests: add unit test to verify async requests time out
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-25 20:00:54 -05:00
Jason Dillaman
c29548519e librbd: restart async requests if lock owner doesn't report progress
Detect the case of a crashed lock owner by waiting for up to 30 seconds
for a async request progress message from the leader.  If a progress
message isn't received, restart the request (and possibly take ownership
of the lock).

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-25 19:51:07 -05:00
Jason Dillaman
c611936c83 librbd: replace Finisher/SafeTimer use with facade
Replace the two Context threading classes used within
ImageWatcher with a facade to orchestrate the scheduling
and canceling of Context task callbacks.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-25 19:51:07 -05:00
Jason Dillaman
41e186a24f librbd: cancel in-progress maint operations before releasing lock
Ensure that all in-flight maintenance operations (resize, flatten) are
not running when the exclusive lock is released.  The lock will be
released when transitioning to a snapshot, closing the image, or
cooperatively when another client requests the lock.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-25 19:51:07 -05:00
Jason Dillaman
dde882cd7a librbd: flush context potentially completing too early
If the async operation associated with a flush request completes,
only complete the flush contexts if no previous operations are
still in flight. Otherwise, move the flush contexts to an older
in-flight async operation.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-25 19:51:07 -05:00
Josh Durgin
17493d648f Merge pull request #3799 from ceph/wip-librbd-image-watcher-tests
tests: add additional test coverage for ImageWatcher RPC

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 16:42:46 -08:00
Josh Durgin
04d360a4c1 librbd: take ImageCtx->snap_lock for write in add_snap()
add_snap() updates the ImageCtx snapshot metadata in memory, as well
as reading the flags as part of the object map snapshot. Both of these
require holding snap_lock.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 15:42:32 -08:00
Josh Durgin
40c2abb08a librbd: use snap_lock to protect ImageCtx->flags
This is another step towards eliminating md_lock from the writeback
path. Almost all the places that use ImageCtx->flags already use
snap_lock, so there's no need to create a new lock. For the others,
add a helper, test_flags() that acquires the lock, similar to
test_features().

This also makes sure we look up flags of the snapshot we're operating
on, instead of those for head.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 15:42:31 -08:00
Josh Durgin
bb4041fc95 librbd: add locking asserts to ImageCtx
A bunch of these used to be here, but were removed when converting to
RWLocks, before RWLocks had is_[w]locked() methods.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 15:41:54 -08:00
Josh Durgin
4bcbdbfd0f librbd: fix ImageWatcher::is_lock_supported() locking
Take snap_lock while reading ImageCtx->snap_id, and
look up the features by snap_id as well.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 15:41:54 -08:00
Josh Durgin
a94ceb6088 librbd: add and use a test_features() helper
This gets the appropriate locks, and checks the currently open
snapshot instead of head.  Looking up features by snap_id prepares us
for future addition or removal of e.g. an object map throughout the
life of an image.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 15:41:54 -08:00
Josh Durgin
cffd93a32f librbd: use ImageCtx->snap_lock for ImageCtx->features
This was being protected by md_lock, but that has become too coarse
since it is used to prevent writes from proceeding while flushing
caches for a snapshot. With the addition of ObjectMap and
ImageWatcher, writeback could try to acquire md_lock again, leading to
a deadlock.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-25 15:41:50 -08:00
Jason Dillaman
468839eac9 tests: add additional test coverage for ImageWatcher RPC
Test flatten, resize, and snap create RPC messages along with
basic error code return paths.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-25 15:03:49 -05:00
Jason Dillaman
915064a732 librbd: add ostream formatter for NotifyOp
Allow for reuse of the NotifyOp to string conversions within
dencoder and tests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-25 14:58:27 -05:00
Greg Farnum
260c8201a8 fuse: do not invoke ll_register_callbacks() on finalize
We were passing in a NULL data structure, probably in an attempt to
let things clean up -- but our implementation just returns with a NULL
pass-in value, so drop it for clarity.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-02-25 11:24:52 -08:00
Gregory Farnum
93e04a04a6 Merge pull request #3794 from ceph/wip-10862-hammer
Backport: mon: do not try and "deactivate" the last MDS
2015-02-25 11:07:59 -08:00
Ken Dreyer
05a4d6b492 Merge pull request #3788 from ceph/wip-devel-python-split
split python-ceph into python-{rados,rbd,cephfs}

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2015-02-25 12:00:43 -07:00
Sage Weil
1c68264928 doc/release-notes: final v0.87.1 notes
Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-25 10:57:43 -08:00
Gregory Farnum
551fffa3be Merge pull request #3790 from ceph/hadoop-workunits
hadoop: workunits don't need java path
2015-02-25 09:20:49 -08:00
Haomai Wang
ff2d497f86 TestMsgr: Add inject error tests for lossless_peer_reuse policy
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2015-02-25 23:43:43 +08:00
Haomai Wang
9f24a8c75c TestMsgr: Make SyntheticWorkload support policy passed in
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2015-02-25 23:43:32 +08:00
John Spray
75d8c01179 mon: do not try and "deactivate" the last MDS
Fixes: #10862
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit a2867987bc)
2015-02-25 14:12:31 +00:00
John Spray
8f18fd9cce Merge pull request #3793 from Ved-vampir/master
common: change default value for perfcounter description ("NO_INFO_FIX">...

Reviewed-by: John Spray <john.spray@redhat.com>
2015-02-25 14:04:28 +00:00
Ved-vampir
94e47cf409 common: change default value for perfcounter description ("NO_INFO_FIX">NULL)
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
2015-02-25 13:40:45 +03:00
Loic Dachary
6d83bd09e9 Merge pull request #3757 from theanalyst/0.93/contributors
mailmap updates

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-02-25 11:34:12 +01:00
Abhishek Lekshmanan
93848b0cfc mailmap: Kefu Chai affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-02-25 15:38:56 +05:30
Abhishek Lekshmanan
061d277d8d mailmap: Andy Allan affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 15:38:56 +05:30
Abhishek Lekshmanan
e2ba6f3137 mailmap: Anis Ayari affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2015-02-25 15:38:56 +05:30
Abhishek Lekshmanan
e57a76f75f mailmap: Armando Segnini affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 15:38:56 +05:30
Abhishek Lekshmanan
c1fce65b02 mailmap: Billy Olsen affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Billy Olsen <billy.olsen@canonical.com>
2015-02-25 15:38:56 +05:30
Abhishek Lekshmanan
8605e051e8 mailmap: Ahoussi Armand affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:56 +05:30
Abhishek Lekshmanan
156a4b91d1 mailmap: Hazem Amara affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:56 +05:30
Abhishek Lekshmanan
252f5f09fe mailmap: Karel Striegel affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
2042dd4e07 mailmap: Florian Coste affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
ace7adbd75 mailmap: Petr Machata affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
cac44fde2b mailmap: Shanggao Qiu affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
39a9b5cbeb mailmap: Thomas Cantin affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
e8ff0a559f mailmap: Tim Freund affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
4de44c4367 mailmap: Travis Rhoden affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
857371e351 mailmap: Kiseleva Alyona affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
5e9acbd0a5 mailmap: Baptiste Veuillez affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30
Abhishek Lekshmanan
b01eb8e50c mailmap: Viktor Suprun affiliation
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
2015-02-25 12:06:55 +05:30