Commit Graph

33298 Commits

Author SHA1 Message Date
Yan, Zheng
3a7d668477 mds: allow early reply when request's witness list is empty
Early reply should be Ok when there were slave requests, but all
of them were for acquiring locks.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-05-01 01:32:39 +08:00
Sage Weil
b5d1dd8a68 Merge pull request #1121 from ceph/wip-no-anchor
mds: remove anchor table (merge post-firefly only)

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 10:11:42 -07:00
Sage Weil
0fa969b5c1 Merge pull request #1670 from yuyuyu101/wip-test-clone
Add clone test on store_test

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 10:10:24 -07:00
Yan, Zheng
41d93aabdb mds: include authority of the source inode in rename witnesses
rename updates source inode's ctime

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-30 18:31:23 +08:00
Sage Weil
68b440d665 osd: automatically scrub PGs with invalid stats
If a PG has recnetly split and has invalid stats, scrub it now, even if
it has scrubbed recently.  This helps the stats become valid again soon.

Fixes: #8147
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-29 11:23:58 -07:00
Joao Eduardo Luis
d01aa5bff3 mon: OSDMonitor: return immediately if 'osd tier cache-mode' is a no-op
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-04-29 18:03:56 +01:00
Yan, Zheng
f689e5f049 mds: remove discover ino
Anchor table was the main user of MDCache::discover_ino(), it has
been removed. MDCache::discover_path() can replace discover_ino()
in remaining places. This patch removes discover ino related code.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-29 13:58:26 +08:00
Yan, Zheng
913a5dd4ea mds: remove anchor table
use backtrace instead of anchors to find/open remote inodes

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-29 09:11:52 +08:00
John Wilkins
8217600033 doc: Ensure fastcgi socket doesn't clash with gateway daemon socket.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-04-28 18:11:03 -07:00
John Wilkins
9c9b92f949 doc: Verified RHEL configuration.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-04-28 18:10:15 -07:00
John Wilkins
ec11bf7eed doc: Fixed inconsistent header.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-04-28 18:09:20 -07:00
John Wilkins
63b2964b34 doc: Added rhel-6-server-optional-rpms repo.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-04-28 18:08:59 -07:00
John Wilkins
150a1de402 Merge branch 'master' of https://github.com/ceph/ceph into wip-doc-radosgw 2014-04-28 18:07:27 -07:00
Haomai Wang
f674f36f4c Copy range using fiemap not entire length
Under rbd usage, if a volume has tens of thousands of objects and each 4M
object only has several KB(run fio on this volume or other cases), this volume
will be very low performance during a long time after create snapshot on
this volume. The OSD will be busy with large bandwidth read/write although
the object actually has few bytes needed to be copied.

This commit try to use fiemap if backend fs support, it can skip unnecessary
range to write. It also can be beneficial to space effective, because the copied
object will be regard as snapshot object which is access infrequently.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 17:28:11 -07:00
Shawn Edwards
3920f40afc rbd-fuse: fix unlink
The path contains a leading / that needs to be ignored.

Fixes: #8197
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 17:08:12 -07:00
Sage Weil
915bd92f50 Merge pull request #1701 from ceph/wip-libkrbd
libkrbd convenience library

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 16:52:12 -07:00
Sage Weil
a0867dbdb0 Merge pull request #1648 from ceph/wip-client-sleep
Wip client sleep

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 16:51:33 -07:00
Josh Durgin
b3db3a5fd6 Merge pull request #1709 from dachary/wip-brag
brag : useability changes

Reviewed-by: Babu Shanmugam <anbu@enovance.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:51:43 -07:00
Josh Durgin
9021b35245 Merge branch 'wip-rbd-invalidate'
Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 15:36:32 -07:00
Josh Durgin
818dde3120 Merge pull request #1737 from steveftaylor/add_rbd_fuse_image_restriction
Added a new command line parameter (-i or --image=) that allows rbd-fuse...

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 15:33:34 -07:00
Josh Durgin
11e060616d Merge pull request #1699 from chrisglass/python-api-cleanup
Simple mechanical cleanups

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:28:31 -07:00
Josh Durgin
5d340d26dd librbd: add an interface to invalidate cached data
This is useful for qemu to guarantee live migration with caching is
safe, by invalidating the cache on the destination before starting it.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:15:03 -07:00
Josh Durgin
e08b8b66c7 librbd: check return code and error out if invalidate_cache fails
This will only happen when shrinking or rolling back an image is done
while other I/O is in flight to the same ImageCtx. This is unsafe, so
return an error before performing the resize or rollback.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:14:47 -07:00
Stephen F Taylor
b1df2c379b Changed the -i parameter to -r in order to avoid a conflict with a generic flag interpreted by the common code. 2014-04-28 15:31:07 -06:00
Sage Weil
d8c5cc679e Merge pull request #1652 from ceph/wip-5170-firefly
Wip 5170 firefly
2014-04-28 14:13:24 -07:00
Sage Weil
8cc878e43b Merge pull request #1734 from ceph/wip-8202
rgw: fix url escaping

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 14:11:20 -07:00
Yehuda Sadeh
5544a51df0 Merge pull request #1736 from ceph/wip-7500-wusui
Fix s3 tests in the rgw workunit.

Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2014-04-28 14:06:11 -07:00
Warren Usui
9e3b8609cb Fix s3 tests in the rgw workunit.
Make it possible to set RGW_PORT with ENV variable.

Fixes: 7500
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-28 13:56:29 -07:00
Stephen F Taylor
3ec0040699 Added a new command line parameter (-i or --image=) that allows rbd-fuse to specify a single image to be made available within
the mount directory. The purpose of this is to allow a single RBD to be "mounted" in userspace without opening (and locking)
the other RBDs in the pool.

This is accomplished by performing a case-sensitive string compare in enumerate_images() when an image name is
specified on the command line. If no image name is specified, all images appear in the mount directory. If a non-existent
image name is specified, the mount directory is empty.

Signed-off-by: Stephen F Taylor <steveftaylor@gmail.com>
2014-04-28 14:49:30 -06:00
Samuel Just
060105c313 ReplicatedPG: we can get EAGAIN on missing clone flush
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-04-28 12:45:43 -07:00
Samuel Just
d83b8f5851 ReplicatedPG: do not preserve op context during flush
Any information stashed in the OpContext may be obsolete by the time we
actually mark the object clean.  Instead, let the start_flush caller
clean up its OpContext and in try_flush_mark_clean we'll create a new
one.  The primary reason to keep the OpContext would have been locking,
but we can set the obc as blocking without holding an OpContext, and
that would allow trimming to happen in the mean time (which is good
since trim_object does not respect rw locks since it doesn't change user
visible state).  In try_flush_mark_clean, we requeue the fop->op along
with (but ahead of) the fop->dup_ops.

Fixes: #8068
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-04-28 12:45:38 -07:00
Sage Weil
a60e15af8a doc/release-notes: v0.67.8 notes
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-28 12:40:04 -07:00
John Wilkins
c511894e9d Merge branch 'master' of https://github.com/ceph/ceph into wip-doc-radosgw 2014-04-28 10:33:47 -07:00
Yehuda Sadeh
bcf92c496a rgw: fix url escaping
Fixes: #8202
This fixes the radosgw side of issue #8202. Needed to cast value
to unsigned char, otherwise it'd get padded.

Backport: dumpling

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-04-28 10:14:07 -07:00
Yan, Zheng
3e41f92b84 client: cleanup unsafe requests if MDS session is reset
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-27 21:40:06 +08:00
Yan, Zheng
70ab0793cc client: wake up cap waiters if MDS session is reset
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-27 21:40:06 +08:00
Yan, Zheng
b8aa58af79 client: drop dirty/flushing caps if auth MDS' session is reset
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-27 21:40:06 +08:00
Yan, Zheng
09a1bc5a46 client: add asok command to kick sessions that were remote reset
Fixes: #8021
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-27 21:40:00 +08:00
Yan, Zheng
c1bf7dbbe1 Merge pull request #1729 from ceph/wip-7966
readlink result in resapwn

Reviewed-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-26 20:49:16 +08:00
Sage Weil
5d497826f9 mds: terminate readlink result in resapwn
readlink(2) does not null terminate the buffer; we need to do that.

Fixes: #7966
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-25 19:46:24 -07:00
wusui
58d7640d25 Merge pull request #1727 from ceph/wip-8193
ceph_test_rados_api_tier: increase HitSetTrim timeouts
2014-04-25 16:20:20 -07:00
Sage Weil
0062070ef4 Merge pull request #1725 from FlorentCoppint/master
Skipping '_netdev' Debian fstab option

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-25 15:58:47 -07:00
Sage Weil
d0f1806d57 ceph_test_rados_api_tier: increase HitSetTrim timeouts
...so that they pass when they get unlucky with thrashing.

This will vastly decrease the probability of failure, but failure will
always be possible when a timeout is in place.

Fixes: #8193
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-25 15:49:06 -07:00
FlorentCoppint
9ac264a856 Skipping '_netdev' Debian fstab option
Signed-off-by: Florent Bautista <florent@coppint.com>
2014-04-25 09:20:02 +02:00
Samuel Just
499adb1db1 rados.h,ReplicatedPG: add CEPH_OSD_FLAG_ENFORCE_SNAPC and use on flush
We need to ensure that even with pool snaps, we use the snapc provided in order
to ensure that the clones are written back correctly.

Fixes: #7941
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-04-24 16:48:15 -07:00
Loic Dachary
9b37398d65 Merge pull request #1717 from dachary/wip-auid
mon: add ceph osd pool set <pool> auid

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-04-24 22:42:09 +02:00
wusui
e8b13f71ca Merge pull request #1724 from ceph/wip-uselocalgithubforqemu-wusui
Use new git mirror for qemu-iotests
2014-04-24 13:27:40 -07:00
Warren Usui
ddf37d903f Use new git mirror for qemu-iotests
Fixes: 8191
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-24 12:55:26 -07:00
Samuel Just
1885792c51 ECBackend::continue_recovery_op: handle a source shard going down
get_min_avail_to_read_shards might return an error if there are
no longer enough sources to reconstruct the missing shards.
This is possible if osds went down while we were writing the
previous chunk -- we already notice in check_recovery_sources
if a source goes down during a read.

Fixes: #8161
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-04-24 12:48:46 -07:00
Loic Dachary
c0c2361b6e brag : implement --verbose on client
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-04-24 10:29:26 +02:00