Commit Graph

33159 Commits

Author SHA1 Message Date
Samuel Just
4aa93dd12c Merge pull request #1698 from ceph/wip-snapmapper-debug
osd/SnapMapper: debug

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-05-02 16:52:36 -07:00
Samuel Just
2700ebf83b Merge pull request #1694 from ceph/wip-throttle-snap-master
osd: throttle snap trimmming with simple delay

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-05-02 16:48:10 -07:00
Danny Al-Gaaf
b45adc9894 Merge pull request #1759 from dachary/wip-mailmap
DNM: mailmap updates

Reviewed-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2014-05-03 01:43:14 +02:00
Samuel Just
84728058db Revert "ReplicatedPG: block scrub on blocked object contexts"
This reverts commit e66f2e36c0.
Reviewed-by: Sage Weil <sage@inktank.com>
2014-05-02 16:36:42 -07:00
Sage Weil
5a6ae2a978 mon/PGMonitor: set tid on no-op PGStatsAck
The OSD needs to know the tid.  Both generally, and specifically because
the flush_pg_stats may be blocking on it.

Fixes: #8280
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-05-02 15:43:29 -07:00
Sage Weil
2e6b24868d mon/OSDMonitor: share latest map with osd on dup boot message
If we get a dup boot message, share the newer maps with the osd so that
they know they are living in the past.

Fixes: #8279
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-05-02 15:43:15 -07:00
Sage Weil
77a6f0aefe mon/MonClient: remove stray _finish_hunting() calls
Callig _finish_hunting() clears out the bool hunting flag, which means we
don't retry by connection to another mon periodically.  Instead, we send
keepalives every 10s.  But, since we aren't yet in state HAVE_SESSION, we
don't check that the keepalives are getting responses.  This means that an
ill-timed connection reset (say, after we get a MonMap, but before we
finish authenticating) can drop the monc into a black hole that does not
retry.

Instead, we should *only* call _finish_hunting() when we complete the
authentication handshake.

Fixes: #8278
Backport: firefly, dumpling
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-05-02 15:42:58 -07:00
Loic Dachary
d0245947f2 mailmap: Florent Bautista affiliation
and name normalization

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-05-03 00:42:24 +02:00
Loic Dachary
61a2f064e9 mailmap: Warren Usui name normalization
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-05-03 00:35:42 +02:00
Loic Dachary
7b192f7db2 mailmap: Guang Yang name normalization
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-05-03 00:35:04 +02:00
Sage Weil
331869a019 Merge pull request #1754 from nereocystis/hardware-to-glossary
doc: Include links from hardware-recommendations to glossary
2014-05-02 14:22:17 -07:00
Sage Weil
9f1a916883 osd/SnapMapper: pass snaps set by const ref
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-01 17:31:05 -07:00
Sage Weil
6105c3556f osd/SnapMapper: debug
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-01 17:29:46 -07:00
Kevin Dalley
c879e895da doc: Include links from hardware-recommendations to glossary
Included :term: in parts of hardware-recommendations so that glossary
links appear.
Signed-off-by: Kevin Dalley <kevin@kelphead.org>
2014-05-01 17:04:43 -07:00
Danny Al-Gaaf
c6ada53a14 Merge pull request #1749 from hufman/fix-typo-releasenotes-pyramind
Fixes a very minor typo in the release notes

Reviewed-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2014-05-02 01:06:26 +02:00
Sage Weil
cc043225f8 mds: note MDiscoverReply encoding change in corpus
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-01 15:07:50 -07:00
Sage Weil
1f4a3e1f3b mds: bump protocol
In commit f689e5f049 we change the encoding
and semantics for MDiscoverReply.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-01 13:46:40 -07:00
Samuel Just
d993b9ca89 Merge pull request #1738 from ceph/wip-8147
osd: automatically scrub PGs with invalid stats

Reviewed-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: David Zafman <david.zafman@inktank.com>
2014-05-01 10:46:31 -07:00
Sage Weil
1ac05fd160 doc/release-notes: changelog link
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-01 09:59:37 -07:00
Sage Weil
ffef20fe8b doc/release-notes: final v0.67.8 notes and changelog
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-01 08:36:42 -07:00
John Wilkins
387b297458 Merge pull request #1750 from nereocystis/doc-link-to-involved
doc: documenting links to get-involved
2014-04-30 23:07:53 -07:00
Walter Huf
0454962e20 Fixes a very minor typo in the release notes
pyramind -> pyramid
2014-05-01 00:25:00 -05:00
Kevin Dalley
78b3c93dd6 doc: documenting links to get-involved
Create a link from documenting-ceph so that it is easy to find the
github repository used for ceph.

Signed-off-by: Kevin Dalley <kevin@kelphead.org>
2014-04-30 21:31:06 -07:00
Samuel Just
e66f2e36c0 ReplicatedPG: block scrub on blocked object contexts
Fixes: #8011
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 15:11:06 -07:00
Sage Weil
3b6d262fdb Merge pull request #1745 from ceph/wip-7941
rados.h,ReplicatedPG: add CEPH_OSD_FLAG_ENFORCE_SNAPC and use on flush

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 15:09:45 -07:00
Sage Weil
ed46433602 Merge pull request #1744 from ceph/wip-8161
ECBackend::continue_recovery_op: handle a source shard going down

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 15:07:51 -07:00
Sage Weil
348e8c176b Merge pull request #1746 from ceph/wip-8086
Wip 8086

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 15:03:45 -07:00
Alfredo Deza
82a3668e7c Merge pull request #1629 from ceph/wip-die-mkcephfs
remove mkcephfs (merge post-firefly?)

Reviewed-by:  Alfredo Deza <alfredo.deza@inktank.com>
2014-04-30 13:52:00 -04:00
Yan, Zheng
8979eb3945 Merge pull request #1741 from ceph/wip-early-reply
Wip early reply
2014-05-01 01:36:49 +08:00
Yan, Zheng
21bbdf5dd9 mds: avoid adding replicas of target dentry to rename witnesses
When the rename target dentry is NULL, we can use MDentryLink messages
instead of slave requests to update its replicas.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-05-01 01:33:14 +08:00
Yan, Zheng
3a7d668477 mds: allow early reply when request's witness list is empty
Early reply should be Ok when there were slave requests, but all
of them were for acquiring locks.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-05-01 01:32:39 +08:00
Sage Weil
b5d1dd8a68 Merge pull request #1121 from ceph/wip-no-anchor
mds: remove anchor table (merge post-firefly only)

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 10:11:42 -07:00
Sage Weil
0fa969b5c1 Merge pull request #1670 from yuyuyu101/wip-test-clone
Add clone test on store_test

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-30 10:10:24 -07:00
Yan, Zheng
41d93aabdb mds: include authority of the source inode in rename witnesses
rename updates source inode's ctime

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-30 18:31:23 +08:00
Sage Weil
68b440d665 osd: automatically scrub PGs with invalid stats
If a PG has recnetly split and has invalid stats, scrub it now, even if
it has scrubbed recently.  This helps the stats become valid again soon.

Fixes: #8147
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-29 11:23:58 -07:00
Yan, Zheng
f689e5f049 mds: remove discover ino
Anchor table was the main user of MDCache::discover_ino(), it has
been removed. MDCache::discover_path() can replace discover_ino()
in remaining places. This patch removes discover ino related code.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-29 13:58:26 +08:00
Yan, Zheng
913a5dd4ea mds: remove anchor table
use backtrace instead of anchors to find/open remote inodes

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-29 09:11:52 +08:00
Haomai Wang
f674f36f4c Copy range using fiemap not entire length
Under rbd usage, if a volume has tens of thousands of objects and each 4M
object only has several KB(run fio on this volume or other cases), this volume
will be very low performance during a long time after create snapshot on
this volume. The OSD will be busy with large bandwidth read/write although
the object actually has few bytes needed to be copied.

This commit try to use fiemap if backend fs support, it can skip unnecessary
range to write. It also can be beneficial to space effective, because the copied
object will be regard as snapshot object which is access infrequently.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 17:28:11 -07:00
Shawn Edwards
3920f40afc rbd-fuse: fix unlink
The path contains a leading / that needs to be ignored.

Fixes: #8197
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 17:08:12 -07:00
Sage Weil
915bd92f50 Merge pull request #1701 from ceph/wip-libkrbd
libkrbd convenience library

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 16:52:12 -07:00
Sage Weil
a0867dbdb0 Merge pull request #1648 from ceph/wip-client-sleep
Wip client sleep

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 16:51:33 -07:00
Josh Durgin
b3db3a5fd6 Merge pull request #1709 from dachary/wip-brag
brag : useability changes

Reviewed-by: Babu Shanmugam <anbu@enovance.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:51:43 -07:00
Josh Durgin
9021b35245 Merge branch 'wip-rbd-invalidate'
Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 15:36:32 -07:00
Josh Durgin
818dde3120 Merge pull request #1737 from steveftaylor/add_rbd_fuse_image_restriction
Added a new command line parameter (-i or --image=) that allows rbd-fuse...

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 15:33:34 -07:00
Josh Durgin
11e060616d Merge pull request #1699 from chrisglass/python-api-cleanup
Simple mechanical cleanups

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:28:31 -07:00
Josh Durgin
5d340d26dd librbd: add an interface to invalidate cached data
This is useful for qemu to guarantee live migration with caching is
safe, by invalidating the cache on the destination before starting it.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:15:03 -07:00
Josh Durgin
e08b8b66c7 librbd: check return code and error out if invalidate_cache fails
This will only happen when shrinking or rolling back an image is done
while other I/O is in flight to the same ImageCtx. This is unsafe, so
return an error before performing the resize or rollback.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-28 15:14:47 -07:00
Stephen F Taylor
b1df2c379b Changed the -i parameter to -r in order to avoid a conflict with a generic flag interpreted by the common code. 2014-04-28 15:31:07 -06:00
Sage Weil
d8c5cc679e Merge pull request #1652 from ceph/wip-5170-firefly
Wip 5170 firefly
2014-04-28 14:13:24 -07:00
Sage Weil
8cc878e43b Merge pull request #1734 from ceph/wip-8202
rgw: fix url escaping

Reviewed-by: Sage Weil <sage@inktank.com>
2014-04-28 14:11:20 -07:00