Commit Graph

34408 Commits

Author SHA1 Message Date
Samuel Just
79f3f67491 Merge pull request #1999 from yuyuyu101/keyvaluestore-cache
Keyvaluestore cache

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-11 17:01:12 -07:00
Gregory Farnum
d24fa335e9 Merge pull request #2096 from ceph/wip-test-post-file
qa/workunits/post-file.sh

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 16:39:02 -07:00
Sage Weil
447f849fec doc/release-notes: v0.80.3
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 16:00:41 -07:00
Sage Weil
29f20b7e82 qa/workunits/post-file.sh
Test ceph-post-file.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 15:33:35 -07:00
Gregory Farnum
509578757f Merge pull request #2090 from ceph/wip-nuke-dlist
nuke dlist

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 15:07:54 -07:00
Sage Weil
96653bb27b Merge pull request #2089 from lpabon/lpabon_readforward
Support for READFORWARD in the caching tier

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:06:53 -07:00
Sage Weil
50c6b83aba Merge pull request #2093 from theanalyst/doc/format-fix
doc: minor format fix for radosgw admin docs
2014-07-11 15:06:33 -07:00
Sage Weil
94d40b5e4f Merge pull request #2042 from ceph/wip-port-fixes
Portability updates

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:02:39 -07:00
Sage Weil
1fd89cead2 Merge pull request #2086 from ceph/wip-8696
mon: OSDMonitor: limit tier-specific pool set/get on non-tier pools

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:00:51 -07:00
Sage Weil
636a899fe0 Merge pull request #2091 from ceph/wip-kinetic-os
prototype kinetic osd backend

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 14:59:19 -07:00
Sage Weil
49e5c8ec88 Merge remote-tracking branch 'gh/next' 2014-07-11 14:56:40 -07:00
Samuel Just
e1fc96f713 Merge pull request #2071 from somnathr/wip-sd-cpu-optimized
Wip sd cpu optimized

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-11 14:42:48 -07:00
Gregory Farnum
fb7d5a3a75 Merge pull request #2094 from ceph/wip-8815
mon: avoid scrub noise due to divering OSDMap encoding versions

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 13:13:31 -07:00
Sage Weil
c93da05bd3 osd/osd_types: be pedantic about encoding last_force_op_resend without feature bit
The addition of the value is completely backward compatible, but if the
mon feature bits don't match it can cause monitor scrub noice (due to the
parallel OSDMap encoding).  Avoid that by only adding the new field if the
feature (which was added 2 patches after the encoding, see
3152faf79f and
45e79a17a9.

Fixes: #8815
Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 11:31:22 -07:00
Sage Weil
712d5d1e29 osd/osd_types: remove useless encode_compat local var for pg_pool_t::encode
This is left over from db3fd1152a
when we made the HitSet stuff incompat, but that behavior was reverted by
dc3ce58add, leaving this cruft behind.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 11:29:05 -07:00
Samuel Just
f9d0e8ff10 Merge pull request #2088 from guangyy/wip-8733
Fix the PG listing issue which could miss objects for EC pool

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-11 10:20:04 -07:00
Sage Weil
bf048976f5 Merge pull request #2092 from onlyjob/rbdmap
rbdmap: per-device mount (Closes: #8538)

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 09:03:03 -07:00
Joao Eduardo Luis
50e93c2138 qa/workunits: cephtool: adjust pool name where missing as it has changed
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 15:22:43 +01:00
Abhishek Lekshmanan
daadff4cd0 doc: minor format fix for radosgw admin docs
Missing backtick fixed

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-11 18:03:54 +05:30
Dmitry Smirnov
b844ec93c5 rbdmap: per-device mount (Closes: #8538)
`/etc/init.d/rbdmap start` was doing `mount -a`. Although (arguably)
`mount -a -O _netdev` could be less disruptive, it's not RBD mapping job to
mount unrelated devices and potentially do it at the wrong time.

Solution is to call `mount {device}` which works as expected and mounts
device even if it given in form `mount /dev/rbd/pool/imagename` while
`/etc/fstab` uses UUID or LABEL notation.

Furthermore this commit

 * fixes global exit code (it was always 0): now it is 0 only when
   all devices were (un)mounted successfully; otherwise non-zero.
 * replaces `mount -a` with per-device post-mapping `mount {dev}`
 * show mapping progress using LSB functions per device instead of for
   {start|stop} invocation.
 * capture output of `(u)mount` (if any) and report it as "info".

Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
2014-07-11 19:50:24 +10:00
Ma, Jianpeng
02683ac6e8 rbd.cc: Check io-size avoid floating point exception.
In func do_bench_write if io_size is zero,it can cause floating point execption.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-10 17:59:18 -07:00
Joao Eduardo Luis
6cd345732b qa/workunits: cephtool: cleanup after pool creation
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 01:02:04 +01:00
Joao Eduardo Luis
704b0a33f2 qa/workunits: cephtool: pool needs to be a tier to be used as such
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 00:17:47 +01:00
Joao Eduardo Luis
49db676715 qa/workunits: cephtool: test erroneous 'tier remove'
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 00:17:47 +01:00
Joao Eduardo Luis
9fea033f30 qa/workunits: cephtool: test get/set on both tier and non-tier pools
Make sure gets and sets of tiering-specific variables succeed on tier
pools and fail on non-tier pools.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 00:17:47 +01:00
Joao Eduardo Luis
df5944955d qa/workunits: cephtool: split get/set on tier pools from get/set tests
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 00:17:47 +01:00
Joao Eduardo Luis
8e5a8daf98 mon: OSDMonitor: be scary about inconsistent pool tier ids
We may not crash your cluster, but you'll know that this is not something
that should have happened.  Big letters makes it obvious.  We'd make them
red too if we bothered to look for the ANSI code.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 00:17:47 +01:00
Joao Eduardo Luis
64bdf6c92b osd: pg_pool_t: clear tunables on clear_tier()
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 00:17:47 +01:00
Joao Eduardo Luis
f131dfbaed mon: OSDMonitor: limit tier-specific pool set/get on non-tier pools
Fixes: 8696

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 00:17:47 +01:00
Sage Weil
026b127aa9 doc/changelog/v0.80.2: include tag
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-10 13:24:08 -07:00
Josh Durgin
59c00e5fd0 os: add prototype KineticStore
Implement the KeyValueDB interface using libkinetic_client,
and allow it to be configured as the backend for the KeyValueStore,
running the entire OSD on it.

This prototype implementation has no transaction safety, and is
only suitable as a proof of concept. Since the libkinetic_client
API does not provide reverse iteration over keys without also reading
the value off disk, it implements iterators in a very slow but correct way.
These are used heavily by the KeyValueDB callers, so this is a bottleneck
in performance.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-10 13:23:35 -07:00
Somnath Roy
74f5e5e9dc PG::op_must_wait_for_map: pass the epoch rather than the map
have_same_or_newer_map is also modified to accept epoch instead of
map.

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-07-10 12:00:20 -07:00
John Wilkins
60f27a2602 Merge branch 'master' of https://github.com/ceph/ceph 2014-07-10 11:30:41 -07:00
John Wilkins
98f92d84d6 doc: Added CentOS/RHEL install for git.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-07-10 11:30:00 -07:00
Sage Weil
115c07857c rgw: modelines
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-10 10:54:51 -07:00
Sage Weil
c4afaf9dab rgw: fix RGWObjManifestRule decoder
Only decode the new field if it is a new struct.

Fixes: #8804
Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-10 10:36:37 -07:00
John Wilkins
0839e2a6de doc: Added keyring location note to resolve pull abandoned pull request #1946.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-07-10 08:05:42 -07:00
Sage Weil
4692257cef nuke dlist
No users.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-10 07:01:44 -07:00
Haomai Wang
a3e5c6d632 Add random_cache.hpp to Makefile.am
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-07-10 10:34:25 +08:00
Josh Durgin
f51f162ebd test: fix make_pair() for c++11
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-09 18:15:56 -07:00
Matt Benjamin
79e3761822 Remove some not-resolving make_pair() invocations.
There's nothing wrong with make_pair(), but there is some type
resolution issue in these instances, at least with GCC 4.8.

Signed-off-by: Matt Benjamin <matt@linuxbox.com>
2014-07-09 18:15:56 -07:00
Matt Benjamin
ebbdb3cc93 Add required spacing after string literals (PRIu64).
The common formatting for these 64bit types is not C++ 2011
clean.

Signed-off-by: Matt Benjamin <matt@linuxbox.com>

Conflicts:
	src/common/perf_counters.cc
2014-07-09 18:15:56 -07:00
Matt Benjamin
16ef1ed515 Convert ConnectionRef explicitly to bool.
Signed-off-by: Matt Benjamin <matt@linuxbox.com>
2014-07-09 18:15:56 -07:00
Matt Benjamin
c930a1f119 Work around an apparent binding bug (GCC 4.8).
A reference to h->seq passed to std::pair ostensibly could not bind
because the header structure is packed.  At first this looked like
a more general unaligned access problem, but the only location the
compiler rejects is a false positive.

Signed-off-by: Matt Benjamin <matt@linuxbox.com>
2014-07-09 18:15:56 -07:00
Guang Yang
228760ce3a Fix the PG listing issue which could miss objects for EC pool (where there is object shard and generation).
Backport: firefly
Signed-off-by: Guang Yang (yguang@yahoo-inc.com)
2014-07-10 01:05:40 +00:00
John Wilkins
bd6ba10042 doc: Clean up formatting, usage and removed duplicate section.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-07-09 17:18:03 -07:00
Sage Weil
15d5b514cc doc/release-notes: v0.80.2
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-09 17:12:39 -07:00
John Wilkins
7e3ad1a6fc Merge pull request #1905 from leseb/doc-rbd-icehouse
doc: rbd icehouse updated. Need to remove duplicate section.

Reviewed-by: John Wilkins <john.wilkins@inktank.com>
2014-07-09 16:27:52 -07:00
John Wilkins
8a0e498c78 Merge pull request #2087 from theanalyst/doc/typo-fix
doc: Fixing a few typos in docs

Reviewed-by: John Wilkins <john.wilkins@inktank.com>
2014-07-09 16:05:57 -07:00
Greg Farnum
29c2bb2a00 Revert "qa: add an fsx run which turns on kernel debugging"
This reverts commit 29c33f0c05.
We don't need the debugging any more, and having two separate fsx runners
already caused one update-in-the-wrong-place issue.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-07-09 10:52:50 -07:00