Commit Graph

34351 Commits

Author SHA1 Message Date
Sage Weil
cf5f535125 doc/release-notes: clarify CRUSH notes about tunables
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-07 07:05:38 -07:00
Dan van der Ster
d84d7204a1 decrement WBThrottle perfcounters in clear_object
We observed that the WBThrottle perfcounters are leaking upwards
at a rate of around 50-100 ios_dirtied per day. The counters are
currently not decremented in clear_object, so that's the likely
explanation. Decrement them like elsewhere in WBThrottle.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2014-07-07 16:02:05 +02:00
Sage Weil
7e3fb06a7e Merge pull request #2075 from ceph/wip-8745
mds: use client-provided time stamp for user-visible file metadata

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-07 06:54:49 -07:00
Yan, Zheng
16df4c3ed8 mds: use client-provided time stamp for user-visible file metadata
Fixes: #8745
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-07-07 16:17:26 +08:00
Dmitry Smirnov
c0806bbdcc doc: mention kernel support for rbd format 2
Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
2014-07-05 19:27:24 +10:00
Sage Weil
dd5b60b4f1 Merge remote-tracking branch 'gh/next' 2014-07-04 21:18:55 -07:00
Sage Weil
50a21833fb Merge pull request #2072 from ceph/wip-8738-next
Patch up the CRUSH map compatibility guards

Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-04 18:35:24 -07:00
Wido den Hollander
c7937ff38c doc: Fix a typo regarding requiretty for RHEL based platforms 2014-07-04 14:28:03 +02:00
Sage Weil
276dbfc4cb Merge pull request #2058 from ceph/wip-refs
refcount debugging for RefCountedObject

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-03 17:36:48 -07:00
Greg Farnum
54af810481 mon: check changes to the whole CRUSH map and to tunables against cluster features
When we change the tunables, or set a new CRUSH map, we need to make sure it's
supported by all the monitors and OSDs currently participating in the cluster.

Fixes: #8738

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-07-03 16:32:41 -07:00
Greg Farnum
2280c0eaa9 OSDMonitor: fix quorum_features comparison in check_cluster_features
We need to see if there's a feature which is not in the quorum_features,
not if there are no features in common!

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-07-03 16:32:41 -07:00
Sage Weil
c0ba58c49f msg: debug refs on incoming Messages
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:26 -07:00
Sage Weil
c0dcf3bf47 common/RefCountedObject: make nref, cct private
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:26 -07:00
Sage Weil
b0da92b895 msg/Message: use RefCountedObject ctor to set initial ref count
Also, drop the useless assert in the dtor (the RefCountedObject dtor does
the same).

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:26 -07:00
Sage Weil
e621856847 msg/Pipe: debug Pipe refs
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:25 -07:00
Sage Weil
242ee89c96 msg: debug Connection refs
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:25 -07:00
Sage Weil
fc8d198049 osd: debug Session refs
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:25 -07:00
Sage Weil
45991c055b common/RefCountedObject: assert nref == 0 in dtor
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:25 -07:00
Sage Weil
ff1521fce4 common/RefCountedObject: optionally take initial ref count to ctor
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:25 -07:00
Sage Weil
054741725f common/RefCountedObject: optionally debug
Introduce a 'refs' subsys for logging.  Print log ref count inc and dec
for any RefCountedObject that gets a cct passed to its ctor.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-03 14:28:25 -07:00
Sage Weil
dc1e425d29 Merge pull request #2059 from ceph/wip-osd-dumpres
osd: allow dumping reservation state via asok

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-03 14:27:42 -07:00
Sage Weil
303a9fdc2e Merge pull request #2069 from thorstenb/thb-buildconvenience-1
Automagically setup submodules on first run.

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-03 14:00:34 -07:00
Sage Weil
235c27ab8d Merge pull request #2066 from thorstenb/wip-janitorial-clang-2
[werror] Fix c++11-compat-reserved-user-defined-literal
2014-07-03 13:56:01 -07:00
Samuel Just
9973d9809b Merge pull request #2062 from somnathr/wip-sd-replicated-pg
ReplicatedPG: Removed the redundant register_snapset_context call

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-03 13:36:50 -07:00
Samuel Just
f21a01791e Merge pull request #2064 from somnathr/wip-sd-share-map
OSD: adjust share_map() to handle the case that the osd is down

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-03 13:36:27 -07:00
Samuel Just
3c03beb3d9 Merge pull request #2065 from somnathr/wip-sd-optracker
Pull request for optracker changes

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-03 13:35:23 -07:00
Samuel Just
c44e14495b Merge pull request #2063 from athanatos/wip-8691
OSD: wake_pg_waiters after dropping pg lock

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-03 13:34:19 -07:00
Loic Dachary
10cdb29b60 Merge pull request #2047 from dachary/wip-osd-config
osd: improve tests for configuration updates

Reviewed-by: Sahid Orentino Ferdjaoui <sahid.ferdjaoui@cloudwatt.com>
2014-07-03 16:00:56 +02:00
Loic Dachary
5b97cd7fa7 Merge pull request #2036 from ceph/wip-osd-map-cache-size
osd: allow osd map cache size to be adjusted at runtime

Reviewed-by: Loic Dachary <loic@dachary.org>
2014-07-03 14:40:42 +02:00
Loic Dachary
72ac3c0a67 Merge pull request #2068 from thorstenb/wip-janitorial-clang-4
ceph_argparse_flag has no regular 3rd parameter.

Reviewed-by: Loic Dachary <loic@dachary.org>
2014-07-03 11:29:35 +02:00
Loic Dachary
2226b91e7d qa: support running under non privileged user
If the test is run against a cluster started with vstart.sh (which is
the case for make check), the --asok-does-not-need-root disables the use
of sudo and allows the test to run without requiring privileged user
permissions.

Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from commit 522174b066)
2014-07-02 20:31:31 -07:00
Sage Weil
a501eb80f4 Merge pull request #2061 from ceph/wip-8728
qa/workunits/rest/test.py: make osd create test idempotent

Reviewed-by: Dan Mick <dan.mick@inktank.com>
2014-07-02 17:55:05 -07:00
Sage Weil
55e297ad9a Merge pull request #2046 from ceph/wip-8670
mon: OSDMonitor: 'osd pool' - if we can set it, we must be able to get it

Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-02 17:44:56 -07:00
Thorsten Behrens
f7086d3684 Automagically setup submodules on first run.
I mean, who's reading the README, anyway?

Signed-off-by: Thorsten Behrens <tbehrens@suse.com>
2014-07-03 00:51:23 +02:00
Thorsten Behrens
0c7c7223a2 ceph_argparse_flag has no regular 3rd parameter.
With clang warning: 'va_start' has undefined behavior with reference
types, noticing copy-paste mistake on ceph_argparse_flag.

Signed-off-by: Thorsten Behrens <tbehrens@suse.com>
2014-07-03 00:43:52 +02:00
Thorsten Behrens
909850eb22 [werror] Fix c++11-compat-reserved-user-defined-literal
c++11 readiness, avoid clash with
http://www.stroustrup.com/C++11FAQ.html#UD-literals

Signed-off-by: Thorsten Behrens <tbehrens@suse.com>
2014-07-03 00:43:32 +02:00
Somnath Roy
fde99e699f OSD: adjust share_map() to handle the case that the osd is down
The assert was hitting while OSd is waiting for becoming healthy
in handle_osd_map(). This can happen while io is going on and
OSDs are made down forcefully by say osd thrash command.
So, the fix could be instead of asserting just return from here.

Fixes: #8646

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-07-02 13:51:11 -07:00
Joao Eduardo Luis
ddc04c83ff mon: OSDMonitor: 'osd pool' - if we can set it, we must be able to get it
Add support to get the values for the following variables:
 - target_max_objects
 - target_max_bytes
 - cache_target_dirty_ratio
 - cache_target_full_ratio
 - cache_min_flush_age
 - cache_min_evict_age

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-02 19:35:31 +01:00
Somnath Roy
0392ddb670 ReplicatedPG: Removed the redundant register_snapset_context call
In the get_object_context(), the get_snapset_context is been called
and the register_snapset_context is already been invoked from there.
This call seems to be redundant.

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-07-02 11:20:29 -07:00
Somnath Roy
2f089d8d4c OpTracker: The optracker enabled/disabled check is added
The optracker enabled/disabled check is now added in the
mark_event(const string&) interface.

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-07-02 11:06:25 -07:00
Somnath Roy
63be0f2033 OpTracker: use mark_event rather than _mark_event
mark_event() interfaced changed to accept time and it is default
to 'now'. The mark_event is the wrapper function of _mark_event()
and it has the check for optracking enabled/disabled as well.
The _mark_event() is now a private function.

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-07-02 11:01:55 -07:00
Sage Weil
bb3e1c92b6 qa/workunits/rest/test.py: make osd create test idempotent
Avoid possibility that we create multiple OSDs do to retries by passing in
the optional uuid arg.  (A stray osd id will make the osd tell tests a
few lines down fail.)

Fixes: #8728
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-02 10:39:17 -07:00
Yan, Zheng
7e1deb6ea9 mds: defer encoding/submitting log events to separate thread
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-07-02 14:01:27 +08:00
Yan, Zheng
44199d6afd mds: use mutex to protect log segment list
prevent race between creating new log segment and trimming old
segment.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-07-02 14:01:27 +08:00
Yan, Zheng
6d8ccdd656 mds: add thread to encode/submit log events
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-07-02 14:01:25 +08:00
Sage Weil
70c0723f80 osd: add dump_reservations asok command
Allow an admin to inspect pending and in-progress reservations.

Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-01 22:04:50 -07:00
Sage Weil
6483710613 common/AsyncReserver: add dump()
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-01 21:49:53 -07:00
Samuel Just
149a3059d4 Merge pull request #2055 from ceph/wip-8692
mon: clear osd request queue latency info on down or up

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-01 13:08:13 -07:00
Sage Weil
9ce5ff96a1 mon: clear osd request queue latency info on down or up
It doesn't make sense to warn about slow requests on OSDs that are down;
clear those stats in the monitor when we see an OSD go down (or up).

Fixes: #8692
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-01 12:42:19 -07:00
Gregory Farnum
3a6711f867 Merge pull request #2054 from ceph/wip-fs-cmds-oops
Apply some accidentally-dropped commits from the wip-fs-cmds branch to be a little friendlier and pass tests.

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-01 11:49:21 -07:00