Commit Graph

19846 Commits

Author SHA1 Message Date
Sage Weil
a1c5ef0486 admin_socket: only init if path is defined
Signed-off-by: Sage Weil <sage@inktank.com>
2012-06-03 13:51:34 -07:00
Sage Weil
ac28c260f3 Merge remote branch 'gh/chef-3' 2012-06-02 14:49:02 -07:00
Sage Weil
3764ca6115 upstart: simplify start; allow group stop via an abstract job
Use a 'ceph-mds' or 'ceph-mon' event to start instances instead of
explicitly calling start.  This avoids the ugly is-this-already-running
check.  [Thanks Guilhem Lettron for that!]

Make the -all job abstract (which means it stays started and can be
stopped).  Trigger a helper task (-all-starter) to trigger instance
start.  Make instances stop with the -all task.  This allows you to do

 start ceph-mds-all
 stop ceph-mds-all
 start ceph-mds id=foo
 start ceph-mds-all
 stop ceph-mds id=bar
 stop ceph-mds-all

but not

 start ceph-mds id=foo
 stop ceph-mds-all

because ceph-mds-all isn't running.  Not quite as flexible in sysvinit in
that regard, but good enough for me.

Fixes: #2414
Signed-off-by: Sage Weil <sage@inktank.com>
2012-06-02 15:19:28 -07:00
Sage Weil
c48de3ad7a paxos: warn on extreme clock skew
This would have helped us diagnose #2480.

Signed-off-by: Sage Weil <sage@inktank.com>
2012-06-02 14:29:48 -07:00
Sage Weil
576dff89d4 omapbench: fix warning
Signed-off-by: Sage Weil <sage@inktank.com>
2012-06-02 14:03:17 -07:00
Sage Weil
ab5139b300 omapbench: fix misc warnings
Signed-off-by: Sage Weil <sage@inktank.com>
2012-06-02 13:18:01 -07:00
Samuel Just
6f3e7a84a2 ReplicatedPG: fix pgls listing, add max listing size
Previously, a client requesting a large pgls could tie up the
osd for an unacceptable amount of time.  Also, it's possible
for the osd to return less than the requested number of
entries anyway, so we now return 1 when we have completed the
listing.

Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2012-06-01 16:13:23 -07:00
Sage Weil
d8e07a34e8 objecter: fix pgls
First problem: if the osd returns more entries than we ask for, max_entries
was going negative, and we were requesting (u64)(-small number) on the
next iteration, slamming the OSD when the PG was big.  We fix that by
finishing response_size >= max_entries.

Second problem: AFAICS we were not requesting the second chunk on a large
PG at all, here, if the OSD returned less than what we wanted.  Fix this
by asking for more in that case.

That means we detect the end of a PG in two ways:

 * if the OSD sets the return value to 1 (instead of 0)
 * if we get 0 items in the response

Another patch will change the OSD behavior to return 1, and all will be
well.  If we run against an old OSD, we'll send an extra request for each
PG and get nothing back before we realize we've hit the end and move on.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Sam Just <sam.just@inktank.com>
2012-06-01 16:11:18 -07:00
Sage Weil
6eb99d4883 Merge remote-tracking branch 'gh/wip-admin' 2012-06-01 13:57:26 -07:00
Sage Weil
b9ef3149f8 mon: fix slurp latest race
It is possible for the latest version to get out in front of the
last_committed version:

 a- start slurping
 a- slurp a bunch of states, through X
 a- get them back, write them out
 b- monitor commits many new states
 a- slurp latest, X+100 say, but only get some of those states due to the
    slurp per-message byte limit
 a- write latest + some (but not all) prior states
 a- call back into slurp(), update_from_paxos(), trigger assert

This fix ensures that we make note of the source's new latest, so that on
the next pass through slurp() we will grab any missing states.

We *also* explicitly require that we get everything up through what we have
stashed, in defense against some future kludging that might only require we
nearly (but not completely) in sync before finishing the slurp.

Fixes: #2379
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2012-06-01 13:54:28 -07:00
Sage Weil
f871d83785 Makefile: include ceph-mds upstart bits in dist tarball
Signed-off-by: Sage Weil <sage@inktank.com>
2012-06-01 13:46:42 -07:00
Eleanor Cawthon
7a4e9234d3 test/: Added object map benchmarking tool
omap_bench writes configurable objectmaps to a configurable number
of objects and generates latency statistics.

Signed-off-by: Eleanor Cawthon <eleanor.cawthon@inktank.com>
2012-06-01 13:02:36 -07:00
Sage Weil
e0f19525f3 doc: fix autobuild debian source line
Signed-off-by: Sage Weil <sage@inktank.com>
2012-06-01 12:53:13 -07:00
Sage Weil
97d4396415 mon: throttle client msgr memory
Limit the amount of memory that can be consumed by client messages, similar
to the OSD.  Do not limit inter-mon messages.

Fixes: #2495
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2012-06-01 09:44:09 -07:00
Yehuda Sadeh
52b28ed631 Merge remote-tracking branch 'origin/wip-2491' 2012-06-01 09:30:31 -07:00
Samuel Just
7e3d90ac22 Objecter: tone down linger op messages on tick
Signed-off-by: Samuel Just <sam.just@inktank.com>
2012-05-31 19:05:25 -07:00
Yehuda Sadeh
4a7683cb5c test_stress_watch: exercise watch/unwatch/close from second client
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2012-05-31 17:04:00 -07:00
Sage Weil
95e0a880c8 qa: stress_watch.sh workunit runs test_stress_watch
Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-31 16:46:25 -07:00
Sage Weil
a4c90b7250 Merge remote-tracking branch 'gh/wip-mon-doc' 2012-05-31 16:42:38 -07:00
John Wilkins
fb7ce59b9a doc: Added preliminary rbd and ko info.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-05-31 15:35:33 -07:00
Adam Crume
10b0db3b53 osd: Adding const to methods in OSDMap
Signed-off-by: Adam Crume <adamcrume@gmail.com>
Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-31 14:20:59 -07:00
Yehuda Sadeh
8609caffd9 vstart.sh: initialize keyring even if not using cephx
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2012-05-31 11:38:37 -07:00
Yehuda Sadeh
e929d54da3 Merge branch 'master' of ssh://github.com/ceph/ceph 2012-05-31 11:37:52 -07:00
Sage Weil
594f2bbdda perf_counters: use bufferlist instead of vector<char>
bufferlist allocates page-sized chunks and avoids realloc, which'll be
more efficient than vector resize doubling just about always.

Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 22:22:34 -07:00
Sage Weil
ea1c0698cd mon: fix admin socket lock dependency
Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 22:22:34 -07:00
Sage Weil
fa2f1deaaa admin_socket: fix unit test
Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 22:22:34 -07:00
Sage Weil
51de7c1a31 osd: ack pending notify when unwatching
If an unwatch crosses paths with a notify, we currently force the notifier
to keep waiting.  Instead, implicitly ack any notify when we unwatch.

Fixes: #2491
Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 22:16:03 -07:00
Sage Weil
5adc85bd9b admin_socket: pass args separately
This avoids making the callback parse off the command portion on their own.
It also lets them assert that the command portion is in the set of
registered commands.

Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 21:58:17 -07:00
Sage Weil
895e24d198 admin_socket: streamline 'version' commands
version     -- ceph version
 git_version -- git sha1
 0           -- proto version (for backward compat)

Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 20:38:38 -07:00
Sage Weil
ca8f3ba8e9 admin_socket: streamline command set
log flush
 log dump
 log reopen
 config show
 config set <var> <val>
 perf dump
 perf schema

Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 20:38:38 -07:00
Sage Weil
e30e937c89 admin_socket: register command prefixes
Allow any command prefix to be registered, provided it is separated by a
space.  Previously, we always matched against the first word.

Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 20:38:38 -07:00
Sage Weil
640eec9cd0 Merge remote branch 'gh/wip-admin'
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2012-05-30 20:38:22 -07:00
Dan Mick
c80bd9daea librbd: Simplify timing init
Remove possibility of set_start_time before set_ictx error

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2012-05-30 16:48:37 -07:00
Dan Mick
04e66b4201 librbd: Add latency (elapsed-time) stats for rbd operations
Fixes: #2408
Signed-off-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2012-05-30 16:18:49 -07:00
Yehuda Sadeh
767664dcb8 rgw: put_bucket_info does not override attrs
This fixes #2487. When writing bucket info we just
wrote the object content, and were overriding any
attrs that object contained (that is -- corrupted
the ACLs).

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2012-05-30 16:22:51 -07:00
Yehuda Sadeh
d8df1e9913 rgw: return default policy if policy attr is broken
In case the policy attr on object/bucket is broken
return a default policy, in which the owner is set
as the bucket owner.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2012-05-30 16:22:51 -07:00
Sage Weil
a24145fcbf log: add missing .cc file
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-30 15:35:30 -07:00
Sage Weil
52187c3eac log: uninline SubsystemMap mutators
This lets you do something like

 p g_ceph_context->_conf->subsys.set_log_level(ceph_subsys_mon, 20)

from gdb.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-30 15:15:50 -07:00
Sage Weil
a6f8fe352e filestore: fix my broken ifdef flow
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-30 15:06:19 -07:00
John Wilkins
188d171805 doc: ceph.conf cleanup for cephx authentication.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-05-30 14:41:42 -07:00
John Wilkins
695f92d8ee doc: fix broken link.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-05-30 14:40:08 -07:00
John Wilkins
d05d98ce80 doc: Added -a to service ceph stop.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-05-30 14:29:51 -07:00
John Wilkins
cb5c6b5db6 doc: Consolidated mkcephfs deployment files.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-05-30 14:29:10 -07:00
Sage Weil
dd1d388061 osd: fix null dereference
The pg arg is optional!

Signed-off-by: Sage Weil <sage@inktank.com>
2012-05-30 14:28:46 -07:00
John Wilkins
a3f4d595f1 doc: Added pools and authentication.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-05-30 13:48:04 -07:00
Sage Weil
a167213a9e mon: fix reweight_by_utilization waiting
Propose if we changed something, but not if we don't.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-30 11:53:37 -07:00
Sage Weil
519fadbc96 osd: fix rewewight_by_utilization
Update the incremental, not the in-memory OSDMap!

Fixes: #2454
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-30 11:53:35 -07:00
Sage Weil
07498d6623 filestore: log about syncfs(2) etc support
Fixes: #2479
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-30 11:14:26 -07:00
Sage Weil
2b856ace21 Merge remote-tracking branch 'gh/stable' 2012-05-30 11:02:36 -07:00
John Wilkins
6dd93b9a97 doc: Updated authentication with header canonicalization.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-05-30 10:14:30 -07:00