Commit Graph

23694 Commits

Author SHA1 Message Date
Sage Weil
2eaa728151 keys: renew autobuild.asc key
This expired today.  Change it to never expire, like the Ubuntu release
keys.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-07 22:31:40 -08:00
Sage Weil
f3ba46d31f Merge remote-tracking branch 'gh/next' 2013-02-07 22:19:58 -08:00
Yehuda Sadeh
8a2de334fe Merge remote-tracking branch 'origin/master' into wip-2941-3 2013-02-07 17:16:49 -08:00
Yehuda Sadeh
278dfe50fd rgw: stream get_obj operation
Fixes: #2941
Instead of iterating through the parts one by one when reading
an object, we can now send multiple requests in parallel. Two new
configurables added to control the max request size, and the total
size of pending requests.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 16:59:41 -08:00
Yehuda Sadeh
3383618da8 throttle: optional non perf counter mode
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 16:59:32 -08:00
Samuel Just
ed2bb38770 OSD: check pg snap collections on start up
Backport: bobtail
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-07 16:16:04 -08:00
Samuel Just
55f857962f OSD::load_pgs: first scan colls before initing PGs
Backport: bobtail
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-07 16:16:01 -08:00
Yehuda Sadeh
70532d1985 rgw: get bucket_owner from policy
We already read the bucket policy, we can get the bucket
owner from there.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 14:54:54 -08:00
Yehuda Sadeh
f6af1e76a8 rgw: fix bucket_owner assignment
s->bucket_acl may be null, so reverting to old behavior.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 14:54:54 -08:00
caleb miles
e345dfe04a Feature 3667: Support extra canned acls.
Support the bucket-owner-read and bucket-owner-full
canned acls.

Signed-off-by caleb miles <caleb.miles@inktank.com>
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 14:54:39 -08:00
Samuel Just
fa47e77a13 ReplicatedPG: check store for temp collection in have_temp_coll
We may not have "created" the temp collection since OSD restart
before removing the PG.  have_temp_coll must also look at the
OSD store.  Currently, the only user is pg removal, so the
extra work is acceptable.

Backport: bobtail
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-02-07 14:27:10 -08:00
Yehuda Sadeh
a18045f0f6 rgw: a tool to fix clobbered bucket info in user's bucket list
This fixes bad entries in user's bucket list that may have occured
due to issue #4039. Syntax:

 $ radosgw-admin user check --uid=<uid> [--fix]

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
(cherry picked from commit 9cb6c33f0e)

Conflicts:
	src/rgw/rgw_admin.cc
2013-02-07 13:55:23 -08:00
Yehuda Sadeh
a00c77abe2 rgw: bucket recreation should not clobber bucket info
Fixes: #4039
User's list of buckets is getting modified even if bucket already
exists. This fix removes the newly created directory object, and
makes sure that user info's data points at the correct bucket.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
(cherry picked from commit 9d006ec40c)

Conflicts:
	src/rgw/rgw_op.cc
	src/rgw/rgw_rados.cc
2013-02-07 13:55:17 -08:00
Dan Mick
784547943b Merge branch 'wip-cephtool' into next
Usage/errmsg fixups for the ceph CLI tool

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-02-07 13:09:28 -08:00
Dan Mick
36cf4d0cdf ceph: fix 'pg' error message to direct user toward better input
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:54 -08:00
Dan Mick
1042060f40 mds: error messages for export_dir said 'migrate_dir'
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
Dan Mick
c44846e035 ceph: ceph mon delete doesn't exist; ceph mon remove is the command
Fix up cli test as well (doc is already correct)

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
Dan Mick
eb9d6cac0d osd: fix name of setomapval admin-daemon command
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
Dan Mick
73872e7194 ceph: use "config set" consistently in help/error msgs
apparently it was once known as set_config.  Fix up everything to
refer to the new name.  Also, fix up the help message.

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
tamil
5896b971a3 modified the script to run on both argonaut and bobtail.
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-02-07 11:47:06 -08:00
Samuel Just
dbce1d0dc9 PG: dirty_info on handle_activate_map
We need to make sure the pg epoch is persisted during
activate_map.

Backport: bobtail
Reviewed-by: Sage Weil <sage@inktank.com>
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-02-07 10:44:46 -08:00
Greg Farnum
9432353519 mds: rename mds_traceless_replies to mds_inject_traceless_reply_probability
Sage pointed out we should try for consistent naming on these debug
options, and this option is like our other inject_[x] stuff.
While we're here, make the config option comment a bit clearer.

08b82b3ef6
2013-02-07 10:25:33 -08:00
Sage Weil
af95d934b0 osd: flush peering queue (consume maps) prior to boot
If the osd itself is behind on many maps during boot, it will get more and
(as part of that) flush the peering wq to ensure the pgs consume them.
However, it is possible for OSD to have latest/recnet maps, but pgs to be
behind, and to jump directly to boot and join.  The OSD is then laggy and
unresponsive because the peering wq is way behind.

To avoid this, call consume_map() (kick the peering wq) at the end of
init and flush it to ensure we are *internally* all caught up before we
consider joining the cluster.

I'm pretty sure this is the root cause of #3905 and possibly #3995.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-02-07 10:21:49 -08:00
Sage Weil
75c40fac60 qa: fix iogen script
Wait 10 minutes and then stop.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-06 22:01:24 -08:00
Greg Farnum
46d7dbd347 client: trigger the completion in _flush when short-cutting
We missed a shortcut return from _flush() when doing
e9a6694d01, so _fsync() calls
were failing. To fix, if _flush discovers there's nothing to flush,
trigger the completion by calling onfinish->finish().

Fixes #4038

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-06 16:47:51 -08:00
Greg Farnum
08b82b3ef6 mds: add "mds traceless replies" debug option
This option specifies (in the range 0-1) the percentage of modifying
operations that should be responded to without including a trace
for the dentries.
In order to implement it, we add a "modify" parameter to
set_trace_dist(), and the callers fill that with
mdr->req->may_write().

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sam Lang <sam.lang@inktank.com>
2013-02-06 13:34:02 -08:00
Gary Lowell
9871cf2751 logrotate.conf: Silence rgw logrotate some more
Apply the same change as commit d02340d90c to
the radosgw logrotate.conf.

Signed-off-by: Gary Lowell  <gary.lowell@inktank.com>
2013-02-06 11:45:30 -08:00
Alexandre Oliva
d02340d90c silence logrotate some more
I was getting email with logrotate error output from “which invoke-rc.d”
on systems without an invoke-rc.d.  This patch silences it.

Silence stderr from which when running logrotate

From: Alexandre Oliva <oliva@gnu.org>

Signed-off-by: Alexandre Oliva <oliva@gnu.org>
2013-02-06 11:44:56 -08:00
Sage Weil
f81e09525f Merge remote-tracking branch 'gh/wip-danny-cleanups'
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-06 10:43:29 -08:00
Sage Weil
0aea4dba04 Merge remote-tracking branch 'gh/wip-3768' 2013-02-06 10:38:08 -08:00
Greg Farnum
c0e1070f2f test: fix Throttle unit test.
A bunch of these are slightly racy so they're enclosed in loops. This
particular one, though, changes the Throttle state in ways that
invalidate the asserts. To fix, reset the state before commencing a
rerun.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-06 10:22:06 -08:00
Sage Weil
1948a02bc8 osd: do not spam system log on successful read_log
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-06 09:02:54 -08:00
Danny Al-Gaaf
3acc4d2cfe rbd-fuse: fix for loop in open_rbd_image()
Remove uninitialized usage of 'int i' as i++ from 'for' loop.
The variale 'i' is never used in this loop and initialized
before the next use with 0.

Related warning from clang++:

rbd_fuse/rbd-fuse.c:141:36: warning: variable 'i' is uninitialized
when used here [-Wuninitialized]
        for (im = rbd_images; im != NULL; i++, im = im->next) {

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:43 -08:00
Danny Al-Gaaf
db0dbe5db8 msg/Message.h: fix C-style pointer casting
Replace C-style pointer casting with correct static_cast<>().

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:04 -08:00
Danny Al-Gaaf
b1fc10ef93 messages/MOSDRepScrub.h: initialize member variable in constructor
Initialize chunky and deep bool member variables in the constructor
with false.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:04 -08:00
Danny Al-Gaaf
22e48b5751 include/xlist.h: fix C-style pointer casting
Replace C-style pointer casting with correct static_cast<>().

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:03 -08:00
Danny Al-Gaaf
d54bd1700f include/types.h: change operator<< function parameter
Fix "Function parameter 'v' should be passed by reference." from cppchecker.
Use 'const pair<A,B>& v' similar to the other operator<< in this file.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:03 -08:00
Danny Al-Gaaf
0327cbaa2a include/buffer.h: fix operator=
Fix operator=: return "iterator&" instead of 'iterator'. Check if 'this'
equals 'other' before set anything.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:03 -08:00
Danny Al-Gaaf
ad526c0e44 obj_bencher.cc: use vector instead of VLA's
Fix "variable length array of non-POD element type" error. (-Wvla)

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:03 -08:00
Danny Al-Gaaf
a4042cc3c9 ceph_crypto.cc: remove unused shutdown() outside crypto ifdef's
Fix "out-of-line declaration of a member must be a definition
[-Wout-of-line-declaration]". Remove ceph::crypto::shutdown() outside
the crypto related ifdef's. Without nss or cryptopp configure will
fail anyways.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:03 -08:00
Danny Al-Gaaf
42682963cc WorkQueue.h: fix cast
Replace C-style pointer casting with correct static_cast<>().

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-06 08:42:03 -08:00
Yehuda Sadeh
27fb0e6305 rgw: a tool to fix buckets with leaked multipart references
Checks specified bucket for the #4011 symptoms, optionally fix
the issue.

sytax:
  radosgw-admin bucket check --bucket=<bucket> [--fix]

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
(cherry picked from commit 2d8faf8e5f)

Conflicts:
	src/rgw/rgw_admin.cc
	src/rgw/rgw_rados.h
2013-02-05 17:56:02 -08:00
Yehuda Sadeh
50c1775dda rgw: radosgw-admin object unlink
Add a radosgw-admin option to remove object from bucket index

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
(cherry picked from commit 16235a7acb)

Conflicts:
	src/rgw/rgw_admin.cc
	src/rgw/rgw_rados.h
	src/test/cli/radosgw-admin/help.t
2013-02-05 17:55:55 -08:00
Sage Weil
9eff2ee13d Merge remote-tracking branch 'gh/wip-osd-commands'
Reviewed-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Joao Luis <joao.luis@inktank.com>
2013-02-05 17:31:48 -08:00
Sage Weil
3b635423bd mon: move list_rules into CrushWrapper method
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-05 16:35:55 -08:00
Sage Weil
9f4d4ac9cc crush: add list_rules() method
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-05 16:35:43 -08:00
Gary Lowell
7f237be2e2 Makefile: Add rgw/logrotate.conf source tarball
Signed-off-by: Gary Lowell  <gary.lowell@inktank.com>
2013-02-05 16:14:10 -08:00
Gary Lowell
99ea303054 logrotate.conf: Remove unneeded loop and update new rgw version.
Remove an unneeded for loop from the ceph logrotate.conf, and
update the new rgw logrotate.conf to reload the radosgw serivce.

Signed-off-by: Gary Lowell  <gary.lowell@inktank.com>
2013-02-05 15:20:43 -08:00
Yehuda Sadeh
c8eace6ff0 rgw: create a separate logrotate file for radosgw
Fixes: #3813
Since radosgw package is separate from the ceph package,
it also needs to have a separate logrotate. The default
path for radosgw log is changed to /var/log/radosgw,
and it now has a different logrotate script.
Updating both deb and rpm packaging.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-05 14:54:38 -08:00
Sage Weil
b79067a863 qa: add workunits/mon/crush_ops.sh
Test creating, listing, removing crush rules via the mon.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-05 14:31:13 -08:00