Commit Graph

23898 Commits

Author SHA1 Message Date
Greg Farnum
09a2d66e2d mds: EMetaBlob::remotebit more modernization for dencoder
And set defaults for the default constructor.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:52 -08:00
Greg Farnum
deb0d45c08 mds: EMetaBlob::full_bit more modernization for dencoder
While we're doing so, make the frag stream operator const!

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:52 -08:00
Greg Farnum
60730271d4 mds: EMetaBlob and its sub-parts use modern encoding now
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:52 -08:00
Greg Farnum
83c1a3c4eb mds: EImportStart event uses modern encoding
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:52 -08:00
Greg Farnum
a25683f307 mds: EImportFinish event uses modern encoding
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:52 -08:00
Greg Farnum
b079733b82 mds: EFragment event uses modern encoding
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:52 -08:00
Greg Farnum
8906ae9a12 mds: remove unused EString event
While we're at it, #include LogEvent.h from each of
the log events, some of which didn't include it previously!

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:52 -08:00
Greg Farnum
f886f31e3c mds: EExport event uses modern encoding
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
d21de8108c mds: ECommitted now uses modern encoding
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
7bad50787c SnapServer: use modern encoding for server_state
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
6e797e0055 InoTable: use modern encoding for encode_state and decode_state
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
eb060bb423 CInode: use modern encoding for encode_export/decode_import
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
d8a7b87606 CInode: use modern encoding for encode_store
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
95cee97ea9 AnchorServer: use modern encoding for server state
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Sage Weil
d5a6a251ae DecayCounter: use modern encoding
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
0fe7a08607 mds: old_rstat_t now uses modern encoding
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:51 -08:00
Greg Farnum
ff63530d67 mds: Capability (and sub-structs) now uses modern encoding
Signed-off-by: Sage Weil <sage@inktank.com>
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-02-08 13:17:46 -08:00
Sage Weil
3cf3710be0 mon: fix typo in C_Stats
Broken by previous commit.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-08 09:59:25 -08:00
Sage Weil
2bdf753d7d mon: assert valid context return values
We recognized EAGAIN, ECANCELED, and success only.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Luis <joao.luis@inktank.com>
2013-02-08 09:18:11 -08:00
Sage Weil
3322e96b7b Merge branch 'next' 2013-02-08 09:18:01 -08:00
Sage Weil
4837063d44 mon: retry PGStats message on EAGAIN
If we get EAGAIN from a paxos restart/election/whatever, we should
restart the message instead of just blindly acking it.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Luis <joao.luis@inktank.com>
2013-02-08 09:09:20 -08:00
Sage Weil
17827769f1 mon: handle -EAGAIN in completion contexts
We can get ECANCELED, EAGAIN, or success out of the completion contexts,
but in the EAGAIN case (meaning there was an election) we were sending
a success to the client.  This resulted in client hangs and all-around
confusion when the monitor cluster was thrashing.

Backport: bobtail
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Luis <joao.luis@inktank.com>
2013-02-08 09:09:03 -08:00
Sage Weil
5a02d6de7e Merge branch 'next' 2013-02-07 23:20:44 -08:00
Sage Weil
1b05b0edba radosgw-admin: fix cli test
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-07 22:51:29 -08:00
Sage Weil
2eaa728151 keys: renew autobuild.asc key
This expired today.  Change it to never expire, like the Ubuntu release
keys.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-07 22:31:40 -08:00
Sage Weil
f3ba46d31f Merge remote-tracking branch 'gh/next' 2013-02-07 22:19:58 -08:00
Yehuda Sadeh
8a2de334fe Merge remote-tracking branch 'origin/master' into wip-2941-3 2013-02-07 17:16:49 -08:00
Yehuda Sadeh
278dfe50fd rgw: stream get_obj operation
Fixes: #2941
Instead of iterating through the parts one by one when reading
an object, we can now send multiple requests in parallel. Two new
configurables added to control the max request size, and the total
size of pending requests.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 16:59:41 -08:00
Yehuda Sadeh
3383618da8 throttle: optional non perf counter mode
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 16:59:32 -08:00
Samuel Just
ed2bb38770 OSD: check pg snap collections on start up
Backport: bobtail
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-07 16:16:04 -08:00
Samuel Just
55f857962f OSD::load_pgs: first scan colls before initing PGs
Backport: bobtail
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-07 16:16:01 -08:00
Yehuda Sadeh
70532d1985 rgw: get bucket_owner from policy
We already read the bucket policy, we can get the bucket
owner from there.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 14:54:54 -08:00
Yehuda Sadeh
f6af1e76a8 rgw: fix bucket_owner assignment
s->bucket_acl may be null, so reverting to old behavior.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 14:54:54 -08:00
caleb miles
e345dfe04a Feature 3667: Support extra canned acls.
Support the bucket-owner-read and bucket-owner-full
canned acls.

Signed-off-by caleb miles <caleb.miles@inktank.com>
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2013-02-07 14:54:39 -08:00
Samuel Just
fa47e77a13 ReplicatedPG: check store for temp collection in have_temp_coll
We may not have "created" the temp collection since OSD restart
before removing the PG.  have_temp_coll must also look at the
OSD store.  Currently, the only user is pg removal, so the
extra work is acceptable.

Backport: bobtail
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-02-07 14:27:10 -08:00
Yehuda Sadeh
a18045f0f6 rgw: a tool to fix clobbered bucket info in user's bucket list
This fixes bad entries in user's bucket list that may have occured
due to issue #4039. Syntax:

 $ radosgw-admin user check --uid=<uid> [--fix]

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
(cherry picked from commit 9cb6c33f0e)

Conflicts:
	src/rgw/rgw_admin.cc
2013-02-07 13:55:23 -08:00
Yehuda Sadeh
a00c77abe2 rgw: bucket recreation should not clobber bucket info
Fixes: #4039
User's list of buckets is getting modified even if bucket already
exists. This fix removes the newly created directory object, and
makes sure that user info's data points at the correct bucket.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
(cherry picked from commit 9d006ec40c)

Conflicts:
	src/rgw/rgw_op.cc
	src/rgw/rgw_rados.cc
2013-02-07 13:55:17 -08:00
Dan Mick
784547943b Merge branch 'wip-cephtool' into next
Usage/errmsg fixups for the ceph CLI tool

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-02-07 13:09:28 -08:00
Dan Mick
36cf4d0cdf ceph: fix 'pg' error message to direct user toward better input
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:54 -08:00
Dan Mick
1042060f40 mds: error messages for export_dir said 'migrate_dir'
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
Dan Mick
c44846e035 ceph: ceph mon delete doesn't exist; ceph mon remove is the command
Fix up cli test as well (doc is already correct)

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
Dan Mick
eb9d6cac0d osd: fix name of setomapval admin-daemon command
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
Dan Mick
73872e7194 ceph: use "config set" consistently in help/error msgs
apparently it was once known as set_config.  Fix up everything to
refer to the new name.  Also, fix up the help message.

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-02-07 13:06:53 -08:00
tamil
5896b971a3 modified the script to run on both argonaut and bobtail.
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-02-07 11:47:06 -08:00
Samuel Just
dbce1d0dc9 PG: dirty_info on handle_activate_map
We need to make sure the pg epoch is persisted during
activate_map.

Backport: bobtail
Reviewed-by: Sage Weil <sage@inktank.com>
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-02-07 10:44:46 -08:00
Greg Farnum
9432353519 mds: rename mds_traceless_replies to mds_inject_traceless_reply_probability
Sage pointed out we should try for consistent naming on these debug
options, and this option is like our other inject_[x] stuff.
While we're here, make the config option comment a bit clearer.

08b82b3ef6
2013-02-07 10:25:33 -08:00
Sage Weil
af95d934b0 osd: flush peering queue (consume maps) prior to boot
If the osd itself is behind on many maps during boot, it will get more and
(as part of that) flush the peering wq to ensure the pgs consume them.
However, it is possible for OSD to have latest/recnet maps, but pgs to be
behind, and to jump directly to boot and join.  The OSD is then laggy and
unresponsive because the peering wq is way behind.

To avoid this, call consume_map() (kick the peering wq) at the end of
init and flush it to ensure we are *internally* all caught up before we
consider joining the cluster.

I'm pretty sure this is the root cause of #3905 and possibly #3995.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-02-07 10:21:49 -08:00
Sage Weil
75c40fac60 qa: fix iogen script
Wait 10 minutes and then stop.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-06 22:01:24 -08:00
Greg Farnum
46d7dbd347 client: trigger the completion in _flush when short-cutting
We missed a shortcut return from _flush() when doing
e9a6694d01, so _fsync() calls
were failing. To fix, if _flush discovers there's nothing to flush,
trigger the completion by calling onfinish->finish().

Fixes #4038

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-06 16:47:51 -08:00
Greg Farnum
08b82b3ef6 mds: add "mds traceless replies" debug option
This option specifies (in the range 0-1) the percentage of modifying
operations that should be responded to without including a trace
for the dentries.
In order to implement it, we add a "modify" parameter to
set_trace_dist(), and the callers fill that with
mdr->req->may_write().

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sam Lang <sam.lang@inktank.com>
2013-02-06 13:34:02 -08:00