Commit Graph

16760 Commits

Author SHA1 Message Date
Sage Weil
195a484b47 ceph.spec: capitalize first letter to make rpmlint happy
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-17 08:49:04 -07:00
Sage Weil
a6f3bbb744 v0.37 2011-10-17 08:35:57 -07:00
Sage Weil
502fbba56b paxos: trim extra state dirs
OSDMonitor, for instance, stores both an "osdmap" and "osdmap_full" for
each state.  Trim them both.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-14 20:21:18 -07:00
Samuel Just
6d123067ce PG: call set_last_peering_reset in Started contructor
Calling it here should cover all possible replica and primary peering
resets.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-14 20:20:59 -07:00
Sage Weil
ba41e6c7b1 osd: send full map if we don't have sufficiently old incremental
If the peer has a really old map, send a full map instead of crashing
because we are missing the needed incremental.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-14 13:31:03 -07:00
Samuel Just
ef30e69cdb PG: Fix log.empty confusion
Previously, log.empty meant that the log.head was everion_t().  However,
it was in a few places used to mean that log.head == log.tail.  Now,
log.empty means log.head == log.tail and log.null() indicates that
log.head is eversion_t().

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-14 12:57:02 -07:00
Sage Weil
1f3b12e0d2 osd: bound generate_past_intervals() by oldest map
The oldest osdmap we maintain is a lower bound on last_epoch_clean for the
entire system (assuming the monitor is doing it's job right).  We can stop
generating past intervals when we hit it.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-13 09:53:41 -07:00
Greg Farnum
45ebaf705d cls_rgw: remove the write_bucket_dir function.
It's no longer called anywhere. Hurray, we don't do our own
read-modify-write cycle any more (and can exploit the power of
btrees later)!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:35:07 -07:00
Greg Farnum
0167e82441 cls_rgw: rewrite rgw_bucket_complete_op to use update.
Unfortunately we can't do multiple writes via the interface -- the
second one will clobber the first one. So use the update functionality
and go through that pain instead.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:35:07 -07:00
Greg Farnum
75f7e54601 cls_rgw: refactor rgw_bucket_complete_op in terms of TMAP
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:33:35 -07:00
Greg Farnum
2592e41a5f cls_rgw: refactor rgw_bucket_prepare_op in terms of tmap
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:33:34 -07:00
Greg Farnum
83504c42c7 cls_rgw: refactor rgw_bucket_init_index in terms of tmap
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:33:22 -07:00
Greg Farnum
15a3df84dd cls_rgw: refactor read_bucket_dir in terms of tmap.
This function won't be called often once refactoring is done, but
its functionality will be needed for listing, if nothing else.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:33:11 -07:00
Greg Farnum
583e16d959 objclass: add map interfaces.
Right now, they implement the TMAP functions, plus a few obvious
extras to read/write select keys and the header. In the future it
should be easy to switch them to better mapping implementations.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:32:24 -07:00
Greg Farnum
c98e1c57d4 ReplicatedPG: remove unused tmap implementation.
If it's surrounded by an if(0), it shouldn't still be in the code.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:29:03 -07:00
Josh Durgin
42c8ae77d6 test_librbd: expect copy to succeed
0 is the success return code. These were accidentally changed in the
conversion to gtest.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-10-12 16:26:45 -07:00
Josh Durgin
d0d265bf1c librbd: return errors when read_iterate fails during copy
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-10-12 16:26:18 -07:00
Samuel Just
a50fbe2b98 PG: merge_old_entry: merged delete might not be in missing
If the new log does not contain an entry for that oid, it might not yet
be in missing, and we would need to add it.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-12 15:44:08 -07:00
Yehuda Sadeh
42bbea892a rgw: swift key removal 2011-10-12 14:46:42 -07:00
Sage Weil
05dae94fb2 Revert "config: base default libdir, sysconfdir off autoconf values"
This reverts commit 7e5dee907a.
2011-10-12 11:14:39 -07:00
Sage Weil
7e5dee907a config: base default libdir, sysconfdir off autoconf values
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-12 09:34:02 -07:00
Yehuda Sadeh
e07b956b84 rgw: implement some missing swift api, other swift fixes 2011-10-11 15:06:34 -07:00
Yehuda Sadeh
5790a363d8 rgw: encoded swift key contains full user name 2011-10-11 12:31:48 -07:00
Yehuda Sadeh
f883e6382f rgw: multiple swift keys per user 2011-10-11 12:31:48 -07:00
Samuel Just
9b18e55e86 PG,OSD: clean up xlist::items on pg removal
Should take care of #1599.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-11 11:39:07 -07:00
Sage Weil
b43b864502 osd: fix race between op requeueing and _dispatch
If a message is working it's way through _dispatch, and another thread
requeues waiting messages under pg->lock (e.g.
osd->take_waiting(waiting_for_active)), the requeued ops are processed
after the one _dispatch() is chewing on, breaking client ordering.

Instead, add a new OSD::requeue_ops() that reinjects ops back into the
op queue by feeding them to the _handle_*() helpers.  Those do last minute
checks before enqueuing the ops.

Fixes: #1490 (again)
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-11 11:16:50 -07:00
Sage Weil
f7ec9f79f7 thread: whitespace
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-11 11:16:50 -07:00
Sage Weil
fc3aac6b97 filestore: clean up error output
No color codes in the logs!

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-11 11:08:04 -07:00
Sage Weil
cd2dedd7d1 filestore: tolerate missing current/
We remove it anyway.  If it's missing entirely, just continue and roll
back to the latest snap_ when the user passes --osd-use-stale-snap.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-11 11:08:02 -07:00
Sage Weil
3f619ddb55 ceph.spec.in: fix radosgw files
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:45 -07:00
Sage Weil
468c7dce79 rgw: find fcgi headers in /usr/include or /usr/include/fastcgi
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:45 -07:00
Sage Weil
032dd84c3c ceph.spec.in: more updates to make build.opensuse.org happy
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:45 -07:00
Sage Weil
465f1bf18b ceph.spec.in: add init-radosgw back
Accidentally took this out a few patches back.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:22 -07:00
Sage Weil
52bad62d03 rgw: push log list|show|rm into RGWStore
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:27 -07:00
Sage Weil
93a88150bd radosgw-admin: push log listing into RGWRados
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:22 -07:00
Sage Weil
69e9f51d3f rgw: chdir to dir in conf (default /)
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:19 -07:00
Sage Weil
930d57f864 rgw: push intent log processing into RGWRados layer
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:16 -07:00
Sage Weil
d7f7a21354 librbd: don't return >32bit value from copy().
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 11:51:09 -07:00
Greg Farnum
42ac18cd6b .gitignore: test_libhadoopcephfs build
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-10 10:55:52 -07:00
Greg Farnum
968b09095d Merge branch 'master' of github.com:NewDreamNetwork/ceph 2011-10-10 10:55:10 -07:00
Sage Weil
9ec60b4dc4 librbd: fix overflow on large large image copy
Fixes: #1611
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 11:04:30 -07:00
Sage Weil
b6c4615866 librbd: slightly cleaner
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 11:03:26 -07:00
Sage Weil
7060efa9ba librbd: fix copy progress
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 09:50:33 -07:00
Greg Farnum
61855170a7 hadoop: get the right class member, and ask for it properly.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-09 16:28:00 -07:00
Sage Weil
dc40b37403 auth: move AuthAuthorizeHandler registry into class
Static classes with constructors and destructors are dangerous.  Explicitly
manage these as part of the server components (OSD, MDS).

Fixes: #1608
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 16:47:35 -07:00
Samuel Just
11a1d601f5 OSD,ReplicatedPG: expire and cleanup unconnected watchers
During handle_notify_timeout or ms_handle_reset, watchers are now marked
unconnected via pg->register_unconnected_watcher. A safe timer event has
been added to trigger OSD::handle_watch_timeout.
remove_watchers_and_notifies (called on role change) cleans up these
events before peering.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-07 16:07:09 -07:00
Greg Farnum
9d846d33b2 move ceph_mount call 2011-10-07 14:37:10 -07:00
Sage Weil
039035b366 osd: discard requests that from disconnected clients
If we can't reply, throw out the request; they'll need to resend it anyway.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 14:29:36 -07:00
Sage Weil
88de6ab53b ceph.spec.in: handle docdir properly
Pass correct path to configure (fixes SuSE builds).

Use %doc command to install sample.ceph.conf and sample.fetch_conf.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 14:29:35 -07:00
Josh Durgin
0121bcd2f8 clitests: add test case for crush exhaustive search
This detects the bug that caused #1594.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-10-07 14:13:37 -07:00