Commit Graph

16748 Commits

Author SHA1 Message Date
Greg Farnum
15a3df84dd cls_rgw: refactor read_bucket_dir in terms of tmap.
This function won't be called often once refactoring is done, but
its functionality will be needed for listing, if nothing else.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:33:11 -07:00
Greg Farnum
583e16d959 objclass: add map interfaces.
Right now, they implement the TMAP functions, plus a few obvious
extras to read/write select keys and the header. In the future it
should be easy to switch them to better mapping implementations.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:32:24 -07:00
Greg Farnum
c98e1c57d4 ReplicatedPG: remove unused tmap implementation.
If it's surrounded by an if(0), it shouldn't still be in the code.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-13 09:29:03 -07:00
Josh Durgin
42c8ae77d6 test_librbd: expect copy to succeed
0 is the success return code. These were accidentally changed in the
conversion to gtest.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-10-12 16:26:45 -07:00
Josh Durgin
d0d265bf1c librbd: return errors when read_iterate fails during copy
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-10-12 16:26:18 -07:00
Samuel Just
a50fbe2b98 PG: merge_old_entry: merged delete might not be in missing
If the new log does not contain an entry for that oid, it might not yet
be in missing, and we would need to add it.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-12 15:44:08 -07:00
Yehuda Sadeh
42bbea892a rgw: swift key removal 2011-10-12 14:46:42 -07:00
Sage Weil
05dae94fb2 Revert "config: base default libdir, sysconfdir off autoconf values"
This reverts commit 7e5dee907a.
2011-10-12 11:14:39 -07:00
Sage Weil
7e5dee907a config: base default libdir, sysconfdir off autoconf values
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-12 09:34:02 -07:00
Yehuda Sadeh
e07b956b84 rgw: implement some missing swift api, other swift fixes 2011-10-11 15:06:34 -07:00
Yehuda Sadeh
5790a363d8 rgw: encoded swift key contains full user name 2011-10-11 12:31:48 -07:00
Yehuda Sadeh
f883e6382f rgw: multiple swift keys per user 2011-10-11 12:31:48 -07:00
Samuel Just
9b18e55e86 PG,OSD: clean up xlist::items on pg removal
Should take care of #1599.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-11 11:39:07 -07:00
Sage Weil
b43b864502 osd: fix race between op requeueing and _dispatch
If a message is working it's way through _dispatch, and another thread
requeues waiting messages under pg->lock (e.g.
osd->take_waiting(waiting_for_active)), the requeued ops are processed
after the one _dispatch() is chewing on, breaking client ordering.

Instead, add a new OSD::requeue_ops() that reinjects ops back into the
op queue by feeding them to the _handle_*() helpers.  Those do last minute
checks before enqueuing the ops.

Fixes: #1490 (again)
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-11 11:16:50 -07:00
Sage Weil
f7ec9f79f7 thread: whitespace
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-11 11:16:50 -07:00
Sage Weil
fc3aac6b97 filestore: clean up error output
No color codes in the logs!

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-11 11:08:04 -07:00
Sage Weil
cd2dedd7d1 filestore: tolerate missing current/
We remove it anyway.  If it's missing entirely, just continue and roll
back to the latest snap_ when the user passes --osd-use-stale-snap.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-11 11:08:02 -07:00
Sage Weil
3f619ddb55 ceph.spec.in: fix radosgw files
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:45 -07:00
Sage Weil
468c7dce79 rgw: find fcgi headers in /usr/include or /usr/include/fastcgi
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:45 -07:00
Sage Weil
032dd84c3c ceph.spec.in: more updates to make build.opensuse.org happy
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:45 -07:00
Sage Weil
465f1bf18b ceph.spec.in: add init-radosgw back
Accidentally took this out a few patches back.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 19:11:22 -07:00
Sage Weil
52bad62d03 rgw: push log list|show|rm into RGWStore
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:27 -07:00
Sage Weil
93a88150bd radosgw-admin: push log listing into RGWRados
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:22 -07:00
Sage Weil
69e9f51d3f rgw: chdir to dir in conf (default /)
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:19 -07:00
Sage Weil
930d57f864 rgw: push intent log processing into RGWRados layer
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-10 11:51:16 -07:00
Sage Weil
d7f7a21354 librbd: don't return >32bit value from copy().
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 11:51:09 -07:00
Greg Farnum
42ac18cd6b .gitignore: test_libhadoopcephfs build
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-10 10:55:52 -07:00
Greg Farnum
968b09095d Merge branch 'master' of github.com:NewDreamNetwork/ceph 2011-10-10 10:55:10 -07:00
Sage Weil
9ec60b4dc4 librbd: fix overflow on large large image copy
Fixes: #1611
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 11:04:30 -07:00
Sage Weil
b6c4615866 librbd: slightly cleaner
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 11:03:26 -07:00
Sage Weil
7060efa9ba librbd: fix copy progress
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-10 09:50:33 -07:00
Greg Farnum
61855170a7 hadoop: get the right class member, and ask for it properly.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-10-09 16:28:00 -07:00
Sage Weil
dc40b37403 auth: move AuthAuthorizeHandler registry into class
Static classes with constructors and destructors are dangerous.  Explicitly
manage these as part of the server components (OSD, MDS).

Fixes: #1608
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 16:47:35 -07:00
Samuel Just
11a1d601f5 OSD,ReplicatedPG: expire and cleanup unconnected watchers
During handle_notify_timeout or ms_handle_reset, watchers are now marked
unconnected via pg->register_unconnected_watcher. A safe timer event has
been added to trigger OSD::handle_watch_timeout.
remove_watchers_and_notifies (called on role change) cleans up these
events before peering.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-07 16:07:09 -07:00
Greg Farnum
9d846d33b2 move ceph_mount call 2011-10-07 14:37:10 -07:00
Sage Weil
039035b366 osd: discard requests that from disconnected clients
If we can't reply, throw out the request; they'll need to resend it anyway.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 14:29:36 -07:00
Sage Weil
88de6ab53b ceph.spec.in: handle docdir properly
Pass correct path to configure (fixes SuSE builds).

Use %doc command to install sample.ceph.conf and sample.fetch_conf.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 14:29:35 -07:00
Josh Durgin
0121bcd2f8 clitests: add test case for crush exhaustive search
This detects the bug that caused #1594.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-10-07 14:13:37 -07:00
Sage Weil
e5db7b243c Makefile: only reset docdir if it's not already defined
This is only for old versions of automake, and won't work for ancient
SuSe.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 13:13:29 -07:00
Sage Weil
2f877f8220 crushtool: fix --weight arg parsing
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 13:03:00 -07:00
Sage Weil
8ff1cbb5c9 crushtool: add --force N
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 13:02:49 -07:00
Sage Weil
af6a9f3069 crush: try _all_ bucket items when doing exhaustive search
N-1 isn't exhaustive.

Fixes: #1594
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 12:54:59 -07:00
Sage Weil
5a23694240 ceph.spec.in: build on suse
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 11:10:46 -07:00
Sage Weil
6e29c28260 mon: tolerate 50ms (instead of 10ms) of clock drift
NTP on sepia can't manage 10ms, it seems.  Sigh.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-10-07 09:53:52 -07:00
Sage Weil
ff31d3cca0 rgw: fix printf format warning
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-07 09:32:34 -07:00
Sage Weil
8be9450b31 rgw: make log object naming configurable
Use date(1) codes for object name, plus %i and %n for bucket id/name, and
make UTC vs localtime configurable.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-06 17:39:40 -07:00
Sage Weil
3d2f89fac2 mon: make other send_incremental variant handle map discontinuity
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-06 16:17:14 -07:00
Sage Weil
64935d4c24 auth: fix authorizer leak fix
We were never reusing the authorizer, so make it local.  This fixes a crash
(double-free) on reset().

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-06 16:17:14 -07:00
Sage Weil
6e04f60ed4 mon: fix osdmap trimming unsigned overflow
This was trimming way to aggressively for early epochs due to the unsigned
version overflowing.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-06 16:17:14 -07:00
Sage Weil
4fe9cca5dd objecter: cope with missing osdmaps in history
Signed-off-by: Sage Weil <sage@newdream.net>
2011-10-06 16:17:14 -07:00