Sage Weil
babb1e9032
add SequencerPosition type
...
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
a6077f6c37
filestore: pass trans_num into _do_transaction
...
This gives us the <op_seq, trans_num, op_num> triple to identify every
constituent operation.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
808812a2a4
filestore: use proper type for readdir_r tmp
...
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
184b180256
Merge branch 'master' of github.com:ceph/ceph
2012-03-09 14:13:03 -08:00
Samuel Just
7f9cfdd994
RadosModel: fix omap_clear case in RemoveAttrsOp
...
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-09 14:12:24 -08:00
Sage Weil
fce180dfe8
Merge branch 'wip-rgw-encode'
...
Conflicts:
src/rgw/rgw_cls_api.h
Reviewed-by: Sage Weil <sage@newdream.net>
2012-03-09 14:03:15 -08:00
Sage Weil
799e6f974b
rgw: fix rgw_cls_list_ret ctor
...
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 14:01:38 -08:00
Yehuda Sadeh
b71d814c89
ceph-object-corpus: added 0.43
...
Signed-off-by: Yehuda Sadeh <yehuda.sadeh@dreamhost.com>
2012-03-09 14:01:38 -08:00
Yehuda Sadeh
b4f05788c1
test/encoding/import.sh: fix target directory
...
Signed-off-by: Yehuda Sadeh <yehuda.sadeh@dreamhost.com>
2012-03-09 14:01:38 -08:00
Yehuda Sadeh
b66cdea664
Makefile.am: update link dependencies for some unit tests
2012-03-09 14:01:38 -08:00
Yehuda Sadeh
09949b3d36
rgw: various encoding related fixes
...
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-09 14:01:25 -08:00
Sage Weil
e43546dee9
osd: fix watch_lock vs map_lock ordering
...
watch_lock is inside map_lock (and pg->lock), which means we need to
drop it to take pg->lock here. That means verifying in
handle_watch_timeout that we haven't raced with another thread canceling
the timeout event, which would be indicated by
- the entity not appearing in unconnected_watchers
- the entity having a different (presumably newer) expire time
Fixes : #2103
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-09 13:34:55 -08:00
Sage Weil
80d9252809
osd: update_heartbeat_peers as needed
...
Before, we were being very careful about updating the heartbeat peers if
new PGs were created or when certain types of messages were received.
However, the PG can change it's peers in lots of cases (e.g., when
recovery completes), but the OSD doesn't re-aggregate.
Instead, set a flag when each PG updates it's set, and check that flag in
the OSD code periodically or in likely places. A call in tick() acts as
a catch-all.
The num_created counts can probably be cleaned out now...
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-03-09 12:26:22 -08:00
Yehuda Sadeh
619244d81f
rgw: implement dump() for encoders
...
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-09 00:06:34 -08:00
Yehuda Sadeh
2277fb4536
rgw: add stubs for dencoder test
...
still need to add some content to the dump methods
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-08 16:58:00 -08:00
Yehuda Sadeh
71323ffeda
Merge remote branch 'origin/wip-2139'
...
Conflicts:
src/cls_rgw.cc
src/rgw/rgw_rados.cc
src/rgw/rgw_rados.h
Signed-off-by: Yehuda Sadeh <yehuda.sadeh@dreamhost.com>
2012-03-08 16:15:18 -08:00
Yehuda Sadeh
64e3ffb26d
Merge branch 'master' of ssh://github.com/ceph/ceph
2012-03-08 15:54:14 -08:00
Alex Elder
ac28b6036d
ceph: document the way files are laid out
...
This adds a document that I wrote about how Ceph client file data
is striped across Ceph objects to the repository. It's a text
document. Someone with better document preparation skills than I
should use the content below as a basis for something prettier if
that's appropriate.
[Made a few edits... -sage]
Signed-off-by: Alex Elder <elder@dreamhost.com>
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 15:18:59 -08:00
Sage Weil
1ed1d46682
librados: fix unit test for omap_get_vals_by_key rename
...
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 15:09:30 -08:00
Sage Weil
ce43bd5351
osd: format time nicely in ops_in_flight output
...
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 15:06:39 -08:00
Sage Weil
934ee487fe
librados: fix map -> std::map in header, string -> std::string
...
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 15:06:19 -08:00
Sage Weil
fafbddd9cb
doc: example of diagnosing radosgw hang
...
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 15:02:02 -08:00
Sage Weil
99cb994586
doc: explain how unfound objects happen
...
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 14:55:21 -08:00
Sage Weil
47ce7adee6
doc: make osd failure example include >3 osds
...
More realistic.
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 14:55:08 -08:00
Sage Weil
80864a1204
testrados: fix omap_get_vals_by_keys call
...
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-08 14:46:56 -08:00
Sage Weil
e7e3baebd6
osd: add zero_to field to PG::OndiskLog; track zeroed region of pg log
...
Track which region of the log has been zeroed on disk. This may be
different from tail if 'osd preserved trimmed log = false' in the config.
Only zero the portion of the log we need to. This avoids rezeroing regions
or missing bits when 'osd preserved trimmed log' was off and is then turned
on.
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-08 14:30:09 -08:00
Sage Weil
ed6cc47b18
filestore: use FL_ALLOC_PUNCH_HOLE to zero, when available
...
First try the FL_ALLOC_PUNCH_HOLE fallocate() flag. If we get EOPNOTSUPP,
fall back to writing zeros.
Check for fallocate(2) with configure. Also, avoid this if we are not
Linux, since I'm not sure about the hard-coded FL_ALLOC_PUNCH_HOLE being
correct on other platforms.
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-08 14:30:06 -08:00
Sage Weil
1468d95101
osd: fix op_wq vs pg->lock ordering
...
map_lock
-> pg->lock
-> op_wq
Fixes : #2153
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-08 14:16:59 -08:00
Yehuda Sadeh
c0aa33192d
Merge branch 'master' of ssh://skinny/home/yehudasa/ceph
2012-03-07 22:58:42 -08:00
Yehuda Sadeh
5f8bbf1ff2
Merge branch 'wip-rgw-new-atomic'
2012-03-07 22:53:32 -08:00
Yehuda Sadeh
465a88eae8
rgw: append the currect bucket marker when removing bucket
...
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 22:52:24 -08:00
Yehuda Sadeh
8ce3d229de
Merge branch 'master' of ssh://skinny/home/yehudasa/ceph
2012-03-07 22:39:46 -08:00
Yehuda Sadeh
89648a0d1a
Merge branch 'wip-rgw-omap'
2012-03-07 22:35:40 -08:00
Yehuda Sadeh
72d678b85f
cls_rgw: fix rgw_bucket_init_index
...
was failing to error in case header already existed
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 22:25:47 -08:00
Yehuda Sadeh
eaafc5784d
rgw: remove extra unused params from omap_get()
...
and also rename it to omap_get_all()
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 22:19:25 -08:00
Yehuda Sadeh
765962dc8c
rgw: add cls_cxx_map_clear
...
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 22:18:57 -08:00
Samuel Just
afe2598a58
leveldb: drop compaction unit test
...
Signed-off-by: Samuel Just <rexludorum@gmail.com>
2012-03-07 21:59:44 -08:00
Samuel Just
4d6578ca62
ReplicatedPG,librados: add filter_prefix to omap_get_vals
...
Signed-off-by: Samuel Just <rexludorum@gmail.com>
2012-03-07 17:20:23 -08:00
Yehuda Sadeh
e0744390f6
rgw: use prefix filter for bucket listing
...
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 17:10:18 -08:00
Yehuda Sadeh
4c908442fb
objclass, cls_rgw: add prefix to omap_get_vals()
2012-03-07 17:03:45 -08:00
Yehuda Sadeh
a6b524f602
librados: add higher level call for omap_get_keys() with prefix
...
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 17:02:57 -08:00
Yehuda Sadeh
7a72bf0120
Merge remote-tracking branch 'origin/wip_prefix' into wip-rgw-omap
2012-03-07 16:46:18 -08:00
Yehuda Sadeh
ffcf62f670
rgw: switch to new encoders/decoders
...
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 16:29:11 -08:00
Yehuda Sadeh
ffae4dfef5
enconding: add legacy decoder for 32 bit versions
...
In these cases if the version is smaller than the compat ver
we skip 3 bytes.
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 16:28:01 -08:00
Josh Durgin
b0c9d58c18
rbd: pass all mon addrs when mapping devices
...
Previously this repeated the address of the first monitor.
Fixes : #2152
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Reviewed-by: Sage Weil <sage@newdream.net>
2012-03-07 16:05:14 -08:00
Greg Farnum
65d170a848
msgr: remove declaration of undefined SimpleMessenger::write_pid_file
...
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Reviewed-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-07 13:54:39 -08:00
Greg Farnum
9dc7c65399
msgr: remove SimpleMessenger::get_ms_addr() in favor of Messenger::get_myaddr
...
And fix the comments on set_ip.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Reviewed-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-07 13:54:39 -08:00
Sage Weil
4d0bcdc8e4
objectstore: fix collection_move() encoding
...
This was broken in the original f43c3d958f
.
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-07 14:07:38 -08:00
Samuel Just
0a59d08d93
ReplicatedPG,librados: add filter_prefix to omap_get_vals
...
Signed-off-by: Samuel Just <rexludorum@gmail.com>
2012-03-07 13:08:36 -08:00
Yehuda Sadeh
6bf72019e4
rgw: some minor cleanups
...
following a review
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-07 12:34:35 -08:00