Commit Graph

30995 Commits

Author SHA1 Message Date
Yehuda Sadeh
184e64d073 Merge pull request #1092 from ceph/wip-rgw-loadgen
Wip rgw loadgen

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-17 10:24:18 -08:00
Yehuda Sadeh
021534214a rgw: loadgen, configurable num of objs, buckets
also fix request draining

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-17 10:16:09 -08:00
Yehuda Sadeh
7c867645ac rgw: loadgen shutdown, error out on failures
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-17 10:14:43 -08:00
Yehuda Sadeh
85267cf6af rgw: sign loadgen requests
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-17 10:14:42 -08:00
Yehuda Sadeh
e8a4b307f9 rgw: loadgen frontend read uid, init access key
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-17 10:14:42 -08:00
Yehuda Sadeh
57137cb4b0 rgw: add a load generation frontend
Still missing some pieces, but already generates requests.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-17 10:14:37 -08:00
Sage Weil
b04d26ae41 Merge pull request #1107 from xylv/wip-osd-crash-with-leveldb-cache-set
osd: OSD failed to start with osd_leveldb_cache_size > 0

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-17 09:58:42 -08:00
Sage Weil
65d3348425 Merge pull request #1109 from ceph/wip-rbd-mount_timeout
rbd: expose mount_timeout map option

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-17 09:36:17 -08:00
Ray Lv
f01202de89 Fixes: #7172
To ensure LevelDBStore::db is destroyed before dependent LevelDBStore::db_cache and LevelDBStore::filterpolicy.

Signed-off-by: Signed-off-by: Ray Lv <xiangyulv@gmail.com>
2014-01-17 20:42:54 +08:00
Ilya Dryomov
b1a853e433 rbd: expose mount_timeout map option
Expose mount_timeout map option.  (I missed it in commit 9b7364d245,
which added -o / --options option and among other options exposed
osdkeepalive and osd_idle_ttl timeouts.)

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-01-17 11:53:38 +02:00
Sage Weil
8ec7fa85ab PendingReleaseNotes: note ceph -s fix
See 790dda9c0b.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-01-16 22:44:26 -08:00
Sage Weil
d6b2f87e20 Merge pull request #1104 from concubidated/master
osd: OSDMap: fix output from ceph status --format=json for num_in_osds

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-16 22:42:39 -08:00
Sage Weil
f29ffa2836 Merge pull request #1097 from ceph/fix-configure-rerunning
avoid re-running configure after initial 'make' invocation

This appears to pass the gitbuilders (and the multiple runs of configure have been irritating me for ages). Yay!

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-16 22:33:50 -08:00
Josh Durgin
f61491058b Merge pull request #1103 from ceph/wip-7073
rgw: use configurable prime number for gc hash

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-01-16 20:35:33 -08:00
John Wilkins
6e931326b0 doc: Removed Calxeda example.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 17:00:38 -08:00
John Wilkins
dd4a9e1875 doc: Removed saucy salamander reference.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:57:16 -08:00
John Wilkins
e7d28a72e6 doc: Added host resolution commentary.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:54:25 -08:00
John Wilkins
22e9a75690 doc: Added comments from #6682.
fixes: #6682

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:51:17 -08:00
John Wilkins
6e37b7a81f doc: Added modification to quick start.
fixes: #6682

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:48:09 -08:00
John Wilkins
742d425fca doc: Changed file name.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:11:15 -08:00
John Wilkins
f7f9bedf48 doc: Added source file for graphic.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:11:01 -08:00
John Wilkins
26aa60212a doc: Added source file for graphic.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:10:47 -08:00
John Wilkins
c30b1387a6 doc: Added third monitor icon.
fixes: #6959

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:10:23 -08:00
John Wilkins
add59b836f doc: Added additional monitor icon.
fixes: #6959

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:09:45 -08:00
John Wilkins
4b03326bad doc: Removed old file. Changed file name.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 16:09:07 -08:00
Yehuda Sadeh
a84cf15f64 rgw: use rwlock for cache
Use a window for cache lru updates, so that we don't need to get the
writer lock every read.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-16 13:32:33 -08:00
Concubidated
790dda9c0b osd: OSDMap: fix output from ceph status --format=json for num_in_osds
num_up_osds returns as an int value, while num_in_osds returns as a string.
Since only an int can be returned from get_num_in_osds(), num_in_osds should
should also be an int to remain consistant with num_up_osds.

Fixes: 7159

Signed-off-by: Tyler Brekke <tyler.brekke@inktank.com>
2014-01-16 12:12:13 -08:00
Yehuda Sadeh
27590c7a32 Merge pull request #915 from ceph/wip-rgw-expose-bucket
6748: rgw: Optionally return the bucket name in a response header.

Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-16 11:58:12 -08:00
John Wilkins
3194d66d23 doc: Fixed keyring command and updated for current conventions.
fixes: #6692

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-16 11:36:39 -08:00
Sage Weil
d4160fdec3 Merge pull request #1094 from ceph/wip-7117-redhat
packaging: ship libdir/ceph

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-16 08:23:23 -08:00
Loic Dachary
ac5a9fecc7 mon: larger timeout for mon mkfs.sh test
Otherwise slow machines may timeout just because they are slow and not
because the process is blocked by an actual problem.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-01-16 14:32:15 +01:00
Loic Dachary
50808af942 ceph-disk: larger timeout in the test script
Otherwise slow machines may timeout just because they are slow and not
because the process is blocked by an actual problem.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-01-16 14:32:15 +01:00
Loic Dachary
d27731fece Merge pull request #1095 from ceph/wip-7166
osd: OSDMap: build reverse name->pool map upon decoding

Reviewed-by: Loic Dachary <loic@dachary.org>
2014-01-16 05:21:34 -08:00
Joao Eduardo Luis
1aa2601818 osd: OSDMap: build reverse name->pool map upon decoding
Commit 3d7c69fb09 introduced a new OSDMap encoding/decoding scheme.
However, while the classic decoding function still kept building the
reverse name->pool map, the new decoding function did not, causing the
monitor to be unable to map pool names to pool ids.

This patch fixes this, by factoring out the loop responsible for
populating the 'name_pool' map, as well as calling 'calc_num_osds()', to
OSDMap::post_decode() and having this function called from both the
classic and the new decode functions.

Fixes: 7166

Signed-off-by: Joao Eduardo Luis <jecluis@gmail.com>
2014-01-16 12:51:32 +00:00
Wido den Hollander
f97264d484 6748: rgw: Optionally return the bucket name in a response header.
This can be useful in situations where accounting of traffic is done externally
when for example HTTP traffic is cached by a reverse proxy like Varnish.

Since not all traffic reaches the RGW daemon it can't fully account all traffic
and this the caching proxy needs to be aware of which bucket the request came for.

Signed-off-by: Wido den Hollander <wido@42on.com>
2014-01-16 10:02:50 +01:00
Sage Weil
3b696f28d6 Merge pull request #1086 from ceph/wip-temp-primary
Add a "primary temp" to go with "pg temp"

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-15 19:04:48 -08:00
Ken Dreyer
2d0d48b829 packaging: ship libdir/ceph
Automake puts ceph_common.sh into libdir/ceph, but the Red Hat packaging
was not capturing this file.

Add the libdir/ceph location to the RPM packaging.

Fixes #7117
2014-01-15 20:02:48 -07:00
Sage Weil
8b09a43657 doc/release-notes: v0.76 draft notes
Signed-off-by: Sage Weil <sage@inktank.com>
2014-01-15 19:02:23 -08:00
Sage Weil
2b36761b81 mon: favor 'mds set max_mds' over 'mds set_max_mds'
Signed-off-by: Sage Weil <sage@inktank.com>
2014-01-15 19:02:23 -08:00
Sage Weil
f3021efe43 Merge pull request #1093 from kdreyer-inktank/redhat-missing-tests
packaging: add missing test files

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-15 19:01:08 -08:00
Ken Dreyer
e60dcfa80d packaging: add missing test files
Two tests were inadvertantly missing from the RPM packaging:

ceph_test_c_headers was added to ceph in
ffdd30efc8

ceph_test_get_blkdev_size was added to ceph in
324dd54534

Add both of these to the packaging.

Signed-off-by: Ken Dreyer <ken.dreyer@inktank.com>
2014-01-15 19:40:40 -07:00
Yehuda Sadeh
5ed7865ae8 rgw: use configurable prime number for gc hash
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-15 16:45:27 -08:00
Greg Farnum
e7b323675b OSDMonitor: make sure we don't send out maps with a primary_temp mapping
Making sure a cluster supports primary_temp is complicated and we don't
have any of the machinery in place right now (nor a need to actually support
it). We don't have any mechanisms for setting it to begin with, so assert
that we never create anything with any such mapping in update_from_paxos()
to catch any errors.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:07 -08:00
Greg Farnum
28e0b76191 test: add an OSDMap unittest
This is not super-sophisticated, but it does basic mapping function
consistency checks and looks at the [pg|primary]_temp manipulations. If
we want to in the future, we can do these programmatically across a range
of pgids instead of just checking hash 0.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:07 -08:00
Greg Farnum
b18311577a OSDMap: move temp manipulation functions out of OSDMonitor
In doing so, consolidate remove_down_pg_temp() and remove_down_primary_temp().

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:07 -08:00
Greg Farnum
fafc8e93dd OSDMap: pay attention to the temp_primary in _get_temp_osds
Switch _get_temp_osds to use pointers instead of references, and force callers
to check the out params instead of relying on a return code for if anything
was set (trying to use the return code when there are two possible outputs
does not provide useable semantics). For the new temp_primary out param, fill it
in from temp_primary if set, or from the pg_temp list if it's set, or leave
it blank if neither are.

Also, don't use pointers to heap elements. Just put the ints and vectors on
the stack, and assign/swap the out parameters with them. This is less
confusing and should be a bit faster in general.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:07 -08:00
Greg Farnum
12122b11c7 OSDMap: add primary out params to _pg_to_osds and _raw_to_up_osds
Switch to use pointers for the out parameters instead of references.

These functions are still just pointing at the front of the generated
lists for the "primary" params, but now that all their callers respect
these outputs we can add programmatic leader assignment with just these
two functions.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:07 -08:00
Greg Farnum
0c3050932b OSDMap: add primary out params to internal _pg_to_up_acting_osds function
And use pointers instead of references for out params.

Now pg_to_up_acting_osds and pg_to_acting_osds can plug in to this slightly
more real implementation, instead of making up their own. (We are still
just using the first member anyway, but we're about to plug it into
the bottom layer of functions.)

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:07 -08:00
Greg Farnum
1c750c65f5 OSDMonitor: implement remove_down_primary_temp()
Same as remove_down_pg_temp()

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:06 -08:00
Greg Farnum
412afea976 OSDMonitor: make remove_redundant_pg_temp clear primary, too
So that this works with future CRUSH changes, we copy the map and clear
out the primary_temp, then compare its output with the real map's output. If
they match, remove the primary_temp from the real map.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-15 16:33:06 -08:00