Commit Graph

32088 Commits

Author SHA1 Message Date
Sage Weil
64a6b26b1a doc/release-notes: fill in some firefly history
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-11 16:02:17 -07:00
Sage Weil
f4196cc3e1 doc/release-notes: firefly draft release notes
Some updates; still incomplete.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-11 16:02:17 -07:00
Sage Weil
9df52611ca Merge pull request #1428 from ceph/wip-is_down-boolean
OSDMap: clarify is_{down,in}() definitions

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-11 10:04:41 -07:00
Ilya Dryomov
406ff0b711 OSDMap: clarify is_{down,in}() definitions
Make it clear that is_down() == !is_up() and is_in() == !is_out().
This is not a functional change.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-03-11 18:11:38 +02:00
Sage Weil
ccf9a7459c Merge pull request #1310 from ceph/wip-doc-documenting-ceph
Wip doc documenting ceph

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-10 16:13:08 -07:00
John Wilkins
d7c4d6abc2 doc: Added init caps to Signed-off-by: and Fixes:
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-03-10 15:58:57 -07:00
John Wilkins
7ac98b2aff doc: Updated sign-off by to sign-off-by
sign-off-by: John Wilkins <john.wilkins@inktank.com>
2014-03-10 15:45:01 -07:00
John Wilkins
0f7d954b19 doc: Updated pull request with suggested changes.
signed-off by: John Wilkins <john.wilkins@inktank.com>
2014-03-10 11:58:53 -07:00
John Wilkins
7e43823faf doc: Fixed typo.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-03-10 10:07:44 -07:00
Sage Weil
0fd636c488 Merge remote-tracking branch 'gh/firefly'
Conflicts:
	README
2014-03-07 08:19:20 -08:00
Sage Weil
88047d0b77 Merge pull request #1399 from jrcresawn/docfix
Changed Availability section of ceph-mds.rst to reference ceph-mds, not ...

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 21:14:47 -08:00
Sage Weil
8221a8ecba Merge pull request #1394 from ceph/wip-7610
obj_bencher: allocate contentsChars to object_size, not op_size

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 21:11:25 -08:00
Dan Mick
e53aed287d SubmittingPatches: clarify "github fork" in preference to "clone"
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2014-03-06 21:11:18 -08:00
Sage Weil
1322e05d0d Merge pull request #1371 from ceph/wip-debian-files
packaging: use wildcard for test files in Debian

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 21:09:00 -08:00
Sage Weil
c09caf034f Merge pull request #1374 from ceph/wip-vstart-paths
test: Use non-default out/ dev/ paths in vstart

Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 21:05:31 -08:00
James Ryan Cresawn
c9eaa6510d Changed Availability section of ceph-mds.rst to reference ceph-mds, not ceph-mon.
Signed-off-by: James Ryan Cresawn <jrcresawn@gmail.com>
2014-03-06 22:05:15 -07:00
Sage Weil
23db6782bb Merge pull request #1397 from ceph/wip-7638
ReplicatedPG::trim_object: use old_snaps for rollback

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 20:06:59 -08:00
Sage Weil
4a0c3a6673 Merge pull request #1398 from ceph/wip-7634
ReplicatedPG: use hobject_t for snapset_contexts map

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 20:05:19 -08:00
Samuel Just
0037ee4550 Merge pull request #1395 from ceph/wip-7637
osd: fix agent thread shutdown

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-03-06 19:19:12 -08:00
Sage Weil
09668a4958 osd: fix agent thread shutdown
We had an old invariant that agent_queue would have at least 1 entry in
it to simplify some other code paths, but it turns out that it is simpler
not to do that.

In particular, this was triggering a failed assertion on shutdown when we
assert that the queue is empty.

Dump offending items on shutdown if they are there, tho, to catch any
future bugs.

Fixes: #7637
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-06 16:12:30 -08:00
Samuel Just
06b96ffdc8 Merge pull request #1389 from ceph/wip-firefly-misc
fix rest tests; fix COLL_MOVE_RENAME dump

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-03-06 15:51:40 -08:00
Sage Weil
d4b4468c88 Merge pull request #1393 from dachary/wip-7072
logrotate: copy/paste daemon list from ceph-*-all-starter.conf

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 15:51:15 -08:00
Loic Dachary
7411c3c6a4 logrotate: copy/paste daemon list from *-all-starter.conf
Each upstart/*-all-starter.conf use the same script to find the list of
daemons and their ids. Copy it over to the corresponding logrotate.conf
script instead of using a less reliable script based on initctl list
output.

If logrotate fails to run initctl reload on a daemon, it will keep
writing to the rotated log file, even after it is deleted and until it
fills the disk. By using the exact same shell snippet as the upstart
scripts used to start the daemon, all of them will be sent the HUP
signal and reopen the log file that was just rotated.

http://tracker.ceph.com/issues/7072 fixes #7072

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-03-07 00:47:58 +01:00
Sage Weil
6f7c8c79f5 Merge pull request #1392 from ceph/wip-7632
ReplicatedPG: consistently use ctx->at_version.version for stashed objec...

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 15:34:59 -08:00
Sage Weil
57c7e19819 Merge pull request #1391 from ceph/wip-7393
ReplicatedPG: clean up num_dirty adjustments

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 15:30:59 -08:00
Samuel Just
b6872b255c ReplicatedPG::trim_object: use old_snaps for rollback
We need to rollback the old value of snaps, not the
new one.

Fixes: #7638
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-06 15:01:04 -08:00
Samuel Just
b5b67d19aa ReplicatedPG: use hobject_t for snapset_contexts map
Otherwise, two objects with different namespaces but
the same object_t will end up clobbering each other's
contexts.

Fixes: #7634
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-06 14:40:12 -08:00
Sage Weil
b436930779 qa/workunits/rest/test.py: do not test 'osd thrash'
This wreaks havoc on our QA because it marks osds up and down and then
immediately after that we try to scrub and some osds are still down.

Adjust the CLI test to wait for all OSDs to come back up after thrashing.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-06 13:46:10 -08:00
Sage Weil
237f0fb455 os/ObjectStore: dump COLL_MOVE_RENAME
This got missed way back in ef7cffc34f
(pre-0.71).

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-06 13:44:39 -08:00
Samuel Just
f888ab41bd ReplicatedPG: consistently use ctx->at_version.version for stashed object
Otherwise, two ops might end up using the same version number.

Fixes: #7632
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-06 12:11:31 -08:00
Samuel Just
eca7e633c8 ReplicatedPG: clean up num_dirty adjustments
Previously, a _delete_head() followed by a recreation on an object in
the same transaction would result in num_dirty being decremented in
_delete_head() without the flag being cleared.  make_writeable() would
then see exists and was_dirty and therefore not increment num_dirty
resulting in a mismatch.  Rather than trying to maintain the num_dirty
number in _delete_head(), rollback_to(), and make_writeable(), it seems
simpler to do the adjustment once in make_writeable based on undirty,
ctx->obc->obs.oi, and ctx->new_obs->oi.

Fixes: 7393
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-06 12:05:10 -08:00
Greg Farnum
c8c2f5473d Client: fix build issue (lost semicolon)
Signed-off-by: Greg Farnum <greg@inktank.com>
2014-03-06 11:32:38 -08:00
Samuel Just
d171418058 obj_bencher: allocate contentsChars to object_size, not op_size
Otherwise, our attempt to sanitize object_size bytes of
data.object_contents will be doomed to memory corruption.

Fixes: #7610
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-06 11:12:25 -08:00
Sage Weil
7403b23544 Merge pull request #1386 from ceph/wip-7624
ReplicatedPG: ensure clones are readable after find_object_context

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 11:01:30 -08:00
Sage Weil
cf2f3adfa6 Merge pull request #1387 from ceph/wip-7618
ReplicatedPG::wait_for_degraded_object: only recover if found

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-06 10:59:47 -08:00
Gregory Farnum
b1ac3aff3c Merge pull request #1320 from ceph/wip-libcephfs-fixes
Wip libcephfs fixes

Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2014-03-06 10:54:44 -08:00
Gregory Farnum
aa7945abc8 Merge pull request #1379 from ceph/wip-7562
mon: make quorum list (by name) be in quorum order

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-03-06 10:44:42 -08:00
Samuel Just
bafd76ada3 ReplicatedPG: ensure clones are readable after find_object_context
We only get EAGAIN if the object is missing.  We also need the
clone to be readable if we are reading it.

The other find_object_context callers already require !degraded.

Fixes: #7624
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-06 08:48:32 -08:00
Gregory Farnum
9d387d38de Merge pull request #1378 from ceph/wip-7487
mon: no crush buckets with type 0 (#7487)

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-03-05 20:58:40 -08:00
João Eduardo Luís
697bf8fdb3 Merge pull request #1380 from ceph/wip-pool-delete
mon/OSDMonitor: fix pool deletion races

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-03-06 01:38:33 +00:00
Sage Weil
2adc534a72 mon/OSDMonitor: fix pool deletion checks, races
Unify the pool deletion safety checks into a single set of functions.
Make sure we check the committed state and error out if there is a problem.
Also check the pending state, if any, and delay+retry if there is a
problem there.

This ensures that we correctly verify that a pool is not in use when it
is deleted (by another tier or by cephfs).  These checks are also now
applied to librados calls.

Fixes: #7590
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-05 15:58:52 -08:00
Samuel Just
d9e8806308 ReplicatedPG::wait_for_degraded_object: only recover if found
Fixes: #7618
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-05 15:51:53 -08:00
Samuel Just
b563a7c7d6 Merge pull request #1381 from ceph/wip-7618
ReplicatedPG::recover_replicas: do not assume that missing objects are u...

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-05 15:31:57 -08:00
Samuel Just
16e3d4d36f Merge pull request #1382 from ceph/wip-7616
Wip 7616

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-05 15:18:19 -08:00
Samuel Just
a222e7a12b ReplicatedPG::recover_replicas: do not assume that missing objects are unfound
Fixes: #7618
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-05 15:14:15 -08:00
David Zafman
3f59f02913 Revert "c_read_operations.cc: fix resource leak"
This reverts commit 3cd751b0a2.

A rados_release_read_op() has already been performed, but coverity
didn't recognize that as releasing memory.

Fixes: #7621

Signed-off-by: David Zafman <david.zafman@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-03-05 15:13:55 -08:00
Sage Weil
a71ddb0b7d mon: make quorum list (by name) be in quorum order
Fixes: #7562
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-05 14:29:02 -08:00
Gregory Farnum
b642e3884c Merge pull request #1343 from ceph/wip-cache-warn-full
mon: warn when cache tier is full

Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Greg Farnum <greg@inktank.com>
2014-03-05 14:22:34 -08:00
Sage Weil
10f660723e Merge pull request #1372 from ceph/wip-7607
wip 7607

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-05 14:21:45 -08:00
Sage Weil
b093958a11 Merge pull request #1351 from ceph/wip-7248
osd: OSD: limit the value of 'size' and 'count' on 'osd bench'

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-05 14:18:28 -08:00