Commit Graph

25530 Commits

Author SHA1 Message Date
John Wilkins
b71ec9c25a doc: Added some detail. Calculating PGs, maps; reorganized a bit.
fixes: #2968

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-04-22 21:02:45 -07:00
Gregory Farnum
2501980350 Merge pull request #234 from ceph/wip-4758
Fixes #4758.

Reviewed-by: Greg Farnum <greg@inktank.com>
2013-04-22 15:22:04 -07:00
Sage Weil
b33fae4ea1 mon: commit LogSummary on every message
This moves our version pointer up so that we don't re-log (by re-consuming)
log messages to /var/log/ceph/ceph.log on ceph-mon restart.  OTOH, it means
we rewrite the summary of the last 50 messages, but we consider that to be
relatively cheap (and something we *always* did prior for bobtail and
earlier anyway).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 15:12:22 -07:00
Sage Weil
59d6953ca0 mon: set threshold to periodically stash_full
Set an interval to periodically write a full copy of the map that is lower
than the trim point (which is generally a very large number of commits).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 15:12:22 -07:00
Sage Weil
5792be81ad Merge pull request #230 from ceph/wip-mon-paxos-fixes
Wip mon paxos fixes

Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-04-22 15:11:46 -07:00
Gregory Farnum
c200cdb081 Merge pull request #225 from ceph/wip-4543
Fixes #4543

Reviewed-by: Greg Farnum <greg@inktank.com>
2013-04-22 15:05:14 -07:00
Joao Eduardo Luis
1164345a6e ceph-mon: Attempt to obtain monmap from several possible sources
In order of interest/priority:

  - our latest monmap version
  - a backup monmap version created during sync start, if the store
    appears to be in a post-aborted sync state
  - a mkfs monmap version

If none of these are found, we should go ahead and try to build a
monmap from ceph.conf to join an existing cluster.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-04-22 22:55:18 +01:00
Joao Eduardo Luis
9ba32404ae mon: Monitor: backup monmap prior to starting a store sync
If by fate we end up attempting a store sync after failing at
least one before, we might not have a monmap to read from the
store to backup.  Therefore, in that case, we shall backup the
current monmap being used by the monitor.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-04-22 22:53:14 +01:00
Yehuda Sadeh
de5d1da810 rgw: don't send tail to gc if copying object to itself
Fixes: #4776
Backport: bobtail
Need to make sure that when copying an object into itself we don't
send the tail to the garbage collection.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-04-22 13:44:19 -07:00
Josh Durgin
cec5282b2a Merge pull request #232 from ceph/wip-4710
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-04-22 13:36:38 -07:00
Sage Weil
70e1e47da0 Merge pull request #233 from ceph/wip-mon-idempotent
Wip mon idempotent

Reviewed-by: Dan Mick <dan.mick@inktank.com>
2013-04-22 12:58:08 -07:00
Sage Weil
85fd2ca20d mon: make 'osd pool rmsnap ...' idempotent
Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 12:50:09 -07:00
Sage Weil
43d62c00c9 mon: make 'osd pool mksnap ...' idempotent
Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 12:49:58 -07:00
Sage Weil
08e3ec116f mon: make 'osd blacklist rm ...' idempotent
Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 12:48:49 -07:00
Sage Weil
5926ffa576 rbd: only set STRIPINGV2 feature when needed
Only set the STRIPINGV2 feature if the striping parameters are non-default.
Specifically, fix the case where the passed-in size and count are == 0.

Fixes: #4710
Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 12:41:49 -07:00
Sage Weil
5446218f7b rbd: fix feature display for --info
Only include the feature if it is set!

Backport: bobtail
Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 12:38:11 -07:00
Sage Weil
568101fa72 rbd: avoid clobbering return value with udevadm settle
Fixes: #4707
Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-22 11:41:27 -07:00
Samuel Just
8db9d0a274 FileJournal: a valid entry after invalid entry =/=> corrupt
Out of order journal entry writes using aio may cause entry
n+2 to be written prior to n.  This does not indicate
corruption.

Fixes: #4736
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-04-22 11:32:25 -07:00
Sylvain Munaut
9b953aa410 radosgw: Fix duplicate 'Content-Type' when using 'response-content-type'
Signed-off-by: Sylvain Munaut <s.munaut@whatever-company.com>
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2013-04-22 09:14:10 -07:00
Joao Eduardo Luis
4b9a2a39c9 mon: MonmapMonitor: add function to obtain latest monmap
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-04-22 17:08:27 +01:00
Joao Eduardo Luis
41b874cb70 mon: PaxosService: add 'exists_key/version' helper functions
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-04-22 17:08:06 +01:00
Gary Lowell
1a8b30eff1 ceph-create-keys: Don't wait if permission denied
If get or create keys returns permssion denied, exit
gracefully instead of retrying.

Signed-off-by: Gary Lowell  <gary.lowell@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-04-21 22:08:49 -07:00
John Wilkins
1fa719d59e doc: Aesthetic improvements. Removed unnecessary graphic and overrode margin for h3 tag.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-04-20 11:10:51 -07:00
John Wilkins
3749ffe652 doc: Added a scenario to PG troubleshooting.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-04-20 11:08:08 -07:00
John Wilkins
cf915941be doc: Changed usage to "bucket-name". Description was okay.
fixes: #4102

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-04-20 11:06:44 -07:00
David Zafman
c4f8adca83 Merge branch 'wip-4201' into next
Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-04-19 18:14:28 -07:00
David Zafman
870f47c7cb tools/ceph-filestore-dump: Implement remove, export and import
Change local names to be clearer
Break real_log() into common function get_log()
Move infos_oid, biginfo_oid and log_oid to globals for general use

Feature: #4201 (osd: data loss: pg export/import/remove)

Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 18:11:26 -07:00
Samuel Just
481c532ff3 Merge branch 'wip_4662_clean' into next
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-04-19 17:11:31 -07:00
Samuel Just
88d9ee1d01 ReplicatedPG::_finish_mark_all_unfound_lost: only requeue if !deleting
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-04-19 17:10:27 -07:00
Samuel Just
0e155550dd ReplicatedPG::_applied_recovered_object*: don't queue scrub if deleting
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-04-19 17:10:27 -07:00
Samuel Just
6ef0f162df PG: check for pg change in ~FlushState
Fixes: #4662
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-04-19 17:10:27 -07:00
Samuel Just
b8cb9d7e7b PG: bail if deleting in _finish_recovery
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-04-19 17:10:26 -07:00
Samuel Just
75cb55b4e2 AsyncReserver: delete context in cancel_reservation
Fixes: #4662
Backport: bobtail
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-04-19 17:10:22 -07:00
David Zafman
d73b9fbe3e tools/ceph-filestore-dump: Error messages lost because stderr is closed
Use cout instead of cerr for command errors
Use cerr for debug mode because stderr is avail
Output map_epoch in debug mode
Fix a message and only for debug mode

Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 17:08:37 -07:00
David Zafman
37d2fe2c71 osd: Make clear_temp() public for use by remove
Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 17:08:37 -07:00
David Zafman
460db08955 osd: Add flag to force version write in _write_info()
Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 17:08:37 -07:00
David Zafman
da39f911e0 osd: Create static PG::_write_log() function
Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 17:08:36 -07:00
Samuel Just
ad845e61b9 OSDMonitor: pg split is no longer experimental
Fixes: #4711
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-04-19 15:23:53 -07:00
Sage Weil
095dc4f6ba Merge pull request #228 from alram/next
Fix journal partition creation

Reviewed-by: Sage Weil <sage@inktank.com>
2013-04-19 15:16:41 -07:00
Alexandre Marangone
56619ab917 Fix journal partition creation
With OSD sharing data and journal, the previous code created the
journal partiton from the end of the device. A uint32_t is
used in sgdisk to get the last sector, with large HD, uint32_t
is too small.
The journal partition will be created backwards from the
a sector in the midlle of the disk leaving space before
and after it. The data partition will use whichever of
these spaces is greater. The remaining will not be used.

This patch creates the journal partition from the start as a workaround.

Signed-off-by: Alexandre Marangone <alexandre.marangone@inktank.com>
2013-04-19 15:11:09 -07:00
Sage Weil
fe9d326099 rbd: fix qa tests to use --allow-shrink
Fixes: #4763
Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-19 14:37:21 -07:00
Gregory Farnum
f114fdc40a Merge pull request #227 from ceph/wip-4574
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-04-19 14:28:18 -07:00
Sage Weil
d395aa521e init-ceph: do not stop start on first failure
When starting we often loop over many daemon instances.  Currently we stop
on the first error and do not try to start other daemons.

Instead, try them all, but return a failure if anything did not start.

Fixes: #2545
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Gary Lowell <gary.lowell@inktank.com>
2013-04-19 13:05:43 -07:00
Joao Eduardo Luis
9a7d1f5197 mon: Monitor: fix timechecks get_health clobbering overall status
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-04-19 12:26:13 -07:00
Sage Weil
aa0d5f39d6 mon: fix health monitor calls
- unconditionally call get_health, regardless of formatter *
- return a meaningful health status code

Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-19 12:16:11 -07:00
Sage Weil
be4807f5b8 global: call observers (and start logging) in global_init
Call observers so that the logging infrastructure gets initailized and we
start logging.  Otherwise, unless a default log setting has been modified,
we won't start logging until we daemonize, and we won't get the nice
version banner in the log file.

Unlike the previous attempt to fix this (a3091774), we do this after all
of the lockdep initialization has completed.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-04-19 12:03:43 -07:00
David Zafman
76505c28de osd: Create new static function PG::_write_info() for use by PG import
Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 11:29:18 -07:00
David Zafman
52d8240adf osd: Add OSD::make_infos_oid() as common function to create oid
Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 11:29:18 -07:00
David Zafman
5ffb3ef4c2 filestore, osd: Fixes to comform to programming guidelines
Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-04-19 11:29:17 -07:00
Joao Eduardo Luis
fa89cfd2e4 mon: QuorumService: return health status on get_health()
This allows us to return the appropriate overall health status on
Monitor::get_health().

Fixes: 4574

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-04-19 19:26:51 +01:00