Commit Graph

17453 Commits

Author SHA1 Message Date
Sage Weil
722ec7e5f5 osd: kill unused PG_STATE_SCANNING
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
d7f7bbdcb2 osd: remove recovery-from-backlog kludge last_update
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
9ceecc8934 osd: kill PG::Info::backlog
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
7521c51af2 osd: remove backlog case from clean_up_local
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
257b85d87b osd: remove log_backlog from PG::Info
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
e7514f75df osd: state machine whitespace
I feel better now

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
6d299552cd osd: strip backlog logic out of PG::activate()
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
3f5ced6960 osd: kill backlog_requested
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
82a23dbe51 osd: strip backlog case out of merge_log
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
5b558dc42c osd: strip out some backlog logic
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:33 -08:00
Sage Weil
78b64473ce osd: kill PG::Log::copy_non_backlog
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
b8ee27a384 osd: remove Query::BACKLOG processing
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
6e9d135ae9 osd: simplify replica queries for finding divergent objects
No need to request backlog here, clearly, since those don't exist anymore.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
b06648569d osd: remove backlog generation code
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
73d15e016f osd: do not read backlog off disk
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
004e7c9283 osd: add Incomplete peering state
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
4509e61985 test_backfill.sh 2011-12-14 11:31:32 -08:00
Sage Weil
910398fea0 osd: recover discontiguous peers using backfill instead of backlog
Instead of generating a huge list of objects to recover, and then pushing
them, iterate over the collection and copy objects as we go.

Disable various bits of backlog code; it will all get ripped out shortly.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
e4ab0e3b17 osd: add MOSDPGBackfill message
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
353195d68c types: operator<< for multimaps
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
17b5d5c34e osd: implement do_scan
Handle MOSDPGScan messages to request or send a digest of a range of
objects in a collection, sorted in hobject_t (hash) order.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
92d290d641 osd: implement ReplicatedPG::scan_range
Scan a range of the local collection.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
55c2481377 osd: implement ReplicatedPG::_lookup_object_context
Look up an existing ObjectContext without taking a reference.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
8f14a35857 osd: add PG::BackfillInterval type
Describe a range of objects for the purposes of backfilling a PG.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
9e51c63950 osd: MOSDPGScan
Message to query hash ranges of a PG.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-14 11:31:32 -08:00
Sage Weil
2cdc6b4e00 osd: rewrite choose_acting process
Consolidate callers, eliminate obsolete backlog ones.

New process:
 - pick best log, with preferences for those that might end up primary
 - pick best primary that is log-contiguous with best log, with preference
   for longer tails that will result in more acting osds.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
99c614fa05 osd: don't keep push state on replicas
Primaries need this, but replicas don't: the primary will explicitly pull
the pieces of the object that it wants.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:32 -08:00
Sage Weil
10e481d17b osd: fix push_to_replica typo
We are always pushing soid.  If we are missing snapdir locally, that means
we can't do an informed efficient clone, and should push the whole
object... NOT that we should push snapdir!

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 11:31:31 -08:00
Yehuda Sadeh
e8e1e5dffb swift: auth response returns X-Auth-Token instead of X-Storage-Token 2011-12-14 10:50:30 -08:00
Sage Weil
c9d0e556c7 osd: fix build_incremental_map_msg
We keep both the inc and the full for our oldest osdmap.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-14 09:31:17 -08:00
Sage Weil
5804477b20 qa: trivial_libceph test
This currently fails... see #1827

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 16:31:02 -08:00
Sage Weil
207c40b08a libceph: add missing #includes
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 16:29:02 -08:00
Sage Weil
2f281d1ffd libceph: catch errors from Client::init()
And clean up error paths.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 16:29:02 -08:00
Sage Weil
c87f31e0a5 client: return errors from init
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 16:29:02 -08:00
Sage Weil
7133a2faf0 filestore: dump transaction to log if we hit an error
This will let us see which operation in the transaction failed.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 09:15:23 -08:00
Sage Weil
6b4256763a objectstore: implement Transaction::dump()
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 09:15:23 -08:00
Sage Weil
3d13f003e4 objectstore: create Transaction::iterator class
Remove iterator state from Transaction itself.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 09:05:10 -08:00
Sage Weil
6ff95e9d23 qa: rados load-gen workunits
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-13 08:19:37 -08:00
Samuel Just
6d5e5bdb1a pybind/rados: add asynchronous write,append,read,write_full operations
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-12-12 16:00:06 -08:00
Andre Noll
fb8fd186aa doc: Clarify documentation of reweight command.
This caused some discussions on the mailing list, so let's try to be clear
about the meaning of an OSD weight.

Signed-Off-By: Andre Noll <maan@systemlinux.org>
2011-12-12 14:31:10 -08:00
Andre Noll
db30716b27 doc: Add missing documentation for osd pool get.
"osd pool set" was already documented, but the corresponding "get"
command was not. This patch adds the list of valid fields for this
command, together with short descriptions.

Thanks to Gregory Farnum for pointing out a flaw in the description
of lpl_num and lpgp_num in an earlier version of the patch.

Signed-Off-By: Andre Noll <maan@systemlinux.org>
2011-12-12 14:31:10 -08:00
Andre Noll
7dce3e6fe2 doc: Update the list of fields for the pool set command.
This list was lacking a few fields: crash_replay_interval, pg_num,
pgp_num and crush_ruleset. Include these fields and add add short
descriptions.

Signed-Off-By: Andre Noll <maan@systemlinux.org>
2011-12-12 14:31:10 -08:00
Andre Noll
1867a74584 doc: Document pause and unpause osd commands.
These two commands were undocumented so far. This patch adds a short
description.

Signed-Off-By: Andre Noll <maan@systemlinux.org>
2011-12-12 14:31:10 -08:00
Andre Noll
9aadd41b20 doc: Add documentation of missing osd commands.
The set of OSD commands which added by the previous commit is
incomplete. This patch adds documentation for the following
OSD commands which were previously missing: dump, tree, crush,
cluster_snap, lost, create, rm.

Signed-Off-By: Andre Noll <maan@systemlinux.org>
2011-12-12 14:31:10 -08:00
Andre Noll
78b7a25598 doc: Import the list of ceph subcommands from wiki.
This adds the content of the wiki page at

http://ceph.newdream.net/wiki/Monitor_commands

to doc/control.rst in order to make it available at the new official
location for the ceph documentation. This first patch is just the
result of a cut-and-paste operation. There are no changes in content,
but the text was converted to rst format.

Signed-Off-By: Andre Noll <maan@systemlinux.org>
2011-12-12 14:31:10 -08:00
Sage Weil
5e215c7ee3 Merge branch 'wip-mon-stats' 2011-12-12 09:29:36 -08:00
Sage Weil
711447d8d5 mon: add mds, mon info to cluster_logger
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-12 09:27:17 -08:00
Sage Weil
808a851d6b mdsmap: rename get_num_*_mds() methods
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-12 09:27:17 -08:00
Sage Weil
ac31d526d2 mon: report basic cluster stats via perfcounters
These are basic point-in-time cluster stats.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-12 09:24:27 -08:00
Sage Weil
1f1b5fdfdc crush: drop unused label
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-12 09:22:49 -08:00