Commit Graph

21021 Commits

Author SHA1 Message Date
John Wilkins
199dc5d0dc :doc: Refactored and moved control.rst page.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:21:31 -07:00
John Wilkins
d90fea6cad :doc: Consolidated file system recommendations.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:21:04 -07:00
John Wilkins
ab020da912 :doc: Minor syntax update.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:20:30 -07:00
John Wilkins
64b9e9f505 :doc: restructuredText syntax corrections.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:19:51 -07:00
John Wilkins
c94034a29e :doc: Added index page. This will be refactored again soon.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:17:57 -07:00
John Wilkins
32398f347d :doc: Refactored and moved to ceph/docs/cluster-ops/pools.rst
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:17:20 -07:00
John Wilkins
c53a110406 :doc: Removed. New section is in ceph/doc/cluster-ops/authentication.rst
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:16:29 -07:00
John Wilkins
f1c869cbe3 :doc: Fixed heading syntax.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-05 17:15:27 -07:00
Sage Weil
79b3054347 crush: change default type from 'pool' to 'root'
The 'pool=default' in the default crush maps is confusing wrt rados pools.
'root' makes more sense given that we are talking about hierarchies/trees.

Signed-off-by: Sage Weil <sage@inktank.com>
2012-09-05 13:20:48 -07:00
Samuel Just
a0c87b8675 Merge remote-tracking branch 'upstream/wip-kvstore' 2012-09-05 10:50:50 -07:00
Gary Lowell
195eda62f7 Monitor.cc: Added include for limits.h.
This include is needed on Centos.  It seems to be included implicitly
on other platforms.
2012-09-04 20:31:00 -07:00
John Wilkins
ca7fb83816 Merge branch 'master' of github.com:ceph/ceph 2012-09-04 17:17:07 -07:00
John Wilkins
2266876987 :doc: Added a section for adding and removing monitors. Singificantly re-factored.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 17:16:23 -07:00
John Wilkins
c1ff83de40 :doc: Incorporated Joao's feedback into the reference material.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 17:15:35 -07:00
Wido den Hollander
0c78a03d24 docs: Add CloudStack documentation
The basic documentation about how you can use RBD with CloudStack

Signed-off-by: Wido den Hollander <wido@widodh.nl>
2012-09-04 16:48:47 -07:00
John Wilkins
2b8690be29 :doc: Added recovering from OSD failures. Will be re-factored again soon.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:34:32 -07:00
John Wilkins
9db84be4b7 doc: Added monitor failure recovery. Will be re-factored again soon.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:33:47 -07:00
John Wilkins
6dff5d5614 doc: Re-factored adding an OSD.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:19:33 -07:00
John Wilkins
32b44cb4ae doc: Minor updates.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:18:54 -07:00
John Wilkins
00dd6a63bd Merge branch 'master' of github.com:ceph/ceph 2012-09-04 16:17:46 -07:00
John Wilkins
d233271434 doc: Added admonishments for Ceph FS per http://tracker.newdream.net/issues/3077
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:17:29 -07:00
John Wilkins
4b774b6950 doc: Updated to incorporate Sage's changes.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:08:35 -07:00
John Wilkins
327969ca53 doc: Added anchor references.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:03:34 -07:00
John Wilkins
a50f73ea9e doc: Refactored the debug section to point back to reference.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:02:37 -07:00
John Wilkins
31d632876f doc: Added QA reference to --valgrind option.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:01:48 -07:00
Sage Weil
ccfd841364 Revert "ReplicatedPG: fill in user log entry last after snapdir tran"
This reverts commit 0aad5462eb.

This gives us two events with the same version, and crashes like so:

osd/PG.cc: In function 'void PG::add_log_entry(pg_log_entry_t&, ceph::bufferlist&)' thread 7fd21b187700 time 2012-09-04 15:10:39.475385
osd/PG.cc: 2181: FAILED assert(e.version > info.last_update)

 ceph version 0.51-411-g40fd6ba (commit:40fd6ba8ed9ba70c8d20a79936f53f10f2dfe839)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x95) [0x1025139]
 2: (PG::add_log_entry(pg_log_entry_t&, ceph::buffer::list&)+0xb0) [0xe47552]
 3: (PG::append_log(std::vector<pg_log_entry_t, std::allocator<pg_log_entry_t> >&, eversion_t, ObjectStore::Transaction&)+0x1cd) [0xe47939]
 4: (ReplicatedPG::do_op(std::tr1::shared_ptr<OpRequest>)+0x41f2) [0xcb5c84]
 5: (PG::do_request(std::tr1::shared_ptr<OpRequest>)+0x1f3) [0xe42329]
 6: (OSD::dequeue_op(PG*)+0x286) [0xd9a214]
 7: (OSD::OpWQ::_process(PG*)+0x27) [0xda20e7]
 8: (ThreadPool::WorkQueue<PG>::_void_process(void*)+0x2e) [0xdf1ab4]
 9: (ThreadPool::worker()+0x4ce) [0x101c762]
 10: (ThreadPool::WorkThread::entry()+0x1c) [0xda049e]
 11: (Thread::_entry_func(void*)+0x23) [0x1016a49]
 12: (()+0x7e9a) [0x7fd22b7fce9a]
 13: (clone()+0x6d) [0x7fd229db14bd]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2012-09-04 15:21:45 -07:00
Samuel Just
40fd6ba8ed OSD::handle_pg_stats_ack: grab pg refcount while processing pg
If the queue refcount is the last one for the pg, the pg->put()
in the loop will destroy the pg while the lock is still held
leading to #3071.  Thus, grab refcount in case we need to drop
it.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2012-09-04 13:55:09 -07:00
Samuel Just
0aad5462eb ReplicatedPG: fill in user log entry last after snapdir tran
The user log entry contains the request id, which will be used
by replay ops to put themselves in the correct place in the
waiting_for_commit/ack maps.  Thus, the repop needs to be tagged
with the same version as the log entry with the request id.
Thus, the request id bearing log entry should be the last in
the log entry vector.

This should fix #3072, wherein a replay which should wait on
the repop tagged as version '36 will instead wait on '35.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2012-09-04 13:47:03 -07:00
Samuel Just
1db67c443d PG: In Active, don't transition to WantActingChange
want_acting is filled in during recovery completion in
order to move the newly backfilled osd into its correct
place.  In this case, however, want_acting must contain
only members of acting and up.  Thus, we can be sure that
if any of them go down, we would restart peering anyway.
Thus, we need not transition to WaitActingChange, which
does not reflect that we continue to serve client operations
in the interim.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2012-09-04 12:17:42 -07:00
Sage Weil
46b86426e8 Merge branch 'wip-msgr'
Reviewed-by: Greg Farnum <greg@inktank.com>
2012-09-04 12:17:13 -07:00
Sage Weil
035cf96501 msg/Pipe: kill useless onconnect arg
This reduces debug output but nothing else, for know discernable reason.
Drop it.

Signed-off-by: Sage Weil <sage@inktank.com>
2012-09-04 11:54:44 -07:00
John Wilkins
b6ef17a1f3 Merge branch 'master' of github.com:ceph/ceph 2012-09-04 11:40:51 -07:00
John Wilkins
31b1c2f84a doc: Added PG states.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:40:25 -07:00
John Wilkins
ef6814d96e doc: Promoting PG concepts into mainline docs. Redundant version still in Internals.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:39:16 -07:00
John Wilkins
25b759390a doc: New section on placement groups.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:38:27 -07:00
John Wilkins
3fcdbe42c7 doc: Moved from configuration to operations. Updated with new info.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:37:52 -07:00
John Wilkins
9da49667b8 doc: Created a more robust doc for monitoring a cluster.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:37:13 -07:00
John Wilkins
743e0b8d2b doc: Consolidated start and stop.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:36:33 -07:00
John Wilkins
3e562001fd doc: Added a new "Data Placement" overview section for added continuity.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:35:33 -07:00
John Wilkins
2a1ac68089 doc: Added a new CRUSH map section. Will need to incorporate new tunables info.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:34:58 -07:00
John Wilkins
fc093f8b09 doc: Moving new auth section from configuration to operations.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 11:33:37 -07:00
Sage Weil
e09b26555c objecter: fix osdmap wait
When we get a pool_op_reply, we find out which osdmap we need to wait for.
The wait_for_new_map() code was feeding that epoch into
maybe_request_map(), which was feeding it to the monitor with the subscribe
request.  However, that epoch is the *start* epoch, not what we want.  Fix
this code to always subscribe to what we have (+1), and ensure we keep
asking for more until we catch up to what we know we should eventually
get.

Bug: #3075
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2012-09-04 11:29:21 -07:00
Tommi Virtanen
c1e000b999 doc: Fix leftover "localhost" mention.
Commit dd011aba90 changed
the conf file sample to say {hostname}, but changed the
prose only from ``localhost`` to ``{localhost}``.

Signed-off-by: Tommi Virtanen <tv@inktank.com>
2012-09-04 08:20:57 -07:00
John Wilkins
3302a2d498 doc: Added debug ref to toctree. Trimmed title names a bit.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-03 14:06:44 -07:00
John Wilkins
4609639ba1 doc: Added "how to" for debug/logging config. Trimmed titles too.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-03 14:05:51 -07:00
John Wilkins
7465dbeb82 doc: Added logging reference under configuration section.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-03 14:04:11 -07:00
Sage Weil
4ab9f02f2a msg/Pipe: do not special-case failure during connect
Do not special case failure during connect.  In particular, we may be
reconnecting and experience a second fault, and wipe out our session
(e.g., between the fs client and the mds) and destroy important session
state.

This logic dates back to the original patch in '08 when the standby
state was introduced.

Bug: #3070
Signed-off-by: Sage Weil <sage@inktank.com>
2012-09-03 14:00:27 -07:00
John Wilkins
7b6c77388e doc: Added runtime configuration example.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-03 13:35:49 -07:00
Eleanor Cawthon
73d016fdb3 test, key_value_store: added distributed flat btree key-value store
Uses one index object and many sub objects to store key-value pairs. The pairs
are stored in the omaps of librados objects. The index contains keys
corresponding to the highest key in an object, and values that contain the
name of the object where the key range is stored. The tree guarantees that
the number of pairs in an object will be > k and < 2k for a user-specified k.
KvStoreBench contains benchmarking tests.

Signed-off-by: Eleanor Cawthon <eleanor.cawthon@inktank.com>
2012-09-02 14:46:12 -06:00
Sage Weil
bfa9a59f0e vstart.sh: -r to start radosgw
Uses a fixed access/secret key for easier testing.  Starts a standalone
apache2 process with basic config (based on the teuthology one).

Signed-off-by: Sage Weil <sage@inktank.com>
2012-09-01 14:51:04 -07:00