Commit Graph

16108 Commits

Author SHA1 Message Date
Sage Weil
8b8e47b1b3 client: simplify Inode operator<<
Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-30 08:38:37 -07:00
Sage Weil
8d4c7e84cd client: relink_inode -> relink
and some comments.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-08-30 07:13:53 -07:00
Sage Weil
70178046ae client: add some asserts
Add sanity checks in close_dir(), and make sure we aren't replacing a dn
with the same name in link().

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-08-30 07:10:04 -07:00
Sage Weil
afd5236c65 client: fix readder result merge
When merging readdir results into the cache, we want to remove any names
_preceeding_ the current item before updating it.  Then, at the end, we
clean up the trailing items.

This fixes a cfuse crash on workunits/snaps/snaptest-2.sh.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-08-30 07:09:06 -07:00
Sage Weil
89fb93e448 os/hashindex: fix #include
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-08-29 19:32:22 -07:00
Samuel Just
b4e84cf7bc Merge branch 'wip_colindex' 2011-08-29 17:59:10 -07:00
Samuel Just
05989673dd osd/,os/,osdc/: Convert collection_list_handle_t to a struct
Previously, we stored the collection_list handle as an opaque
uint64_t.  Now, collection_list_handle_t is a struct defined
in types.h.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:06 -07:00
Samuel Just
e6c91f6b55 fsconverter.cc: Added fsconverter
fsconverter updates an existing FileStore to the most recent FileStore
format

Signed-off-by: Samuel Just <rexludorum@gmail.com>
2011-08-29 17:43:06 -07:00
Samuel Just
279e16354a FileStore: On mount, scan collections for unstable state
CollectionIndex implementations may perform compound operations
leaving invalid state if interrupted.  index->cleanup() gives
the implementation an oportunity to cleanup any in-progress
operation.  For HashIndex, split and merge fall in this
category

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:06 -07:00
Samuel Just
42742ccd31 FileStore: Added update_version_stamp
update_version_stamp may be used to refresh the filestore version
stamp when all collections have been brought to the current
version.

Signed-off-by: Samuel Just <rexludorum@gmail.com>
2011-08-29 17:43:06 -07:00
Samuel Just
341fb208aa FileStore: Add filestore version stamp
A filestore will now be tagged with a version stamp during
mkfs.  If on mount the version stamp detected lags the current
version, the mount will fail unless filestore_update_collections
is set in gconf.  If it is set, opening a collection will cause
the version stamp on the collection to be read and the
appropriate indexing implmentation to be used.  This will allow
for conversion from old collection indexing schemes to new
ones.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:06 -07:00
Samuel Just
e23e1924dc osd_types.h: Fix support for old object_info_t
The object locator in the old encoding is necessary
to get the hash for soid.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:06 -07:00
Samuel Just
d59f34ab0e FileStore: Integrates HashIndex/IndexManager into FileStore
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:06 -07:00
Samuel Just
eb22b8df6d os/FlatIndex: FlatIndex encapsulates previous FileStore behavior
FlatIndex will be used to read and convert the previous on disk
format.

Signed-off-by: Samuel Just <rexludorum@gmail.com>
2011-08-29 17:43:06 -07:00
Samuel Just
d0744cdd1a FileStore: CollectionIndex, HashIndex, IndexManager
Adds ColletionIndex, an interface for collection indexing
systems, and HashIndex, a mechanism for organising a prehashed
collection.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
5492cbdfda ReplicatedPG: find_object_context now takes an hobject_t
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
5e927ebe0b osd/: fix hobject_t construction
sobject_t requires only an object_t and a snapid_t.  hobject_t also
requires the hash which should be used for the object.  In most cases,
the osd must fill this in using the op message.  In cases where the hash
used does not matter (as in the metadata collection), the explicit
hobject_t(const sobject_t &) constructor supplies a hash.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
a09c49134c dupstore: s/sobject_t/hobject_t
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
8fed10e265 src/messages/: s/sobject_t/hobject_t
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
f76baf1e9b src/osd/: s/sobject_t/hobject_t/g
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
1f591c2933 src/os/: s/sobject_t/hobject_t/g
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
45d829646d object.h: hobject_t definition
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:05 -07:00
Samuel Just
de1f424a72 ceph/src/test/store_test.cc: added store_test.cc
Meant to test basic file store functionality

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:43:01 -07:00
Samuel Just
71123b2dce ObjectStore.h: const cleanup in transaction method params
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:42:51 -07:00
Samuel Just
1fe54bfefe FileStore.cc: Fix error in collection_rename
Previously, the rename operated on the collection names.  Now, rename
operations on the full paths to the collections.

Signed-off-by: Samuel Just <rexludorum@gmail.com>
2011-08-29 17:42:51 -07:00
Samuel Just
30856dc18e JournalingObjectStore: journal_replay committed_seq fix
Previously, committed_seq was set to op_seq at the end of
replay_journal.  committed_seq should not actually be set until the
sync thread runs.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-08-29 17:42:51 -07:00
Tommi Virtanen
afede55c83 Integrate Doxygen into Sphinx docs.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-08-29 17:27:14 -07:00
Tommi Virtanen
f1d8964499 First draft of the documentation overhaul.
To build the docs, run ./admin/build-doc. To browse them, either get
them on any static website, or just run ./admin/serve-doc to serve
them quickly off of port 8080.

build-doc sets up a virtualenv to avoid needing Sphinx installed
system-wide. serve-doc needs thttpd installed.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-08-29 17:27:14 -07:00
Yehuda Sadeh
68f57f9afb test: make escaping unitest happy 2011-08-29 17:19:37 -07:00
Yehuda Sadeh
f2d19a0317 json escaping fix 2011-08-29 17:12:03 -07:00
Yehuda Sadeh
a2b0857c5e radosgw_admin, rados tool: don't use camel casing for json output 2011-08-29 17:02:38 -07:00
Yehuda Sadeh
19f09c0a83 fix json escaping 2011-08-29 17:02:38 -07:00
Sage Weil
b140ff223e client: debug link/unlink and dn_set parent relationship
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-08-29 15:53:57 -07:00
Sage Weil
853658e9f1 heartbeatmap: fix reset_timeout with mixed-used threads
If you have a ThreadPool used by multiple WorkQueues, and some of them are
setting a suicide timeout, we need to clear it when a suicide timeout is
not set.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 15:02:46 -07:00
Yehuda Sadeh
f8296ef550 rados tool: df dumps formatted data 2011-08-29 15:04:59 -07:00
Yehuda Sadeh
c4219a11fb rgw: log show dumps some information about bucket owner 2011-08-29 14:20:17 -07:00
Samuel Just
8cb25cab2e bandaid for gitbuider 2011-08-29 13:42:36 -07:00
Sage Weil
3ecdd1122b Merge remote branch 'vapre/wip-pgid' 2011-08-29 13:39:12 -07:00
Sage Weil
698df7e15c osd: remove dead lookup_lock_pg()
Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 13:39:10 -07:00
Sage Weil
9d37c92c58 osd: set suicide timeouts on some workqueues
OpWQ: timeout * 10
RecoveryWQ: this does no io; it if stalls we're probably stuck in an
  infinite loop.  timeout * 10.
ScrubFinalizeWQ: this is cpu only. we're probably stuck in a loop, or
  swapping.  timeout * 10.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 11:54:21 -07:00
Sage Weil
66b6289a1b mon: health not ok when up < in osds
We were warning if there were any not up or in osds.  Instead, warn if
there are any osds that are in but not up.  That means if a node fails
and successfully marks the node out and retracts onto remaining nodes, the
ceph cluster is healthy again.

Presumably the fact that the nodes failed should raise other alerts,
because those specific daemons/nodes are not healthy.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 11:46:16 -07:00
Sage Weil
502cf0b239 filestore: add suicide grace to workqueue
The main thing we are worried about here are kernel BUGs that kill off our
threads.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 11:46:16 -07:00
Sage Weil
5fde4011ac heartbeatmap: add suicide grace
Add a second suicide grace period that will make us kill ourselves if
we are sufficiently catatonic.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 11:46:15 -07:00
Yehuda Sadeh
68d1ba84a7 rgw: don't check for time skew when Expires was set 2011-08-29 10:58:28 -07:00
Sage Weil
1bb0e3cc69 client: simplify Client::remove_cap() args
Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 09:31:17 -07:00
Sage Weil
b9c824c038 client: clean up Client::remove_session_caps() args
Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 09:31:17 -07:00
Sage Weil
16a5761fa9 client: don't falsely populate mds_sessions on bad MClientSession msg
If from isn't in the map, we don't want to add it via operator[].

Fixes: #1367
Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 09:31:16 -07:00
Sage Weil
04153abb4b testlibrbd: remove useless sizeofs
Should be sizeof(*result), if anything.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 08:59:46 -07:00
Sage Weil
3dcb04b9e7 testlibrbd: fix assert side effect
Coverity cid 1, 2

Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-29 08:56:49 -07:00
Wido den Hollander
66f1d41dae FileJournal: Also classify kernel major version 3 as safe with disk-cache on
Signed-off-by: Wido den Hollander <wido@widodh.nl>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-08-27 20:53:58 -07:00