Commit Graph

17317 Commits

Author SHA1 Message Date
Tommi Virtanen
200d7c89a6 doc: Switch diagram tools from dia to ditaa.
Now you can create diagrams easily with the ".. ditaa::"
directive in the Sphinx documents.

admin/build-doc now checks for debs required for building
the documentation, or just lists commands missing for hosts
not using dpkg.

For more on Ditaa, see http://ditaa.sourceforge.net/

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-12-06 12:07:59 -08:00
Sage Weil
33753c82af filestore: send back op error to log, not stderr
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-06 10:50:01 -08:00
Sage Weil
20b7af79c6 doc: fix typo
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-06 10:50:01 -08:00
Josh Durgin
66b6b1bff8 workunits: add some tests for kernel rbd
This covers some snapshot and resize functions that aren't tested by fs benchmarks.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 10:31:17 -08:00
Josh Durgin
fd9556f0ac rbd: the showmapped command shouldn't connect to the cluster
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 10:26:24 -08:00
Josh Durgin
16a211bfee ceph-rbdnamer: include snapshot name if present
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 10:26:24 -08:00
Josh Durgin
274f4890dc rbd, mount.ceph: use pre-stored secret if available
If a secret is specified, store and use it, but otherwise
check for a pre-existing secret to use.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 10:26:24 -08:00
Josh Durgin
0ad0fbfe3a secret: add is_kernel_secret function
This will let us know whether we can add a key mount option
if no secret is specified.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 10:26:24 -08:00
Josh Durgin
01d30e6acb secret: fix error check
add_key will return -1 when an error occurs, which should be handled at a higher level and not printed here.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 10:26:24 -08:00
Josh Durgin
575f717fd4 rbd: allow snapshots to be mapped
unmap and showmapped already support snapshots. map should too.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 10:26:24 -08:00
Josh Durgin
ddc11a8f17 test_rados.py: clean up after EEXIST test
This extra pool caused subsequent pool tests to fail.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-06 08:34:47 -08:00
Sage Weil
54758abccf Merge remote branch 'gh/stable' 2011-12-05 17:33:57 -08:00
Sage Weil
9512aed5f5 doc: fix rst syntax
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 16:16:35 -08:00
Sage Weil
7178f1caa8 doc: document monitor cluster expansion/contraction
Pretty sure my rst syntax is wrong.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 14:07:44 -08:00
Sage Weil
16f79282cd cephtool: fix shutdown
Fix 'ceph -w' brokenness from commit ad13d0b7.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-05 13:33:39 -08:00
Sage Weil
019597e6f4 filejournal: make FileJournal::open() arg slightly less weird
Pass in fs_op_seq (last_committed_seq), not the next expected seq, so we
can avoid subtracting and adding 1 in odd places.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 11:21:14 -08:00
Sage Weil
bfbc4324d6 Merge branch 'stable' 2011-12-05 11:21:08 -08:00
Sage Weil
86c34ba9ee vstart.sh: .ceph_keyring -> keyring
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 11:21:04 -08:00
Sage Weil
1e3da7edcf filejournal: remove bogus check in read_entry
It is perfectly fine to read events that are older than the fs's seq from
the journal; open() will skip them when positioning the read pointer on
open.

Also, this code is nonsensical; it always failed the assertion.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 10:53:27 -08:00
Sage Weil
dc167bac78 filejournal: set last_committed_seq based on fs, not journal
last_committed_seq is the last seq committed to the fs, not the journal.
Set it when we begin replay with the fs provided value, not from the newest
entry in the journal.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 09:37:10 -08:00
Sage Weil
4a0b00a0f2 mon: stub perfcounters for monitor, cluster
The 'mon' perfcounter is for the local daemon and is always registered.

The 'cluster' perfcounter is for cluster state, and is only registered
(and thus only shows up via the admin socket) when the current daemon is
part of the cluster quorum.

No actual counters yet.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-02 15:35:38 -08:00
Sage Weil
8bbe576cab osd: safely requeue waiting_for_ondisk waiters on_role_change
This could conceivably cause the reply ordering mismatch seen in bug
#1490.  Not sure why we didn't also fix this caller when we fixed that
bug last time :).

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-02 15:27:38 -08:00
Sage Weil
6dd81485c3 osd: rename {take -> requeue}_object_waiters
It calls osd->requeue_ops(), so make naming more consistent and avoid
confusing people like me.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-02 15:27:38 -08:00
Josh Durgin
c883100448 rados.py: add list_pools method
Signed-off-by: Eric Chen <Eric_YH_Chen@wistron.com>
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-02 13:38:19 -08:00
Sage Weil
6b4b659594 Merge branch 'stable' 2011-12-02 12:06:50 -08:00
Mark Kampe
06228716e3 Doc: add a conceptual overview of the peering process
Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-02 11:28:38 -08:00
Sage Weil
c45a8491fe mds: remove obsolete doc 2011-12-02 11:19:24 -08:00
Sage Weil
0c183ec7b0 crush: ignore forcefed input that doesn't exist
This might happen if, e.g., the file_layout specifies an osd that later
is removed from the cluster entirely.  Just ignore it instead of making
upper layers duplicate this check.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-02 09:58:45 -08:00
Sage Weil
faf5ce6293 Revert "CrushWrapper: ignore forcefeed if it does not exist"
This reverts commit 6fbab6da69.

This fails a unit test.

And I change my mind.. I think this is most cleanly handled inside crush, so
we don't duplicate the same check that is generating the error with an different
data structure.
2011-12-02 09:47:58 -08:00
Sage Weil
321ecdaba2 v0.39 2011-12-02 09:01:31 -08:00
Samuel Just
75aff02371 OSDMap: build_simple_from_conf pg_num should not be 0 with one osd
Previously, pg_num would end up set to 0 if osd.0 is the only osd.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-12-02 09:00:27 -08:00
Sage Weil
2f5bd5f737 objecter: initialize global_op_flags to zero
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-01 20:36:13 -08:00
Mark Kampe
813523a681 Doc: delete gratuitous index.html
It was not an index, and seems to contain recommendations
for system configuration.  I have renamed it to confusing.txt
and will merge it in a future commit.

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:13:12 -08:00
Mark Kampe
48165af5c2 Doc: complete reversion of architecture.rst
(abandon in progress improvements until everything works)

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:12:34 -08:00
Mark Kampe
3c7a82a6dc Doc: deleted gratuitious PlanningImplementation.html,
which was a copy of PlanningImplementation.txt
(and not html at all).

restored previous index.rst, which was overwritten with a copy
of PlanninImplementation.txt, but removed all of the recursively
included content from the document.

I will cherry-pick merge the new contents in a subsequent commit.

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:12:12 -08:00
Mark Kampe
fdf3f7bd7d Doc: Restore the previous version of architecture.rst
it was accidentally overwritten with a version of the product
had a somewhat different audience/focus and a few sphinx
formatting errors.

I will cherry-pick the corrections in a subsequent commit.

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:11:05 -08:00
Mark Kampe
4cfe0815cb doc: change state model from .svg to .png
Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:07:41 -08:00
Steve MacGregor
1bbf9ae6b5 fixed ubuntu version typo 2011-12-01 14:41:38 -08:00
Samuel Just
6fbab6da69 CrushWrapper: ignore forcefeed if it does not exist
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-12-01 14:20:12 -08:00
Josh Durgin
363ebb6ccc librbd: report an error if rbd header does not match
This will fail on future incompatible versions of the header format.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-01 12:38:57 -08:00
Greg Farnum
cce67171a7 Merge branch 'wip_local_reads' 2011-12-01 11:15:44 -08:00
Greg Farnum
d4aef20210 hadoop: apache license.
We haven't made explicit that the Hadoop Java code is under the Apache
License. Do so (with permission from the other contributors, thanks!).

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-12-01 11:15:29 -08:00
Sage Weil
348c71c414 mds: fix blocking in standby replay thread
We need to hold mylock before waiting on the cond or else we get

./common/Cond.h: In function 'int Cond::Wait(Mutex&)', in thread '7f37fe0c8700'
./common/Cond.h: 46: FAILED assert(mutex.is_locked())
 ceph version 0.38-2-g73f99a1 (commit:73f99a189f491866da2be88adcfe0bd512282755)
 1: (MDLog::_replay_thread()+0x2483) [0x6c4393]
 2: (MDLog::ReplayThread::entry()+0xd) [0x4decbd]
 3: (()+0x6d8c) [0x7f3803e8fd8c]
 4: (clone()+0x6d) [0x7f38028d504d]
 ceph version 0.38-2-g73f99a1 (commit:73f99a189f491866da2be88adcfe0bd512282755)
 1: (MDLog::_replay_thread()+0x2483) [0x6c4393]
 2: (MDLog::ReplayThread::entry()+0xd) [0x4decbd]
 3: (()+0x6d8c) [0x7f3803e8fd8c]
 4: (clone()+0x6d) [0x7f38028d504d]
*** Caught signal (Aborted) **
 in thread 7f37fe0c8700

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-01 09:17:56 -08:00
Sage Weil
f6ee3699c9 global: make daemon banner print explicit
This eliminates some flags and avoids annoying cases where the banner is
printed but we don't want to see it.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-01 09:17:51 -08:00
Sage Weil
5828009e69 mds: fix usage text
Filename is not optional.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-01 08:19:47 -08:00
Sage Weil
353ee0004a mds: adjust flock lock state on export
Looks like this was missed when flocklock was added.  Did a quick grep and
it doesn't look like it is missing anywhere else.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-30 09:57:58 -08:00
Greg Farnum
2443878b81 Objecter: loop the right direction when searching for local replicas
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-29 18:14:29 -08:00
Samuel Just
1c696b6566 doc: Add peering state diagram
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-11-29 16:35:59 -08:00
Sage Weil
30ede648fe Makefile: ipaddr.h, pick_address.h
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-29 15:36:07 -08:00
Sage Weil
77a62fdce4 Makefile: add missing uuid.h to tarball
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-29 13:31:38 -08:00