Commit Graph

17503 Commits

Author SHA1 Message Date
Sage Weil
16f79282cd cephtool: fix shutdown
Fix 'ceph -w' brokenness from commit ad13d0b7.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-05 13:33:39 -08:00
Sage Weil
019597e6f4 filejournal: make FileJournal::open() arg slightly less weird
Pass in fs_op_seq (last_committed_seq), not the next expected seq, so we
can avoid subtracting and adding 1 in odd places.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 11:21:14 -08:00
Sage Weil
bfbc4324d6 Merge branch 'stable' 2011-12-05 11:21:08 -08:00
Sage Weil
86c34ba9ee vstart.sh: .ceph_keyring -> keyring
Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 11:21:04 -08:00
Sage Weil
1e3da7edcf filejournal: remove bogus check in read_entry
It is perfectly fine to read events that are older than the fs's seq from
the journal; open() will skip them when positioning the read pointer on
open.

Also, this code is nonsensical; it always failed the assertion.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 10:53:27 -08:00
Sage Weil
dc167bac78 filejournal: set last_committed_seq based on fs, not journal
last_committed_seq is the last seq committed to the fs, not the journal.
Set it when we begin replay with the fs provided value, not from the newest
entry in the journal.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-05 09:37:10 -08:00
Sage Weil
4a0b00a0f2 mon: stub perfcounters for monitor, cluster
The 'mon' perfcounter is for the local daemon and is always registered.

The 'cluster' perfcounter is for cluster state, and is only registered
(and thus only shows up via the admin socket) when the current daemon is
part of the cluster quorum.

No actual counters yet.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-02 15:35:38 -08:00
Sage Weil
8bbe576cab osd: safely requeue waiting_for_ondisk waiters on_role_change
This could conceivably cause the reply ordering mismatch seen in bug
#1490.  Not sure why we didn't also fix this caller when we fixed that
bug last time :).

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-02 15:27:38 -08:00
Sage Weil
6dd81485c3 osd: rename {take -> requeue}_object_waiters
It calls osd->requeue_ops(), so make naming more consistent and avoid
confusing people like me.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-02 15:27:38 -08:00
Josh Durgin
c883100448 rados.py: add list_pools method
Signed-off-by: Eric Chen <Eric_YH_Chen@wistron.com>
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-02 13:38:19 -08:00
Sage Weil
6b4b659594 Merge branch 'stable' 2011-12-02 12:06:50 -08:00
Mark Kampe
06228716e3 Doc: add a conceptual overview of the peering process
Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-02 11:28:38 -08:00
Sage Weil
c45a8491fe mds: remove obsolete doc 2011-12-02 11:19:24 -08:00
Sage Weil
0c183ec7b0 crush: ignore forcefed input that doesn't exist
This might happen if, e.g., the file_layout specifies an osd that later
is removed from the cluster entirely.  Just ignore it instead of making
upper layers duplicate this check.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-02 09:58:45 -08:00
Sage Weil
faf5ce6293 Revert "CrushWrapper: ignore forcefeed if it does not exist"
This reverts commit 6fbab6da69.

This fails a unit test.

And I change my mind.. I think this is most cleanly handled inside crush, so
we don't duplicate the same check that is generating the error with an different
data structure.
2011-12-02 09:47:58 -08:00
Sage Weil
321ecdaba2 v0.39 2011-12-02 09:01:31 -08:00
Samuel Just
75aff02371 OSDMap: build_simple_from_conf pg_num should not be 0 with one osd
Previously, pg_num would end up set to 0 if osd.0 is the only osd.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-12-02 09:00:27 -08:00
Sage Weil
2f5bd5f737 objecter: initialize global_op_flags to zero
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-12-01 20:36:13 -08:00
Mark Kampe
813523a681 Doc: delete gratuitous index.html
It was not an index, and seems to contain recommendations
for system configuration.  I have renamed it to confusing.txt
and will merge it in a future commit.

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:13:12 -08:00
Mark Kampe
48165af5c2 Doc: complete reversion of architecture.rst
(abandon in progress improvements until everything works)

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:12:34 -08:00
Mark Kampe
3c7a82a6dc Doc: deleted gratuitious PlanningImplementation.html,
which was a copy of PlanningImplementation.txt
(and not html at all).

restored previous index.rst, which was overwritten with a copy
of PlanninImplementation.txt, but removed all of the recursively
included content from the document.

I will cherry-pick merge the new contents in a subsequent commit.

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:12:12 -08:00
Mark Kampe
fdf3f7bd7d Doc: Restore the previous version of architecture.rst
it was accidentally overwritten with a version of the product
had a somewhat different audience/focus and a few sphinx
formatting errors.

I will cherry-pick the corrections in a subsequent commit.

Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:11:05 -08:00
Mark Kampe
4cfe0815cb doc: change state model from .svg to .png
Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-12-01 16:07:41 -08:00
Steve MacGregor
1bbf9ae6b5 fixed ubuntu version typo 2011-12-01 14:41:38 -08:00
Samuel Just
6fbab6da69 CrushWrapper: ignore forcefeed if it does not exist
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-12-01 14:20:12 -08:00
Josh Durgin
363ebb6ccc librbd: report an error if rbd header does not match
This will fail on future incompatible versions of the header format.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-12-01 12:38:57 -08:00
Greg Farnum
cce67171a7 Merge branch 'wip_local_reads' 2011-12-01 11:15:44 -08:00
Greg Farnum
d4aef20210 hadoop: apache license.
We haven't made explicit that the Hadoop Java code is under the Apache
License. Do so (with permission from the other contributors, thanks!).

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-12-01 11:15:29 -08:00
Sage Weil
348c71c414 mds: fix blocking in standby replay thread
We need to hold mylock before waiting on the cond or else we get

./common/Cond.h: In function 'int Cond::Wait(Mutex&)', in thread '7f37fe0c8700'
./common/Cond.h: 46: FAILED assert(mutex.is_locked())
 ceph version 0.38-2-g73f99a1 (commit:73f99a189f491866da2be88adcfe0bd512282755)
 1: (MDLog::_replay_thread()+0x2483) [0x6c4393]
 2: (MDLog::ReplayThread::entry()+0xd) [0x4decbd]
 3: (()+0x6d8c) [0x7f3803e8fd8c]
 4: (clone()+0x6d) [0x7f38028d504d]
 ceph version 0.38-2-g73f99a1 (commit:73f99a189f491866da2be88adcfe0bd512282755)
 1: (MDLog::_replay_thread()+0x2483) [0x6c4393]
 2: (MDLog::ReplayThread::entry()+0xd) [0x4decbd]
 3: (()+0x6d8c) [0x7f3803e8fd8c]
 4: (clone()+0x6d) [0x7f38028d504d]
*** Caught signal (Aborted) **
 in thread 7f37fe0c8700

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-01 09:17:56 -08:00
Sage Weil
f6ee3699c9 global: make daemon banner print explicit
This eliminates some flags and avoids annoying cases where the banner is
printed but we don't want to see it.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-01 09:17:51 -08:00
Sage Weil
5828009e69 mds: fix usage text
Filename is not optional.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-12-01 08:19:47 -08:00
Sage Weil
353ee0004a mds: adjust flock lock state on export
Looks like this was missed when flocklock was added.  Did a quick grep and
it doesn't look like it is missing anywhere else.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-30 09:57:58 -08:00
Greg Farnum
2443878b81 Objecter: loop the right direction when searching for local replicas
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-29 18:14:29 -08:00
Samuel Just
1c696b6566 doc: Add peering state diagram
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-11-29 16:35:59 -08:00
Sage Weil
30ede648fe Makefile: ipaddr.h, pick_address.h
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-29 15:36:07 -08:00
Sage Weil
77a62fdce4 Makefile: add missing uuid.h to tarball
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-29 13:31:38 -08:00
Greg Farnum
ebb585d9c0 Objecter: fix local reads in recalc_op_target
We want to use the actual OSD, not the index into the array!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-29 13:30:45 -08:00
Sage Weil
8788a404ae osd: subscribe to next map if flagged FULL
This ensures the osd finds out when we become un-full in a timely manner.

Fixes: #1755
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-29 08:28:57 -08:00
Sage Weil
c2889fef42 mds: encode truncate_pending in inode
Otherwise we don't actually journal this value, and we get confused when
we replay a start_truncate and try to restart it.

Fixes: #1756
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-28 21:39:21 -08:00
Greg Farnum
98e0a6fddf uclient: remove filer_flags and use Objecter::global_op_flags instead
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-28 12:52:51 -08:00
Greg Farnum
da2e0c3c14 Objecter: add a new global_op_flags that is passed to every Op constructor.
We can use this for a global use of LOCALIZE_READS (and are about
to do so!).

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-28 12:52:46 -08:00
Greg Farnum
51385930cd Objecter: remove unused variable in op_submit
These flags are probably relics from when the function got split;
they belong in send_op now.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-28 12:30:46 -08:00
Greg Farnum
4974a9c284 uclient: remove useless if-else based on snapid
These are the same command anyway!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-28 10:32:07 -08:00
Wido den Hollander
cef16732e7 debian init: Do not stop or start daemons when installing or upgrading
Signed-off-by: Wido den Hollander <wido@widodh.nl>
2011-11-28 09:01:50 -08:00
Sage Weil
ce65722739 mon: search for local ip during mkfs
If an address isn't explicitly specified during mkfs, look for an unnamed
monitor in the (generated) monmap and see if any of those addresses is
configured on the local machine.  If so, assume it's us, and name ourselves
in the seed monmap.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-27 16:11:29 -08:00
Sage Weil
61b9db3a8e pick_address: implement have_local_addr()
Check for a local ip from within a list of addresses.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-27 16:11:28 -08:00
Sage Weil
84b0059755 monclient: name nameless monitors noname-<foo>
This makes them easy to pick out as unnamed.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-27 16:04:52 -08:00
Sage Weil
7a453402e3 pick_address: whitespace
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-27 14:50:46 -08:00
Mark Kampe
30def38d21 corrected variable (con) to be consistent with prior examples (cluster)
Signed-off-by: Mark Kampe <mark.kampe@dreamhost.com>
2011-11-23 15:56:52 -08:00
Samuel Just
934e1e5251 ReplicatedPG: Also count overlaps for snapsets on snapdirs
Previously, the overlaps for snapdirs would not be included in
cstat causing the computed total to be incorrect.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-11-23 14:07:54 -08:00