Commit Graph

17227 Commits

Author SHA1 Message Date
Tommi Virtanen
0477f23879 common/pickaddr: Pick cluster_addr/public_addr based on *_network. 2011-11-21 14:27:45 -08:00
Tommi Virtanen
eec61b4873 common/ipaddr: Add utility function to parse ip/cidr style networks.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-11-21 14:27:45 -08:00
Tommi Virtanen
0f748d4c9e common/ipaddr: Find a configured IP address in given subnet.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-11-21 14:27:44 -08:00
Tommi Virtanen
97464bcabe msg: Move public_addr use outside ->bind() 2011-11-21 13:37:39 -08:00
Tommi Virtanen
0f9a06051c common/str_list: Make unused return value void.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-11-21 13:37:39 -08:00
Tommi Virtanen
2bae3506b6 osd: Remove unused variable. 2011-11-21 13:37:39 -08:00
Sage Weil
3c8fec2d33 osd: fix 'stop' command
Special case.  We can't join the command_tp thread from itself.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-21 13:28:36 -08:00
Sage Weil
b47347bd7c osd: protect handle_osd_map requeueing with queue lock
pending_ops was protected by osd_lock, but it tracks something in the
queue, which has it's own lock.  Messy.  Also, useless, since
wait_for_no_ops had a single caller in shutdown() that op_wq.drain() can
do for us.

Rip it out, and track queue size under the queue lock.

Fixes: #1727
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-21 13:23:59 -08:00
Sage Weil
70dfe8e9a0 osd: lock pg when requeuing requests
The op queue is shut down, so this is mostly safe, unless someone comes
through and does requeue_ops() from a callback or something.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-21 11:15:38 -08:00
Sage Weil
88963a181a objecter: simplify map request check
We should request a missing/intervening map if it appears to exist.
Otherwise, skip it.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-21 09:19:59 -08:00
Sage Weil
cd2e523fba objecter: cancel tick event on shutdown
Hopefully this is the root cause for

2011-11-20 23:57:41.555292 7f75dd743780 ceph version 0.38-205-g3b53b72
(commit:3b53b722b34b5284e6b8a5571a08d4b7ec276241), process ceph-fuse, pid
21223
 *  Caught signal (Segmentation fault) *
    in thread 7f75d9c6e700
    ceph version 0.38-205-g3b53b72
    (commit:3b53b722b34b5284e6b8a5571a08d4b7ec276241)
    1: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x6993a4]
    2: (()+0xfb40) [0x7f75dd0eeb40]
    3: (PerfCounters::set(int, unsigned long)+0x2a) [0x511bca]
    4: (Objecter::tick()+0x1f3) [0x653f43]
    5: (Objecter::C_Tick::finish(int)+0x15) [0x66aef5]
    6: (SafeTimer::timer_thread()+0x4b0) [0x5825c0]
    7: (SafeTimerThread::entry()+0x15) [0x586865]
    8: (Thread::_entry_func(void)+0x12) [0x52a832]
    9: (()+0x7971) [0x7f75dd0e6971]
    10: (clone()+0x6d) [0x7f75db97592d]

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-21 09:19:40 -08:00
Yehuda Sadeh
3b53b722b3 rgw: support alternative date formatting
being used by s3cmd
2011-11-20 13:18:26 -08:00
Sage Weil
9920a168c5 config: support --no-<foo> for bool options
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-19 13:56:21 -08:00
Sage Weil
1a468c7e0b config: whitespace
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-19 13:56:17 -08:00
Greg Farnum
cc5b5e17e6 osdmon: set the maps-to-keep floor to be at least epoch 0
Looks like this conditional was just set backwards by mistake. There
have been a number of issues with OSDMap versions that are probably
related to this...
(Thanks to some smarts in trim_to, we at least did not trim ALL of
our maps. But on every tick prior to epoch 500 [that's the default]
the leader was trimming all old maps off the system.)

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-18 16:13:29 -08:00
Samuel Just
45cf89c108 Revert "osd: simplify finalizing scrub on replica"
This reverts commit dd5087fabb.

Calling osr.flush() is not quite enough since the onreadable callbacks
may not have been called (thus, last_update_applied may still lag behind
the tail of the log).

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-11-18 15:57:00 -08:00
Samuel Just
57ad8b2ebf FileStore.cc: onreadable callbacks in OpSequencer order is enough
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-11-18 15:56:59 -08:00
Greg Farnum
dedf2c4a06 osd: error responses should trigger all requested notifications.
There's no good reason I can find to limit error code responses to
the ACK.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-18 09:49:57 -08:00
Greg Farnum
09c20c5129 objecter: trigger oncommit acks if the request returns an error code.
Many users only set oncommit acks, so if they get an error code
(which comes only as a CEPH_OSD_OP_ACK right now) the request
disappears into the ether.
(And remove stupid debug statements while we're at it.)

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-11-18 09:49:57 -08:00
Sage Weil
9800faeb92 paxos: do not create_pending if !active
This avoids a scenario like:

- _active()
  - proposes value
- _commit()
  - creates new pending, even though in updating state

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-18 09:49:03 -08:00
Sage Weil
fa5876870a Revert "mon: don't propose new state from update_from_paxos"
This reverts commit 66c628acc8.
2011-11-18 09:43:09 -08:00
Sage Weil
66c628acc8 mon: don't propose new state from update_from_paxos
Proposing a new state from within update_from_paxos() confuses some callers,
like PaxosService::_active().  Instead, do it in the on_active() callback.
This also let's us collapse the check_osd_map() caller into on_active(),
and makes it happen on leaders and peons alike, which ought to avoid some
of the pg creation lag we see sometimes (presumably when the osds have
sessions with peons instead of the leader).

Fixes: #1708
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-17 20:45:54 -08:00
Yehuda Sadeh
6ae0f81e17 rgw: if swift url is not set up, just use whatever client used 2011-11-17 16:55:48 -08:00
Sage Weil
ef5ca293a7 fuse: fix readdir return code
Ignore ENOSPC generated by our own callback, as it is only used to
terminate the loop.

Broken by commit cd90061239.

Fixes: #1728
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 15:01:25 -08:00
Sage Weil
d61ba6441b paxos: fix trimming when we skip over incrementals
Remove open-coded trimming of old states and use our method (that also
removes additional per-state files).  Fixes old stray state files.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 14:11:38 -08:00
Sage Weil
367ab142d7 paxos: store stashed state _and_ incrementals
Paxos::share_state() may share a stashed state and incrementals that
follow; we need to store the same.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 14:10:34 -08:00
Sage Weil
6bc9a544b6 mon: elector: always start election via monitor
Don't go from active -> electing without passing (monitor) go.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 13:53:52 -08:00
Sage Weil
685450b76b common: libraries should not log to stdout/stderr
Certainly not by default.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 12:07:34 -08:00
Sage Weil
f1dd56d93d objecter: set skipped_map if we skip a map
This ensures that we resend _all_ requests, since we aren't sure which
may have mapped to a different primary and then back.  This was missed in
the original implementation in 4fe9cca5dd.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 11:56:37 -08:00
Sage Weil
5afef0209f objecter: add is_locked() asserts
Sanity check.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 11:39:55 -08:00
Sage Weil
bf91177e57 objecter: send slow osd MPing via Connection*
This may address #1732 indirectly because we have a Connection* reference
here.  However, it's still not clear how we ended up with an OSDSession*
for an osd that doesn't exist.  :/

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-17 11:39:36 -08:00
Sage Weil
fa4b0fb961 osd: add pending_ops assert
Just a sanity check, hopefully helping us track down #1727.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-16 13:11:07 -08:00
Sage Weil
17fa1e0d4e mon: renamed get_latest* -> get_stashed*
This makes e.g. get_latest_version() vs get_last_committed() less
confusing.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-16 11:01:59 -08:00
Sage Weil
b9d5fbe494 mon: fix ver tracking for auth database
Local variable keys_ver needs to be updated when we slurp up latest stashed
version.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-16 10:57:23 -08:00
Sage Weil
b425f6d6ce mon: always load stashed version when version doesn't match
The slurp process can happen after the monitor has started and has some
in-memory version of the state, and that process may wipe out old
incrementals and change the stashed version.  That means that in
update_from_paxos, we need to pull the stashed version if it doesn't
match what we currently have or else we may not have the incrementals we
need to get up to date.

This simplifies and cleans up that code a bit so it is not specific to
monitor startup.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-16 10:54:59 -08:00
Yehuda Sadeh
2e195500b5 rgw: don't log entries with bad utf8 2011-11-14 17:02:08 -08:00
Yehuda Sadeh
0276eab440 rgw: adjust error code in swift copy failures 2011-11-14 14:39:18 -08:00
Yehuda Sadeh
1fe16923b4 rgw: fix swift responses encoding 2011-11-14 13:55:29 -08:00
Josh Pieper
2445fd8416 rgw: Fix some merge problems uncovered by gcc warnings:
* a refactor in e2100bce left the mod_ptr and unmod_ptr members set
   incorrectly in RGWCopyObj::init_common
 * a fix in 6752babd aggregated error returns, but then failed to do
   anything with them

Signed-off-by: Josh Pieper <jjp@pobox.com>
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-14 13:23:29 -08:00
Josh Pieper
cd90061239 Resolve gcc warnings.
These should have no functional changes:
 * Check errors from functions that currently cannot return any
 * Initialize variables that gcc can't determine will be initialized
   in a following function call
 * Remove unused variables

Signed-off-by: Josh Pieper <jjp@pobox.com>
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-14 13:23:18 -08:00
Sage Weil
a5b8c8518f osd: remove dead osd_max_opq code
This is no longer used as of a while ago!

Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-14 12:15:14 -08:00
Josh Durgin
f418775d2c workunits: rados python workunit should be executable
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-11-14 08:18:47 -08:00
Sage Weil
102c434297 crush: send debug output to dout, not stdout/err
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-13 14:18:19 -08:00
Sage Weil
25eee416fd test/run_cmd: use mkstemp instead of mkstemps
my box didn't have mkstemps

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-13 14:16:52 -08:00
Sage Weil
18009866f2 ceph-authtool: fix clitests
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-13 14:07:01 -08:00
Sage Weil
d476ae2509 test_str_list: make sure ' ' and ', ' separaters work for str lists
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-12 15:17:29 -08:00
Sage Weil
ecd713c5c3 ceph-authtool: make error msg more helpful
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-12 14:55:39 -08:00
Sage Weil
4f39aaa7a9 keyring: don't print auid if it is the default
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-12 14:55:28 -08:00
Sage Weil
ee02a1e12b mon: implement 'fsid' command
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-11-12 14:55:06 -08:00
Sage Weil
5a3004e2c4 Merge branch 'stable' 2011-11-12 14:19:26 -08:00