Commit Graph

18239 Commits

Author SHA1 Message Date
Sage Weil
fe39d58d30 move SnapContext, SnapRealmInfo to common/snap_types.{h,cc}
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-06 13:34:24 -08:00
Sage Weil
f07d2835d1 ceph-dencoder: filepath
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-06 13:34:05 -08:00
Sage Weil
1fbb8ebc71 ceph-dencoder: CompatSet
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-06 13:33:59 -08:00
Sage Weil
5b423b6016 kill unused tstring
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-06 13:33:42 -08:00
Sage Weil
cba2674bac kill useless [cn]string.h
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-06 13:33:37 -08:00
Yehuda Sadeh
c23d217c93 rgw: escape and list correctly objects that start with underscore
This should fix bug #2025.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-02-06 13:12:58 -08:00
Sage Weil
8ded264720 crush: don't BUG_ON
Fail gracefully on map errors; only BUG on code errors.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-06 10:36:12 -08:00
Alexandre Oliva
9895f0bff7 crush: don't BUG_ON within crush_choose
It's very hard to recover from an invalid crushmap if mons fail
assertions while processing the map, and osds crash while advancing
past an already-fixed map.  Skip such broken rules instead of
aborting.

Signed-off-by: Alexandre Oliva <oliva@lsd.ic.unicamp.br>
2012-02-06 10:33:08 -08:00
Sage Weil
8427090a30 filejournal: flush needn't abort on write_stop
Flush should wait for things to flush, even if we are also shutting down.
Not sure this would ever trigger, but this seems more correct.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-05 21:28:32 -08:00
Sage Weil
4b8374cce0 filejournal: clean up check_aio_completion
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-05 21:27:16 -08:00
Sage Weil
fffee8255f filejournal: get multiple aios at a time
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-05 21:25:22 -08:00
Sage Weil
f3dd583237 filejournal: print aio mode on open
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-04 17:44:24 -08:00
Sage Weil
fb0e2a3ece configure: add --without-libaio option
Use it by default; fail if it's not there.  Unless --without-libaio is
specified.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-04 17:44:24 -08:00
Sage Weil
4842b3d2eb ceph.spec.in: buildrequires libaio-devel
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-04 17:44:24 -08:00
Sage Weil
3f0a592a71 debian: depend on libaio-dev
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-04 17:44:24 -08:00
Sage Weil
30a77acb07 filejournal: implement aio for writes
Implement aio for the journal writes.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-04 17:44:24 -08:00
Sage Weil
b7c20e7772 streamtest: show total throughput, avg latencies
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-04 17:44:24 -08:00
Sage Weil
a9a6046184 client: init/shutdown objecter in init/shutdown
Not in mount/unmount, and don't do shutdown() twice!

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-04 13:25:40 -08:00
Greg Farnum
06ea2f7faa doc: add the ceph mds stop command.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-02-03 13:27:26 -08:00
Josh Durgin
caabec9613 mon: show full status in ceph health
HEALTH_WARN when nearfull, HEALTH_ERROR when full.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-03 10:35:50 -08:00
Sage Weil
7641a0e171 osd: signal dispatch_cond on ms_dispatch completion
There may be another dispatch thread waiting on this cond; we do need to
signal it!

Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-03 09:28:01 -08:00
Yehuda Sadeh
13c89137e7 rgw: use request uri if script name is empty
this was required for some nginx configuration

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-02-03 09:34:10 -08:00
Sage Weil
eaa46f50ca osd: reorder PG recovery_state initialization
The state machine state constructors print stuff to the logs, and the
PG::gen_prefix() includes all kinds of PG fields in that.  Move the
recovery_state member to the end of the class so that all previous fields
are initialized when that happens.  This makes valgrind shut up.

Some more deliberate tidying of the PG members and methods would also
be nice...

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-03 09:27:47 -08:00
Sage Weil
d7f61c8d6d test/encoding/readable.sh: nicer output
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 21:06:42 -08:00
Sage Weil
5216eb0721 ceph-dencoder: more helpful error message for messages
If the type doesn't match, share what it was vs what you expected.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 21:06:39 -08:00
Sage Weil
5103338cee messages: set type in default constructor
ceph-dencoder wants this to verify it decoded the correct message type.
Not that it is likely to happen, but let's be pendantic about it anyway.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 21:06:33 -08:00
Alexandre Oliva
ae67c2deb1 pick object from random osd for primary recovery
When recovering a primary, try the osds that have a copy of the object
in random order, rather than preferring the lowest-numbered.

Signed-off-by: Alexandre Oliva <oliva@lsd.ic.unicamp.br>
Suggested-by: Samuel Just <samuel.just@dreamhost.com>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 19:24:46 -08:00
Sage Weil
05f66c45cd msg: fix message leak on receipt of undecodable message
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 17:04:08 -08:00
Sage Weil
c3eacb15b7 Makefile: add test/encoding/types.h
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 17:01:08 -08:00
Sage Weil
0dcbc86ca0 Merge branch 'wip-encoding'
Reviewed-by: Josh Durgin <josh.durgin@dreamhost.com>

Conflicts:
	src/msg/Message.h
	src/osd/OSD.cc
	src/osd/ReplicatedPG.cc
	src/osd/ReplicatedPG.h
2012-02-02 17:00:38 -08:00
Sage Weil
d597dc2d5b encoding: document ENCODE/DECODE macros
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 16:58:12 -08:00
Sage Weil
625a89d4cb test/encoding/readable.sh: nicer output
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 16:58:12 -08:00
Sage Weil
6e62fc48b7 test/encoding/readable.sh: check all version
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 16:58:12 -08:00
Sage Weil
e9b97c1366 osd: fix another repop->ctx->op deref
Ok this time I actually looked for more and didn't see any.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-02 15:20:14 -08:00
Sage Weil
bf5d7d054b Merge remote branch 'gh/wip-objecter-initialized'
Reviewed-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-02-02 15:16:02 -08:00
Sage Weil
2f5ba8fb70 osd: avoid null deref of repop->ctx->op
It's optional.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-02 15:07:54 -08:00
Sage Weil
a0dde42287 encoding: document ENCODE_DUMP throttling weirdness
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 13:48:26 -08:00
Sage Weil
96876097fc encoding: fix DECODE_START macro
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 13:43:35 -08:00
Sage Weil
9c2d779b24 encoding: add DECODE_OLDEST macro
So we can (gracefully) fail to decode very old encoded versions we no
longer support.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 13:43:30 -08:00
Sage Weil
690b99195d osd: fix another issue_repop() ctx->op null deref
Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-02 13:31:58 -08:00
Sage Weil
d9261942b5 check-generated.sh: do self-decode test first
This way we get a helpful error instead of silent failure on later.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 12:50:04 -08:00
Sage Weil
efe77a8ee7 check-generated.sh: nicer output
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 12:47:58 -08:00
Sage Weil
153e89d24e ceph-dencoder: print errors to stderr
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 12:46:37 -08:00
Sage Weil
2a26295694 osd: do not dereference ctx->op when NULL
We may not have an OpRequest.  Make the later check do the cast properly
when it is needed.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-02 12:36:27 -08:00
Sage Weil
8623c64d0b encoding: better DECODE_START_LEGACY_COMPAT_LEN
- let you specify whether to decode compat and/or len
- put the argument order in the macro name so you know when you get it
  wrong

This is useful for FileJournal::header_t.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 11:30:35 -08:00
Sage Weil
73e92b319d buffer: iterator::get_remaining()
It's helpful to know how much data is remaining.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-02-02 11:30:30 -08:00
Sage Weil
04753e9a34 Merge remote-tracking branch 'gh/wip-osd-op-tracking'
Reviewed-by: Sage Weil <sage@newdream.net>
2012-02-02 10:55:41 -08:00
Sage Weil
dab9f0f997 Merge branch 'master' into wip-encoding
Conflicts:
	src/osd/OSD.cc
	src/osd/PG.cc
	src/osd/PG.h
2012-02-02 10:41:00 -08:00
Jim Schutt
83432af2ad common/Throttle: throttle in FIFO order
Under heavy write load from many clients, many reader threads will
be waiting in the policy throttler, all on a single condition variable.
When a wakeup is signalled, any of those threads may receive the
signal.  This increases the variance in the message processing
latency, and in extreme cases can significantly delay a message.

This patch causes threads to exit a throttler in the same order
they entered.

Signed-off-by: Jim Schutt <jaschut@sandia.gov>
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-02-02 10:38:47 -08:00
Sage Weil
c4ca1142cd osd: fix osd_recover_clone_overlap
- we need to populate data_subset
- add check in calc_head_subsets() too

Fixes 2116f012.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-02-02 10:53:39 -08:00