Commit Graph

26805 Commits

Author SHA1 Message Date
Samuel Just
b16fdf23e5 PGLog: replace dirty_log with mark_dirty_*
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:53 -07:00
Samuel Just
f35bc02591 PG: move instances of log dirtying in PG into PGLog
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:53 -07:00
Samuel Just
d77c4ffa53 PGLog: track dirty_to and dirty_from for log
This allows the log to only write out/clear the keys
which have actually changed.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Samuel Just
fb88873cd5 osd_types: move code for pg_log_entry_t::get_key_name into eversion_t
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Samuel Just
b73aa30e47 PGLog: remove OndiskLog
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Samuel Just
ca1637ff87 PGLog: remove other ondisklog references
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Samuel Just
a9a41bc0db PGLog: pass only divergent_priors, not ondisklog
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Samuel Just
7bc43055a6 PG: remove ondisklog usages from PG
ondisklog is now only relevant for the divergent priors mapping.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Sage Weil
53e1fda0c7 FileStore: add rmkeyrange
Handling it in DBObjectMap really only has efficiency
advantages if the object is a clone.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Samuel Just
39245319ef PGLog: clear missing on backfill reset
When backfill is reset, the missing set should be cleared
since all objects are >last_backfill.

Fixes: #5320
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-06-17 14:50:52 -07:00
Samuel Just
47ce702ce6 *: always include rados.h using types.h
types.h redefines __le* to ceph_le* to ensure endian
safety.

Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-06-17 14:20:53 -07:00
Samuel Just
5cf5f18e3d Merge branch 'next' 2013-06-17 13:29:57 -07:00
Samuel Just
d46e6c3bff OSD: we need to check pg ?.0 for resurrection
Fixes: #5269
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-06-17 13:15:30 -07:00
Sage Weil
5bf08cd5a0 libcephfs: add a couple multiclient tests
Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-17 12:24:16 -07:00
Sage Weil
ee40c217e3 client: fix sync read zeroing at EOF
If we have a read that hits EOF, we need to do a short read.  Previously
we would zero the buffer if we were completely withing the file, but
we also need to zero things if we overlap with EOF.  This fixes a hang
of mpi-fsx on ceph-fuse.  Triggered/tested by
LibCephFS.MulticlientHoleEOF.

Fixes: #5368
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-06-17 12:24:02 -07:00
Yehuda Sadeh
d582ee2438 rgw: escape prefix correctly when listing objects
Fixes: #5362
When listing objects prefix needs to be escaped correctly (the
same as with the marker). Otherwise listing objects with prefix
that starts with underscore doesn't work.
Backport: bobtail, cuttlefish

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-06-17 10:55:53 -07:00
Sage Weil
b7143c2f84 client: fix ancient typo in caps revocation path
If we have dropped all references to a revoked capability, send the ack
to the MDS.  This typo has been there since v0.7 (early 2009)!

Backport: cuttlefish
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-06-17 10:41:56 -07:00
Sage Weil
f179dc1f3d mon: make mark_me_down asserts match check
The OSD may have sent a request where the message source does not match
the target in the message.  Verify that the target matches so that it
matches the assert.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-16 20:13:51 -07:00
Sage Weil
e3fb095d8a Merge branch 'next' 2013-06-16 16:49:47 -07:00
Sage Weil
2fe4d29f4d ceph: remove space when prefix is blank
Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-16 16:49:05 -07:00
Sage Weil
8d9eef2394 ceph: fix return code for multi-target commands
Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-16 16:48:41 -07:00
Sage Weil
84d1847f50 ceph: error out properly when failing to get commands
If we make ret positive here we miss the failure check below.  Instead,
just set outs appropriately.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-16 16:48:27 -07:00
Sage Weil
8d9272ec48 test/admin_socket/objecter_requests: fix test
Commit 2bda9db1c2 added command_ops
to the result.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-16 16:42:27 -07:00
Sage Weil
efebdba011 ceph: do not print status to output file when talking to old mons
The old cli would send the status message to stdout instead of stderr;
we try to emulate that behavior when talking to old monitors because
they send some useful data to outs instead of the data payload.
However, when outputting to a *file*, the outs would still go to
stdout.  Maintain that so that, e.g.,

 ceph mon getmap -o /tmp/foo

doesn't prefix the monmap with 'got latest monmap\n'.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-16 13:36:19 -07:00
Sage Weil
80c2d5a8db osd/ReplicatedPG: length 0 writes are allowed
From f1b6bd7988.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-16 08:50:50 -07:00
Sage Weil
9ef6041fe7 Merge branch 'next' 2013-06-15 20:48:32 -07:00
Sage Weil
7e7ff7532d common/Preforker: fix broken recursion on exit(3)
If we exit via preforker, call exit(3) and not recursively back into
Preforker::exit(r).  Otherwise you get a hang with the child blocked
at:

Thread 1 (Thread 0x7fa08962e7c0 (LWP 5419)):
#0  0x000000309860e0cd in write () from /lib64/libpthread.so.0
#1  0x00000000005cc906 in Preforker::exit(int) ()
#2  0x00000000005c8dfb in main ()

and the parent at

#0  0x000000309860eba7 in waitpid () from /lib64/libpthread.so.0
#1  0x00000000005cc87a in Preforker::parent_wait() ()
#2  0x00000000005c75ae in main ()

Backport: cuttlefish
Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-15 20:48:05 -07:00
Sage Weil
f25f212027 osd/OSDMap: fix is_blacklisted()
You can only call set_port() if is_ip() is true (there is an assert in
the accessor).

Fixes: #5366
Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-15 20:47:39 -07:00
Sage Weil
21e85f90be qa/workunits/misc/multiple_rsync.sh: wtf
2013-06-15T12:55:29.808 INFO:teuthology.task.workunit.client.0.err:+ rsync -auv --exclude local/ /usr/ usr.1
2013-06-15T12:55:29.808 INFO:teuthology.task.workunit.client.0.err:+ tee a
2013-06-15T12:55:29.820 INFO:teuthology.task.workunit.client.0.out:sending incremental file list
2013-06-15T12:56:46.019 INFO:teuthology.task.workunit.client.0.out:
2013-06-15T12:56:46.020 INFO:teuthology.task.workunit.client.0.out:sent 1452634 bytes  received 7485 bytes  19086.52 bytes/sec
2013-06-15T12:56:46.020 INFO:teuthology.task.workunit.client.0.out:total size is 3205063225  speedup is 2195.07
2013-06-15T12:56:46.020 INFO:teuthology.task.workunit.client.0.err:+ wc -l a
2013-06-15T12:56:46.021 INFO:teuthology.task.workunit.client.0.out:4 a
2013-06-15T12:56:46.022 INFO:teuthology.task.workunit.client.0.err:+ wc -l a
2013-06-15T12:56:46.022 INFO:teuthology.task.workunit.client.0.err:+ grep 4
2013-06-15T12:56:46.023 INFO:teuthology.task.workunit.client.0.out:4 a
2013-06-15T12:56:46.024 INFO:teuthology.task.workunit.client.0.err:+ rsync -auv --exclude local/ /usr/ usr.2
2013-06-15T12:56:46.024 INFO:teuthology.task.workunit.client.0.err:+ tee a
2013-06-15T12:56:46.112 INFO:teuthology.task.workunit.client.0.out:sending incremental file list
2013-06-15T12:57:17.172 INFO:teuthology.task.workunit.client.0.out:
2013-06-15T12:57:17.174 INFO:teuthology.task.workunit.client.0.out:sent 1452634 bytes  received 7485 bytes  46352.98 bytes/sec
2013-06-15T12:57:17.174 INFO:teuthology.task.workunit.client.0.out:total size is 3205063225  speedup is 2195.07
2013-06-15T12:57:17.175 INFO:teuthology.task.workunit.client.0.err:+ wc -l a
2013-06-15T12:57:17.175 INFO:teuthology.task.workunit.client.0.out:3 a

Signed-off-by: Sage Weil <sage@inktank.com>
2013-06-15 20:42:39 -07:00
Sage Weil
08c915c87c Merge remote-tracking branch 'gh/next' 2013-06-14 21:05:18 -07:00
Sage Weil
9253cd8174 ceph: pass --format=foo to old monitors
And --threshold too, although.. really.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviwed-by: Dan Mick <dan.mick@inktank.com>
2013-06-14 17:30:57 -07:00
Sage Weil
c35c98d16d ceph: add newline when using old monitors
The old tool would print a newline after outs, e.g. from 'ceph osd create'.
Do the same when we are talking to old monitors.  Also, put outs at the
top, not the bottom!

Tweak the json code to not add the newline again if we already did so
above.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Dan Mick <dan.mick@inktank.com>
2013-06-14 17:30:44 -07:00
John Wilkins
0d3517b2ed doc: Added index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:58:29 -07:00
John Wilkins
fb07f9df3d doc: Added index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:58:04 -07:00
John Wilkins
fd423fce43 doc: Added index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:57:48 -07:00
John Wilkins
8a5b276022 doc: Added index tag.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:57:31 -07:00
John Wilkins
d5dbc2f22b doc: Updated usage and index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:57:15 -07:00
John Wilkins
ceba9537a2 doc: Updated usage and index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:56:58 -07:00
John Wilkins
81d4f9d9e0 doc: Added introductory section. Updated usage. Index tags.
fixes: #3220

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:56:39 -07:00
John Wilkins
0b604fb441 doc: Index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:54:52 -07:00
John Wilkins
f851c5d47f doc: Update for usage and index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:54:36 -07:00
John Wilkins
4a79fabd41 doc: Update for usage. Index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:54:14 -07:00
John Wilkins
20e68b748b doc: Updated for glossary usage. Index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:53:56 -07:00
John Wilkins
44bf35a2cb doc: Updated index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:53:20 -07:00
John Wilkins
a529882a5b doc: Updated index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:52:46 -07:00
Dan Mick
bb5fae4a5c ceph.in: zero-arg invocation was broken (check array length)
Also remove stray comment char

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-06-14 16:52:33 -07:00
John Wilkins
8f8fd7a915 doc: Updated index tags.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:52:25 -07:00
John Wilkins
2be167010e doc: Minor updates.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:06:59 -07:00
John Wilkins
b3a143d977 doc: Minor updates for usage.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-06-14 16:06:06 -07:00
Gary Lowell
3474fa8361 rules: Don't disable tcmalloc on ARM (and other non-intel)
Fixes #5342

Signed-off-by: Gary Lowell  <gary.lowell@inktank.com>
2013-06-14 15:11:05 -07:00