Commit Graph

19079 Commits

Author SHA1 Message Date
Sage Weil
07ddff4271 librbd: instrument with perfcounters
Track IO operations on a per-image basis.

Implements: #1451
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-21 12:50:05 -07:00
Sage Weil
4ddbbf5467 librbd: allow image resize to non-block boundaries
The caller is still invalidating the entire cache, so we don't need to
deal with discard at this level.  That might be worth cleaning up
later, though.

Fixes: #2296
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:01 -07:00
Sage Weil
165038d589 objectcacher: rename truncate_set -> discard_set, and use discard
Do not assume the object extents are at the trailing edge of objects.
Instead, discard arbitrary extents.  Fix callers.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:01 -07:00
Sage Weil
7232396598 objectcacher: implement Object::discard()
Discard a range of bytes from an object.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:01 -07:00
Sage Weil
5b60343710 librbd: fix debug output
objects is misleading here, these are byte offsets

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:01 -07:00
Sage Weil
81af4e8618 librbd: make discard invalidate the range in cache
Fed this to test_librbd_fsx and it was happy.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:01 -07:00
Sage Weil
b94d6a6cf4 librbd: fix zeroing of trailing bits on short reads that span objects
handle_sparse_read() was taking buf_ofs and buf_len, but buf_len was being
interpreted as the total size of the buffer, not the length of the extent
in the buffer start at buf_ofs.  Both callers pass in an extent length, so
fix the zero code to do the right thing.

Specifically, the behavior I saw was:

 - read range spanning 2 objects, trailing 20k and leading 50k
 - first object didn't exist, zeroed first 20k of buffer
 - second object didn't exist, zeroed next 30k (50k-20k) of buffer
   - the last 20k of buffer was unzeroed.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:01 -07:00
Sage Weil
379c5e721e librbd: fix debug output for image resize
Print old -> new, not new -> old.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:00 -07:00
Sage Weil
dd78c3df65 test_librbd_fsx: port newer xfsprogs version
Builds and runs... for a few ops at least.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:51:00 -07:00
Sage Weil
e861e20a1a revert to xfstests' fsx, which has discard support 2012-04-20 16:51:00 -07:00
Sage Weil
a8aaa93b3e admin_socket: add a separate debug subsys/level
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-20 16:50:43 -07:00
Sage Weil
f7699cc993 log: prefix dump with line numbers
This makes it easier to interpret the dump, and makes it obvious what is
dump (and potentially a dup of something that was already logged) and what
is not.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 16:36:54 -07:00
Sage Weil
a68b3069de test_filestore_workloadgen: track pg log size in memory
Avoid a stat!

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 15:35:44 -07:00
Sage Weil
6b28f55cd3 test_filestore_workloadgen: whitespace
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 15:30:45 -07:00
Sage Weil
2834f601ef organize test_filestore_idempotent*
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 15:25:32 -07:00
Sage Weil
8bb58bc2b4 remove hopelessly flawed test_filestore_idempotent
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 15:23:17 -07:00
Sage Weil
94ebe8d951 test_store -> test_filestore
and organize source

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 15:22:36 -07:00
Sage Weil
77c645a199 test_wrkldgen -> test_filestore_workloadgen
Also put the code in src/test/filestore/.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 15:20:16 -07:00
Sage Weil
f00dab6f4a ceph-authtool: rename cli test dir
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 13:28:23 -07:00
Sage Weil
613d81794b ceph-conf: rename cli test dir
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-20 13:28:03 -07:00
Sage Weil
0616c5b26d Merge branch 'stable'
Conflicts:
	src/osd/OpRequest.cc
2012-04-20 13:22:22 -07:00
Sage Weil
ac874a6253 OpRequest: mark_event output is now at debug 5
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-04-20 13:21:14 -07:00
Sage Weil
f2d4574bd6 config: dump subsys log levels with --show-config
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-19 22:24:43 -07:00
Yehuda Sadeh
0df33e4300 Merge branch 'wip-2313' 2012-04-19 16:43:36 -07:00
Sage Weil
8335eb5383 rgw: can't remove user that owns data
This is a workaround for #1681. We don't allow the removal of
user that still has data.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
Reviewed-by: Sage Weil <sage@newdream.net>
2012-04-19 16:25:03 -07:00
Samuel Just
56fc92c0f2 FileStore: don't read reference to writeq head after pop_write
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-04-19 15:22:53 -07:00
Yehuda Sadeh
758fa9ba7e rgw: bucket HEAD operation should return 200, not 204
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-04-19 13:21:17 -07:00
Sage Weil
9cb796a03a obsync: section 8 -> 1
Fixes: #2263
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-19 12:47:50 -07:00
Yehuda Sadeh
09100b6bea rgw: HEAD bucket, don't dump rounded size
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-04-19 09:23:31 -07:00
Sage Weil
9c2251f605 osd: fix vector array out of bounds
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-19 09:19:43 -07:00
Sage Weil
e82c33099a ceph-fuse: only call common_init_finish in child; fix admin socket
If we do it in the parent and child, we break the admin socket (among
other things).

Fixes: #2293
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-18 21:58:14 -07:00
Sage Weil
f1de0d6cb3 qa: drop rgw.py from test_python.sh workunit
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-18 21:27:49 -07:00
Sage Weil
d3a57a211a ceph.spec.in: drop rgw.py
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-18 21:27:39 -07:00
Sage Weil
0995d08477 Makefile: drop rgw.py
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-18 21:26:53 -07:00
Sage Weil
4390c08acd mon: fix full/nearfull ratio initialization
create_pending() is called before create_initial(), so just put these in
the first incremental.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-18 17:14:09 -07:00
Yehuda Sadeh
aab516da7f rgw: allow subuser creation on radosgw-admin user create
This fixes issue #2312: allow the creation of both user
and a subuser in a single radosgw-admin command.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-04-18 15:45:09 -07:00
Sage Weil
dbe779a568 osd: dump old ops singly rather than all at once.
Fixes #2269. Convert the OpTracker::check_ops_in_flight interface
to take a vector<string> and create a separate warning for each old
Op, and dump those singly to the clog in the OSD.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Reviewed-by: Sage Weil <sage@newdream.net>
2012-04-18 15:23:58 -07:00
Sage Weil
b0532aa6ed osdmap: restructure flow in OSDMap::decode
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-18 15:23:57 -07:00
Sage Weil
bc458bfdf3 ceph-object-corpus: prune archive
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-18 15:13:38 -07:00
Sage Weil
ebb19e70b6 test/encoding/import.sh: fix
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-18 15:09:18 -07:00
Yehuda Sadeh
e1622e4f9c rgw: HEAD bucket also dumps bucket meta info
Shows total objects, bytes used, actual bytes used.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-04-18 14:53:59 -07:00
Yehuda Sadeh
0769efa56b rgw: add x-rgw-* as a possible meta header prefix
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-04-18 14:53:06 -07:00
Sage Weil
2de37e01d7 Merge remote-tracking branch 'gh/wip_journal'
Reviewed-by: Sage Weil <sage@newdream.net>
2012-04-18 14:36:15 -07:00
Sage Weil
c3bfe45692 osdmap: remove bad cct reference
Not in OSDMap

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-18 14:10:22 -07:00
Sage Weil
9ef953b5e2 Merge branch 'wip-2286-ratio-a'
Reviewed-by: Sage Weil <sage@newdream.net>
2012-04-18 13:28:54 -07:00
Sage Weil
eea982e567 osdmap: workaround old bug that zeroed pool_max
Signed-off-by: Sage Weil <sage@newdream.net>
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-18 12:50:47 -07:00
Yehuda Sadeh
ee22c97b0f python-ceph: remove rgw bindings
We shouldn't expose these internal apis.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-04-18 11:32:19 -07:00
Greg Farnum
eb8a8fdfee pgmap: allow Incrementals to specify [near]full_ratios of 0
This commit isn't entirely safe: old monitors used 0 to mean "no change".
We can revert this (and the PGMonitor.cc portion of
841f288531) if we don't want to allow
0 as a valid ratio setting, and to maintain perfect backwards
compatibility.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-18 11:10:36 -07:00
Greg Farnum
88525eaa0a pgmon: add "set_full_ratio x" and "set_nearfull_ratio x" commands
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-18 11:05:31 -07:00
Greg Farnum
882bd5b879 pgmon: convert PGMonitor::prepare_command to our standard infrastructure.
So that I can add another command.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-18 11:05:19 -07:00