Commit Graph

54823 Commits

Author SHA1 Message Date
Sage Weil
e5cbb450b6 os/bluestore/bluestore_types: drop overlay fields from wal and onode
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 17:56:59 -04:00
Sage Weil
be61cc921a os/bluestore: drop overlay support
We can resurrect this from the history if/when we decide we want it.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 17:56:59 -04:00
Sage Weil
82c8793bed os/bluestore/bluestore_types: remove flags from lextent_t
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 17:56:58 -04:00
Sage Weil
bd6471fdc9 os/bluestore: drop old bluestore_extent_t
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 15:49:43 -04:00
Sage Weil
80d789f1a1 os/bluestore: extent_t -> pextent_t
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 15:49:42 -04:00
Ali Maredia
94fac96aa0 Merge pull request #9753 from liewegas/wip-readme
README: update with vstart, test, and make check instructions

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2016-06-16 14:19:46 -04:00
Sage Weil
925691b36c README.md: note where make check test log output goes
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 14:18:12 -04:00
Sage Weil
1a877660e9 README.md: document running a test cluster
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 14:14:26 -04:00
Sage Weil
3b56a2e22c README.md: simplify cmake instructions
Assume build is subdir of the ceph.git checkout.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 14:14:21 -04:00
Sage Weil
ed885eaf42 README.md: drop obsolete comment about debian squeeze
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 14:14:18 -04:00
Sage Weil
6041a04e4c README.md: get source first (including submodules!)
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 14:14:15 -04:00
Sage Weil
e0203b91ba README.md: document how to run unit tests (with autotools)
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 14:14:11 -04:00
Jason Dillaman
6034019cdf Merge pull request #9151 from fullerdj/wip-djf-15706
rbd: add methods to set and get snapshot limits

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-06-16 14:05:16 -04:00
Jason Dillaman
799633c72d Merge pull request #9292 from marcan/pyrbd-aio
pybind: AIO bindings for RBD

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-06-16 14:03:01 -04:00
Jason Dillaman
996b4471e4 Merge pull request #9333 from VictorDenisov/consistency_groups_only_crud
rbd: initial operations for consistency groups

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-06-16 14:00:48 -04:00
Jason Dillaman
89e5d1cc9f Merge pull request #9535 from xinxinsh/wip-bug
librbd: object_may_exist always return true when you write an empty object

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-06-16 14:00:28 -04:00
Jason Dillaman
4e01557ace Merge pull request #9682 from yuyuyu101/wip-fix-task-finisher
librbd: cancel all tasks should wait until finisher is done

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-06-16 13:55:12 -04:00
Sage Weil
456781c00a Merge pull request #9567 from liewegas/wip-bluestore-blobcache
os/bluestore: convert cache to be blob-based (vs onode-based)

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-06-16 10:29:10 -04:00
Sage Weil
5bb3fc4f7c os/bluestore: include device offsets in csum error message
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 10:13:58 -04:00
Sage Weil
eb92ea2ed3 os/bluestore: remove Onode's BufferSpace
(now unused)

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 10:13:58 -04:00
Sage Weil
e2a76791bf os/bluestore: change _do_read to use blob cache
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-16 10:13:58 -04:00
Matt Benjamin
fb6df30b7d Merge pull request #9748 from Yan-waller/yj-wip-rgwstoreuserinfo
rgw/user: remove needless bufferlist encoding

build verfiied, there can be no side effect
2016-06-16 09:54:58 -04:00
Mykola Golub
00baf49b2b Merge pull request #9720 from dillaman/wip-16202
qa/workunits: rados cppool now requires --yes-i-really-really-mean-it

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-06-16 12:51:50 +03:00
Yan Jun
cc1ae01673 rgw/user: remove needless bufferlist encoding
info encoded but never be used.

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2016-06-16 17:28:34 +08:00
Victor Denisov
684f515937 mailmap: Victor Denisov affiliation
Signed-off-by: Victor Denisov <denisovenator@gmail.com>
2016-06-16 02:32:52 -04:00
Victor Denisov
8d06d8bbb7 rbd: Add cg create, cg list, cg remove commands
Signed-off-by: Victor Denisov <denisovenator@gmail.com>
2016-06-16 02:32:52 -04:00
Victor Denisov
d6f8b92267 librbd: Add cg_create, cg_list, cg_remove
Signed-off-by: Victor Denisov <denisovenator@gmail.com>
2016-06-16 02:32:52 -04:00
Victor Denisov
e0a6b62f41 cls_rbd: Add cg_create, cg_dir_add, cg_dir_remove, cg_dir_list
Signed-off-by: Victor Denisov <denisovenator@gmail.com>
2016-06-16 02:32:52 -04:00
Dan Mick
2380351e16 Merge pull request #9708 from tchaikov/wip-make_rocksdb_makefile-without-rdb
script/make_rocksdb_makefile.sh: do not include rocksdb/tools/rdb/*

Reviewed-by: Dan Mick <dmick@redhat.com>
Reviewed-by: Sage Weil <sweil@redhat.com>
2016-06-15 15:50:05 -07:00
John Spray
b56d1f48e7 Merge pull request #9713 from xiexingguo/xxg-wip-server_droppin
server: drop locks and auth pins before waiting for trunc

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2016-06-15 23:43:28 +01:00
John Spray
9e0dbe85c4 Merge pull request #9710 from xiexingguo/xxg-wip-server_duplock
Server: avoid duplicated call to acquire_locks()

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2016-06-15 23:42:43 +01:00
John Spray
d8d9f83581 Merge pull request #9706 from xiexingguo/xxg-wip-server_dcr
mds/server: avoid side-effect of more() method

Reviewed-by: John Spray <john.spray@redhat.com>
2016-06-15 23:42:01 +01:00
John Spray
f66b8a96e8 Merge pull request #9647 from xiexingguo/xxg-wip-server_hcr
server: fix potential access violation

Reviewed-by: John Spray <john.spray@redhat.com>
2016-06-15 23:41:37 +01:00
John Spray
bbcb125923 Merge pull request #8737 from david-z/wip-mds-slow-req-output
mds: ceph status outputs mds slow request for better monitoring

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2016-06-15 23:40:43 +01:00
Sage Weil
5154f865c6 os/bluestore: inline and simplify _read_whole_blob
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 16:21:54 -04:00
Sage Weil
b7168d983c os/bluestore: use _dump_blob_map helper
Unify bnode and onode dump output.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 16:21:54 -04:00
Sage Weil
85af407cb3 os/bluestore: do writes into blob buffer cache
No change to the read-side yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 16:21:53 -04:00
Sage Weil
44523afe92 ceph_test_objectstore: use single bl_eq helper
Use a single bl comparator helper that dumps buffers if they do not match.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 16:21:53 -04:00
Sage Weil
d445d5b8cc os/bluestore: clean up csum read error checks
Fix warning message and return error code.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 16:06:24 -04:00
Sage Weil
3ef840d88a os/bluestore: use Blob* in WriteContext::write_item
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 16:06:24 -04:00
Sage Weil
de6b2584b0 os/bluestore: switch to intrusive_set for blobs
Switch from a map of bare bluestore_blob_t's to an intrusive_set of
Blob structs that includes id, bluestore_blob_t, and BufferSpace.  The
buffer cache portion isn't used yet, but it is properly initialized with
the Cache parent.

There is no real functional change here except that during clone we move
the existing Blob from the Onode's BlobMap to the Bnode's without any
copying.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 16:05:04 -04:00
Sage Weil
e65d2b8692 os/bluestore: move blob_map out of onode_t
Move the blob_map index out of the onode_t proper.  None of the (important)
onode_t methods use the blob_map, which is expected since blobs may exist
in the onode or bnode map.  Instead, move it into Onode, parallel the
Bnode counterpart.

This will allow us to create a blob map that includes the buffer cache
with an encode/decode and lifecycle independent of the onode_t.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:58:23 -04:00
Sage Weil
20d75c533c Merge pull request #9526 from liewegas/wip-bluestore-csum2
os/bluestore: vary csum chunk sizes based on hints

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-06-15 15:57:30 -04:00
Sage Weil
e84c0ad933 os/bluestore: add crc32c_16 and crc32c_8
This is much faster than a slice-by-8 crc16, perhaps even without the
intel instructions.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:25:30 -04:00
Sage Weil
c9cdc74687 os/bluestore: whitespace
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:25:30 -04:00
Sage Weil
21971b57ad compressor/snappy: style cleanup
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:25:30 -04:00
Sage Weil
765a9d0e75 compressor/snappy: compress to page-aligned memory buffer
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:25:30 -04:00
Sage Weil
5b2ce732d6 os/bluestore: remove unused ext_offset region_t field
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:25:30 -04:00
Sage Weil
9d643af753 os/bluestore: simplify spare read path, remove pextent constraint
The previous read code had the constraint that a physical extent had to
be a multiple of the csum chunk size.  This isn't needed: we might have
a csum_block of 1MB and min_alloc_size of 4KB and that's okay.

Collapse the two helpers into a single loop that uses the blob_t::map()
method to do the pextent part of the read.  This is simpler and avoids
the temporary extents2read structure.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:25:30 -04:00
Sage Weil
819dd4e57c os/bluestore: csum_block -> csum_chunk
Be consistent with terminology.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-15 15:25:30 -04:00