Commit Graph

58221 Commits

Author SHA1 Message Date
Sage Weil
b16bd7781a unittest_bluestore_types: show sizeof for key types
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-04 11:14:08 -04:00
Sage Weil
304a3b1bf8 os/bluestore: use Extent::assign_blob
More explicit, less error-prone.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-04 10:59:15 -04:00
Sage Weil
0118293a4e os/bluestore: turn bluestore_onode_cache_size 16k -> 4k
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:42:03 -04:00
Sage Weil
05bb253c94 os/bluestore: drop unnecessary assert
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:42:03 -04:00
Sage Weil
a706908340 os/bluestore: instrument cache blob and extent counts
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:42:03 -04:00
Sage Weil
8c4cabec0f unittest_bluestore_types: attach blobs to cache
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:42:03 -04:00
Sage Weil
c8a06ce1ee do_cmake.sh: set .ceph_port to random port
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:40:07 -04:00
Sage Weil
33e26d021d os/bluestore: add perf counters for cache size
Onodes, buffers, buffer bytes.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:40:07 -04:00
Sage Weil
6098761000 os/bluestore: fix typo in write_penalty_read_ops perf counter
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:40:06 -04:00
Sage Weil
cbfa540c68 os/bluestore: fix cache tunables to be process-wide
Divide by the shard count so that the user isn't totally
confused.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 18:40:06 -04:00
Sage Weil
2efe05128b Merge pull request #11300 from liewegas/wip-bluestore-onode-add
os/bluestore: fix onode cache addition race
2016-10-03 17:11:57 -05:00
Sage Weil
2150e9914b os/bluestore: fix onode cache addition race
Two threads may try to add the same onode to the cache.
This is rare, but allowed (in the case of the meta
collection).  If that happens, one of them will just
back off and use the winning onode ref.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 17:37:15 -04:00
Gregory Farnum
8d37c68b56 Merge pull request #11298 from liewegas/wip-mgr-fix
mgr/MgrClient: fix ms_handle_reset
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-03 11:13:12 -07:00
Sage Weil
848ee05932 mgr/MgrClient: fix ms_handle_reset
Return false because we don't handle the reset.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 13:59:51 -04:00
Radoslaw Zarzynski
cfc0a16e04 Merge pull request #11292 from rzarzynski/yj-wip-swift-build_token-cleanup
rgw/swift: remove redundant assignment operation

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-03 17:53:19 +02:00
Kefu Chai
eb62120723 Merge pull request #11019 from liewegas/wip-autotools-must-die
autotools: remove a few other remaining traces

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-03 23:52:38 +08:00
Jason Dillaman
ada727047d Merge pull request #11294 from trociny/fixup-qa-rbd_mirror-metadata_set
qa/workunits/rbd: set image-meta on primary image and wait it is replicated

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-10-03 11:50:04 -04:00
Sage Weil
8242afb135 Merge pull request #11288 from stiopaa1/osd_replicatedpg_moveCOSDOnAppliedClass
osd/ReplicatedPG:move C_OSD_OnApplied class to cc

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-03 09:26:03 -05:00
Sage Weil
dbef9d057e Merge pull request #11289 from stiopaa1/mds_sessionmap_moveStatementUnderAssertPushPv
mds/SessionMap.h: change statement to assertion

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2016-10-03 09:25:36 -05:00
Mykola Golub
eb4097b8ef qa/workunits/rbd: set image-meta on primary image and wait it is replicated
After recently added image metadata replication it is not possible any
more to update it on non-primary image.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-10-03 17:02:59 +03:00
Sage Weil
b424a35f3a run-make-check.sh: use cmake exclusively
..and drop the separate cmake script

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 09:46:50 -04:00
Sage Weil
5bd88a54bb make-debs.sh: use make-dist
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-03 09:46:50 -04:00
Yan Jun
f0ae5fe1bd rgw/swift: remove redundant assignment operation
Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2016-10-03 14:11:09 +02:00
Loic Dachary
00873f26e5 Merge pull request #11086 from bassamtabbara/wip-ec-simd-runtime-detection
erasure-code: Runtime detection of SIMD for jerasure and shec

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-03 11:43:29 +02:00
Michal Jarzabek
677c8f6aad mds/SessionMap.h: change statement to assertion
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-10-02 10:30:20 +01:00
Michal Jarzabek
675c1e44f2 osd/ReplicatedPG:move C_OSD_OnApplied class to cc
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-10-01 17:49:34 +01:00
Dan Mick
62d8e60cb6 Merge pull request #11285 from liewegas/wip-mgr-rpm
ceph.spec: fix ceph-mgr version requirement

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-09-30 15:40:35 -07:00
Sage Weil
3447601ac3 ceph.spec: fix ceph-mgr version requirement
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 18:13:50 -04:00
Sage Weil
ad6aeb0f01 Merge pull request #11282 from liewegas/wip-bluestore-gc-fix
os/bluestore: fix gc when blob extends past eof
2016-09-30 16:17:57 -05:00
Sage Weil
570615b63a os/bluestore: fix gc when blob extends past eof
This can happen if we aren't referencing the bob.  Don't try to
read what isn't logically referenced.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 17:06:47 -04:00
Sage Weil
2dc5775449 Merge pull request #11279 from liewegas/wip-bluestore-gc
os/bluestore: compaction fixes
2016-09-30 13:50:08 -05:00
Sage Weil
ea0aee6073 os/bluestore: fix compaction left-side length
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 14:49:35 -04:00
Sage Weil
1164a30235 os/bluestore: more concise SharedBlob print
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 14:32:31 -04:00
Sage Weil
506e4aedd4 os/bluestore: cosmetic gc cleanups
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 14:23:32 -04:00
Sage Weil
75bf4d18a2 Merge pull request #11271 from stiopaa1/osd_repicatedpg_addOverride
osd/ReplicatedPG.h: add override to virtual funct

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-30 12:57:02 -05:00
Sage Weil
ce9781ae8b Merge pull request #11239 from liewegas/wip-bluestore-max-blob
os/bluestore: add max blob size; fix compressed min blob size logic

Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
2016-09-30 12:47:58 -05:00
Sage Weil
beed433254 os/bluestore: set min compressed blob size floor at 2x min_alloc_size
Otherwise there's not point in compressing--we won't be able to
allocation a smaller space to store it.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 13:47:23 -04:00
Sage Weil
87f6d23b2f os/bluestore: introduce bluestore_max_blob_size
This is enforced for compressed and non-compressed blobs alike.
We keep the separate compressoin min and max tunables since these
may be adjusted on a per-pool basis as well.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 13:47:22 -04:00
Sage Weil
f32b682f13 os/bluestore: adjust compression blob sizes down
These were way too big.  64KB is enough to get good compression,
and 4MB is way too big.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 13:47:22 -04:00
Sage Weil
a389a29e16 os/bluestore: fix blob depth encoding
1) Fix the flag constnat
2) Redefine the meaning to be more intuitive.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-30 13:45:36 -04:00
Sage Weil
c72bcd667e Merge pull request #11232 from Roushan81/wip-bluestore-blob-gc
os/bluestore: garbage collect partially overlapped blobs

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-30 09:43:33 -05:00
Sage Weil
599b6e459f Merge pull request #11263 from liewegas/wip-bluestore-reshard-slop
os/bluestore: sloppy reshard boundaries to avoid spanning blobs

Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
2016-09-30 09:41:46 -05:00
Sage Weil
6bf86fefdc Merge pull request #11275 from xiexingguo/xxg-wip-make-audit-buffer-option
os/bluestore: drop redundant call of get_blob

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-30 09:21:37 -05:00
xie xingguo
a2aaf2b4a4 os/bluestore: drop redundant call of get_blob
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-30 22:12:14 +08:00
Sage Weil
094944230a Merge pull request #11268 from liewegas/wip-bluefs-aio-leak
os/bluestore/BlueFS: release completed aios
2016-09-30 08:51:39 -05:00
Jason Dillaman
42d51117ad Merge pull request #11005 from jazeltq/add-sparse-read
rbd-mirror: Add sparse read for sync image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-30 09:39:58 -04:00
Jason Dillaman
f3d3941177 Merge pull request #11168 from trociny/wip-16212
rbd-mirror: replicate image metadata settings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-30 09:37:50 -04:00
Sage Weil
979c6e8754 Merge pull request #11274 from xiexingguo/xxg-wip-bluestore-0930
os/bluestore: still more cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-30 08:31:35 -05:00
John Spray
3707b30b98 Merge pull request #11136 from jcsp/wip-16016
mds: populate DamageTable from scrub and log more quietly

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2016-09-30 12:41:37 +01:00
Orit Wasserman
f555ddfafc Merge pull request #11270 from ceph/wip-17443
rgw: set correct instance on the object
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-09-30 10:41:25 +02:00