Commit Graph

58507 Commits

Author SHA1 Message Date
Jason Dillaman
a0c82b4276 cls_rbd: fix compiler warning due to feature bit macro type change
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-06 14:50:21 -04:00
Mykola Golub
5a98a8cdef Merge pull request #11326 from dillaman/wip-17416
rbd-mirror: improve resiliency of stress test case

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-10-06 21:47:45 +03:00
Mykola Golub
26f72673a3 Merge pull request #11327 from dillaman/wip-17422
librbd: cls_rbd updates for separate data pool

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-10-06 21:46:48 +03:00
Sage Weil
b675f343df Merge pull request #11329 from atheism/rgw-b64-remove-ostr
rgw: remove unused variable "ostr" in rgw_b64.h and fix the comment

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-06 12:23:38 -05:00
Sage Weil
9be5163306 Merge pull request #11351 from ifed01/wip-bluestore-misc2
os/bluestore: Fix invalid compression statfs caused by clone op

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-06 12:22:27 -05:00
Sage Weil
a3420f5a1f Merge pull request #11350 from liewegas/wip-bluestore-compression
os/bluestore: fix up compression tests and debug output

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-06 11:35:37 -05:00
Igor Fedotov
73ac2c6926 os/bluestore: Fix invalid compression statfs caused by clone op
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-06 16:35:00 +00:00
Igor Fedotov
b34841d8e3 Merge pull request #11317 from liewegas/wip-bluestore-aios
os/bluestore: fix has_aios

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-06 19:27:09 +03:00
Sage Weil
1c9a79534f ceph_test_objectstore: adjust SyntheticMatrixCsumVsCompression parameters
- larger writes
- test both codecs
- use smaller min_alloc_size so that it's easier to write compressed data
- don't bother with compression off; other matrices cover that.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 12:05:04 -04:00
Sage Weil
f78c54359a os/bluestore: clean up compression debug output
The previous output was impossible to interpret properly.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 12:03:05 -04:00
Sage Weil
97cb04a15b ceph_test_objectstore: limit entropy in 'random' data so it can compress
Both zlib and snappy weren't able to do anything with the current data.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 12:02:10 -04:00
Sage Weil
09af02725e os/bluestore: fix build error
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 11:17:01 -04:00
Sage Weil
f73b7652cd Merge pull request #11346 from ifed01/wip-bluestore-misc
os/bluestore: misc cleanup and test fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-06 09:37:56 -05:00
Sage Weil
5c615be1c5 Merge pull request #11328 from liewegas/wip-bluestore-more-types
os/bluestore: pack a few more in-memory types
2016-10-06 09:33:59 -05:00
Igor Fedotov
1a5a30f1b4 test/store_test: BluestoreStatFSTest fixes for issues introduced with bluestore_compression_min_blob_size adjustment
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-06 14:17:40 +00:00
Igor Fedotov
af1b41522a os/bluestore: some cleanup around garbage collector
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-06 14:00:02 +00:00
Igor Fedotov
003dbc83e5 Merge pull request #11344 from xiexingguo/xxg-wip-bluestore-1006
os/bluestore: fix write_big counter and some more cleanups

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-06 13:47:03 +03:00
xie xingguo
e73764204c os/bluestore: fix comment
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-06 17:33:00 +08:00
xie xingguo
97386dbcce os/bluestore: simplify bluestore_gc_merge_data checking
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-06 16:59:31 +08:00
xie xingguo
1747d49789 os/bluestore: fix counter of l_bluestore_write_big_bytes
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-06 16:44:30 +08:00
xie xingguo
9837f981ae os/bluestore: more cleanups on _do_write_small()
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-06 16:33:00 +08:00
xie xingguo
c1fcb53132 os/bluestore: add _dump_transaction to reduce code redundancy
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-06 16:21:42 +08:00
xie xingguo
cbbd546309 os/bluestore: upgrade wal_seq to std::atomic
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-06 15:36:20 +08:00
Sage Weil
afbcece9b9 Merge pull request #11336 from liewegas/wip-bluestore-spanning-map
os/bluestore: switch spanning_blob_map to std::map
2016-10-05 17:36:20 -05:00
Casey Bodley
cf1785881f Merge pull request #11340 from yehudasa/wip-13286
rgw-admin: allow unsetting user's email

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-10-05 16:34:14 -04:00
Alfredo Deza
a35b7f6a67 Merge pull request #11334 from ceph/wip-make-dist-tag
make-dist: set rpm_release correctly for release builds

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2016-10-05 15:30:24 -04:00
Yehuda Sadeh
10dbfc540a rgw: remove user email index using helper function
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-05 11:41:42 -07:00
Weijun Duan
ebfd713d9a rgw:user email can modify to empty
Fixes: http://tracker.ceph.com/issues/13286

Signed-off-by: Weijun Duan <duanweijun@h3c.com>
2016-10-05 11:34:21 -07:00
Dan Mick
0ff0c9a8b9 make-dist: set rpm_release correctly for release builds
Similar to autobuild-ceph 17591db, only try to set rpm_release if there
is a release part to the git describe output (i.e. if it's not at a
version tag)

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2016-10-05 11:18:42 -07:00
Sage Weil
63d5b68da1 os/bluestore: switch spanning_blob_map to std::map
The intrusive map overhead on Blob is expensive when a tiny fraction of
Blobs actually end up in the spanning_blob_map.  Let's pay the extra
allocation overhead (for the map node holding the BlobRef) for those rare
cases.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 12:17:07 -04:00
Yehuda Sadeh
1b90ab375e Merge pull request #11127 from SirishaGuduru/multitenancy-doc-change
Changed config parameter "rgw keystone make new tenants" in radosgw multitenancy

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-05 09:07:17 -07:00
Yehuda Sadeh
086cebc9a3 Merge pull request #10159 from mhackett/wip-mhackett-16604
doc: add rgw_enable_usage_log option in Rados Gateway admin guide

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-05 09:04:02 -07:00
Yehuda Sadeh
a173427232 Merge pull request #10641 from weiqiaomiao/wqm-wip-rgw-s3api
doc/radosgw: fix description of response elements 'Part'

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-05 08:55:34 -07:00
Casey Bodley
85224aefb9 Merge pull request #11286 from yehudasa/wip-16930
rgw: don't fail if lost race when setting acls

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-10-05 10:51:08 -04:00
Weibing Zhang
478d010074 rgw: remove unused variable "ostr" in rgw_b64.h and fix the comment
Signed-off-by: Weibing Zhang <zhangweibing@unitedstack.com>
2016-10-05 22:34:33 +08:00
Sage Weil
fefd61f85a Merge pull request #11319 from markhpc/wip-bluestore-optimize-size
os/bluestore: optimize intrusive sets for size.

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-05 09:15:22 -05:00
Jason Dillaman
7176b61bad Merge pull request #11313 from ceph/wip-krbd-lock-on-read-option
rbd: recognize lock_on_read option

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-10-05 10:00:29 -04:00
Sage Weil
0932d39e28 os/bluestore: simplify BufferSpace writing_map / list
We were tracking buffers by seq.  In reality, though, we
won't have very many buffers that have in flight IO to
the same blob at the same time, so we can get by with
just a list here.  We can rely on the fact that the
list will be sorted (seq's increase, and we put new
buffers at the end).

This saves us a memory allocation.  No change in size of
BufferSpace and Blob (std::list -> intrusive::list).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 09:56:09 -04:00
Sage Weil
6bbac0e02f unittest_bluestore_types: more type sizeofs
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 09:44:53 -04:00
Sage Weil
7072be6a49 Merge pull request #11264 from liewegas/wip-bluestore-blob-split
os/bluestore: try to split blobs instead of spanning them

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-05 08:44:30 -05:00
Sage Weil
871aa4a300 os/bluestore: make Buffer smaller
160 -> 152 bytes

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 09:43:07 -04:00
Jason Dillaman
06448acf3d cls_rbd: add initial support for separate data pools
Fixes: http://tracker.ceph.com/issues/17422
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-05 08:11:04 -04:00
Jason Dillaman
c5f2290047 librbd: new RBD_FEATURE_DATA_POOL feature bit
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-05 08:11:00 -04:00
Igor Fedotov
4d077b14cf Merge pull request #11323 from liewegas/wip-bluestore-more-types
unittest_bluestore_types: a few more types for sizeof

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-05 14:04:01 +03:00
Jason Dillaman
a6dd6b50d6 qa/workunits: reduce amount of client IO for rbd-mirror stress
Journal IO is faster now, resulting in OSDs quickly filling up
under the stress test case.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-04 21:31:54 -04:00
Jason Dillaman
8c2ff9bce6 rbd-mirror: potential race allocating tag during shut down
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-04 21:31:54 -04:00
Jason Dillaman
355c79cb7c librbd: ignore attempts to request lock if already lock owner
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-04 21:31:54 -04:00
Jason Dillaman
24faead086 journal: clean up object recorder closed/overflow callback
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-04 21:31:54 -04:00
Jason Dillaman
4483531aa3 journal: delay moving overflowed buffers until quiesced
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-04 21:31:54 -04:00
Jason Dillaman
a960658155 journal: use reverse iterator search to find flush record
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-04 21:31:54 -04:00