RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2024-12-27 05:53:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
59,609 Commits 211 Branches 394 Tags 1.4 GiB
916d46172f
Commit Graph

59609 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Casey Bodley
b8fb18ade3 rgw: add accounted_size argument to UpdateIndex::complete 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
2d2d370762 rgw: add accounted_size to RGWObjEnt 
and use accounted_size for BucketList operations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
9a105a6966 rgw: add accounted_size to RGWObjState 
RGWRados::get_obj_state() now initializes accounted_size based on
the compression attribute, if present

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
20c723b6d4 cls/rgw: use rgw_bucket_dir_entry_meta::size to accumulate actual_size 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:05 +01:00
Casey Bodley
63db0ebc7f cls/rgw: add actual_size to rgw_bucket_caregory_stats 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:10:25 +01:00
Casey Bodley
abecf85177 cls/rgw: fix function names of log output 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:10:25 +01:00
Adam Kupczyk
a5f8ebc9ee Added missing decompression when reading SLO. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 12:10:25 +01:00
Kefu Chai
39cbb557f3 Merge pull request #11738 from ceph/wip-cmake 
cmake: do not link erasure tests again libosd

Reviewed-by: Loic Dachary <ldachary@redhat.com>
 2016-11-02 18:44:26 +08:00
Mykola Golub
8e1cc88e06 rbd-mirror: snap protect of non-layered image results in split-brain 
Fixes: http://tracker.ceph.com/issues/16962
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2016-11-02 12:43:45 +02:00
Kefu Chai
9613de3002 Merge pull request #11384 from wjwithagen/patch-14 
test_subman.sh: Don't use --tmpdir

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2016-11-02 18:39:28 +08:00
Adam Kupczyk
6fd1910516 Added compression handling when syncing. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:23 +01:00
Adam Kupczyk
1fe4aa9fc7 Moved handling extra data from RGWPutObjProcessor to RGWRadosPutObj 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
681f65b4b9 Cleanup of compression-related code in RGWGetObj::execute. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
128132d390 RGWRados::Object::Read::prepare no longer calculates offsets. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
c609215e5a Fixed problem with using uninitialized 'compressed' field. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Casey Bodley
6db48432b9 test/rgw: add unit test for rgw compression 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 11:35:22 +01:00
Ved-vampir
cd0cc75a86 rgw: move compression code in filters system 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
b1a6f77eb6 Renamed and moved RGWPutObjEncryptFilter -> RGWPutObj_Filter. 
Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)
 2016-11-02 11:34:51 +01:00
Adam Kupczyk
69740441fe Introduced filter concepts to RGWGetObj. Plugged in decryption. 
Allows to plug in decompression in future.

Signed-off-by: Adam Kupczyk (a.kupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
8c8ce72a8e Change contract of rgw put operation. Now last, 0 - sized chunk is also processed. 
Allows to implement flush-like operations on data.

Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
70ff7147ac Added RGWPutObjEncryptFilter. Will be used for encryption and compression filters. 
Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
9f4233d843 Changed hash calculation logic. 
Changed RGWPutObjProcessor interface with regard to hash calculation.

Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
	src/rgw/rgw_rados.cc
 2016-11-02 11:34:50 +01:00
Ved-vampir
e66ea7d3af rgw: fix output for stat functions to return decompressed data size 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:34:50 +01:00
Ved-vampir
89174520f6 rgw: compression: add multipart and copy support 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:34:49 +01:00
Ved-vampir
8a1ce0fb8e rgw: add compression support for ranged queries 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:10 +01:00
Ved-vampir
44d397d4c8 rgw: replace multiple compression attributes by struct 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Ved-vampir
988462a801 rgw: add decompression & cmpressor attrs save 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Ved-vampir
11f8d97949 rgw: add compression to RGWPutObj 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Willem Jan Withagen
0894865ed8 test_subman.sh: Don't use --tmpdir 
test_subman.sh: Don't use --tmpdir since on most Linux-is it is consideren default
when creating a directory:
`If TEMPLATE is not specified, use tmp.XXXXXXXXXX, and --tmpdir is implied.`

And on FreeBSD --tmpdir is not available anyways.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2016-11-02 11:03:34 +01:00
xie xingguo
ec071376e7 os/bluestore: use string for most cases in _open_db() 
For a better readability.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2016-11-02 17:41:49 +08:00
Kefu Chai
9bdc5d1328 cmake: do not link erasure tests again libosd 
they are not referencing any symbols from it. and also the tests testing
plugins are not linked against the ec plugins, they *depend* on them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2016-11-02 14:56:05 +08:00
haodong
bb340c8d7a kv/rocksdb: enable rocksdb write path breakdown 
bluestore has unstable write performance partly because of
rocksdb internal overhead. So we add more breakdown in
rocksdb writh path.

Signed-off-by: Haodong Tang <haodong.tang@intel.com>
 2016-11-02 12:57:49 +08:00
Li Wang
7a7f2fc81b FileStore: Only verify split when it has been really done and done correctly 
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
 2016-11-02 03:37:58 +00:00
Kefu Chai
3d83dc8454 Merge pull request #11730 from ceph/wip-17654 
librados-dev: install inline_memory.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2016-11-02 10:53:24 +08:00
xie xingguo
857263fe3e os/bluestore: drop unused parameter "deep" from _fsck_check_extents() 
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2016-11-02 09:56:37 +08:00
xie xingguo
69088dc893 tools/ceph_objectstore_tool: handle fsck and fsck-deep op in unified path 
181e28ba99
introduces too much code redundancy, this patch simplifies it a little.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2016-11-02 09:19:15 +08:00
Michal Jarzabek
3e82fb6a84 mds/MDSRank: add const to member functions 
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
 2016-11-01 22:31:37 +00:00
Josh Durgin
ac1c1f6f0e librados-dev: install inline_memory.h 
This is needed to compile against the c++ api since
c38869232c

Fixes: http://tracker.ceph.com/issues/17654
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2016-11-01 15:15:38 -07:00
Yehuda Sadeh
f890a71501 Merge pull request #11697 from weiqiaomiao/wqm-wip-rgw-bilist 
rgw: fix osd crashes when execute "radosgw-admin bi list --max-entries=1" command

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2016-11-01 13:57:07 -07:00
Sage Weil
352078deaa Merge pull request #11695 from tanghaodong25/cache-logger-wip 
os/bluestore: update cache logger after 'trim_cache' operation

Reviewed-by: Sage Weil <sage@redhat.com>
 2016-11-01 13:25:06 -05:00
Yehuda Sadeh
d36cc6d0fd Merge pull request #11506 from cbodley/wip-17569 
rgw: clear data_sync_cr if RGWDataSyncControlCR fails

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2016-11-01 11:16:09 -07:00
Matt Benjamin
2aecf6b73c Merge pull request #11707 from yehudasa/wip-17755 
rgw: json encode/decode index_type, allow modification
 2016-11-01 13:51:54 -04:00
Sage Weil
27cee5ab9e os/bluestore: rename variable in set_lextent 
Defensive naming

Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 13:46:06 -04:00
Sage Weil
7c96b674f5 os/bluestore: fix shard span check in set_lextent 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 13:46:06 -04:00
Sage Weil
be22364959 os/bluestore: fsck: check for extents spanning shards 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 13:46:06 -04:00
haodong
6c7ed8f050 os/bluestore: udpate cache logger after trim_cache 
Signed-off-by: Haodong Tang <haodong.tang@intel.com>
 2016-11-02 01:44:23 +08:00
Sage Weil
888c8e635b Merge pull request #11708 from nitinkamble/master 
install-deps.sh: allow building on SLES systems
 2016-11-01 12:30:52 -05:00
Matt Benjamin
2c8d25b6fd Merge pull request #10767 from rzarzynski/wip-rgw-frontend-rework 
rgw: frontend subsystem rework

all requested changes have been made by the author
tested by-hand w/sigv2 and sigv4, and already passed teuthology rgw suite
 2016-11-01 13:11:07 -04:00
Haomai Wang
dafac2fb3d test/librados/CMake: add EXTRALIBS to make tests linking pass 
Signed-off-by: Haomai Wang <haomai@xsky.com>
 2016-11-02 00:56:44 +08:00
Haomai Wang
3e7fc8ec52 msg/async/rdma: make RDMADispatch thread spawn after forking 
Signed-off-by: Haomai Wang <haomai@xsky.com>
 2016-11-02 00:26:31 +08:00