RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-15 23:43:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
59,415 Commits 216 Branches 394 Tags 1.6 GiB
b6e6fc107e
Commit Graph

59415 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Casey Bodley
b6e6fc107e rgw: use RGWStorageStats::dump() to format 'bucket stats' 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
df64c45803 rgw: Bucket::List::list_objects no longer reads compression attribute for size 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
bbf5fddbfc rgw: remove compression attribute from bucket instance 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Adam Kupczyk
99fd03bb12 Fixed possible problems when compression expands data. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 12:13:06 +01:00
Adam Kupczyk
262f6683c0 Fixed problem with snappy compressor when data size <=3. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
7902ce2069 rgw: pass accounted_size directly into RGWPutObjProcessor::complete 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
2bcd4efe49 rgw: add accounted_size to RGWUploadPartInfo 
and use accounted_size for ListMultipart operations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
885606c76c rgw: add accounted_size argument to Write::write_meta 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
b8fb18ade3 rgw: add accounted_size argument to UpdateIndex::complete 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
2d2d370762 rgw: add accounted_size to RGWObjEnt 
and use accounted_size for BucketList operations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
9a105a6966 rgw: add accounted_size to RGWObjState 
RGWRados::get_obj_state() now initializes accounted_size based on
the compression attribute, if present

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:06 +01:00
Casey Bodley
20c723b6d4 cls/rgw: use rgw_bucket_dir_entry_meta::size to accumulate actual_size 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:13:05 +01:00
Casey Bodley
63db0ebc7f cls/rgw: add actual_size to rgw_bucket_caregory_stats 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:10:25 +01:00
Casey Bodley
abecf85177 cls/rgw: fix function names of log output 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 12:10:25 +01:00
Adam Kupczyk
a5f8ebc9ee Added missing decompression when reading SLO. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 12:10:25 +01:00
Adam Kupczyk
6fd1910516 Added compression handling when syncing. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:23 +01:00
Adam Kupczyk
1fe4aa9fc7 Moved handling extra data from RGWPutObjProcessor to RGWRadosPutObj 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
681f65b4b9 Cleanup of compression-related code in RGWGetObj::execute. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
128132d390 RGWRados::Object::Read::prepare no longer calculates offsets. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
c609215e5a Fixed problem with using uninitialized 'compressed' field. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2016-11-02 11:35:22 +01:00
Casey Bodley
6db48432b9 test/rgw: add unit test for rgw compression 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2016-11-02 11:35:22 +01:00
Ved-vampir
cd0cc75a86 rgw: move compression code in filters system 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:35:22 +01:00
Adam Kupczyk
b1a6f77eb6 Renamed and moved RGWPutObjEncryptFilter -> RGWPutObj_Filter. 
Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)
 2016-11-02 11:34:51 +01:00
Adam Kupczyk
69740441fe Introduced filter concepts to RGWGetObj. Plugged in decryption. 
Allows to plug in decompression in future.

Signed-off-by: Adam Kupczyk (a.kupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
8c8ce72a8e Change contract of rgw put operation. Now last, 0 - sized chunk is also processed. 
Allows to implement flush-like operations on data.

Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
70ff7147ac Added RGWPutObjEncryptFilter. Will be used for encryption and compression filters. 
Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
9f4233d843 Changed hash calculation logic. 
Changed RGWPutObjProcessor interface with regard to hash calculation.

Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
	src/rgw/rgw_rados.cc
 2016-11-02 11:34:50 +01:00
Ved-vampir
e66ea7d3af rgw: fix output for stat functions to return decompressed data size 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:34:50 +01:00
Ved-vampir
89174520f6 rgw: compression: add multipart and copy support 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:34:49 +01:00
Ved-vampir
8a1ce0fb8e rgw: add compression support for ranged queries 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:10 +01:00
Ved-vampir
44d397d4c8 rgw: replace multiple compression attributes by struct 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Ved-vampir
988462a801 rgw: add decompression & cmpressor attrs save 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Ved-vampir
11f8d97949 rgw: add compression to RGWPutObj 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Kefu Chai
3d83dc8454 Merge pull request #11730 from ceph/wip-17654 
librados-dev: install inline_memory.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2016-11-02 10:53:24 +08:00
Josh Durgin
ac1c1f6f0e librados-dev: install inline_memory.h 
This is needed to compile against the c++ api since
c38869232c

Fixes: http://tracker.ceph.com/issues/17654
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2016-11-01 15:15:38 -07:00
Yehuda Sadeh
f890a71501 Merge pull request #11697 from weiqiaomiao/wqm-wip-rgw-bilist 
rgw: fix osd crashes when execute "radosgw-admin bi list --max-entries=1" command

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2016-11-01 13:57:07 -07:00
Sage Weil
352078deaa Merge pull request #11695 from tanghaodong25/cache-logger-wip 
os/bluestore: update cache logger after 'trim_cache' operation

Reviewed-by: Sage Weil <sage@redhat.com>
 2016-11-01 13:25:06 -05:00
Yehuda Sadeh
d36cc6d0fd Merge pull request #11506 from cbodley/wip-17569 
rgw: clear data_sync_cr if RGWDataSyncControlCR fails

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2016-11-01 11:16:09 -07:00
Matt Benjamin
2aecf6b73c Merge pull request #11707 from yehudasa/wip-17755 
rgw: json encode/decode index_type, allow modification
 2016-11-01 13:51:54 -04:00
haodong
6c7ed8f050 os/bluestore: udpate cache logger after trim_cache 
Signed-off-by: Haodong Tang <haodong.tang@intel.com>
 2016-11-02 01:44:23 +08:00
Sage Weil
888c8e635b Merge pull request #11708 from nitinkamble/master 
install-deps.sh: allow building on SLES systems
 2016-11-01 12:30:52 -05:00
Matt Benjamin
2c8d25b6fd Merge pull request #10767 from rzarzynski/wip-rgw-frontend-rework 
rgw: frontend subsystem rework

all requested changes have been made by the author
tested by-hand w/sigv2 and sigv4, and already passed teuthology rgw suite
 2016-11-01 13:11:07 -04:00
Sage Weil
2847e17769 Merge pull request #11724 from liewegas/wip-bluestore-fsck 
os/bluestore: deep fsck

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
 2016-11-01 11:21:16 -05:00
Sage Weil
6fc48bc7b1 os/bluestore: verify we can read objects on deep fsck 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 12:20:51 -04:00
Sage Weil
181e28ba99 os: add fsck deep/shallow option 
deep==false checks just metadata, and deep==true will (eventually) check
all data (and checksums) too.

Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 12:20:50 -04:00
Sage Weil
a9c3e9b916 ceph_test_objectstore: fix synthetic fsck 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 12:20:12 -04:00
Sage Weil
0b7577f8f5 Merge pull request #11537 from liewegas/wip-bluestore-parallel 
os/bluestore: refactor bluestore_sync_submit_transaction

Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
 2016-11-01 10:59:30 -05:00
Sage Weil
2bb9f9bcb3 Merge pull request #11661 from ceph/wip-git-ver 
cmake: fix git version string, cleanup
 2016-11-01 10:04:10 -05:00
Sage Weil
516b0db87e os/bluestore: default to bluestore_sync_submit_transaction=true 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:31:27 -04:00
Sage Weil
24eb39055d os/bluestore: randomly inject serialize transaction submission 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:31:27 -04:00