RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2024-12-27 05:53:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
59,393 Commits 211 Branches 394 Tags 1.4 GiB
b1a6f77eb6
Commit Graph

59393 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Adam Kupczyk
b1a6f77eb6 Renamed and moved RGWPutObjEncryptFilter -> RGWPutObj_Filter. 
Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)
 2016-11-02 11:34:51 +01:00
Adam Kupczyk
69740441fe Introduced filter concepts to RGWGetObj. Plugged in decryption. 
Allows to plug in decompression in future.

Signed-off-by: Adam Kupczyk (a.kupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
8c8ce72a8e Change contract of rgw put operation. Now last, 0 - sized chunk is also processed. 
Allows to implement flush-like operations on data.

Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
70ff7147ac Added RGWPutObjEncryptFilter. Will be used for encryption and compression filters. 
Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)
 2016-11-02 11:34:50 +01:00
Adam Kupczyk
9f4233d843 Changed hash calculation logic. 
Changed RGWPutObjProcessor interface with regard to hash calculation.

Signed-off-by: Adam Kupczyk (akupczyk@mirantis.com)

Conflicts:
	src/rgw/rgw_op.cc
	src/rgw/rgw_rados.cc
 2016-11-02 11:34:50 +01:00
Ved-vampir
e66ea7d3af rgw: fix output for stat functions to return decompressed data size 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:34:50 +01:00
Ved-vampir
89174520f6 rgw: compression: add multipart and copy support 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:34:49 +01:00
Ved-vampir
8a1ce0fb8e rgw: add compression support for ranged queries 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:10 +01:00
Ved-vampir
44d397d4c8 rgw: replace multiple compression attributes by struct 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Ved-vampir
988462a801 rgw: add decompression & cmpressor attrs save 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Ved-vampir
11f8d97949 rgw: add compression to RGWPutObj 
Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>
 2016-11-02 11:31:09 +01:00
Kefu Chai
3d83dc8454 Merge pull request #11730 from ceph/wip-17654 
librados-dev: install inline_memory.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2016-11-02 10:53:24 +08:00
Josh Durgin
ac1c1f6f0e librados-dev: install inline_memory.h 
This is needed to compile against the c++ api since
c38869232c

Fixes: http://tracker.ceph.com/issues/17654
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2016-11-01 15:15:38 -07:00
Yehuda Sadeh
f890a71501 Merge pull request #11697 from weiqiaomiao/wqm-wip-rgw-bilist 
rgw: fix osd crashes when execute "radosgw-admin bi list --max-entries=1" command

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2016-11-01 13:57:07 -07:00
Sage Weil
352078deaa Merge pull request #11695 from tanghaodong25/cache-logger-wip 
os/bluestore: update cache logger after 'trim_cache' operation

Reviewed-by: Sage Weil <sage@redhat.com>
 2016-11-01 13:25:06 -05:00
Yehuda Sadeh
d36cc6d0fd Merge pull request #11506 from cbodley/wip-17569 
rgw: clear data_sync_cr if RGWDataSyncControlCR fails

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2016-11-01 11:16:09 -07:00
Matt Benjamin
2aecf6b73c Merge pull request #11707 from yehudasa/wip-17755 
rgw: json encode/decode index_type, allow modification
 2016-11-01 13:51:54 -04:00
haodong
6c7ed8f050 os/bluestore: udpate cache logger after trim_cache 
Signed-off-by: Haodong Tang <haodong.tang@intel.com>
 2016-11-02 01:44:23 +08:00
Sage Weil
888c8e635b Merge pull request #11708 from nitinkamble/master 
install-deps.sh: allow building on SLES systems
 2016-11-01 12:30:52 -05:00
Matt Benjamin
2c8d25b6fd Merge pull request #10767 from rzarzynski/wip-rgw-frontend-rework 
rgw: frontend subsystem rework

all requested changes have been made by the author
tested by-hand w/sigv2 and sigv4, and already passed teuthology rgw suite
 2016-11-01 13:11:07 -04:00
Sage Weil
2847e17769 Merge pull request #11724 from liewegas/wip-bluestore-fsck 
os/bluestore: deep fsck

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
 2016-11-01 11:21:16 -05:00
Sage Weil
6fc48bc7b1 os/bluestore: verify we can read objects on deep fsck 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 12:20:51 -04:00
Sage Weil
181e28ba99 os: add fsck deep/shallow option 
deep==false checks just metadata, and deep==true will (eventually) check
all data (and checksums) too.

Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 12:20:50 -04:00
Sage Weil
a9c3e9b916 ceph_test_objectstore: fix synthetic fsck 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 12:20:12 -04:00
Sage Weil
0b7577f8f5 Merge pull request #11537 from liewegas/wip-bluestore-parallel 
os/bluestore: refactor bluestore_sync_submit_transaction

Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
 2016-11-01 10:59:30 -05:00
Sage Weil
2bb9f9bcb3 Merge pull request #11661 from ceph/wip-git-ver 
cmake: fix git version string, cleanup
 2016-11-01 10:04:10 -05:00
Sage Weil
516b0db87e os/bluestore: default to bluestore_sync_submit_transaction=true 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:31:27 -04:00
Sage Weil
24eb39055d os/bluestore: randomly inject serialize transaction submission 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:31:27 -04:00
Sage Weil
4c13014a2a ceph_test_objectstore: move main() to bottom 
Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:31:05 -04:00
Sage Weil
27257b4bfa os/bluestore: fix {nid,blobid}_max 
- single case to cover increases ahead of schedule or just in time
- update global max only after txn commits, eliminating race
- drop unneeded id_lock
- improve t naming

Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:30:03 -04:00
Sage Weil
722bb20306 os/bluestore: prevent sync transaction submit with extent freelist 
It doesn't support unordered transactions.

Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:30:03 -04:00
Sage Weil
e2ba42bd75 os/bluestore: submit txn via kv_sync_thread if ids exceed max 
This ensures the txn will not commit before an update to the
global max.

Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:30:03 -04:00
Sage Weil
e013293b7f os/bluestore: refactor bluestore_sync_submit_transaction 
And drop bluestore_sync_transaction, at least for now.

The key change here is to make a per-txc flag indicating
whether the txn was already submitted.  This allows us
to make a choice between sync and not-sync on a per-txn
basis.

Signed-off-by: Sage Weil <sage@redhat.com>
 2016-11-01 10:30:03 -04:00
Kefu Chai
0d93b608b8 Merge pull request #11721 from dachary/wip-17561-log 
tests: TestErasureCodePluginJerasure must stop the log thread

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2016-11-01 21:53:52 +08:00
Sage Weil
c0c0f4664e Merge pull request #11718 from xiexingguo/xxg-wip-bluestore-1101 
os/bluestore: add counter to trace blob splitting

Reviewed-by: Sage Weil <sage@redhat.com>
 2016-11-01 08:17:43 -05:00
Loic Dachary
17fe16d461 tests: TestErasureCodePluginJerasure must stop the log thread 
When a log entry is created in dout.h, it holds a pointer to the

   static size_t _log_exp_length

variable. When OnExitManager::~OnExitManager from Log.cc is called
during global destruction, it may happen after the static variables
referenced by some entries have been deallocated. The flush() function
will try to access these deallocated variables via the hint_size()
method and core dump.

To prevent this race, the Log::stop() method must be called explicitly
to ensure no entries are left when the global destructors are called.

Fixes: http://tracker.ceph.com/issues/17561

Signed-off-by: Loic Dachary <ldachary@redhat.com>
 2016-11-01 13:33:08 +01:00
Alfredo Deza
6d01da687c Merge pull request #10248 from ktdreyer/wip-doc-no-rpm-md 
doc: rm "type=rpm-md" from yum repositories

Reviewed-by: Alfredo Deza <adeza@redhat.com>
 2016-11-01 08:24:17 -04:00
xiexingguo
bafec40191 Merge pull request #11690 from yonghengdexin735/wip-zzz-fixword 
src/common/perf_counters.h: fix wrong word

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
 2016-11-01 20:03:53 +08:00
xie xingguo
332e07f4ca os/bluestore: add sanity check when compress_extent_map() 
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2016-11-01 18:37:29 +08:00
xie xingguo
822e3afecf os/bluestore: formatting changes 
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2016-11-01 18:37:29 +08:00
xie xingguo
d85f2dcff4 os/bluestore: add counter to trace blob splitting 
As we want to know if it really happens and how often does it happen.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2016-11-01 18:37:21 +08:00
Mykola Golub
478d666a89 Merge pull request #11568 from dillaman/wip-17588 
librbd: cannot access non-primary image when mirroring force disabled

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2016-11-01 12:37:01 +02:00
Orit Wasserman
63e86e542e Merge pull request #11280 from ceph/wip-17440 
rgw: fixes for virtual hosting of buckets
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
 2016-11-01 10:14:13 +01:00
Mykola Golub
7b7d0984f0 Merge pull request #11559 from dillaman/wip-17618 
librbd: exclusive lock incorrectly initialized when switching to head revision

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2016-11-01 09:14:07 +02:00
Mykola Golub
ef4f128a26 Merge pull request #11623 from dillaman/wip-cls-rbd-group 
librbd: ensure consistency groups will gracefully fail on older OSDs

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2016-11-01 09:13:23 +02:00
Mykola Golub
3189a7dff6 Merge pull request #11703 from dillaman/wip-17750 
test: skip TestLibRBD.DiscardAfterWrite if skip partial discard enabled

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2016-11-01 09:11:50 +02:00
Loic Dachary
564a5b3979 Merge pull request #11714 from dachary/wip-17757-eio 
tests: disable failing tests

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
 2016-11-01 01:29:57 +01:00
Loic Dachary
d72353824e tests: disable failing unittest_erasure_code_plugin_jerasure 
While figuring out what's wrong with it.

Refs: http://tracker.ceph.com/issues/17561

Signed-off-by: Loic Dachary <ldachary@redhat.com>
 2016-11-01 00:42:49 +01:00
Loic Dachary
f018c9ec08 tests: disable failing test-erasure-eio.sh 
While figuring out what's wrong with it.

Refs: http://tracker.ceph.com/issues/17757

Signed-off-by: Loic Dachary <ldachary@redhat.com>
 2016-11-01 00:38:09 +01:00
Yuri Weinstein
98e5931b06 Merge pull request #11382 from yuyuyu101/wip-fix-shadow 
osd/PGBackend: fix collection_list shadow return value

Reviewed-by: Kefu Chai <kchai@redhat.com>
tchaikov
 2016-10-31 16:37:45 -07:00