Commit Graph

58876 Commits

Author SHA1 Message Date
Radoslaw Zarzynski
bbdcc620ef rgw: handle errors via exceptions in RGWStreamIOEngine.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
0ae4e1360c rgw: cleanup in the LoadGen frontend.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
8e73888e1d rgw: port the LoadGen frontend to the new RGWStreamIOEngine infrastructure.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
299510263c rgw: ONLY improve formatting in the FCGI frontend.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
ddf61a8d9a rgw: port the FCGI frontend to the new RGWStreamIOEngine infrastructure.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
2825cc7c61 rgw: port the ASIO frontend to the new RGWStreamIOEngine infrastructure.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
1a8a0d798d rgw: cleaning in the glue code for CivetWeb.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
e03cdd5271 rgw: switch out RGWCivetWeb to the new frontend infrastructure.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
e2bfd3e2a8 rgw: implement RGWStreamIOChunkingEngine.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
d54eb7e42c rgw: implement RGWStreamIOReorderingEngine.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:19 +02:00
Radoslaw Zarzynski
c1780267ff rgw: implement RGWStreamIOConLenControllingEngine.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
98907b187b rgw: ONLY rename RGWMongooseFrontend to RGWCivetWebFrontend.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
4d79ba924d rgw: ONLY rename RGWMongoose to RGWCivetWeb and marks overrides.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
61e35e4530 rgw: eradicate dynamic memory allocations from RGWEnv.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
1c492cbba1 rgw: implement RGWStreamIOBufferingEngine.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
754bf7cd1e rgw: RGWClientIO::get_env() is pure virtual now.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
ba0050865a rgw: implement RGWStreamIOAccountingEngine.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
082e414816 rgw: RGWMongoose uses RGWStreamIOEngine instead of RGWStreamIO.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
16f73244f4 rgw: implement RGWStreamIOLegacyWrapper for using new front-ends with RGWStreamIO.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
21af773344 rgw: dissect non-core ops from RGWStreamIOEngine to RGWStreamIOFacade.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
8c7a271edf rgw: dissect accounting interface from RGWClientIO.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:18 +02:00
Radoslaw Zarzynski
3e52525508 rgw: add basic infrastructure for decorators over RGWStreamIOBase.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:17 +02:00
Radoslaw Zarzynski
18104f194e rgw: rename RGWStreamIOBase to RGWStreamIOEngine.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:17 +02:00
Radoslaw Zarzynski
980c3c7c8f rgw: further cleaning in RGWStreamIOBase.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:17 +02:00
Radoslaw Zarzynski
63dd818418 rgw: strip out AWSv4 signature calculation from RGWStreamIOBase.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:17 +02:00
Radoslaw Zarzynski
cbb26fea84 rgw: improve const-correctness in the front-end infrastructure.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:17 +02:00
Radoslaw Zarzynski
c599078039 rgw: move transfer accounting management from RGWClientIO to RGWStreamIO.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:17 +02:00
Radoslaw Zarzynski
e4ee1d0329 rgw: introduce RGWStreamIOBase to separate all non-IO related things.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:17 +02:00
Matt Benjamin
81439138b6 rgw: mark asio frontend as experimental
Users will need to set "rgw-asio-frontend" as an experimental
feature.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-10-21 22:57:17 +02:00
Casey Bodley
04057a088a rgw: s3 PutObj sends status first
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:17 +02:00
Casey Bodley
a084b82183 rgw: s3 GetObj sends status first
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:17 +02:00
Casey Bodley
8340439b09 rgw: asio frontend uses async_read
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:17 +02:00
Casey Bodley
b2cc1d9ad6 rgw: implement ClientIO interface for asio + beast
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
0dff37419e rgw: asio frontend calls process_request
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
52d511ef41 rgw: RGWEnv::set takes boost::string_ref
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
c50bdf3915 rgw: implement Frontend interface for asio
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
2c48dc669b vstart: add --rgw_frontend option
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
c5543a4951 rgw: add skeleton for boost::asio frontend
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
273e5407a4 rgw: add submodule for Beast header-only library
Beast is a c++ http protocol library build on top of boost::asio

Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:08 +02:00
Kefu Chai
4d9ce9e9a5 Merge pull request #11534 from ceph/wip-17607-ceph-disk
tests: ceph-disk: force debug monc = 0

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-19 15:29:58 +08:00
Kefu Chai
78f298df05 Merge pull request #11512 from wjwithagen/wip-wjw-freebsd-depends
FreeBSD: update require packages

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-19 11:32:59 +08:00
Sage Weil
5f07ecbfb8 Merge pull request #11204 from liewegas/wip-rados-ack
librados: do not request osd ack if no completed completion is set

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-10-18 21:40:44 -05:00
Sage Weil
20ee727792 Merge pull request #11213 from liewegas/wip-osd-fastinfo
osd: add a pg _fastinfo attribute to reduce per-io metadata updates

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-10-18 21:39:58 -05:00
Sage Weil
0aeea8941b Merge pull request #11354 from liewegas/wip-rocksdb
rocksdb: update to latest, and make it the default for the mons
2016-10-18 21:38:53 -05:00
Sage Weil
d30ee64fc7 Merge pull request #11500 from liewegas/wip-lttng
CMakeLists.txt: enable LTTNG by default

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-18 21:38:40 -05:00
Sage Weil
ad2dde108b Merge pull request #11540 from liewegas/wip-bluestore-cow
os/bluestore: default bluestore_clone_cow=true
2016-10-18 15:53:37 -05:00
Sage Weil
dcbe9f05d4 Merge pull request #11539 from liewegas/wip-bluestore-gc
os/bluestore: no garbage collection for uncompressed blobs

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-18 15:53:25 -05:00
Sage Weil
369244314d os/bluestore: default bluestore_clone_cow=true
This has been stable for a long time.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 16:53:09 -04:00
Sage Weil
108724b7eb Revert "ceph_test_objecstore: use 1TB block device"
This reverts commit 5389133ff9.

This is too slow with the bitmap allocator.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 16:50:28 -04:00
Roushan Ali
ef8989ce74 os/bluestore: No garbage collection for uncompressed blobs
Signed-off-by: Roushan Ali<roushan.ali@sandisk.com>
2016-10-18 16:49:50 -04:00