Commit Graph

46729 Commits

Author SHA1 Message Date
Josh Durgin
f9f4d5c662 Merge pull request #6830 from vumrao/wip-12112-vumrao
rbd: add --object-size option, deprecate --order

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-08 15:30:09 -08:00
Josh Durgin
7d93cf43f7 buffer: make usable outside of ceph source again
Add a rados/buffer_fwd.h symlink and remove the "include/" prefix from
buffer.h.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-12-08 15:09:54 -08:00
Radoslaw Zarzynski
72785ee969 rgw: enforce SLO part's ETag match during GET on SLO of Swift.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:10 +01:00
Radoslaw Zarzynski
1cf149d6b5 rgw: append X-Static-Large-Object attribute during PUT on SLO.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:09 +01:00
Radoslaw Zarzynski
630eac10cf rgw: add support for normalisation of ranged SLO requests.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:09 +01:00
Radoslaw Zarzynski
31f1b89fb6 rgw: fix wrong ofs handling during GET on Swift's SLO.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:09 +01:00
Radoslaw Zarzynski
dabf535605 rgw: handle errors during GET on Swift's SLO appropriately.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:09 +01:00
Radoslaw Zarzynski
fa71082ee4 rgw: make response for multipart delete on a SLO compliant with Swift.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:08 +01:00
Radoslaw Zarzynski
7e06dba6ba rgw: add support for multipart delete on a SLO of Swift.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:08 +01:00
Radoslaw Zarzynski
0a36b9576f rgw: fix iterate_slo_parts() and improve its declaration's formatting.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:08 +01:00
Radoslaw Zarzynski
4bab3fcac1 rgw: move RGWBulkDelete in rgw/rgw_op.h.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:58:08 +01:00
Yehuda Sadeh
1df28c8edd rgw: iterate over slo parts
Read slo parts when a read request was sent.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Conflicts:
	src/rgw/rgw_op.cc
2015-12-08 17:58:07 +01:00
Yehuda Sadeh
7f5fdcedee rgw: store slo info when putting object
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Conflicts:
	src/rgw/rgw_op.cc
	src/rgw/rgw_op.h
2015-12-08 17:58:07 +01:00
Yehuda Sadeh
d8593b161f rgw: read and parse put slo obj request
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Conflicts:
	src/rgw/rgw_op.h
	src/rgw/rgw_rest_swift.cc
2015-12-08 17:58:07 +01:00
Yehuda Sadeh
ffb4691c78 rgw: s/obj_manifest/dlo_manifest
Be more clear, as slo_manifest will come later.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Conflicts:
	src/rgw/rgw_op.cc
2015-12-08 17:57:25 +01:00
Radoslaw Zarzynski
8eb8048573 rgw: support bucket removal in Bulk Delete API implementation.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:24 +01:00
Radoslaw Zarzynski
60018d9241 rgw: improve response code handling for Bulk Delete API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:24 +01:00
Radoslaw Zarzynski
c421037f5a rgw: enable chunking in Bulk Delete API implementation.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:24 +01:00
Radoslaw Zarzynski
b665b04672 rgw: add support for Bulk Delete API of Swift.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:24 +01:00
Radoslaw Zarzynski
2ff837f469 rgw: rework authorization parts to accomodate Bulk Delete API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:23 +01:00
Radoslaw Zarzynski
4ea0c7c65d rgw: XMLFormatter may print XML tags lowercased and underscored now.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:23 +01:00
Radoslaw Zarzynski
3ecc2c3e90 rgw: RGWFormatter_Plain does support key-value style for Bulk Delete API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:22 +01:00
Radoslaw Zarzynski
2b45910ffd rgw: implement std::streambuf over RGWClientIO.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:22 +01:00
Radoslaw Zarzynski
619e9452aa rgw: improve code formatting in Swift's DLO implementation.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:22 +01:00
Radoslaw Zarzynski
b48f3d7741 rgw: fix wrong length in Content-Range HTTP header of Swift's DLO.
Fixes: #13452
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:21 +01:00
Radoslaw Zarzynski
66f47f35bb rgw: fix wrong first byte pos in Content-Range HTTP header of Swift's DLO.
Fixes: #13452
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:21 +01:00
Radoslaw Zarzynski
2945bef8eb rgw: add support for putting Swift's X-Object-Manifest through POST.
Fixes: #12886
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2015-12-08 17:57:21 +01:00
Loic Dachary
2d8d706191 Merge pull request #6857 from dachary/wip-13986-test-pg-scrub
tests: osd-scrub-snaps.sh to display full osd logs on error

Reviewed-by: Xinze Chi <xinze@xsky.com>
2015-12-08 17:03:10 +01:00
John Spray
1b6a7e3600 doc: note that cephfs auth stuff is new in jewel
+ bonus whitespace fixes to the code blocks to
get them to render properly

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-08 14:10:18 +00:00
Loic Dachary
2c7c712925 tests: osd-scrub-snaps.sh to display full osd logs on error
This generates a large output but is the only way to get more
information about race conditions that turn out to show up frequently.

http://tracker.ceph.com/issues/13986 Refs: #13986

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-08 13:54:58 +01:00
John Spray
76467ee132 Merge pull request #6850 from H3C/wip-zcl-ceph-mds
ceph-mds:add --help/-h

Reviewed-by: John Spray <john.spray@redhat.com>
2015-12-08 12:31:40 +00:00
John Spray
534ff381ab Merge pull request #6848 from H3C/wip-zcl-layout-rst
doc:file must be empty when writing layout fields of file use "setfattr"

Reviewed-by: John Spray <john.spray@redhat.com>
2015-12-08 11:47:22 +00:00
Vikhyat Umrao
71690e707f rbd: add --object-size option
Object size can be specified when creating an image with the --order option,
as a number of bits in the size.

This patch is adding new option --object-size. This new option will specify
object size directly for example --object-size 2M.

It would be easier to use. --order is still present for backwards compatibility.
For simplicity, we are rounding up the object size to the nearest power of 2.

Fixes #12112

Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>
2015-12-08 16:14:03 +05:30
Cilang Zhao
a69367d971 ceph-mds:add --help/-h
When use ceph-mds --hlep/-h, the usage will be showed

Signed-off-by: Cilang Zhao <zhao.cilang@h3c.com>
2015-12-08 04:01:12 -05:00
Cilang Zhao
07c334a2ca doc:file must be empty when writing layout fields of file use "setfattr"
When the layout fields of a file are modified, this file must be empty, otherwise an error would occur.

Signed-off-by:Cilang Zhao zhao.cilang@h3c.com
2015-12-08 03:45:43 -05:00
Loic Dachary
84ee7c3399 Merge remote-tracking branch 'ceph/jewel' 2015-12-08 09:03:55 +01:00
Loic Dachary
2c1af382c6 Merge pull request #6844 from dachary/wip-13997-centos-libunwind-jewel
build/ops: enable CR in CentOS 7

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2015-12-08 08:52:58 +01:00
Loic Dachary
247ee6084b build/ops: enable CR in CentOS 7
To get libunwind from the CR repositories until CentOS 7.2.1511 is released.

http://tracker.ceph.com/issues/13997 Fixes: #13997

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-08 08:25:24 +01:00
Loic Dachary
91264778b3 Merge pull request #6842 from badone/wip-13997
tests: centos7 needs the Continuous Release (CR) Repository enabled for

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-12-08 07:47:06 +01:00
Brad Hubbard
b47eeae1da tests: centos7 needs the Continuous Release (CR) Repository enabled for
libunwind

Fixes: #13997
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2015-12-08 16:07:38 +10:00
Ji Chen
7d48f62f5c LifeCycle feature
As same as amazon S3 interface,"PUT Bucket lifecycle" and
"DELETE Bucket lifecycle" have been implemented,
"GET Bucket lifecycle" not realized yet as S3cmd has not
realize it also.
The feature`s main point is to remove expire file per day.
Files transfer from hot layer to cold layer is not supported.
ToDo:Maybe to transfer from replicate pool to EC pool or
from ssd to sata pool will be valuable.

Now put all buckets which should do lifecycle into shard
objects in .rgw.lc pool.

lifecycle config file format:
<LifecycleConfiguration>
    <Rule>
        <ID>sample-rule</ID>
        <Prefix></Prefix>
        <Status>enable</Status>
        <Expiration>
           <Days>1</Days>
        </Expiration>
    </Rule>
</LifecycleConfiguration>

Signed-off-by: Ji Chen <insomnia@139.com>
2015-12-08 11:22:26 +08:00
Josh Durgin
8676120b44 Merge pull request #6818 from trociny/fix-cmake
cmake: update for recent rbd changes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-07 16:06:18 -08:00
Josh Durgin
caedebded5 Merge pull request #6837 from dreamhost/wip-test-cephtool-filenames
qa/workunits/cephtool/test.sh: false positive fail on /tmp/obj1.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-07 15:52:47 -08:00
Robin H. Johnson
cd0c13bbf0 qa/workunits/cephtool/test.sh: false positive fail on /tmp/obj1.
If /tmp/obj1 happened to exist already, and was not writable by the
testing user, then this test failed!

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2015-12-07 15:27:12 -08:00
Josh Durgin
f112e25f42 Merge pull request #6838 from stiopaa1/Wreorder_ceph_context
common/ceph_context.cc:fix order of initialisers

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-07 15:21:16 -08:00
Josh Durgin
b667259470 Merge pull request #6831 from fullerdj/wip-14010
qa/krbd: Expunge generic/247

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-07 15:01:01 -08:00
David Zafman
74ee7bd241 Merge pull request #6793 from dzafman/wip-hist-les-fix
osd: Allow repair of history.last_epoch_started using config

Reviewed-by: Samuel Just <sjust@redhat.com>
2015-12-07 14:56:03 -08:00
Michal Jarzabek
a80ff1fe43 common/ceph_context.cc:fix order of initialisers
Fix order of member initialisers causing [-Wreorder] warning.

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2015-12-07 22:39:11 +00:00
Yehuda Sadeh
0a883a48b4 Merge branch 'unlinkcallbyrmbucket'
Conflicts:
	src/rgw/rgw_bucket.cc

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2015-12-07 11:54:49 -08:00
Aran85
0186cdc622 rgw:dont update entrypoint when removing bucket
when removing bucket,we unlink the bucket bucket but we don't want
to update the entrypoint here.Because the update_entrypoint's default
value is true,so we need to indicate it to false.

Signed-off-by: Zengran Zhang <zhangzengran@h3c.com>
2015-12-07 11:51:25 -08:00