Commit Graph

58735 Commits

Author SHA1 Message Date
Yehuda Sadeh
0df0eabc41 rgw: REST client, don't sign requests if empty key
If key is not passed in, don't try to sign the request.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:20 -07:00
Yehuda Sadeh
90ccfbfb63 rgw: move the rgw sync code module around
No real code change

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:20 -07:00
Yehuda Sadeh
a88e2b3946 rgw: some abstraction around log sync module
Moving code that fetches remote object meta to its own classes.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:19 -07:00
Yehuda Sadeh
2c0f1a3117 rgw: log sync module gets source object's meta
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:19 -07:00
Yehuda Sadeh
2dcafc722a rgw: propagate attrs, mtime, size of remote object
Use new rgwx-stat http param that allows getting only object's
meta. Use that when calling stat_remote_object().

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:19 -07:00
Yehuda Sadeh
d75ffe4277 rgw: add cr to stat remote obj
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:18 -07:00
Yehuda Sadeh
006bd492b7 rgw: helper to stat remote obj
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:18 -07:00
Yehuda Sadeh
561dd09240 rgw: add a simple logging sync module
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:18 -07:00
Yehuda Sadeh
f84bd9d223 rgw: non-rgw tier is not writeable
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:17 -07:00
Yehuda Sadeh
2abd5ac847 rgw: define sync_module on RGWRados
Instead of having it as part of the data sync module. Since we only have a
single sync_module, having it there will make it easier to get its properties.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 10:31:17 -07:00
Yehuda Sadeh
ddbda514d8 rgw_admin: can set/modify zone tier's config
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 09:58:21 -07:00
Yehuda Sadeh
f2d547e067 rgw: add tier config for zone params
Needed for sync module instance configuration

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 09:58:21 -07:00
Yehuda Sadeh
b184f8dfbe rgw: define zone tier type, sync from appropriate tiers only
Can only sync from tiers that can export data.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 09:58:19 -07:00
Yehuda Sadeh
f30c9663ce rgw: define sync modules manager, instance
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-07 09:57:45 -07:00
Ilya Dryomov
620f5e1455 rbd: expose rbd unmap options
Reuse rbd map -o infrastructure to expose rbd unmap options in
a similar fashion.  Currently it's just one bool option, but we may
need more in the future.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2016-10-07 17:21:15 +02:00
Ilya Dryomov
ba8f9ee791 rbd: fix up terminology in help texts
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2016-10-07 16:22:26 +02:00
Patrick Donnelly
03c8fe3af2
client: add pid to metadata
This allows us to distinguish multiple clients on a machine.

Fixes: http://tracker.ceph.com/issues/17276

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-10-07 09:52:54 -04:00
Sage Weil
c3c5c14e74 Merge pull request #11361 from batrick/fs-rm-formatting
mon: add missing space in warning message

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-07 08:49:46 -05:00
Sage Weil
275ebcfd6c Merge pull request #11364 from badone/wip-_lsb_release_-dead-declarations
osd: Remove unused '_lsb_release_' declarations

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-07 08:47:45 -05:00
Sage Weil
df4973c14c Merge pull request #11349 from liewegas/wip-compressor
compressor: fixes and tests; disable zlib isal (it's broken)

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-07 08:42:23 -05:00
Sage Weil
d834a6d318 Merge pull request #11366 from xiexingguo/xxg-wip-bluestore-1007
os/bluestore: simplify blob status checking for small writes

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-07 08:41:35 -05:00
Sage Weil
90de6e0dc1 unittest_compression: naming nit
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-07 09:33:33 -04:00
Sage Weil
46b67f3d17 unittest_compression: restore zlib_isal setting
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-07 09:33:08 -04:00
John Spray
020e0f8523 Merge pull request #11236 from renhwztetecs/renhw-wip-cephfs-journal-tool
tool/cephfs: displaying "list" in journal event mode

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-07 15:16:06 +02:00
Orit Wasserman
a32ead391f Merge pull request #10021 from rzarzynski/wip-rgw-swift-auth-errors
rgw: handle Swift auth errors in a way compatible with new Tempests.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-10-07 11:52:43 +02:00
xie xingguo
e9596f14af os/bluestore: make randomizing value process of kvpair faster
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-07 16:29:17 +08:00
xie xingguo
ff5aa939f6 os/bluestore: fsck() on idempotent mkfs() request
E.g., if the fsck() found something during the first mkfs() try,
it can still be caught by the following retry.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-07 15:37:58 +08:00
xie xingguo
7fb237c16d os/bluestore: fix comment
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-07 14:44:39 +08:00
Brad Hubbard
f17c0ba9a9 osd: Remove unused '_lsb_release_' declarations
_lsb_release_set and _lsb_release_parse declarations still exist despite their
definitions being removed some time ago.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-10-07 13:38:40 +10:00
xie xingguo
9fafd7d425 os/bluestore: sanity check iterator of BufferSpace::_rm_buffer()
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-07 11:20:49 +08:00
xie xingguo
50884818e1 os/bluestore: simplify blob status checking for small writes
If a blob is marked as compressed and still mutable, something
is wrong.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-10-07 09:49:28 +08:00
Josh Durgin
61ffc1c553 Merge pull request #11302 from asheplyakov/rados-doc-fixup
doc: fix librados example programs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-10-06 16:24:52 -07:00
Yehuda Sadeh
739aa5866d rgw: use data sync module callbacks
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-06 16:08:20 -07:00
Yehuda Sadeh
841ac3861d rgw: initial data plugin definition and default implementation
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-06 16:08:20 -07:00
Patrick Donnelly
66a122025f
mds: respawn using /proc/self/exe
This allows the MDS to respawn using the same executable file even if it
has since been deleted (on Linux). Otherwise, the execv fails because
the readlink returns "/path/to/deleted (deleted)". (There is no path to
the old executable.)

Fixes: http://tracker.ceph.com/issues/17531

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-10-06 18:56:01 -04:00
Patrick Donnelly
a95f6fe688
mon: add missing space in warning message
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-10-06 18:08:54 -04:00
Sage Weil
f8a0e053fe unittest_compression: subsume plugin test
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 15:36:08 -04:00
Sage Weil
b49eda7046 unittest_compression: subsume _zlib and _snappy test cases
This includes zlib and isal interop.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 15:36:08 -04:00
Sage Weil
67d27740a3 unittest_compressor: smaller big test
Just so it runs a bit faster!

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 15:36:08 -04:00
Sage Weil
79e2b59e8a compressor/zlib: disable ISA-L
This fails the unit tests.  Do not reenable until it is fixed!

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 15:36:08 -04:00
Sage Weil
c3d78f03ee compressor/zlib: add compressor_zlib_isal config option to disable ISA-L
We dynamically enable this if the necessary processor features are present.
Allow this probing to be disabled explicitly.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 15:36:08 -04:00
Sage Weil
06ae3da85f compressor/snappy: fix decompress buffer sizing for large buffers
4 bytes is enough for small buffers, but fails for larger buffers because
snappy encodes the length as a varint.  8 is enough.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 15:36:07 -04:00
Sage Weil
e57196bd03 unittest_compressor: unified compression tests, parameterized by plugin
This obsoletes the per-plugin plugin tests, which are tedious anyway.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-06 15:36:07 -04:00
Jason Dillaman
0a0a88c715 rbd: utilize new API methods for image id and block name prefix
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-06 14:50:21 -04:00
Jason Dillaman
366e6075ca librbd: new API methods to retrieve image id and block name prefix
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-06 14:50:21 -04:00
Jason Dillaman
b083fa0c93 librbd: relocate image option processing to create state machine
Replace the individual image option parameters with the ImageOptions
wrapper and extract the options within the state machine itself.
This will simplify adding support for the data pool and other options
in the future.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-06 14:50:21 -04:00
Jason Dillaman
8b72efd181 librbd: add data pool option to API and config
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-06 14:50:21 -04:00
Jason Dillaman
a0c82b4276 cls_rbd: fix compiler warning due to feature bit macro type change
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-10-06 14:50:21 -04:00
Mykola Golub
5a98a8cdef Merge pull request #11326 from dillaman/wip-17416
rbd-mirror: improve resiliency of stress test case

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-10-06 21:47:45 +03:00
Mykola Golub
26f72673a3 Merge pull request #11327 from dillaman/wip-17422
librbd: cls_rbd updates for separate data pool

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-10-06 21:46:48 +03:00