Commit Graph

46539 Commits

Author SHA1 Message Date
Jason Dillaman
f8a9aeffcd librbd: snap create doesn't properly handle race conditions
The ESTALE result code was being filtered out, preventing the retry
logic.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-02 11:11:12 -05:00
Jason Dillaman
9809c3c406 librbd: use md_ctx for self-managed snapshot management
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-02 11:11:11 -05:00
Jason Dillaman
835989c71e librbd: convert op state machines to templates
Using templates allows the creation of mocked test cases to
verify non-librados expectations.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-02 11:11:11 -05:00
Jason Dillaman
5b63666f88 tests: add gmock unit tests for librbd object map state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-02 11:11:11 -05:00
Jason Dillaman
dfbcbc72a3 librbd: ensure object map is invalidated on disk if forced
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-02 11:11:11 -05:00
Jason Dillaman
1786fa8aa9 Merge pull request #6657 from kylinstorage/wip-rbd-nbd
rbd-nbd: network block device (NBD) support for RBD 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2015-12-02 10:38:54 -05:00
branto1
ca777e8974 Merge pull request #6769 from aiicore/configure_fix
configure.ac: macro fix

Reviewed-by: Boris Ranto <branto@redhat.com>
2015-12-02 14:31:48 +01:00
Ved-vampir
dc2b1764dd common: PluginRegistry modification 2015-12-02 14:00:52 +03:00
Sage Weil
5eb64dd324 common: PluginRegistry
Generic plugin loader.  Based on the ErasureCodePlugin.

Signed-off-by: Sage Weil <sage@redhat.com>

Conflicts:
	src/common/Makefile.am
	src/common/ceph_context.cc
	src/common/ceph_context.h

missing files
2015-12-02 14:00:52 +03:00
Igor Podoski
e8002c38d5 configure.ac: macro fix
Configure fails with autoconf 2.63 on Centos 6.6 with:

./configure: line 34026: syntax error near unexpected token `newline'
./configure: line 34026: `  yes:no:'

Signed-off-by: Igor Podoski <igor.podoski@ts.fujitsu.com>
2015-12-02 11:58:07 +01:00
Orit Wasserman
e9daed221e rgw: use smart pointer for C_Reinitwatch
Fixes: 13529
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2015-12-02 11:16:05 +01:00
Yan, Zheng
0716debe92 Merge pull request #5685 from ceph/wip-12133
cephfs-data-scan: scrub tag filtering (#12133 and #12145)
2015-12-02 16:15:50 +08:00
Jiaying Ren
c4fbec7118 rgw: fix partial read mime map issue
Signed-off-by: Jiaying Ren <mikulely@gmail.com>
2015-12-02 15:52:12 +08:00
John Spray
e04beab82a tools/cephfs: enable tag filter in DataScan
Fixes: #12133
Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 15:24:04 +08:00
John Spray
9e71abaa0a tools/cephfs: fix datascan kwarg parsing
Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 15:16:20 +08:00
John Spray
786d111a97 cls_cephfs: add PGLSCephFSFilter
Special purpose filter for use with CephFS disaster
recovery.

Fixes: #12145
Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 15:16:16 +08:00
Jason Dillaman
9c266e5995 common: re-enable backtrace support
A recent porting effort disabled support for backtrace creation.  It
also didn't initialize all variables, which would lead to a crash when
deleting a backtrace instance.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-02 00:43:48 -05:00
Yan, Zheng
9d42f1abcb Merge pull request #6719 from jcsp/wip-13898
tools: Fix layout handing in cephfs-data-scan (#13898)
2015-12-02 11:44:22 +08:00
Yunchuan Wen
b0deee4961 Update man page for new rbd nbd command
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2015-12-02 11:29:41 +08:00
Yunchuan Wen
dcb78b25dd update test_librbd_fsx to support rbd-nbd
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2015-12-02 11:29:31 +08:00
Yunchuan Wen
2c7cc532a8 add rbd-nbd man page reference
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2015-12-02 11:29:30 +08:00
Yunchuan Wen
330c7f86f5 add rbd-nbd wrap to rbd CLI
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2015-12-02 11:29:01 +08:00
Josh Durgin
fdd1a6b010 Merge pull request #6661 from xiaoxichen/rbd_misc_fix1
cls/cls_rbd.cc: fix misused metadata_name_from_key

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-01 19:06:44 -08:00
Xiaoxi Chen
bff706f48b cls/cls_rbd.cc: no need to skip key == after.
We already skip the pair where key == after in both LevelDBWholeSpaceIteratorImpl::upper_bound
and RocksDBWholeSpaceIteratorImpl::upper_bound.

Fixes: #13922

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>
2015-12-02 11:01:11 +08:00
Jason Dillaman
685fc1cdc1 journal: fire replay complete event after reading last object
Fixes: #13924
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-12-01 21:49:32 -05:00
Jiaying Ren
f914b8db11 rgw: fix rgw_admin partial read issue
Signed-off-by: Jiaying Ren <mikulely@gmail.com>
2015-12-02 10:35:46 +08:00
Guang Yang
61f61a2dbe osd: add recovery_priority and recovery_op_priority to pool_opts_t
Fixes: 13121
Signed-off-by: Guang Yang <yguang@yahoo-inc.com>
2015-12-02 01:51:19 +00:00
Dan Mick
708ec2b814 tests and tools/scratchtool: Don't attempt to use NULL xattr
Prior commit changes rados{striper}_getxattrs_next to be able to return
NULL in the 'val' param.  Handle that.

Fixes: #13944
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-12-01 14:38:48 -08:00
Dan Mick
4ec0def94c librados.cc: rados_getxattrs_next: don't try to use malloc(0)
If an xattr is 0 length, don't try to malloc a buffer for the value;
leave it NULL.  (Linux doesn't promise malloc(0) returns a pointer,
and other implementations, like AIX, definitely return NULL.)

Usage changes are in following commits.

Fixes: #13944
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-12-01 14:35:35 -08:00
Sage Weil
db9ec690e6 osd: mark osd backend type in osd_data dir
When we create an osd, mark the type of the backend in the
osd_data dir in the 'type' file.  On startup, if this file is
present, us this to decide which ObjectStore to instantiate.  If
it is not present, use the osd_objectstore option as before.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-12-01 17:21:00 -05:00
Sage Weil
880a59d1b7 osd: make block device fsid probing generic
Currently the option name and invocation assume that the block device
is a journal (and FileStore journal, managed by FileJournal).  Rework
the interface so that we can probe any block device and other ObjectStore
implementations will have a chance to identify the device (and return the
osd fsid).

Switch to a static method while we are at it so we avoid instantiating
each backend.

Note that only FileStore is probed at the moment; that will change soon!

Signed-off-by: Sage Weil <sage@redhat.com>
2015-12-01 17:16:11 -05:00
Adam Kupczyk
999b24f722 Implemented log message size predictor. It tracks size of log messages.
Initial allocation size is derived from last log message from the same line of code.
Fixed bug in test.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2015-12-01 18:15:48 +01:00
Josh Durgin
18c5e18fc5 Merge pull request #6742 from dillaman/wip-13913
librbd: automatically flush IO after blocking write operations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-12-01 08:31:14 -08:00
Ken Dreyer
a45e02539c Merge pull request #6691 from SUSE/wip-13858
ceph.spec.in: limit _smp_mflags when lowmem_builder is set in SUSE's OBS

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2015-12-01 09:27:52 -07:00
John Spray
ff53763425 Merge pull request #6747 from ukernel/wip-osd-getfilter
osd: fix ClassHandler::ClassData::get_filter()

Reviewed-by: John Spray <john.spray@redhat.com>
2015-12-01 16:04:35 +00:00
wangchaunhong
2f36909e1e init-ceph: fix systemd-run cant't start ceph daemon sometimes
Fixes: #13474
Signed-off-by: Chuanhong Wang <wang.chuanhong@zte.com.cn>
2015-12-01 10:29:09 -05:00
Loic Dachary
9bd4f745d7 Merge pull request #6749 from dachary/wip-doc-install
doc: INSTALL redirect to online documentation

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-12-01 16:03:54 +01:00
John Spray
2ab79d72f3 tools/cephfs: fix layout handling in injection
When the stashed-layout handling stuff was added,
the guessing part got lost from the path where
we only had a single object.  Broke test_data_scan.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-01 14:57:23 +00:00
Jason Dillaman
b2370e4135 Merge pull request #6729 from majianpeng/librbd-journal
librbd: only send signal when AIO completions queue empty

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2015-12-01 09:24:05 -05:00
John Spray
c07c76b8bc Merge pull request #6751 from ceph/wip-cmake-strerror_r
cmake: define STRERROR_R_CHAR_P for GNU-specific strerror_r

Reviewed-by: John Spray <john.spray@redhat.com>
2015-12-01 14:17:46 +00:00
Jason Dillaman
2884d8b4b5 Merge pull request #5465 from yuyuyu101/wip-librbd-ap
librbd: support eventfd for AIO completion notifications

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2015-12-01 09:16:19 -05:00
Ilya Dryomov
184914b8de cmake: define STRERROR_R_CHAR_P for GNU-specific strerror_r
This is what autotools does with AC_FUNC_STRERROR_R bit.  It takes us
from

    $ monmaptool --print nonexistant
    monmaptool: monmap file nonexistant
    monmaptool: couldn't open nonexistant: (2)

to

    $ monmaptool --print nonexistant
    monmaptool: monmap file nonexistant
    monmaptool: couldn't open nonexistant: (2) No such file or directory

on cmake - otherwise we end up using GNU-specific version as if it was
the POSIX version.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2015-12-01 15:07:48 +01:00
Sage Weil
57c7d55856 Merge pull request #6745 from drunkard/master
doc: fix typo in cephfs/quota
2015-12-01 08:59:57 -05:00
Sage Weil
48abbe7081 Merge remote-tracking branch 'gh/jewel' 2015-12-01 08:51:48 -05:00
Loic Dachary
e27109ba39 doc: INSTALL redirect to online documentation
The INSTALL file has obsolete and misleading instructions to compile
from sources (-pg actually fails at link time). Replace with links to
the online installation and build from source documentations.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-01 14:44:02 +01:00
Sage Weil
35403da171 qa/workunits/cephtool/test.sh: no ./
Introduced by 1ace4d03b2

Signed-off-by: Sage Weil <sage@redhat.com>
2015-12-01 08:14:53 -05:00
Yan, Zheng
88e6694aa9 osd: fix ClassHandler::ClassData::get_filter()
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-12-01 20:21:53 +08:00
Drunkard Zhang
9fba402413 doc: typo fix in cephfs/quota 2015-12-01 17:15:29 +08:00
Jianpeng Ma
fd684ca15d librbd/JournalReplay: Only Send signal when aio completions queue empty.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2015-12-01 17:14:37 +08:00
Loic Dachary
ac20f38f1f Merge pull request #6697 from XinzeChi/wip-scrub-test
test: fix osd-scrub-snaps.sh

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-12-01 09:50:06 +01:00