Commit Graph

92088 Commits

Author SHA1 Message Date
Sage Weil
c99c5f877f common/config: fix debug output for config callbacks changes
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-16 05:05:36 -06:00
Kefu Chai
2271440fc8
Merge pull request #25046 from tchaikov/wip-16500
tests: do not check for invalid k/m combinations

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-11-16 18:34:24 +08:00
Lenz Grimmer
34a5ac0b19
Merge pull request #25084 from s0nea/wip-dashboard-add-missing-test-suites
mgr/dashboard/qa: add missing dashboard suites

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-11-16 11:16:42 +01:00
Sage Weil
13d1f62538 Merge PR #24973 into master
* refs/pull/24973/head:
	mgr: Separate diskprediction cloud plugin from the diskprediction plugin
2018-11-16 00:23:14 -06:00
Sage Weil
22b43b5b5b Merge PR #20185 into master
* refs/pull/20185/head:
	Common, log: Added functionality test for recovery after silenced (#20174)

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-16 00:22:37 -06:00
Sage Weil
d941b28089 Merge PR #19987 into master
* refs/pull/19987/head:
	qa/tasks/ceph: ignore failure when chown ceph:ceph

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-16 00:22:17 -06:00
hsiang41
9799eb67eb mgr: Separate diskprediction cloud plugin from the diskprediction plugin
Separate diskprediction local cloud from the diskprediction plugin.
Devicehealth invoke device prediction function related on the global
configuration "device_failure_prediction_mode".

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-16 00:15:41 -06:00
Kefu Chai
ed5b7e779d
Merge pull request #20683 from Aran85/wip-rados-loadgen-align
tools: add offset-align option to "rados" load-gen 

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-16 13:22:16 +08:00
Kefu Chai
fc72de4cca
Merge pull request #24799 from xiexingguo/wip-js-safe-to-destroy
mgr/DaemonServer: add js-output for "ceph osd safe-to-destroy"

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-16 13:21:07 +08:00
Kefu Chai
d9f8ecd206
Merge pull request #24969 from joke-lee/doc-dump-journal-help-info
osd: add --dump-journal option in ceph-osd help info

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-16 13:19:53 +08:00
Casey Bodley
9554f5452e
Merge pull request #24866 from linuxbox2/wip-rm-aclparser
rgw: remove rgw_aclparser.cc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-15 14:01:17 -05:00
Kefu Chai
1cb4df760e
Merge pull request #25108 from tchaikov/wip-bluestore-repair
tools/ceph_kvstore_tool: do not open rocksdb when repairing it

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-11-16 00:06:57 +08:00
Kefu Chai
0ffe51057d
Merge pull request #25070 from tchaikov/wip-25146
rocksdb: pick up a fix to be backward compatible

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-15 21:15:33 +08:00
Tatjana Dehler
ef62c5eb4e mgr/dashboard/qa: add missing dashboard suites
Fixes: https://tracker.ceph.com/issues/37152
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-11-15 11:45:56 +01:00
Kefu Chai
b187c190d8 rocksdb: pick up a fix to be backward compatible
see https://github.com/facebook/rocksdb/pull/3488

also bump up the rocksdb version to v5.17.2

Fixes: http://tracker.ceph.com/issues/25146
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 16:44:49 +08:00
Kefu Chai
0534786b9d
Merge pull request #24901 from wjwithagen/wjw-fix-rbd-ggate-cmake
tool: link rbd-ggate against librados-cxx

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:40:04 +08:00
Kefu Chai
01409a542c
Merge pull request #25060 from mooncak/fix_typos
doc: Fix some typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:29:39 +08:00
Kefu Chai
052b0f4614
Merge pull request #24999 from MrStupnikov/master-docfix-1358
doc: Put command template into literal block

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:14:03 +08:00
Kefu Chai
c3d13aab43 erasure-code/lrc: error out if "l == 0"
l (locality) should not be 0, and k+m should be multiple of it

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
5b70ba8cdf erasure-code: return error using ss not derr
log is not very visible from user's perspective. we'd better return the
error message using the input parameter, if the technique is
unsupported.

also, remove the trailing newline, as `ss` will be sent back to user,
it's the the front-end's responsibility to format the error message.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
2b13c7f7e9 tests: do not check for invalid k/m combinations
This reverts commit c5bafae6fd.

in 37f73607 and 3ec41030, we detect invalid "k". and we should always
detect invalid combinations of parameters in
ErasureCodeInterface::init(), and return -EINVAL instead of "autotune" them
as put in the commit message of c5bafae6, if the profile is invalid for
given erasure plugin. so ErasureCodeBench::encode() and
ErasureCodeBench::decode() will bail out with the error message returned by
ErasureCodeInterface::init() if the parameters are not valid.

also, i checked all ErasureCodeInterface::init() implementations, none
of them is overwriting the settings without returning a non-zero return
code. so we are not overriding or autotuning the settings specified by
user.

Fixes: http://tracker.ceph.com/issues/16500
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
83762041a4 tests: use stoi() instead of atoi()
stoi() is simpler if we need to convert std::string to integer.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
d143450450
Merge pull request #24996 from mcv21/bug/note_file_move
debian: correct ceph-common relationship with older radosgw package

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:28:47 +08:00
Kefu Chai
994229ac51
Merge pull request #25048 from swinds24/master_fix_36764
ceph-mgr: hold lock while accessing the request list and submitting request

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:26:53 +08:00
Kefu Chai
578f7e082e
Merge pull request #24458 from rzarzynski/wip-osd-drop-osd_instructions
osd: drop the unused request_redirect_t::osd_instructions

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:16:05 +08:00
Kefu Chai
ac48b5659d
Merge pull request #24141 from liu-chunmei/ceph_seastar_perfcounter
common,crimson: port perfcounters to seastar

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:13:39 +08:00
Kefu Chai
a04691031c
Merge pull request #24858 from jecluis/wip-pr-19983-tests
qa/cephtool: test bounds on pool's `hit_set_*`

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:12:09 +08:00
Kefu Chai
5965aff12e
Merge pull request #25106 from tchaikov/wip-qa-envlibrados
qa: fix upgrade tests and test_envlibrados_for_rocksdb.sh

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-15 14:06:54 +08:00
Kefu Chai
85c65a58cc tools/ceph_kvstore_tool: do not open rocksdb when repairing it
before this change, the `need_open_db` parameter is passed to the
constructor of BlueStore as `min_alloc_size`. and rocksdb will fail to
repair because Repairer::Run() also tries to acquire the db lock, and it
will fail to do so if the lock file is already acquired by
BlueStore::_mount().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:02:05 +08:00
Kefu Chai
60dc1c2a32 qa: patch rocksdb the right way
quote from patch(1)

>       but usually just
>
>       patch -pnum <patchfile

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 13:03:00 +08:00
Neha Ojha
d46a472915
Merge pull request #24979 from neha-ojha/wip-upgrade-bug
doc/releases/mimic.rst: make note of 13.2.2 upgrade bug

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-14 20:51:55 -08:00
Kefu Chai
bbdb569666
Merge pull request #25072 from tchaikov/wip-silence-sign-compare
os/tests: silence -Wsign-compare warning

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-11-15 12:09:49 +08:00
Kefu Chai
2dc0f86227 qa: use FOUND_VAR to be backward compatible with cmake 2.8.12
before this change, we assume that the variable set if rados::radospp is
found will be radospp_FOUND, but this is a feature cmake 3, see
https://cmake.org/cmake/help/v3.3/module/FindPackageHandleStandardArgs.html

while the cmake shipped by centos is cmake 2.8.12, where the variable
name will be <UPPERCASED_NAME>_FOUND, see
https://cmake.org/cmake/help/v2.8.12/cmake.html#module:FindPackageHandleStandardArgs

in the test of test_envlibrados_for_rocksdb.sh, we are using cmake not
the cmake3 offered by EPEL7, so RADOSPP_FOUND will be set instead. that's why
executable env_librados_test will fail to link against rados::radospp.
as rados::radospp won't be defined if radospp_FOUND is not defined/set.

after this change, the 2nd mode of FIND_PACKAGE_HANDLE_STANDARD_ARGS()
is used instead to ensure that radospp_FOUND is defined even if cmake
2.8.12 is used.

also, the message() commands for debugging purpose are removed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 11:57:52 +08:00
Kefu Chai
ae36a61446 qa/suites: add librados2 to "extra_packages" for upgrade tests
we use the playbook of "testnodes.yml" defined by ceph-cm-ansible for
initializing test nodes, and the role of "testnode" is used by
testnodes.yml. "testnode" requires "qemu-system-x86" or "qemu-kvm"
package to be installed. the qemu in turn depends on librbd1 and
librados2.

before librados3 was introduced, this worked perfectly. because in ceph
repo, qa/packages/packages.yaml defines the default set of packages the
"install" tasks should install. and in that yaml file, librados2 was
listed. so the package management system will overwrite the librados2
installed by ansible playbook with the version specified by the
"install" task, as apt/yum thinks this is what user requires explicitly,
so it's fine to install a different version of librados2.

after librados3 was introduced, librados2 was removed from
qa/packages/packages.yaml. because, by default, we need to install
librados3 instead of librados2 for ready a nautilus cluster. but the
problem is, the packge list also applies to "install" tasks installing
releases before nautilus, where we still need to replace the librados2
installed by ansible.

so, to address this issue, "librados2" is added to "extra_packages" of
the "install" tasks of tests installing old releases to install
librados2 explicitly instead of as a dependency of other ceph packages
like librbd1.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 11:56:24 +08:00
xie xingguo
432f194355 mgr/DaemonServer: add js-output for "ceph osd safe-to-destroy"
E.g.:
 - case 1:
$ceph osd safe-to-destroy 0 1 2 -f json-pretty
Error EAGAIN: 12 pgs have unknown state; cannot draw any conclusions

 - case 2:
$ceph osd safe-to-destroy 0 1 2 -f json-pretty
{
    "safe_to_destroy": [
        0,
        1,
        2
    ],
    "active": [],
    "missing_stats": [],
    "stored_pgs": []
}

 - case 3:
$ceph osd safe-to-destroy 0 1 2 -f json-pretty
{
    "safe_to_destroy": [],
    "active": [
        0,
        1,
        2
    ],
    "missing_stats": [],
    "stored_pgs": []
}

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-11-15 11:02:01 +08:00
Alfredo Deza
eaf8e40980
Merge pull request #25098 from ceph/rm-27062
ceph-volume: reject devices that have existing GPT headers

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-14 13:31:18 -05:00
Andrew Schoen
74f25e5b81
Merge pull request #25093 from alfredodeza/wip-bz1644828
ceph-volume: remove LVs when using zap --destroy

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-11-14 11:00:34 -06:00
Kefu Chai
0a517ec0ac os/tests: silence -Wsign-compare warning
silence warning like

In file included from
/home/jenkins-build/build/workspace/ceph-pull-requests-arm64/src/test/objectstore/store_test.cc:25:0:
/home/jenkins-build/build/workspace/ceph-pull-requests-arm64/src/googletest/googletest/include/gtest/gtest.h:
In instantiation of 'testing::AssertionResult
testing::internal::CmpHelperEQ(const char*, const char*, const T1&,
const T2&) [with T1 = int; T2 = long unsigned int]':

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 00:59:02 +08:00
Andrew Schoen
0cb95ace88 ceph-volume: update tests after removing the LVPath arg validator
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Resolves: rm#27062
2018-11-14 10:36:30 -06:00
Andrew Schoen
fdf7f3c575 ceph-volume: return lvs as vg/lv from ValidDevice if as_string is True
All code in prepare and activate expect lvs to be in that format.
Eventually we can refactor all that to use the Device class as well.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Resolves: rm#27062
2018-11-14 10:36:30 -06:00
Andrew Schoen
cc0317efac ceph-volume: adds lv_name property to Device class
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Resolves: rm#27062
2018-11-14 10:36:30 -06:00
Andrew Schoen
d6a5a7606c ceph-volume: combine the LVPath arg validator with ValidDevice
This combines the two arg validators and makes both batch and
prepare/active both use ValidDevice.

This will also allow us to use lvs with a full path, like
/dev/vg/lv instead of always enforcing vg/lv.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Resolves: rm#27062
2018-11-14 10:36:29 -06:00
Andrew Schoen
568a0ce5be ceph-volume: adds has_gpt_headers property to Device class
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Resolves: rm#27062
2018-11-14 10:36:29 -06:00
Andrew Schoen
3d86d2dda9 ceph-volume: add PTTYPE to blkid parser
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Resolves: rm#27062
2018-11-14 10:36:29 -06:00
Jos Collin
6ea924df4b
Merge pull request #25094 from CharlotteRose/wip-fix-boxes
doc: Fixed the paragraph and boxes

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-11-14 21:53:28 +05:30
Lenz Grimmer
4e5559f26c
Merge pull request #24789 from Ranjitha-G/dashboard-test-erasure
mgr/dashboard: Add unit test case for controller/erasure_code_profile.py

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-14 16:46:34 +01:00
Scoots Hamilton
eec2310e9d doc: Fixed the paragraph and boxes.
Signed-off-by: Scoots Hamilton <scoots@redhat.com>
2018-11-14 10:27:48 -05:00
Lenz Grimmer
acde3a4d4c
Merge pull request #24788 from Ranjitha-G/dashboard-hacking-doc
mgr/dashboard: Fix some setup steps in HACKING.rst

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-11-14 13:44:19 +01:00
mooncake
67a44af1a5 doc: Fix some typos
Signed-off-by: mooncake <xcoder@tenxcloud.com>
2018-11-14 19:49:13 +08:00
Josh Durgin
bc2c80f437
Merge pull request #25080 from smithfarm/wip-37089
tests: make ceph-admin-commands.sh log what it does

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-14 15:47:52 +05:30