Commit Graph

92295 Commits

Author SHA1 Message Date
Jan Fajerski
8a80990471 ceph-volume: rename Device property valid to available
This flag is used in the inventory reporting and available is deemed more
appropriate. Furthermore this fixes a bug where rejected_reasons
accumulated duplicate entries.

Fixes: http://tracker.ceph.com/issues/36701
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 09:22:06 +01:00
Jan Fajerski
dfc0e1d9a6 doc: add ceph-volume inventory sections
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 08:35:56 +01:00
runsisi
d4da1f59fc mon: require keyring even if cephx is optional
Signed-off-by: runsisi <luo.runbing@zte.com.cn>
2018-11-16 14:56:39 +08:00
Sage Weil
13d1f62538 Merge PR #24973 into master
* refs/pull/24973/head:
	mgr: Separate diskprediction cloud plugin from the diskprediction plugin
2018-11-16 00:23:14 -06:00
Sage Weil
22b43b5b5b Merge PR #20185 into master
* refs/pull/20185/head:
	Common, log: Added functionality test for recovery after silenced (#20174)

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-16 00:22:37 -06:00
Sage Weil
d941b28089 Merge PR #19987 into master
* refs/pull/19987/head:
	qa/tasks/ceph: ignore failure when chown ceph:ceph

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-16 00:22:17 -06:00
hsiang41
9799eb67eb mgr: Separate diskprediction cloud plugin from the diskprediction plugin
Separate diskprediction local cloud from the diskprediction plugin.
Devicehealth invoke device prediction function related on the global
configuration "device_failure_prediction_mode".

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-16 00:15:41 -06:00
Sage Weil
a3a3eb5f84 mgr/DaemonServer: fix session leak
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-15 23:34:07 -06:00
Sage Weil
a3e82e99dd mon/MonClient: ignore new mon commands while stopping
If one thread is stopping and another threads tries to send a new mon
command, just ignore it.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-15 23:34:07 -06:00
Kefu Chai
ed5b7e779d
Merge pull request #20683 from Aran85/wip-rados-loadgen-align
tools: add offset-align option to "rados" load-gen 

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-16 13:22:16 +08:00
Kefu Chai
fc72de4cca
Merge pull request #24799 from xiexingguo/wip-js-safe-to-destroy
mgr/DaemonServer: add js-output for "ceph osd safe-to-destroy"

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-16 13:21:07 +08:00
Kefu Chai
d9f8ecd206
Merge pull request #24969 from joke-lee/doc-dump-journal-help-info
osd: add --dump-journal option in ceph-osd help info

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-16 13:19:53 +08:00
Jason Dillaman
5ec88d0e91 librbd: retry mirror disable if parent/clone ordering causes issues
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-11-16 10:15:39 +05:30
hsiang41
f4f25fde54 mgr: Fixed devicehealth plugin resource leak
The devicehealth plugin not close rados connection at show device metrics
 function.

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-16 09:44:58 +08:00
Sage Weil
60876ccce4 mgr/ClusterState: add with_osdmap_and_pgmap
Several call sites need to lock both

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-15 16:26:48 -06:00
Casey Bodley
9554f5452e
Merge pull request #24866 from linuxbox2/wip-rm-aclparser
rgw: remove rgw_aclparser.cc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-15 14:01:17 -05:00
Kefu Chai
1cb4df760e
Merge pull request #25108 from tchaikov/wip-bluestore-repair
tools/ceph_kvstore_tool: do not open rocksdb when repairing it

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-11-16 00:06:57 +08:00
Jeff Layton
a516905591 orchestrator: merge the ServiceLocation class into ServiceDescription
The ServiceDescription object just holds a list of ServiceLocation
objects.  Eliminate ServiceLocation and merge it into the
ServiceDescription class. Have describe_service return a list of
ServiceDescriptions.

Suggested-by: Tim Serong <tserong@suse.com>
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 09:02:54 -05:00
Kefu Chai
0ffe51057d
Merge pull request #25070 from tchaikov/wip-25146
rocksdb: pick up a fix to be backward compatible

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-15 21:15:33 +08:00
Jeff Layton
f396fa1d7f orchestrator_cli: add an orchestrator service ls function
There's currently no way to enumerate the services that the
orchestrator backend knows about. Add a "service ls" command
that will list them with some basic info, subject to filters
given on the command line.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 07:27:51 -05:00
Jeff Layton
1c0b172a2c orchestrator/rook: rework describe_service() to accomodate "service ls"
Rework the describe_service operation for rook to allow listing of
services, with optional filters for service type, id and nodename.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 07:21:15 -05:00
Jeff Layton
99cbbdd5a1 orchestrator: rework describe_service prototype to allow for nodename
...and a new service_type field in ServiceLocation object.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-11-15 07:20:57 -05:00
Tatjana Dehler
ef62c5eb4e mgr/dashboard/qa: add missing dashboard suites
Fixes: https://tracker.ceph.com/issues/37152
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-11-15 11:45:56 +01:00
Kefu Chai
b187c190d8 rocksdb: pick up a fix to be backward compatible
see https://github.com/facebook/rocksdb/pull/3488

also bump up the rocksdb version to v5.17.2

Fixes: http://tracker.ceph.com/issues/25146
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 16:44:49 +08:00
David Zafman
1841928e28 test: Add test for requested scrub priority
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-14 23:57:20 -08:00
David Zafman
5f1a7ef029 osd: Prioritize user specified scrubs
Fixes: http://tracker.ceph.com/issues/37269

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-14 23:57:20 -08:00
Kefu Chai
0534786b9d
Merge pull request #24901 from wjwithagen/wjw-fix-rbd-ggate-cmake
tool: link rbd-ggate against librados-cxx

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:40:04 +08:00
Kefu Chai
01409a542c
Merge pull request #25060 from mooncak/fix_typos
doc: Fix some typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:29:39 +08:00
Kefu Chai
052b0f4614
Merge pull request #24999 from MrStupnikov/master-docfix-1358
doc: Put command template into literal block

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:14:03 +08:00
Kefu Chai
c3d13aab43 erasure-code/lrc: error out if "l == 0"
l (locality) should not be 0, and k+m should be multiple of it

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
5b70ba8cdf erasure-code: return error using ss not derr
log is not very visible from user's perspective. we'd better return the
error message using the input parameter, if the technique is
unsupported.

also, remove the trailing newline, as `ss` will be sent back to user,
it's the the front-end's responsibility to format the error message.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
2b13c7f7e9 tests: do not check for invalid k/m combinations
This reverts commit c5bafae6fd.

in 37f73607 and 3ec41030, we detect invalid "k". and we should always
detect invalid combinations of parameters in
ErasureCodeInterface::init(), and return -EINVAL instead of "autotune" them
as put in the commit message of c5bafae6, if the profile is invalid for
given erasure plugin. so ErasureCodeBench::encode() and
ErasureCodeBench::decode() will bail out with the error message returned by
ErasureCodeInterface::init() if the parameters are not valid.

also, i checked all ErasureCodeInterface::init() implementations, none
of them is overwriting the settings without returning a non-zero return
code. so we are not overriding or autotuning the settings specified by
user.

Fixes: http://tracker.ceph.com/issues/16500
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
83762041a4 tests: use stoi() instead of atoi()
stoi() is simpler if we need to convert std::string to integer.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
d143450450
Merge pull request #24996 from mcv21/bug/note_file_move
debian: correct ceph-common relationship with older radosgw package

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:28:47 +08:00
Kefu Chai
994229ac51
Merge pull request #25048 from swinds24/master_fix_36764
ceph-mgr: hold lock while accessing the request list and submitting request

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:26:53 +08:00
Kefu Chai
578f7e082e
Merge pull request #24458 from rzarzynski/wip-osd-drop-osd_instructions
osd: drop the unused request_redirect_t::osd_instructions

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:16:05 +08:00
Kefu Chai
ac48b5659d
Merge pull request #24141 from liu-chunmei/ceph_seastar_perfcounter
common,crimson: port perfcounters to seastar

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:13:39 +08:00
Kefu Chai
a04691031c
Merge pull request #24858 from jecluis/wip-pr-19983-tests
qa/cephtool: test bounds on pool's `hit_set_*`

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:12:09 +08:00
Kefu Chai
5965aff12e
Merge pull request #25106 from tchaikov/wip-qa-envlibrados
qa: fix upgrade tests and test_envlibrados_for_rocksdb.sh

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-15 14:06:54 +08:00
Kefu Chai
85c65a58cc tools/ceph_kvstore_tool: do not open rocksdb when repairing it
before this change, the `need_open_db` parameter is passed to the
constructor of BlueStore as `min_alloc_size`. and rocksdb will fail to
repair because Repairer::Run() also tries to acquire the db lock, and it
will fail to do so if the lock file is already acquired by
BlueStore::_mount().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:02:05 +08:00
Kefu Chai
60dc1c2a32 qa: patch rocksdb the right way
quote from patch(1)

>       but usually just
>
>       patch -pnum <patchfile

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 13:03:00 +08:00
Neha Ojha
d46a472915
Merge pull request #24979 from neha-ojha/wip-upgrade-bug
doc/releases/mimic.rst: make note of 13.2.2 upgrade bug

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-14 20:51:55 -08:00
Kefu Chai
bbdb569666
Merge pull request #25072 from tchaikov/wip-silence-sign-compare
os/tests: silence -Wsign-compare warning

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-11-15 12:09:49 +08:00
Kefu Chai
2dc0f86227 qa: use FOUND_VAR to be backward compatible with cmake 2.8.12
before this change, we assume that the variable set if rados::radospp is
found will be radospp_FOUND, but this is a feature cmake 3, see
https://cmake.org/cmake/help/v3.3/module/FindPackageHandleStandardArgs.html

while the cmake shipped by centos is cmake 2.8.12, where the variable
name will be <UPPERCASED_NAME>_FOUND, see
https://cmake.org/cmake/help/v2.8.12/cmake.html#module:FindPackageHandleStandardArgs

in the test of test_envlibrados_for_rocksdb.sh, we are using cmake not
the cmake3 offered by EPEL7, so RADOSPP_FOUND will be set instead. that's why
executable env_librados_test will fail to link against rados::radospp.
as rados::radospp won't be defined if radospp_FOUND is not defined/set.

after this change, the 2nd mode of FIND_PACKAGE_HANDLE_STANDARD_ARGS()
is used instead to ensure that radospp_FOUND is defined even if cmake
2.8.12 is used.

also, the message() commands for debugging purpose are removed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 11:57:52 +08:00
Kefu Chai
ae36a61446 qa/suites: add librados2 to "extra_packages" for upgrade tests
we use the playbook of "testnodes.yml" defined by ceph-cm-ansible for
initializing test nodes, and the role of "testnode" is used by
testnodes.yml. "testnode" requires "qemu-system-x86" or "qemu-kvm"
package to be installed. the qemu in turn depends on librbd1 and
librados2.

before librados3 was introduced, this worked perfectly. because in ceph
repo, qa/packages/packages.yaml defines the default set of packages the
"install" tasks should install. and in that yaml file, librados2 was
listed. so the package management system will overwrite the librados2
installed by ansible playbook with the version specified by the
"install" task, as apt/yum thinks this is what user requires explicitly,
so it's fine to install a different version of librados2.

after librados3 was introduced, librados2 was removed from
qa/packages/packages.yaml. because, by default, we need to install
librados3 instead of librados2 for ready a nautilus cluster. but the
problem is, the packge list also applies to "install" tasks installing
releases before nautilus, where we still need to replace the librados2
installed by ansible.

so, to address this issue, "librados2" is added to "extra_packages" of
the "install" tasks of tests installing old releases to install
librados2 explicitly instead of as a dependency of other ceph packages
like librbd1.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 11:56:24 +08:00
xie xingguo
432f194355 mgr/DaemonServer: add js-output for "ceph osd safe-to-destroy"
E.g.:
 - case 1:
$ceph osd safe-to-destroy 0 1 2 -f json-pretty
Error EAGAIN: 12 pgs have unknown state; cannot draw any conclusions

 - case 2:
$ceph osd safe-to-destroy 0 1 2 -f json-pretty
{
    "safe_to_destroy": [
        0,
        1,
        2
    ],
    "active": [],
    "missing_stats": [],
    "stored_pgs": []
}

 - case 3:
$ceph osd safe-to-destroy 0 1 2 -f json-pretty
{
    "safe_to_destroy": [],
    "active": [
        0,
        1,
        2
    ],
    "missing_stats": [],
    "stored_pgs": []
}

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-11-15 11:02:01 +08:00
Tiago Melo
5623e216fd mgr/dashboard: Trim HTML translations
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-11-14 18:53:03 +00:00
Tiago Melo
33296a7676 mgr/dashboard: Add locale files
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-11-14 18:53:03 +00:00
Tiago Melo
c556795811 mgr/dashboard: Use I18N in TypeScript strings
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-11-14 18:53:03 +00:00
Tiago Melo
1b6efc52a5 mgr/dashboard: Add missing HTML translations
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-11-14 18:53:03 +00:00