Commit Graph

92123 Commits

Author SHA1 Message Date
Yuri Weinstein
f9df042c97
Merge pull request #23652 from theanalyst/rgw/awsv4/presign-slashes
rgw: s3: awsv4 drop special handling for x-amz-credential

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-16 08:06:23 -08:00
Yuri Weinstein
7fddd94dc7
Merge pull request #25003 from ivancich/wip-update-reshard-params
rgw: reshard improvements

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-16 08:03:35 -08:00
Yuri Weinstein
a6e10a44bd
Merge pull request #25102 from cbodley/wip-rgw-log-http-status
rgw: log http status with op prefix if available

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-16 08:03:09 -08:00
Alfredo Deza
fad9694f3a
Merge pull request #25007 from jan--f/c-v-dont-duplicated-rejected-reasons
ceph-volume: rename Device property valid to available

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-16 10:28:16 -05:00
Casey Bodley
5d6298b75a
Merge pull request #25002 from yehudasa/wip-rgw-svc-5
rgw: fix uninitialized access

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-16 09:57:04 -05:00
Kefu Chai
578616a389
Merge pull request #24967 from bi-shun/fix-brotli
compressor: Fix build of Brotli Compressor

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-16 22:32:08 +08:00
Lenz Grimmer
e942c96c2d
Merge pull request #24803 from tspmelo/wip-i18n
mgr/dashboard: Add i18n support

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2018-11-16 15:26:32 +01:00
Sage Weil
d69e8d8de8 Merge PR #14092 into master
* refs/pull/14092/head:
	mgr/DaemonServer: fix session leak
	mon/MonClient: ignore new mon commands while stopping
	mgr/DeviceState: fix DeviceState initial refcount
	qa/suites: valgrind ceph-mgr too

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-16 07:11:44 -06:00
Sage Weil
9989dddca3 Merge PR #25052 into master
* refs/pull/25052/head:
	mgr: lock pg_map too for osd_pool_stats and notify_osdmap
	mgr/DaemonServer: use with_osdmap_and_pgmap instead of nested calls
	mgr/ClusterState: add with_osdmap_and_pgmap

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-16 07:11:15 -06:00
BI SHUN KE
e0b33fcd85 compressor: modify brotli compression plugin.
* add "common/ceph_context.h" header file to CompressionPluginBrotli.cc
* set the brotli v1.0.7 stable version for compressor plugin use.

Signed-off-by: BI SHUN KE <aionshun@livemail.tw>
2018-11-16 21:01:40 +08:00
Alfredo Deza
9c832fdb37
Merge pull request #25092 from jan--f/c-v-inventory-doc
doc: add ceph-volume inventory sections

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-16 07:52:57 -05:00
Lenz Grimmer
d7ae646b2c
Merge pull request #25053 from rhcs-dashboard/pytest-faulthandler
mgr/dashboard: add pytest plugin: faulthandler

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
2018-11-16 12:59:37 +01:00
Sage Weil
03a761c980 mgr: lock pg_map too for osd_pool_stats and notify_osdmap
Fixes: http://tracker.ceph.com/issues/36766
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-16 04:55:43 -06:00
Sage Weil
e10cb8d2ae mgr/DaemonServer: use with_osdmap_and_pgmap instead of nested calls
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-16 04:55:43 -06:00
Kefu Chai
2271440fc8
Merge pull request #25046 from tchaikov/wip-16500
tests: do not check for invalid k/m combinations

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-11-16 18:34:24 +08:00
Lenz Grimmer
34a5ac0b19
Merge pull request #25084 from s0nea/wip-dashboard-add-missing-test-suites
mgr/dashboard/qa: add missing dashboard suites

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-11-16 11:16:42 +01:00
Jan Fajerski
047dc1c157 c-v device test: rename valid to available
Update test to reflect 8a80990471

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 09:30:32 +01:00
Jan Fajerski
d895f97bb0 inventory test: rename valid to available
Fixes test to reflect 8a80990471

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 09:30:15 +01:00
Jan Fajerski
8a80990471 ceph-volume: rename Device property valid to available
This flag is used in the inventory reporting and available is deemed more
appropriate. Furthermore this fixes a bug where rejected_reasons
accumulated duplicate entries.

Fixes: http://tracker.ceph.com/issues/36701
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 09:22:06 +01:00
Jan Fajerski
dfc0e1d9a6 doc: add ceph-volume inventory sections
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 08:35:56 +01:00
Sage Weil
13d1f62538 Merge PR #24973 into master
* refs/pull/24973/head:
	mgr: Separate diskprediction cloud plugin from the diskprediction plugin
2018-11-16 00:23:14 -06:00
Sage Weil
22b43b5b5b Merge PR #20185 into master
* refs/pull/20185/head:
	Common, log: Added functionality test for recovery after silenced (#20174)

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-16 00:22:37 -06:00
Sage Weil
d941b28089 Merge PR #19987 into master
* refs/pull/19987/head:
	qa/tasks/ceph: ignore failure when chown ceph:ceph

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-16 00:22:17 -06:00
hsiang41
9799eb67eb mgr: Separate diskprediction cloud plugin from the diskprediction plugin
Separate diskprediction local cloud from the diskprediction plugin.
Devicehealth invoke device prediction function related on the global
configuration "device_failure_prediction_mode".

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-11-16 00:15:41 -06:00
Sage Weil
a3a3eb5f84 mgr/DaemonServer: fix session leak
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-15 23:34:07 -06:00
Sage Weil
a3e82e99dd mon/MonClient: ignore new mon commands while stopping
If one thread is stopping and another threads tries to send a new mon
command, just ignore it.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-15 23:34:07 -06:00
Kefu Chai
ed5b7e779d
Merge pull request #20683 from Aran85/wip-rados-loadgen-align
tools: add offset-align option to "rados" load-gen 

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-16 13:22:16 +08:00
Kefu Chai
fc72de4cca
Merge pull request #24799 from xiexingguo/wip-js-safe-to-destroy
mgr/DaemonServer: add js-output for "ceph osd safe-to-destroy"

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-16 13:21:07 +08:00
Kefu Chai
d9f8ecd206
Merge pull request #24969 from joke-lee/doc-dump-journal-help-info
osd: add --dump-journal option in ceph-osd help info

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-16 13:19:53 +08:00
Sage Weil
60876ccce4 mgr/ClusterState: add with_osdmap_and_pgmap
Several call sites need to lock both

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-15 16:26:48 -06:00
Casey Bodley
9554f5452e
Merge pull request #24866 from linuxbox2/wip-rm-aclparser
rgw: remove rgw_aclparser.cc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-15 14:01:17 -05:00
Kefu Chai
1cb4df760e
Merge pull request #25108 from tchaikov/wip-bluestore-repair
tools/ceph_kvstore_tool: do not open rocksdb when repairing it

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-11-16 00:06:57 +08:00
Kefu Chai
0ffe51057d
Merge pull request #25070 from tchaikov/wip-25146
rocksdb: pick up a fix to be backward compatible

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-15 21:15:33 +08:00
Tatjana Dehler
ef62c5eb4e mgr/dashboard/qa: add missing dashboard suites
Fixes: https://tracker.ceph.com/issues/37152
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-11-15 11:45:56 +01:00
Kefu Chai
b187c190d8 rocksdb: pick up a fix to be backward compatible
see https://github.com/facebook/rocksdb/pull/3488

also bump up the rocksdb version to v5.17.2

Fixes: http://tracker.ceph.com/issues/25146
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 16:44:49 +08:00
Kefu Chai
0534786b9d
Merge pull request #24901 from wjwithagen/wjw-fix-rbd-ggate-cmake
tool: link rbd-ggate against librados-cxx

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:40:04 +08:00
Kefu Chai
01409a542c
Merge pull request #25060 from mooncak/fix_typos
doc: Fix some typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:29:39 +08:00
Kefu Chai
052b0f4614
Merge pull request #24999 from MrStupnikov/master-docfix-1358
doc: Put command template into literal block

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 15:14:03 +08:00
Kefu Chai
c3d13aab43 erasure-code/lrc: error out if "l == 0"
l (locality) should not be 0, and k+m should be multiple of it

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
5b70ba8cdf erasure-code: return error using ss not derr
log is not very visible from user's perspective. we'd better return the
error message using the input parameter, if the technique is
unsupported.

also, remove the trailing newline, as `ss` will be sent back to user,
it's the the front-end's responsibility to format the error message.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
2b13c7f7e9 tests: do not check for invalid k/m combinations
This reverts commit c5bafae6fd.

in 37f73607 and 3ec41030, we detect invalid "k". and we should always
detect invalid combinations of parameters in
ErasureCodeInterface::init(), and return -EINVAL instead of "autotune" them
as put in the commit message of c5bafae6, if the profile is invalid for
given erasure plugin. so ErasureCodeBench::encode() and
ErasureCodeBench::decode() will bail out with the error message returned by
ErasureCodeInterface::init() if the parameters are not valid.

also, i checked all ErasureCodeInterface::init() implementations, none
of them is overwriting the settings without returning a non-zero return
code. so we are not overriding or autotuning the settings specified by
user.

Fixes: http://tracker.ceph.com/issues/16500
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
83762041a4 tests: use stoi() instead of atoi()
stoi() is simpler if we need to convert std::string to integer.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:34:03 +08:00
Kefu Chai
d143450450
Merge pull request #24996 from mcv21/bug/note_file_move
debian: correct ceph-common relationship with older radosgw package

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:28:47 +08:00
Kefu Chai
994229ac51
Merge pull request #25048 from swinds24/master_fix_36764
ceph-mgr: hold lock while accessing the request list and submitting request

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:26:53 +08:00
Kefu Chai
578f7e082e
Merge pull request #24458 from rzarzynski/wip-osd-drop-osd_instructions
osd: drop the unused request_redirect_t::osd_instructions

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:16:05 +08:00
Kefu Chai
ac48b5659d
Merge pull request #24141 from liu-chunmei/ceph_seastar_perfcounter
common,crimson: port perfcounters to seastar

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:13:39 +08:00
Kefu Chai
a04691031c
Merge pull request #24858 from jecluis/wip-pr-19983-tests
qa/cephtool: test bounds on pool's `hit_set_*`

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:12:09 +08:00
Kefu Chai
5965aff12e
Merge pull request #25106 from tchaikov/wip-qa-envlibrados
qa: fix upgrade tests and test_envlibrados_for_rocksdb.sh

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-15 14:06:54 +08:00
Kefu Chai
85c65a58cc tools/ceph_kvstore_tool: do not open rocksdb when repairing it
before this change, the `need_open_db` parameter is passed to the
constructor of BlueStore as `min_alloc_size`. and rocksdb will fail to
repair because Repairer::Run() also tries to acquire the db lock, and it
will fail to do so if the lock file is already acquired by
BlueStore::_mount().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 14:02:05 +08:00
Kefu Chai
60dc1c2a32 qa: patch rocksdb the right way
quote from patch(1)

>       but usually just
>
>       patch -pnum <patchfile

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-15 13:03:00 +08:00