Commit Graph

96033 Commits

Author SHA1 Message Date
Patrick Donnelly
1ceadf0f07
qa: ignore MON_DOWN for volume-client testing
The test restarts the monitors.

Fixes: http://tracker.ceph.com/issues/38704
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-12 10:38:55 -07:00
Patrick Donnelly
c859be5022
Merge PR #26892 into master
* refs/pull/26892/head:
	qa: stop testing simple messenger in CephFS suites

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-12 10:26:27 -07:00
Ricardo Dias
ecdb4604d1
Merge pull request #26503 from ricardoasmarques/iscsi-support-dots-in-name
mgr/dashboard: iSCSI - Adds support for pool/image names with dots

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-03-12 16:51:06 +00:00
Sage Weil
ccda488815 crush/CrushWrapper: ensure crush_choose_arg_map.size == max_buckets
The crush/builder.c crush_add_bucket method resizes the max_buckets array
but a power of 2 when it has to expand, but the code in CrushWrapper was
assuming that if the array grew the pos for the new bucket would be the
last position in the new array.  This led to a situation where the
crush_choose_arg_map args array size didn't match max_buckets, and
eventually caused a crash.

Fixes: http://tracker.ceph.com/issues/38664
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-12 11:26:43 -05:00
Ricardo Marques
0af071df20
Merge pull request #26891 from rjfd/wip-dashboard-iscsi-ssl
mgr/dashboard: iscsi: adds CLI command to enable/disable API SSL verification

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-03-12 16:23:42 +00:00
Casey Bodley
95ce73360b
Merge pull request #26658 from ivancich/wip-lc-prefix-fix
rgw: fix unordered bucket listing when object names are adorned

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-03-12 12:18:30 -04:00
Casey Bodley
c43465cc05
Merge pull request #26545 from ivancich/wip-rgw-gc-stall-min-fixes
rgw: resolve bug where marker was not advanced during garbage collection

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-03-12 11:59:58 -04:00
Casey Bodley
f686b5add2
Merge pull request #26601 from ivancich/wip-rgw-gc-stall-fixes
rgw: resolve bugs and clean up garbage collection code

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-03-12 11:59:35 -04:00
Casey Bodley
7ecce2b146
Merge pull request #26599 from cbodley/wip-rgw-beast-default
rgw: make beast the default for rgw_frontends

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-03-12 11:58:35 -04:00
Mykola Golub
3c378ad26e
Merge pull request #26896 from dillaman/wip-rbd-cls-warning
cls/rbd: fixed uninitialized variable compiler warning

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-03-12 17:26:12 +02:00
Sage Weil
fb915c4805 osd/PG: invalidate PG if merging with unexpected version
If the source or target PG version is 0'0, we may silently take the max
of the source and target and still leave the PG complete.  This
specifically can happen with an empty PG, as seen with bug 38655.  In
theory we could encounter one of the PGs with some other last_update
that doesn't match what we expect.  If that ever happens, make sure the
result is incomplete so that backfill can clean up.

Additionally check that the pool metadata for the last merge matches the
PGs at all.  This could mismatch if we have an osdmap gap and are forced
to do some merge without merge info at all... in which case we should
definitely invalidate: there should be newer copies of the PG(s), and we
have no idea whether the PGs we are merging are what we want.  If this is
some disaster recovery situation, an operator is always free to use
ceph-objectstore-tool to re-mark a PG complete (at their own peril!).

Fixes: http://tracker.ceph.com/issues/38655
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-12 10:08:46 -05:00
Sébastien Han
7c4f29bf4a ceph.spec.in: add libstoragemgmt to mgr package
The libstoragemgmt package is needed so we can activate the drive
blink-led feature so we should pull that package.

Signed-off-by: Sébastien Han <seb@redhat.com>
2019-03-12 15:56:12 +01:00
Lenz Grimmer
a06a2d6cf9
Merge pull request #26854 from ricardoasmarques/fix-mutual-password-input-type
mgr/dashboard: Fix iSCSI mutual password input type

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-03-12 15:39:24 +01:00
Sage Weil
7f49be2104 mon/OSDMonitor: set ec min_size to k + min(1, m - 1)
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-12 09:14:36 -05:00
Ricardo Marques
ffe3140253 mgr/dashboard: Fix iSCSI mutual password input type
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-03-12 12:56:54 +00:00
Sage Weil
ed0df5a2cb Merge PR #26906 into master
* refs/pull/26906/head:
	Typo in Nautilus release notes: not -> now

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-03-12 07:24:32 -05:00
Sebastian Wagner
f6fd7b158b
Merge pull request #26904 from SUSE/wip-orchestrator-deepsea-sharedsecret
mgr/deepsea: always use 'password' parameter for salt-api auth

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-03-12 11:51:47 +01:00
Lenz Grimmer
9f826892f8
Merge pull request #26851 from rhcs-dashboard/36176-enable-api-tests-coverage
mgr/dashboard: enable coverage for API tests
2019-03-12 11:31:05 +01:00
Ricardo Marques
9173d1f66b
Merge pull request #26669 from ricardoasmarques/iscsi-docs-disk-slash
doc/rbd/iscsi-target-cli: Update disk separator

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-12 10:29:50 +00:00
Ricardo Dias
18dd67b6ce
mgr/dashboard: tests: move helper classes to __init__.py
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-03-12 10:15:58 +00:00
Ricardo Dias
4ff8246ae7
mgr/dashboard: tests: add iscsi CLI commands testing
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-03-12 10:15:57 +00:00
Ricardo Dias
fb92b9ba2a
mgr/dashboard: tests: update tests that mock mons kv store
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-03-12 10:15:57 +00:00
Ricardo Dias
a3708cc457
mgr/dashboard: tests: add mixin classes to mock mons KV store
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-03-12 10:15:57 +00:00
Ricardo Dias
e6f3095a58
doc/mgr/dashboard: update iscsi documentation
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-03-12 10:15:56 +00:00
Ricardo Dias
5af8611501
mgr/dashboard: iscsi: use ssl_verify configuration option in restclient
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-03-12 10:15:56 +00:00
Ricardo Dias
768ea7dcbf
mgr/dashboard: iscsi: add CLI command to disable API SSL verification
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-03-12 10:15:56 +00:00
Ricardo Marques
24c9ac07ef Adds support for pool/image names with dots
According to https://github.com/ceph/ceph-iscsi/pull/29

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-03-12 09:39:32 +00:00
Yaniv Kaul
d10d278f30 Typo in Nautilus release notes: not -> now
Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
2019-03-12 11:31:27 +02:00
Tim Serong
56880b7312 mgr/deepsea: always use 'password' parameter for salt-api auth
Prior to https://github.com/saltstack/salt/commit/71d5601507, the
salt-api expected the password to be sent using the 'sharedsecret'
parameter if using shared secrets, and the 'password' parameter
for other authentication types.  The above commit unifies this so
that we always only need to use the 'password' parameter.

Signed-off-by: Tim Serong <tserong@suse.com>
2019-03-12 20:07:55 +11:00
Xie Xingguo
5b277e425b
Merge pull request #26902 from tchaikov/wip-doc-erasure-clay
doc/rados/operations: add clay to erasure-code-profile

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-03-12 16:13:51 +08:00
Kefu Chai
9f2f403553 doc/rados/operations: add clay to erasure-code-profile
so it's more visible.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-12 13:19:05 +08:00
David Zafman
51a45e796e qa/test-erasure-code.sh: Don't grep entire bluestore directory
Bluestore caused grep crash with "grep: memory exhausted" due to
size of "block" storage.

Fixes: http://tracker.ceph.com/issues/38678

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-03-11 18:47:29 -07:00
David Zafman
d4915ee503 qa: Don't create rbd pool because it creates an object
This also reverts commit 10b9626ea7.

Fixes: http://tracker.ceph.com/issues/38631

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-03-11 16:57:51 -07:00
David Zafman
8114a2619b qa: Can't wait for clean when there aren't any pools/PGs.
Fixes: http://tracker.ceph.com/issues/38678

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-03-11 16:02:48 -07:00
David Zafman
d84501fca1 mon, osd: Fix log messages (missing space, convert int to string)
Binary data was ending up in the log file which could cause
terminals to produce garbage output.

Fixes: http://tracker.ceph.com/issues/38678

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-03-11 16:02:31 -07:00
Sage Weil
6da520e075 osd,mon: include more pg merge metadata in pg_pool_t
The ones we need are source_version and target_version.  Include it in a
nice containing structure to keep things tidy.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-11 17:31:54 -05:00
Sage Weil
cca5bd545c Merge PR #26763 into master
* refs/pull/26763/head:
	mgr/diskprediction_cloud: Fixed cannot import string.maketrans in the python 3.x

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-03-11 17:29:24 -05:00
Sage Weil
f978b27d2b qa/standalone/osd/pg-split-merge.sh: reproduce pg merge problem with empty pgs
This reproduces http://tracker.ceph.com/issues/38655

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-11 17:10:28 -05:00
Sage Weil
8d424ba7c9 osd: add osd_debug_no_{acting_change,purge_strays}
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-11 17:09:52 -05:00
Jason Dillaman
ace6d39ba1 cls/rbd: fixed uninitialized variable compiler warning
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-03-11 17:01:10 -04:00
Sage Weil
29ec97d915 Merge PR #26885 into master
* refs/pull/26885/head:
	doc/releases/nautilus: add msgr2 refs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-11 15:36:34 -05:00
Sage Weil
e5697b2b0d Merge PR #26736 into master
* refs/pull/26736/head:
	mgr: push localized config handling into BaseMgr*Module
	mgr: Fix broken get_localized_module_option function

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-03-11 15:33:14 -05:00
Sage Weil
fc3bdad875 Merge PR #26856 into master
* refs/pull/26856/head:
	os/bluestore: make osd_memory_limit default to .8x the cgroup limit
	os/bluestore: observe osd_memory_target config options
	common/config: set osd_memory_target based on POD_MEMORY_REQUEST
	common/util: include group limit in daemon metadata
	common/util: get_cgroup_memory_limit() helper
	common/config: pass entity_type down into parse_env()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
2019-03-11 15:01:15 -05:00
Sage Weil
bb57b76e35 Merge PR #26879 into master
* refs/pull/26879/head:
	vstart.sh: make 'db' volume 1G instead of 64M
	os/bluestore: make bluefs spillover messages nicer

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-03-11 15:00:56 -05:00
Mykola Golub
327c07dbc8
Merge pull request #26878 from dillaman/wip-pool-init-validation
librbd: bypass pool validation if "rbd_validate_pool" is false

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-03-11 19:41:48 +02:00
Sage Weil
f83fb9aebd Merge PR #26888 into master
* refs/pull/26888/head:
	doc/releases/nautilus: add 'ceph-volume simple scan' to upgrade instructions

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-03-11 12:37:07 -05:00
Sage Weil
5c6b533697 os/bluestore: make osd_memory_limit default to .8x the cgroup limit
We do this at runtime in _set_cache_sizes so that changes to these values
at runtime will be picked up.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-11 12:33:49 -05:00
Jenkins Build Slave User
ae1b3cf8e2 14.1.1 2019-03-11 16:42:55 +00:00
Sage Weil
4ca5596a45 mgr: push localized config handling into BaseMgr*Module
We need both (1) the raw key name (in order to look up the correct option
name and transform the result into the correct type) and (2) the optional
prefix (in order to look up both possible keys).  This simplifies the
mgr_module implementation.

There is a weird mismatch between the way that BaseMgrModule and
BaseMgrStandbyModule implement this method.  I suspect they could be
unified to work the same, but I'll leave that for another day.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-11 17:25:18 +01:00
Volker Theile
bc9643657a mgr: Fix broken get_localized_module_option function
Fixes: https://tracker.ceph.com/issues/38560

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-03-11 17:25:18 +01:00