Commit Graph

93908 Commits

Author SHA1 Message Date
Jeff Layton
fa4f63be66 mgr/rook: add a context manager instead of open-coding exception handling
Suggested-by: Sebastian Wagner <sebastian.wagner@suse.com>
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-01-14 07:05:03 -05:00
Sebastian Wagner
80b3a05c33 mgr/orchestrator: Improve docstrings, add type hinting
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-01-14 12:10:23 +01:00
Sebastian Wagner
b0d0c669f7
Merge pull request #25492 from sebastian-philipp/orchestrator-common-metaclass
pybind/mgr: Unified bits of volumes and orchestrator

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-01-14 12:03:33 +01:00
Ricardo Dias
fdb34f80f4
mgr/dashboard: access_control: change CLI commands declaration
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-01-14 10:48:28 +00:00
Ricardo Dias
a5e9eb0189
mgr/mgr_module: @CLICommand decorator for declaring CLI commands
Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-01-14 10:48:28 +00:00
xie xingguo
c25cd44c6a mgr/balancer: auto balance a list of pools
Add support which limits the auto balancer to a comma-separated list of pools.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-01-14 18:23:41 +08:00
Lenz Grimmer
f3b7d14bb1
Merge pull request #25909 from votdev/issue_37862
mgr/dashboard: Confusing tilted time stamps in the CephFS performance graph

Reviewed-by: Stephan Müller <smueller@suse.com>
2019-01-14 11:16:25 +01:00
Abhishek L
f9374b92fb
Merge pull request #23729 from daikk115/master
docs: Fixed swift client authentication fail

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-14 11:00:27 +01:00
Lenz Grimmer
73abdcfd82
Merge pull request #25913 from s0nea/wip-dashboard-test_full_health-fix
mgr/dashboard: Fix test_full_health test

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-01-14 10:27:47 +01:00
Lenz Grimmer
9cbf2d9e09
Merge pull request #25905 from s0nea/wip-dashboard-osd-add-flag-fix
mgr/dashboard: Provide all four 'mandatory' OSD flags

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-01-14 10:27:29 +01:00
Xie Xingguo
96a20b7899
Merge pull request #25859 from xiexingguo/wip-async-no-force-renew-auth
msg/async: do not force updating rotating keys inline

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-14 16:59:49 +08:00
Xie Xingguo
1c845f3c32
Merge pull request #25930 from xiexingguo/wip-invalid-upmap-access
osd/OSDMap: potential access violation fix

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-14 16:38:53 +08:00
Sage Weil
b59d74023b Merge PR #25933 into master
* refs/pull/25933/head:
	common/numa: remove stray debug output

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-13 09:09:38 -06:00
xie xingguo
df2e01f496 osd/OSDMap: potential access violation fix
Seems we'll continue to access the iterator after it is invalidated
by the __erase__ method.
Also this is more efficient considering there could be some extreme
ec-pool (e.g., 8 + 2) consumers..

Fixes: http://tracker.ceph.com/issues/37881
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-01-13 09:17:07 +08:00
Jason Dillaman
82994c464d
Merge pull request #25931 from yangdongsheng/journal_import
rbd: fix a typo in error output

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-12 13:57:56 -05:00
Sage Weil
cda6699b76 common/numa: remove stray debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-12 10:32:46 -06:00
Sage Weil
b73ef78363 Merge PR #25902 into master
* refs/pull/25902/head:
	qa/standalone/mon/mon-handle-forward: fix grep path and check return results
	mon/MonClient: be less aggressive/paranoid about reopening mon connections

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-01-12 10:26:32 -06:00
Sage Weil
42c9ee9eb6 Merge PR #25884 into master
* refs/pull/25884/head:
	msg/async: better debug output

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-01-12 10:26:16 -06:00
Sage Weil
d0bf18379c Merge PR #25917 into master
* refs/pull/25917/head:
	qa/suites/rados/multimon/tasks/mon_recovery: whitelist PG_AVAILABILITY

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-12 10:25:57 -06:00
Mykola Golub
f1b2c6a841 test/rbd_mirror: wait for release leader lock fully complete
Previously the wait context was completed at post_release_lock
stage, which still was not the end of the lock releasing process.

Fixes: https://tracker.ceph.com/issues/37883
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-01-12 16:03:31 +00:00
Sage Weil
94620be57c Merge PR #25273 into master
* refs/pull/25273/head:
	doc/rados/operations/health-checks: Add LARGE_OMAP_OBJECTS

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-12 05:56:41 -06:00
Sage Weil
646a468e12 Merge PR #25828 into master
* refs/pull/25828/head:
	osd, mgr, mds: make timeout of updating rotating keys configurable

Reviewed-by: yanjun <yan.jun8@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-12 05:45:46 -06:00
Sage Weil
9a32d5ba1f Merge PR #25886 into master
* refs/pull/25886/head:
	qa/tasks/rebuild_mondb: use monmap to properly name the mons
	ceph-monstore-tool: add --monmap <path> argument to rebuild command
	ceph-mon: dump monmap to debug logs
	Revert "mon/MonMap: no noname- mon name prefix when for_mkfs"
	mon/MonMap: improve/fix initial monmap generation for mkfs
	ceph-mon: make membership check with public_addr more robust
	ceph-mon: make mkfs check whether I am in monmap more robust

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-12 05:44:00 -06:00
Sage Weil
ed56c86b1c Merge PR #25806 into master
* refs/pull/25806/head:
	mgr: diskprediction_cloud Add nvme devcie support

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-12 05:13:32 -06:00
Ilya Dryomov
fce08ffbab
Merge pull request #25662 from yangdongsheng/abort_on_full
rbd: introduce abort_on_full option for rbd map

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2019-01-12 10:29:56 +01:00
Dongsheng Yang
5639a8b187 rbd: introduce abort_on_full option for rbd map
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2019-01-12 03:42:15 -05:00
Dongsheng Yang
c341d9b86a rbd: fix a typo in error output
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2019-01-12 03:00:36 -05:00
Brad Hubbard
522a21ec62 doc/rados/operations/health-checks: Add LARGE_OMAP_OBJECTS
Document LARGE_OMAP_OBJECTS health check

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-01-12 12:16:47 +10:00
Patrick Donnelly
6dfa87f65c
mds: convert const char ptr to string_view
Trivial refactor.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-11 15:26:33 -08:00
Neha Ojha
995f320fc6
Merge pull request #25924 from neha-ojha/wip-fix-scrub-doc
doc/rados/configuration: add osd scrub {begin,end} week day

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-11 15:05:02 -08:00
Patrick Donnelly
e62b335622
common/TrackedOp: use string_view interface
Also, don't store pointers to strings outside. The interface was written to
optimize for string literals but this is structurally unsafe programming.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-11 14:58:51 -08:00
Sage Weil
c18a5d2e1c qa/tasks/rebuild_mondb: use monmap to properly name the mons
We used to rely on the monmap bootstrap code to magically create a valid
monmap with named mons because our old-style ceph.conf had mon_addr
values in each mon.foo section.  Instead, just feed it a real monmap
from pre-destruction.

In practice, a user can manually generate this monmap, or rename the
mons after the fact with --inject-monmap, or whatever.  Out of scope
for this test, so we just do the simplest thing to make the rebuild test
work.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 16:10:14 -06:00
Sage Weil
b6b7ef8af4 ceph-monstore-tool: add --monmap <path> argument to rebuild command
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 16:10:14 -06:00
Sage Weil
65fb65c1ce ceph-mon: dump monmap to debug logs
Verbosely during mkfs, at level 10 on normal startup.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 16:10:14 -06:00
Jason Dillaman
6e261774ce mgr/dashboard: incorporate RBD overall performance grafana dashboard
Fixes: http://tracker.ceph.com/issues/37867
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 16:41:48 -05:00
Jason Dillaman
f4ac899950 monitoring/grafana: new RBD overview dashboard page
This page pulls RBD stats from the Natuatilus prometheus exporter.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 16:41:46 -05:00
Neha Ojha
3659a8c5f6 doc/rados/configuration: add osd scrub {begin,end} week day
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-01-11 12:55:51 -08:00
Casey Bodley
000797941f rgw: sanitize customer encryption keys from log output in v4 auth
Fixes: http://tracker.ceph.com/issues/37847

CVE-2018-16889

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-01-11 14:50:58 -05:00
Jason Dillaman
fad75f10f4
Merge pull request #24427 from thmour/thmour_api_purge
librbd: add trash purge api calls

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 14:43:08 -05:00
Jason Dillaman
0d8b41f10d
Merge pull request #25908 from trociny/wip-dperf-bytes
mgr: change 'bytes' dynamic perf counters to COUNTER type

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 14:42:40 -05:00
Mark Nelson
832be4f44c kv/KeyValueDB: Move PriCache implementation to ShardedCache.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2019-01-11 13:02:28 -06:00
Sage Weil
ed70f50b49 msg/async: better debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 12:31:35 -06:00
Neha Ojha
7c081e0fc8
Merge pull request #25887 from neha-ojha/wip-hide-flag
include/rados.h: hide CEPH_OSDMAP_PGLOG_HARDLIMIT from ceph -s

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
2019-01-11 09:21:50 -08:00
Sage Weil
af435783b4 qa/suites/rados/multimon/tasks/mon_recovery: whitelist PG_AVAILABILITY
The mgr creates a pool for device health, and mons may be thrashing and
make peering slow.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 09:43:07 -06:00
Jason Dillaman
504f4e78ef librbd: tweaked trash purge API
Removed the internal usage of the public librbd API, avoided double-opening
image to determine data pool, and fixed issues with the unit test case.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 10:40:54 -05:00
Sage Weil
d037c7a20f mon/ConfigMonitor: add 'config generate-minimal-conf' command
Generate a minimal ceph.conf that should be sufficient for any client
or server-side node.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 09:13:58 -06:00
Tatjana Dehler
146175a872 mgr/dashboard: Fix test_full_health test
Fixes: http://tracker.ceph.com/issues/37872
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-01-11 16:12:59 +01:00
Sage Weil
320c154618 common/options: add FLAG_MINIMAL_CONF
Mark a few auth options that would go in ceph.conf.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-11 09:10:42 -06:00
Jason Dillaman
a3155c3fc2 cls/rbd: reduce erroneous error messages when omap keys don't exist
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-01-11 09:18:45 -05:00
Julien Collet
4d281f8321 test/librbd: fix librbrd test relative to trash purge
Signed-off-by: Julien Collet <julien.collet@cern.ch>
2019-01-11 09:18:45 -05:00