Commit Graph

108052 Commits

Author SHA1 Message Date
Jason Dillaman
bcbdd6cf69 librbd: switch to new metadata retrieval state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-02-21 09:03:09 -05:00
Jason Dillaman
b8e1c65db0 librbd: helper image-meta list state machine
Several locations in librbd re-implement the same loop to collect
all image-meta from the OSD. Consolidate it all to a single state
machine.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-02-21 09:03:09 -05:00
Sage Weil
155d1339b6 Merge PR #33441 into master
* refs/pull/33441/head:
	mgr/orchestrator: add ability to parse placementspec from strings
	mgr/volumes: add arg to fs volume create for mds daemons placement

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-20 21:40:45 -06:00
Sage Weil
3e5c1f8465 Merge PR #33443 into master
* refs/pull/33443/head:
	cephadm: prepare-host: do not create Packager unless we need it

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-20 21:40:34 -06:00
Sage Weil
bb1b96d50d Merge PR #33445 into master
* refs/pull/33445/head:
	cephadm: fix adoption safety check

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-20 21:40:23 -06:00
Sage Weil
eb55a568d7 Merge PR #33446 into master
* refs/pull/33446/head:
	cephadm: pull: strip newline from version string

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-20 21:40:13 -06:00
Jason Dillaman
4d464f7ae6
Merge pull request #32882 from trociny/wip-41559-2
rbd: add 'mirror snapshot schedule' commands

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-02-20 22:12:34 -05:00
Sage Weil
ab57d6f372 Merge PR #33450 into master
* refs/pull/33450/head:
	doc: add CephFS Octopus release notes

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-20 21:10:46 -06:00
Jason Dillaman
dba40bb01d
Merge pull request #33368 from trociny/wip-44161
rbd-mirror: don't expect image map is always initialized

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-02-20 22:09:34 -05:00
Jason Dillaman
614d62cf5c
Merge pull request #33411 from trociny/wip-44159
rbd-mirror: improve detection of blacklisted state

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-02-20 22:08:33 -05:00
Sage Weil
24f4094b73 Merge PR #33426 into master
* refs/pull/33426/head:
	mgr/dashboard: fix tasks.mgr.dashboard.test_rgw suite

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-20 20:01:55 -06:00
Patrick Donnelly
6342de27f7
doc: add CephFS Octopus release notes
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-20 17:47:14 -08:00
Sage Weil
19bbad7c33 cephadm: fix adoption safety check
The 'type' file is only required for *osds*.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-20 17:24:57 -06:00
Sage Weil
e37792205c cephadm: pull: strip newline from version string
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-20 17:18:14 -06:00
Sage Weil
4f13a52b75 Merge PR #33437 into master
* refs/pull/33437/head:
	cephadm: allow multiple get_parm() calls

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-20 16:50:51 -06:00
Daniel-Pivonka
bf20436244 mgr/orchestrator: add ability to parse placementspec from strings
Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
2020-02-20 14:46:24 -05:00
Daniel-Pivonka
2fe4f88ba0 mgr/volumes: add arg to fs volume create for mds daemons placement
add placement arg for mds daemons created by fs volume create

Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
2020-02-20 14:46:17 -05:00
Sage Weil
e9fc46166d cephadm: prepare-host: do not create Packager unless we need it
Otherwise, bootstrap may fail on an unrecognized/unsupported distro even
though all the dependencies are present.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-20 13:20:44 -06:00
J. Eric Ivancich
46fd0a3646
Merge pull request #31338 from ivancich/wip-clean-up-ordered-list
rgw: clean up ordered list

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-02-20 14:06:23 -05:00
Nathan Cutler
60b6b7a64c
Merge pull request #33338 from smithfarm/wip-qa-cephadm-smoke-opensuse
qa/cephadm/smoke: run on opensuse_15.1

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-20 18:03:52 +01:00
Nathan Cutler
652243e71e qa/cephadm: "ls -l" cephadm after downloading it
For better debugging when the download goes awry.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-20 17:26:07 +01:00
Mykola Golub
8fe22f22f3 rbd: add 'mirror snapshot schedule' commands
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-02-20 16:24:28 +00:00
Mykola Golub
a763c0eada mgr/rbd_support: rename 'dump' command to 'list'
and remove the old 'list' command -- we can live with one command.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-02-20 16:24:28 +00:00
Nathan Cutler
a0dd01bc5e qa/cephadm.py: better check for cephadm download success
When the URL passed to "curl --silent ..." does not exist, the
resulting file will be populated with the string:

    404: Not Found

If that (or something similar) happens, the file size will be
suspiciously low, like < 1000 bytes. Fail the test immediately in this
case.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-20 17:22:20 +01:00
Nathan Cutler
dcbdb28317 qa/tasks/cephadm.py: lop off .git more robustly
The line

    rest.replace('.git/', '/')

was added to accommodate weird folks who run teuthology-suite
with an option like this:

    --suite-repo https://github.com/ceph/ceph.git/

but they might just as well give the option like this:

    --suite-repo https://github.com/ceph/ceph.git

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-20 17:22:17 +01:00
Sage Weil
493515e196 cephadm: allow multiple get_parm() calls
This fixes deployment of monitoring components when the config-json is
passed via stdin.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-20 10:03:24 -06:00
Matt Benjamin
69d2aa1960
Merge pull request #31994 from pritha-srivastava/wip-rgw-assume-role-web-id-doc
rgw: adding documentation for AssumeRoleWithWebIdentity.
2020-02-20 10:58:07 -05:00
Mykola Golub
84ec26d0e4 mgr/rbd_support: return 'rbd mirror snapshot schedule status' as json
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-02-20 15:41:21 +00:00
Mykola Golub
b2e825debc
Merge pull request #33166 from dillaman/wip-43936
rbd-mirror: initial snapshot replay state machine

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-02-20 15:53:56 +02:00
Kefu Chai
e8bb2e6b83
Merge pull request #33425 from tchaikov/wip-crimson-watcher
crimson/osd: capture watcher when calling its member function

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-02-20 19:11:46 +08:00
Kefu Chai
7c23240232
Merge pull request #33423 from tchaikov/wip-doc-search
doc: fix errors in "search" page and use relative address for releases.json

Reviewed-by:  Brad Hubbard <bhubbard@redhat.com>
2020-02-20 19:09:34 +08:00
Nathan Cutler
9c238af442 qa/cephadm/smoke: run on opensuse_15.1
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-20 11:50:29 +01:00
Nathan Cutler
fbfb39d91f qa/distros: add opensuse_15.2.yaml
We don't have a FOG image for this, yet, and Shaman is not building for
it (yet), either, but we might as well get this file in place now, since
we already know it will be needed at some point.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-20 11:50:28 +01:00
Nathan Cutler
18cdd8f13d qa/distros: drop obsolete opensuse distros
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-20 11:50:28 +01:00
Sébastien Han
c0171f57d0
Merge pull request #33371 from leseb/raw-list
ceph-volume: silence 'ceph-bluestore-tool' failures
2020-02-20 11:41:01 +01:00
Lenz Grimmer
0ef8f1ec19
Merge pull request #33407 from rhcs-dashboard/coverage-venv-python-version
mgr/dashboard: coverage venv python version same as mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-02-20 10:15:02 +00:00
Alfonso Martínez
7cbee4d725 mgr/dashboard: fix tasks.mgr.dashboard.test_rgw suite
Fixes: https://tracker.ceph.com/issues/44201
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-02-20 10:47:38 +01:00
Kefu Chai
18ce15ab5e crimson/osd: capture watcher when calling its member function
otherwise the extracted node handler will be destroyed, and so does the
watcher enclosed in it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-20 16:09:22 +08:00
Kefu Chai
26a48b36f7 doc: do not use absolute address
use relative address instead, to ease the pain when testing.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-20 14:44:11 +08:00
Kefu Chai
88d6d499e0 doc: do not add suffix for search result links
since sphinx 1.5, SOURCELINK_SUFFIX is always added to the source file,
and search page always tries to add it to the highlighted source result.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-20 14:44:11 +08:00
Kefu Chai
9d2f6329b7 doc: do not try to patch #edit-on-github if not found
we add this element in _templates/page.html, which is only used for the
content pages, not in the "search" page. to avoid the js errors, just
disabled it if it's not found.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-20 14:44:11 +08:00
Sage Weil
e79e424679 Merge PR #33394 into master
* refs/pull/33394/head:
	mgr/cephadm: trigger device refresh after osd creation
	mgr/orch,cephadm: implement 'device zap'
	mgr/cephadm: remove inventory_cache
	mgr/cephadm: reimplement 'device ls' in terms of cache
	mgr/cephadm: fix invalidate helpers
	mgr/cephadm: scrape and cache devices, too
	mgr/cephadm: rename DaemonCache methods etc to generalize

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-19 16:58:47 -06:00
Sage Weil
af4bc61e28 Merge PR #33400 into master
* refs/pull/33400/head:
	mgr/progress: 'progress clear' command should clear events in 'ceph -s'

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-02-19 16:46:16 -06:00
Sage Weil
22bb246395 Merge PR #33402 into master
* refs/pull/33402/head:
	mgr/pg_autoscaler: fix division by zero

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-02-19 16:45:45 -06:00
Sage Weil
347797ff13 Merge PR #33352 into master
* refs/pull/33352/head:
	ceph.in: catch KeyboardInterrupt from outer code
	ceph.in: fix second exception on ^C

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-19 16:45:01 -06:00
Sage Weil
9b1579c74a Merge PR #33374 into master
* refs/pull/33374/head:
	cephadm: remove distutils dependency
	mgr/cephadm: add prepare-host command
	cephadm: prepare-host during bootstrap
	cephadm: add prepare-host command
	cephadm: include docker.io in image name

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-19 16:35:10 -06:00
Sage Weil
607263224c mgr/cephadm: trigger device refresh after osd creation
Presumably the new OSD(s) consumed one or more devices.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-19 14:53:47 -06:00
Sage Weil
b98fdc715f mgr/orch,cephadm: implement 'device zap'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-19 14:53:47 -06:00
Sage Weil
82e4f1e0f1 mgr/cephadm: remove inventory_cache
No longer used.

Clean up _get_hosts now that there is only one user.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-19 14:53:47 -06:00
Sage Weil
f900129c9b mgr/cephadm: reimplement 'device ls' in terms of cache
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-19 14:53:47 -06:00