Commit Graph

104085 Commits

Author SHA1 Message Date
Casey Bodley
d5863f5c2b qa/rgw: use 'testing' kms backend for other rgw subsuites
resolves test failures under rgw/{multifs,thrash,website} similar to
https://github.com/ceph/ceph/pull/30940

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-11-05 09:02:50 -05:00
Casey Bodley
3e718d3f4f
Merge pull request #31363 from cbodley/wip-qa-rgw-ec-is-fast-again
qa/rgw: remove whitelist for SLOW_OPS against ec pools

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-11-05 08:52:10 -05:00
Sage Weil
6be3ef3f25 osd: send smart asok result to stdout, not stderr
Uncross the streams!

Reported-by: Patrick Seidensal <pseidensal@suse.com>
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-05 07:34:07 -06:00
Sage Weil
aa010d47ef Merge PR #31321 into master
* refs/pull/31321/head:
	ceph-daemon: do not relabel system directories
2019-11-05 07:08:09 -06:00
Sage Weil
456417d3ba Merge PR #31342 into master
* refs/pull/31342/head:
	qa/standalone/test_ceph_daemon: fix multi-version python test

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-11-05 07:07:06 -06:00
Sebastian Wagner
a70ec42cad mgr/orchestrator: Improve ceph CLI for blink lights
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-11-05 13:55:12 +01:00
Varsha Rao
3cd8ba6c46 mds: Fix MDCache.h reorder compiler warnings
Fixes: https://tracker.ceph.com/issues/42642
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-11-05 18:07:49 +05:30
Nathan Cutler
626daf4b20
Merge pull request #30598 from smithfarm/wip-doc-releases-toc
doc/releases: access main releases page from top-level TOC

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-11-05 13:18:25 +01:00
Kefu Chai
5830813f2e
Merge pull request #31291 from liewegas/bug-42578
mgr/ActivePyModules: behave if a module queries a devid that does not exist

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-05 04:17:17 -08:00
Kefu Chai
b1180766e5
Merge pull request #31230 from aclamk/fix-rados-put-truncate
tools/rados: prevent 'put' operation from recreating object when --offset=0

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-05 04:16:25 -08:00
Sebastian Wagner
157fb06fac mgr/orchestrator: check for DEVICE_{IDENT|FAULT}_ON
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-11-05 13:02:29 +01:00
Sebastian Wagner
b14ae26a69 mgr/orchestrator: Add interface and tests to device lights
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-11-05 13:02:29 +01:00
Sage Weil
07faf3b991 mgr/orchestrator_cli: 'ceph device {fault,ident}-{on,off}', 'ceph device ls-lights'
Add generic CLI commands to turn device lights on and off.

These will call out to orchestrator stubs, once it has the appropriate hook
implemented, which will in turn call out to salt or rook or ssh or whatever
to actually turn a light on or off.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-05 13:02:29 +01:00
Nathan Cutler
b205cf9973
Merge pull request #31366 from smithfarm/wip-cbs-4
ceph-backport.sh: implement interactive setup routine and new options

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-11-05 12:38:56 +01:00
Lenz Grimmer
0c978210ed
mgr/dashboard: Fix iSCSI Target's validation (#30894)
mgr/dashboard: Fix iSCSI Target's validation

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-11-05 11:22:02 +00:00
Lenz Grimmer
03b07c5a57
mgr/dashboard: Fix OSD's safe_to_destroy method (#30499)
mgr/dashboard: Fix OSD's safe_to_destroy method

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-11-05 11:21:16 +00:00
Kiefer Chang
83dffd3f85
mgr/dashboard: disable pg_autoscale for new pools in e2e tests
The pg_autoscaler might interfere the editing pool e2e test, disable the
global config to avoid this problem.

Fixes: https://tracker.ceph.com/issues/42608
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-11-05 18:38:29 +08:00
Patrick Donnelly
fe35cb1b7e
mds: clarify comment
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-11-05 00:38:58 -08:00
Patrick Donnelly
cf2c39ec9d
Merge PR #30835 into master
* refs/pull/30835/head:
	mds: no assert on frozen dir when scrub path

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-11-04 22:29:29 -08:00
Patrick Donnelly
dcc2c1da86
Merge PR #30915 into master
* refs/pull/30915/head:
	mds: Reorganize class members in MDSAuthCaps header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-11-04 22:27:53 -08:00
Patrick Donnelly
2119809bb7
Merge PR #30745 into master
* refs/pull/30745/head:
	mds: Reorganize class members in MDCache header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-11-04 22:23:07 -08:00
Patrick Donnelly
76493421d2
Merge PR #31330 into master
* refs/pull/31330/head:
	messages: protect CephFS messages get/put methods
	messages: protect MClientCapRelease cons
	messages: simplify MMDSCacheRejoin default cons
	mds: simplify type declarations

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-04 22:21:33 -08:00
Patrick Donnelly
372b6350ba
pybind/mgr/pg_autoscaler: implement shutdown method
Otherwise the mgr cannot shutdown because it waits for the pg_autoscaler
thread forever.

Fixes: https://tracker.ceph.com/issues/42640
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-11-04 22:14:42 -08:00
chenpan
c4888dce66 cls/rbd: add snapshot limit UINT64_MAX test case
Signed-off-by: Chen Pan <chenpan@cmss.chinamobile.com>
2019-11-05 10:07:13 +08:00
Sage Weil
614e9b4109 src/CMakeLists: remove leading 'v' from 'git describe' version
git describe gives you something like 'v15.0.0-6865-g7e4ef7f8ecc' but we
want no leading v, to match prior versions of ceph.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 16:56:45 -06:00
Casey Bodley
5a15148b7b
Merge pull request #31374 from cbodley/wip-qa-rgw-multisite-sse
qa/rgw: use 'testing' kms backend for multisite tests

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-11-04 13:45:24 -05:00
Nathan Cutler
b33f788790 ceph-backport.sh: increment the version number
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-11-04 19:33:44 +01:00
Nathan Cutler
22b27c8c93 ceph-backport.sh: delete deprecated config file after setup complete
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-11-04 19:33:44 +01:00
Nathan Cutler
c250cf2589 ceph-backport.sh: implement interactive setup routine and new options
This commit implements several new features:

* a --cherry-pick-only option
* a --force option
* an --existing-pr option
* an interactive setup routine

The --cherry-pick-only option can be used to test whether a backport
cherry-picks cleanly, for example. This is the same as the --prepare
functionality that was provided by an earlier version of the script, and
--prepare is re-introduced as a synonym for --cherry-pick-only.

The --force option can be used to make the script less careful (less
"cowardly"). For example, if the script refuses to do a backport because the
backport tracker issue is assigned to someone else, the script will "cowardly"
refuse to continue. Use --force to override. Be aware that --force will also
blow away an existing wip branch - the script asks for user confirmation in this
case.

The new --existing-pr option can be used to specify the number (ID) of an
existing backport PR that addresses the backport tracker issue given via the
positional argument.

The new "interactive setup routine" should make the setup process much simpler
for the user. If there is a setup issue, the script produces a report and starts
the interactive setup routine, which prompts the user for the needed
information.

Also, the script no longer requires the user to explicitly provide values for
github_user and redmine_user_id. Instead, it divines the correct values from the
GitHub token and the Redmine key, respectively.

Finally, the existing ~/bin/backport_common.sh file is deprecated in favor of
two files:

    ~/.github_token
    ~/.redmine_key

(The latter is already used by Sage's build-integration-branch tool and it
didn't make sense to have two different configuration files for a single
purpose.)

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-11-04 19:33:40 +01:00
Casey Bodley
ad4ff5f948 qa/rgw: use 'testing' kms backend for multisite tests
a missing piece from https://github.com/ceph/ceph/pull/30940

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-11-04 12:49:07 -05:00
Sebastian Wagner
be6b09feb2
Merge pull request #31192 from sebastian-philipp/run_mypy-0.740
script/run_mypy: Support mypy 0.740

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-11-04 17:37:40 +01:00
Tiago Melo
534b202f40 mgr/dashboard: Improve position of MDS chart tooltip
The previous position was overlapping the data points.

Fixes: https://tracker.ceph.com/issues/42623

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-11-04 15:36:07 -01:00
Sage Weil
8afa48835e Merge PR #31341 into master
* refs/pull/31341/head:
	ceph-daemon: only set up /var/run/ceph/$fsid if it exists

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-11-04 10:34:57 -06:00
Sage Weil
abbe73c77b Merge PR #31331 into master
* refs/pull/31331/head:
	ceph-daemon: Use `shutil` to move/copy files

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-11-04 10:34:43 -06:00
Sage Weil
3507d74336 Merge PR #31353 into master
* refs/pull/31353/head:
	doc/orchestrator: Fix various issues in Orchestrator CLI documentation

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-11-04 10:33:04 -06:00
Sage Weil
ce729f4023 Merge PR #31329 into master
* refs/pull/31329/head:
	ceph-daemon: Fix `ls` cmd for legacy confs

Reviewed-by: Sage Weil <sage@redhat.com>
2019-11-04 10:27:04 -06:00
Michael Fritch
ddaa81e93e
ceph-daemon: Fix ls cmd for legacy confs
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-11-04 09:22:01 -07:00
Sage Weil
3a0edae654 Merge PR #31328 into master
* refs/pull/31328/head:
	ceph-daemon: raise RuntimeError when CephContainer.run() fails
2019-11-04 10:17:05 -06:00
Michael Fritch
62f781d3c5
ceph-daemon: Use shutil to move/copy files
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-11-04 09:07:20 -07:00
Michael Fritch
f956c45851
ceph-daemon: raise RuntimeError when CephContainer.run() fails
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-11-04 08:54:09 -07:00
Sage Weil
79041e03f3 ceph-daemon: make rm-daemon reset-failed
We did this with rm-cluster and forgot to update rm-daemon too.  Also,
switch to call instead of call_throws.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 09:41:14 -06:00
Sage Weil
3a1ac3ff6a ceph-daemon: make rm-cluster handle failed unit cleanup
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 09:36:02 -06:00
Casey Bodley
d08342b8cb qa/rgw: remove whitelist for SLOW_OPS against ec pools
now that https://tracker.ceph.com/issues/41834 is resolved, we can
enforce the SLOW_OPS failures again in ec pool testing

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-11-04 10:12:23 -05:00
Lenz Grimmer
7e4ef7f8ec
mgr/dashboard: Automatically use correct chromedriver version (#31352)
mgr/dashboard: Automatically use correct chromedriver version

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-11-04 14:31:37 +00:00
Sage Weil
9a01f1dcbb Merge PR #31292 into master
* refs/pull/31292/head:
	mgr/ssh: fix remove_mds exception
	doc/mgr/orchestrator_cli: remove extra characters after checkmarks
	doc/mgr/orchestrator_cli: no {stop,start,restart} for all the random svcs
	mgr/ssh: add 'redeploy' operation
	ceph-daemon: stop + reset-failed existing unit on daemon deploy
	ceph-daemon: make second call arg optional
	ceph-daemon: make 'deploy' on mon only to mkfs step is mon doesn't yet exist
	mgr/ssh,orchestrator_cli: add 'restart' service action
	mgr/ssh: service[-instance] [start|stop]
	mgr/ssh: simplify get_services call for 'mds update'
	mgr/ssh: make _get_services take service *id* or service *name*
	mgr/ssh: fix 'service ls' on stopped services
	mgr/ssh: move some code around
	doc/mgr/orchestrator_cli: 'service ls' works for ssh
	doc/mgr/orchestrator_cli: we already completed mds ops for rook+ssh

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-11-04 08:17:16 -06:00
Sage Weil
e019f5fe58 mgr/ssh: fix remove_mds exception
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Sage Weil
a78ece253d doc/mgr/orchestrator_cli: remove extra characters after checkmarks
Not sure what those were.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Sage Weil
3f2f38cee9 doc/mgr/orchestrator_cli: no {stop,start,restart} for all the random svcs
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Sage Weil
f37a05a46d mgr/ssh: add 'redeploy' operation
This will stop, reprovision container, and restart. For most daemons, that
means we can

 - change the container image
 - refresh the config
 - refresh the keyring

For OSDs, it means we also re-run ceph-volume activate.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00
Sage Weil
d3f870ebb8 ceph-daemon: stop + reset-failed existing unit on daemon deploy
Normally it won't exist, but it will on a re-deploy.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-04 08:03:48 -06:00