Commit Graph

6148 Commits

Author SHA1 Message Date
Sage Weil
a7988dfd3f Merge PR #32988 into master
* refs/pull/32988/head:
	qa/tasks/ceph: only re-request scrub on unscrubbed pgs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 21:56:05 -06:00
Sage Weil
2954c607b7 Merge PR #32958 into master
* refs/pull/32958/head:
	qa/suites/rados/singleton/all/lost-unfound*: whitelist SLOW_OPS

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 11:01:24 -06:00
Sage Weil
f10cc22c60 Merge PR #32961 into master
* refs/pull/32961/head:
	qa/standalone/osd/osd-bench: debug bluestore

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:17 -06:00
Sage Weil
32a36f9c75 Merge PR #32968 into master
* refs/pull/32968/head:
	qa/suites/rados/verify: debug monc = 20

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:05 -06:00
Sage Weil
1dc2a8a09e qa/tasks/ceph: only re-request scrub on unscrubbed pgs
If we haven't scrubbed everything, we occasinoally re-request scrub in case
the request was missed by the OSD (this can happen).  But we were
re-requesting scrub on ALL pgs, and if they are done in a
semi-deterministic order and are slow, then we may never get to the final
ones.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 10:22:49 -06:00
Sage Weil
88c49d483a Merge PR #32969 into master
* refs/pull/32969/head:
	qa/suites/rados/cephadm: explicitly test many distros

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-01-30 08:28:25 -06:00
Patrick Donnelly
2931433cd1
Merge PR #32854 into master
* refs/pull/32854/head:
	qa: fix testing kernel branch link

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-30 06:25:25 -08:00
Sage Weil
68d3c86106 Merge PR #32972 into master
* refs/pull/32972/head:
	python-common/ceph/deployment/translate: use 'prepare' instead of 'batch' for trivial case
	qa/tasks/cephadm: pass short dev name to osd prepare
	mgr/cephadm: fix detection of just-created OSDs
	mgr/cephadm: properly indent raise conditions
	mgr/cephadm: add warning to other orchestrators
	mgr/cephadm: separate acceptance criterias for Devices
	mgr/cephadm: fix typos
	mgr/cephadm: move utils in test/utils.py
	mgr/ssh: increase disk size to 20G
	drivegroups: add support for drivegroups + tests
	mgr/orch_cli: allow multiple drivegroups
	drivegroups: translate disk spec to ceph-volume call

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-01-30 07:01:47 -06:00
David Zafman
6bb36f862f
Merge pull request #32945 from dzafman/wip-43864
test: Update pg log test for new trimming behavior

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-29 16:03:44 -08:00
Sage Weil
b119fc5f18 qa/suites/rados/cephadm: explicitly test many distros
Include _latest.yaml in a few cases here to be a bit future-proof.

cephadm-smoke/ is *just* a cephadm bring-up, and includes el7.  cephadm/
installs packages and runs a real workload.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 13:41:59 -06:00
Sage Weil
1ce0b70cc0 Merge PR #32943 into master
* refs/pull/32943/head:
	qa/tasks/ceph_manager: fix chmod on log dir during pg export copy

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-29 10:34:09 -06:00
Sage Weil
8e3eb592b0 qa/suites/rados/verify: debug monc = 20
Hunting https://tracker.ceph.com/issues/43882

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 09:53:41 -06:00
Sage Weil
b99e506a3f qa/standalone/osd/osd-bench: debug bluestore
Looking for https://tracker.ceph.com/issues/43888

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 07:43:41 -06:00
Sage Weil
c227b5d831 Merge PR #32940 into master
* refs/pull/32940/head:
	qa: remove rados/basic/tasks/rgw_snaps.yml

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-01-29 07:23:34 -06:00
Sage Weil
f4156aea10 qa/suites/rados/singleton/all/lost-unfound*: whitelist SLOW_OPS
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 07:11:15 -06:00
David Zafman
e18519ad09 test: Update pg log test for new trimming behavior
Fixes: https://tracker.ceph.com/issues/43864

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-28 15:23:45 -08:00
Sage Weil
f026a1c9f6 qa/tasks/cephadm: pass short dev name to osd prepare
Zap needs a full path, but create/prepare needs the VG/LV
only if it is an existing LV.

We'll make c-v more friendly later.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-28 14:21:53 -06:00
Sage Weil
9a4dd1fb3d qa/tasks/ceph_manager: fix chmod on log dir during pg export copy
With cephadm, we should chmod both /var/log/ceph and /var/log/ceph/$fsid.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-28 13:54:18 -06:00
Ali Maredia
7cf2af6e5c qa: remove rados/basic/tasks/rgw_snaps.yml
rgw_snaps tasks should not be running in the rados suite.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-01-28 14:29:27 -05:00
Yehuda Sadeh
d04ea3aab5 qa: s3a-hadoop: fix user creation
This breaks with the new more strict radosgw-admin command line parsing

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:39 -08:00
Sage Weil
ad67307ed9 Merge PR #32752 into master
* refs/pull/32752/head:
	cephadm: remove `logs` command

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-27 15:20:32 -06:00
Sage Weil
835ce72575 Merge PR #32920 into master
* refs/pull/32920/head:
	qa/suites/rados/rest: run restful test on el8

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-27 13:28:59 -06:00
Sage Weil
b0bea75ed7 Merge PR #32885 into master
* refs/pull/32885/head:
	qa/suites/rados/thrash: debug monc

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-27 11:36:37 -06:00
Sage Weil
e33f610af9 Merge PR #32851 into master
* refs/pull/32851/head:
	qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_2
	qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2020-01-27 11:05:29 -06:00
Sage Weil
674622190e qa/suites/rados/rest: run restful test on el8
For some reason the requests library has trouble connecting from
ubuntu 18.04.  I reproduced this locally on my 18.04 desktop, although
there it fails on the first API request instead of the last (as in QA).

In any case, this appears to be a client library problem.

Fixes: https://tracker.ceph.com/issues/43720
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-27 11:02:07 -06:00
Sage Weil
14d1490f58 Merge PR #32898 into master
* refs/pull/32898/head:
	qa/suites/rados/singleton/all/recovery-preemption: fix pg log length

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-27 10:37:16 -06:00
Michael Fritch
0d331fccdc
cephadm: remove logs command
Fixes: https://tracker.ceph.com/issues/43618
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-27 07:22:11 -07:00
Sage Weil
695d0be225 qa/suites/rados/singleton/all/recovery-preemption: fix pg log length
This was broken by the variable PG log lengths in
9c69c2f7cc585b5e13e4d1b0432016d38135a3de.

Disable the new option to get (roughly) the old behavior, or at least the
short logs that we want to trigger some backfill.

Fixes: https://tracker.ceph.com/issues/43810
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-27 07:42:50 -06:00
Sage Weil
05cc0d8c70 Merge PR #32853 into master
* refs/pull/32853/head:
	qa/suites/fs/upgrade: finish at octopus
	qa/suites/fs/upgrade: set min-compat-client to octopus
	qa/suites/fs/upgrade: set pg_autoscale_mode=off after upgrade

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-27 07:14:37 -06:00
Kefu Chai
fdc1e88b87 qa/workunits/rados/test_crash.sh: do not fail if coredump not found
Fixes: https://tracker.ceph.com/issues/43653
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-27 01:20:56 +08:00
Sage Weil
e04a08069f qa/suites/rados/thrash: debug monc
Hunting https://tracker.ceph.com/issues/43825

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-26 11:13:20 -06:00
Sage Weil
7ce7ac8bfc qa/suites/fs/upgrade: finish at octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-25 16:04:28 -06:00
Sage Weil
3d94bc42db qa/suites/fs/upgrade: set min-compat-client to octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-25 13:31:08 -06:00
Sage Weil
41c03aa143 qa/suites/fs/upgrade: set pg_autoscale_mode=off after upgrade
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-24 21:01:07 -06:00
Patrick Donnelly
8c52bee40d
qa: fix testing kernel branch link
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-24 15:58:41 -08:00
Sage Weil
4fda278eaf Merge PR #32750 into master
* refs/pull/32750/head:
	qa/suites/upgrade/*-x/stress-split: run latest python tests at end
	qa/tasks/ceph_manager: kludge around /var/log/ceph permissions
	mgr/pg_autoscaler: don't check anything until cluster is nautilus
	qa/suites/upgrade: install python3-* as part of final upgrade step
	qa/tasks/radosbench: only set object size if != block size
	qa/tasks/ceph: simplify mon_health_to_clog suppression during restart
	cls_hello: alias write_return_data -> writes_dont_return_data
	ceph_test_cls_hello: only do returndata test on octopus+
	qa: remove unnecessary package excludes in upgrades/nautilus*
	qa: exclude cephadm from upgrade/nautilus-x
	qa/suites/upgrade/mimic-x/parallel: fix msgr2 vs octopus ordering
	qa/suites/upgrade/nautilus-x/stress-split: fix msgr2 vs octopus ordering
	qa/suites/upgrade/mimic-x: fix msgr2 vs octopus ordering
	qa/suites/upgrade/nautilus-x: end on octopus
	qa/suites/upgrade/mimic-x: finish at octopus
	qa/suites/upgrade/nautilus-x: disable TOO_FEW_PGS warning
	qa/tasks/ceph: set mon_health_to_clog=false via mon config
	qa/suites/upgrade/mimic-x: disable TOO_FEW_PGS warning

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-24 17:21:28 -06:00
Neha
b20817795a qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_2
Fixes: https://tracker.ceph.com/issues/43807
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-24 22:42:04 +00:00
Neha
994698277b qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_1
Fixes: https://tracker.ceph.com/issues/43807
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-24 22:20:21 +00:00
Sage Weil
81fc73b24e Merge PR #32788 into master
* refs/pull/32788/head:
	qa/tasks/mgr/dashboard: set pg_num to 32
	mgr/pg_autoscaler: default to pg_num[_min] = 32

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-24 08:32:13 -06:00
Sage Weil
b3914e26bc qa/suites/upgrade/*-x/stress-split: run latest python tests at end
Use the master/test/x branch, so that we run the python3 variant of the
test.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-24 06:52:41 -06:00
Sage Weil
29d3eaa1a3 qa/tasks/ceph_manager: kludge around /var/log/ceph permissions
The ceph.py task normally makes these permissive.  But a package upgrade
can reset the permissions so that we can't read and write the temp
export files.  (We put them in these dirs now because it's alreadly
mapped out of cephadm containers to the host.)

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 21:25:08 -06:00
Sage Weil
37d107cd7e qa/suites/upgrade: install python3-* as part of final upgrade step
These are new packages, so they won't install just by upgrading the old
packages, and they are needed for some of the tests.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 21:14:31 -06:00
Sage Weil
fb991fa5f6 qa/tasks/radosbench: only set object size if != block size
This is mostly pointless, except that the -O option for objects size
used to be -o for pre-octopus, so passing -O breaks the upgrade tests.
Fortunately, the upgrades use the defaults, so we can just skate by here.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 21:14:31 -06:00
Sage Weil
be05f210e7 qa/tasks/ceph: simplify mon_health_to_clog suppression during restart
This only does one thing--do that.  More simply.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 21:14:31 -06:00
Patrick Donnelly
92c19067de
qa: update xfstests version
Building xfstests on CentOS 8 has build errors:

    2020-01-23T21:15:14.939 INFO:tasks.workunit.client.0.smithi155.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests/src/fssum.c:616: undefined reference to `major'
    2020-01-23T21:15:14.939 INFO:tasks.workunit.client.0.smithi155.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests/src/fssum.c:617: undefined reference to `minor'
    2020-01-23T21:15:14.940 INFO:tasks.workunit.client.0.smithi155.stderr:collect2: error: ld returned 1 exit status

From: /ceph/teuthology-archive/pdonnell-2020-01-23_20:47:47-fs-wip-pdonnell-testing-20200122.210533-distro-basic-smithi/4697257/teuthology.log

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-23 15:37:56 -08:00
Patrick Donnelly
4810d68a30
qa: install some dependencies for xfstests
These are needed for CentOS 8 / RHEL8.

Also organize the YAML to use the cleaner array syntax.

Fixes: https://tracker.ceph.com/issues/43459
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-23 15:37:47 -08:00
Josh Durgin
fa27ba5c9c qa: remove unnecessary package excludes in upgrades/nautilus*
These packages are present in nautilus.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-01-23 17:13:09 -06:00
Josh Durgin
ec560a69eb qa: exclude cephadm from upgrade/nautilus-x
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-01-23 17:13:09 -06:00
Sage Weil
ba31ccb533 qa/suites/upgrade/mimic-x/parallel: fix msgr2 vs octopus ordering
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 17:13:09 -06:00
Sage Weil
2adadc2356 qa/suites/upgrade/nautilus-x/stress-split: fix msgr2 vs octopus ordering
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 17:13:09 -06:00