ceph/qa
Kefu Chai 104f054cee qa/suites/orch/rook/smoke: stop testing on ubuntu 18.04
even rook does not really install ceph packages in the host directly, it
uses the ceph container image. but teuthology insists on checking the
existence of debian packages by querying shaman server when it sees a
teuthology facet file which includes:

os_type: ubuntu
os_version: "18.04"

but since we've stopped building ubuntu/bionic packages, teuthology
just complains when we are scheduling test suites which are composed
from facets in qa/suites/orch/rook/smoke.

in this change, the ubuntu_18.04.yaml is dropped because ubuntu/bionic
does not really increase the test coverage of ceph. it helps to test
the rook and container runtime though.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-05 01:11:14 +08:00
..
archs
btrfs
cephfs test: Add test for mgr hang when osd is full 2021-05-22 19:09:07 +05:30
client
clusters
config
crontab qa/tests: added client-upgrade-nautilus-pacific tests 2021-05-14 08:34:27 -07:00
debug
distros Merge pull request #40604 from liewegas/podman-registries-conf 2021-04-07 15:12:24 +08:00
erasure-code
libceph
machine_types qa: schedule random subset 2021-03-04 13:43:27 -08:00
mds
mon/bootstrap
mon_election
msgr
nightlies
objectstore qa/objectstore: reduce debug log levels for bluestore 2021-03-03 14:48:34 -05:00
objectstore_cephfs
objectstore_debug qa/suites: move RADOS tests to use new debug log objectstores 2021-03-03 14:47:59 -05:00
overrides
packages
qa_scripts
rbd qa: krbd_blkroset.t: update for separate hw and user read-only flags 2021-03-17 11:00:33 +01:00
releases qa/suites: some clean up for quincy 2021-01-28 13:29:28 -06:00
rgw qa/rgw: move ignore-pg-availability.yaml out of suites/rgw 2021-04-05 13:09:52 -04:00
rgw_bucket_sharding
rgw_frontend rgw: remove the civetweb frontend from src and qa 2021-05-17 15:00:31 -04:00
rgw_pool_type
standalone test: recovery_scrub: do not display 'repair' status on auto-repair deep-scrub 2021-05-18 17:43:28 +03:00
suites qa/suites/orch/rook/smoke: stop testing on ubuntu 18.04 2021-06-05 01:11:14 +08:00
tasks Merge pull request #41652 from tchaikov/wip-qa-asock-or 2021-06-04 13:50:38 +08:00
timezone
workunits Merge PR #39910 into master 2021-06-03 13:22:23 -07:00
.gitignore
.qa
.teuthology_branch
CMakeLists.txt
find-used-ports.sh
loopall.sh
Makefile
mypy.ini
README qa: expand the documentation on the '$' suite feature 2021-02-03 15:07:54 +01:00
run_xfstests_qemu.sh
run_xfstests-obsolete.sh
run_xfstests.sh qa/run_xfstests.sh: mount ext4 with dioread_nolock 2021-02-27 15:25:39 +01:00
run-standalone.sh
runallonce.sh
runoncfuse.sh
runonkclient.sh
setup-chroot.sh
test_import.py
tox.ini
valgrind.supp valgrind: suppress operator delete[] for tcmalloc 2021-03-02 15:38:41 -05:00

ceph-qa-suite
-------------

clusters/    - some predefined cluster layouts
suites/      - set suite

The suites directory has a hierarchical collection of tests.  This can be
freeform, but generally follows the convention of

  suites/<test suite name>/<test group>/...

A test is described by a yaml fragment.

A test can exist as a single .yaml file in the directory tree.  For example:

 suites/foo/one.yaml
 suites/foo/two.yaml

is a simple group of two tests.

A directory with a magic '+' file represents a test that combines all
other items in the directory into a single yaml fragment.  For example:

 suites/foo/bar/+
 suites/foo/bar/a.yaml
 suites/foo/bar/b.yaml
 suites/foo/bar/c.yaml

is a single test consisting of a + b + c.

A directory with a magic '%' file represents a test matrix formed from
all other items in the directory.  For example,

 suites/baz/%
 suites/baz/a.yaml
 suites/baz/b/b1.yaml
 suites/baz/b/b2.yaml
 suites/baz/c.yaml
 suites/baz/d/d1.yaml
 suites/baz/d/d2.yaml

is a 4-dimensional test matrix.  Two dimensions (a, c) are trivial (1
item), so this is really 2x2 = 4 tests, which are

  a + b1 + c + d1
  a + b1 + c + d2
  a + b2 + c + d1
  a + b2 + c + d2

A directory with a magic '$' file, or a directory whose name ends with '$',
represents a test where one of the non-magic items is chosen randomly.  For
example, both

 suites/foo/$
 suites/foo/a.yaml
 suites/foo/b.yaml
 suites/foo/c.yaml

and

 suites/foo$/a.yaml
 suites/foo$/b.yaml
 suites/foo$/c.yaml

is a single test, either a, b or c.  This can be used in conjunction with the
'%' file in the same (see below) or other directories to run a series of tests
without causing an unwanted increase in the total number of jobs run.

Symlinks are okay.

One particular use of symlinks is to combine '%' and the latter form of '$'
feature.  Consider supported_distros directory containing fragments that define
os_type and os_version:

 supported_distros/%
 supported_distros/centos.yaml
 supported_distros/rhel.yaml
 supported_distros/ubuntu.yaml

A test that links supported_distros as distros (a name that doesn't end with
'$') will be run three times: on centos, rhel and ubuntu.  A test that links
supported_distros as distros$ will be run just once: either on centos, rhel or
ubuntu, chosen randomly.

The teuthology code can be found in https://github.com/ceph/teuthology.git