ceph/qa
Jason Dillaman 103243725f qa/suites: move RADOS tests to use new debug log objectstores
This will retain the debug log settings for all RADOS suites
that were previously symlinked to the 'objectstore'
directory. The next commit will reduce the debug log level
for the original 'objectstore' directory for the remainder
of tests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-03-03 14:47:59 -05:00
..
archs
btrfs
cephfs
client
clusters
config
crontab qa: use --newest 100 to find a recent build 2021-02-23 00:37:53 +00:00
debug
distros Merge pull request #39614 from sebastian-philipp/cephadm-again-test-ubuntu_2004_podman 2021-02-26 11:02:24 +01:00
erasure-code
libceph
machine_types qa: use --newest 100 to find a recent build 2021-02-23 00:37:53 +00:00
mds
mon/bootstrap
mon_election
msgr
nightlies
objectstore
objectstore_cephfs
objectstore_debug qa/suites: move RADOS tests to use new debug log objectstores 2021-03-03 14:47:59 -05:00
overrides
packages
qa_scripts
rbd
releases qa/suites: some clean up for quincy 2021-01-28 13:29:28 -06:00
rgw_bucket_sharding
rgw_frontend
rgw_pool_type
standalone Merge PR #39455 into master 2021-02-27 10:15:27 -05:00
suites qa/suites: move RADOS tests to use new debug log objectstores 2021-03-03 14:47:59 -05:00
tasks Merge PR #39682 into master 2021-03-03 10:05:35 -08:00
timezone
workunits librbd: permit disabling QCOW migration format support 2021-02-23 07:19:43 -05:00
.gitignore
.qa
.teuthology_branch
CMakeLists.txt
find-used-ports.sh
loopall.sh
Makefile
mypy.ini
README qa: expand the documentation on the '$' suite feature 2021-02-03 15:07:54 +01:00
run_xfstests_qemu.sh
run_xfstests-obsolete.sh
run_xfstests.sh qa/run_xfstests.sh: mount ext4 with dioread_nolock 2021-02-27 15:25:39 +01:00
run-standalone.sh
runallonce.sh
runoncfuse.sh
runonkclient.sh
setup-chroot.sh
test_import.py
tox.ini
valgrind.supp valgrind: suppress operator delete[] for tcmalloc 2021-03-02 15:38:41 -05:00

ceph-qa-suite
-------------

clusters/    - some predefined cluster layouts
suites/      - set suite

The suites directory has a hierarchical collection of tests.  This can be
freeform, but generally follows the convention of

  suites/<test suite name>/<test group>/...

A test is described by a yaml fragment.

A test can exist as a single .yaml file in the directory tree.  For example:

 suites/foo/one.yaml
 suites/foo/two.yaml

is a simple group of two tests.

A directory with a magic '+' file represents a test that combines all
other items in the directory into a single yaml fragment.  For example:

 suites/foo/bar/+
 suites/foo/bar/a.yaml
 suites/foo/bar/b.yaml
 suites/foo/bar/c.yaml

is a single test consisting of a + b + c.

A directory with a magic '%' file represents a test matrix formed from
all other items in the directory.  For example,

 suites/baz/%
 suites/baz/a.yaml
 suites/baz/b/b1.yaml
 suites/baz/b/b2.yaml
 suites/baz/c.yaml
 suites/baz/d/d1.yaml
 suites/baz/d/d2.yaml

is a 4-dimensional test matrix.  Two dimensions (a, c) are trivial (1
item), so this is really 2x2 = 4 tests, which are

  a + b1 + c + d1
  a + b1 + c + d2
  a + b2 + c + d1
  a + b2 + c + d2

A directory with a magic '$' file, or a directory whose name ends with '$',
represents a test where one of the non-magic items is chosen randomly.  For
example, both

 suites/foo/$
 suites/foo/a.yaml
 suites/foo/b.yaml
 suites/foo/c.yaml

and

 suites/foo$/a.yaml
 suites/foo$/b.yaml
 suites/foo$/c.yaml

is a single test, either a, b or c.  This can be used in conjunction with the
'%' file in the same (see below) or other directories to run a series of tests
without causing an unwanted increase in the total number of jobs run.

Symlinks are okay.

One particular use of symlinks is to combine '%' and the latter form of '$'
feature.  Consider supported_distros directory containing fragments that define
os_type and os_version:

 supported_distros/%
 supported_distros/centos.yaml
 supported_distros/rhel.yaml
 supported_distros/ubuntu.yaml

A test that links supported_distros as distros (a name that doesn't end with
'$') will be run three times: on centos, rhel and ubuntu.  A test that links
supported_distros as distros$ will be run just once: either on centos, rhel or
ubuntu, chosen randomly.

The teuthology code can be found in https://github.com/ceph/teuthology.git