ceph/qa
Adam King 3011d95498 qa/distros: pass --allowerasing --nobest when installing container-tools
One of the tests in the orch suite is running distro install
commands from multiple distros, causing it to first install
container-tools 3.0 and then later install container-tools,
which fails, causing the test to fail. This is sort of a bandaid
fix to getthe test to work. It will cause whatever the last
version of the package to be installed to end up being installed
(and will do so without error) which is what we want in the tests.

Fixes: https://tracker.ceph.com/issues/57771

Signed-off-by: Adam King <adking@redhat.com>
2023-02-28 13:23:30 -05:00
..
archs
btrfs
cephfs
client
clusters
config qa/config/crimson_qa_overrides: set crimson experimental feature 2023-02-13 22:36:36 -08:00
crontab qa/crontab: temporarily disable teuthology cronjobs 2023-02-22 23:17:19 +00:00
debug
distros qa/distros: pass --allowerasing --nobest when installing container-tools 2023-02-28 13:23:30 -05:00
erasure-code
libceph
machine_types qa: switch to https protocol for repos' server 2022-12-12 21:05:57 +08:00
mds
mgr_ttl_cache
mon/bootstrap
mon_election
msgr
nightlies
objectstore qa/suites: change all osd objectstore filestore 2023-02-12 06:11:29 +00:00
objectstore_cephfs qa/suites: change all osd objectstore filestore 2023-02-12 06:11:29 +00:00
objectstore_debug qa/suites: change all osd objectstore filestore 2023-02-12 06:11:29 +00:00
overrides
packages
qa_scripts
rbd
releases
rgw
rgw_bucket_sharding
rgw_frontend
rgw_pool_type
standalone Merge pull request #50236 from ronen-fr/wip-rf-total-dump 2023-02-26 21:30:30 +02:00
suites Merge pull request #49528 from NitzanMordhai/wip-nitzan-filestore-removal 2023-02-23 12:20:49 +01:00
tasks qa/cephfs: upgrade xfstests_dev.py for FUSE mounts 2023-02-25 16:03:45 +05:30
timezone
workunits Merge pull request #50230 from idryomov/wip-58833 2023-02-27 14:15:31 +01:00
.gitignore
.qa
CMakeLists.txt cmake: temporarily disable py3 test 2022-12-09 01:07:19 +08:00
find-used-ports.sh
loopall.sh
Makefile
mypy.ini
README
run_xfstests_qemu.sh qa: switch to curl for qemu-xfstests 2022-12-22 16:35:08 +01:00
run_xfstests-obsolete.sh qa: switch back to git protocol for qemu-xfstests 2022-12-21 19:27:15 +01:00
run_xfstests.sh
run-standalone.sh
runallonce.sh
runoncfuse.sh
runonkclient.sh
setup-chroot.sh
test_import.py
tox.ini qa: add pytest to deps of py3 env 2022-12-08 23:57:59 +08:00
valgrind.supp src/valgrind.supp: Adding know leaks unrelated to ceph 2022-10-27 11:42:19 +00:00

ceph-qa-suite
-------------

clusters/    - some predefined cluster layouts
suites/      - set suite

The suites directory has a hierarchical collection of tests.  This can be
freeform, but generally follows the convention of

  suites/<test suite name>/<test group>/...

A test is described by a yaml fragment.

A test can exist as a single .yaml file in the directory tree.  For example:

 suites/foo/one.yaml
 suites/foo/two.yaml

is a simple group of two tests.

A directory with a magic '+' file represents a test that combines all
other items in the directory into a single yaml fragment.  For example:

 suites/foo/bar/+
 suites/foo/bar/a.yaml
 suites/foo/bar/b.yaml
 suites/foo/bar/c.yaml

is a single test consisting of a + b + c.

A directory with a magic '%' file represents a test matrix formed from
all other items in the directory.  For example,

 suites/baz/%
 suites/baz/a.yaml
 suites/baz/b/b1.yaml
 suites/baz/b/b2.yaml
 suites/baz/c.yaml
 suites/baz/d/d1.yaml
 suites/baz/d/d2.yaml

is a 4-dimensional test matrix.  Two dimensions (a, c) are trivial (1
item), so this is really 2x2 = 4 tests, which are

  a + b1 + c + d1
  a + b1 + c + d2
  a + b2 + c + d1
  a + b2 + c + d2

A directory with a magic '$' file, or a directory whose name ends with '$',
represents a test where one of the non-magic items is chosen randomly.  For
example, both

 suites/foo/$
 suites/foo/a.yaml
 suites/foo/b.yaml
 suites/foo/c.yaml

and

 suites/foo$/a.yaml
 suites/foo$/b.yaml
 suites/foo$/c.yaml

is a single test, either a, b or c.  This can be used in conjunction with the
'%' file in the same (see below) or other directories to run a series of tests
without causing an unwanted increase in the total number of jobs run.

Symlinks are okay.

One particular use of symlinks is to combine '%' and the latter form of '$'
feature.  Consider supported_distros directory containing fragments that define
os_type and os_version:

 supported_distros/%
 supported_distros/centos.yaml
 supported_distros/rhel.yaml
 supported_distros/ubuntu.yaml

A test that links supported_distros as distros (a name that doesn't end with
'$') will be run three times: on centos, rhel and ubuntu.  A test that links
supported_distros as distros$ will be run just once: either on centos, rhel or
ubuntu, chosen randomly.

The teuthology code can be found in https://github.com/ceph/teuthology.git