ceph/qa
Adam King 46f939f057 qa/tasks/cephadm_cases: increase timeouts in test_cli.py
These seem to be failing sometimes but in my testing
sometimes these events are happening a few seconds after
we hit the timeout. Trying to see if this makes the tests
more consistent. No need to mark the test as failed
if we report something up in 34 seconds vs 25 especially
when cephadm works on a cyclic daemon refresh.

Signed-off-by: Adam King <adking@redhat.com>
2022-02-09 20:42:42 -05:00
..
archs
btrfs
cephfs qa: stop overriding distro for k-testing 2022-02-02 10:44:35 -05:00
client
clusters
config
crontab qa/tests: run upgrades on quincy 2022-01-17 10:18:04 -08:00
debug
distros qa/distros/container-hosts: remove centos_8.2 and centos_8.3 2022-02-02 20:03:33 +00:00
erasure-code
libceph
machine_types
mds
mgr_ttl_cache mgr: TTLCache basic implementation 2022-01-05 10:11:58 +01:00
mon/bootstrap
mon_election
msgr
nightlies
objectstore
objectstore_cephfs
objectstore_debug
overrides qa/cephadm: install hwe kernel only for focal 2022-01-18 10:36:24 +01:00
packages qa/packages: install ceph-volume 2021-09-19 21:51:19 -04:00
qa_scripts
rbd
releases
rgw qa/rgw: add PG_DEGRADED cluster warnings to log-ignorelist 2022-01-12 15:56:38 -05:00
rgw_bucket_sharding
rgw_frontend
rgw_pool_type
standalone Merge pull request #42735 from amathuria/wip-amathuria-scrub-stats 2022-01-14 10:46:28 -08:00
suites Merge PR #42000 into master 2022-02-09 09:34:49 -05:00
tasks qa/tasks/cephadm_cases: increase timeouts in test_cli.py 2022-02-09 20:42:42 -05:00
timezone
workunits Merge pull request #44842 from idryomov/wip-krbd-rxbounce-option 2022-02-06 20:37:31 +01:00
.gitignore
.qa qa: move .qa terminator 2022-02-03 10:08:30 -05:00
.teuthology_branch
CMakeLists.txt qa/tox.ini: check for dead symlinks 2021-09-03 11:38:04 +02:00
find-used-ports.sh
loopall.sh
Makefile
mypy.ini
README
run_xfstests_qemu.sh Merge pull request #44282 from orozery/qa-qemu-nbd-ide-interface 2022-01-25 15:06:14 +01:00
run_xfstests-obsolete.sh
run_xfstests.sh
run-standalone.sh
runallonce.sh
runoncfuse.sh
runonkclient.sh
setup-chroot.sh
test_import.py qa: convert test_import.py to pytest 2021-07-02 10:35:19 +02:00
tox.ini qa: tox.ini: verify yaml syntax 2021-09-07 10:20:34 +02:00
valgrind.supp

ceph-qa-suite
-------------

clusters/    - some predefined cluster layouts
suites/      - set suite

The suites directory has a hierarchical collection of tests.  This can be
freeform, but generally follows the convention of

  suites/<test suite name>/<test group>/...

A test is described by a yaml fragment.

A test can exist as a single .yaml file in the directory tree.  For example:

 suites/foo/one.yaml
 suites/foo/two.yaml

is a simple group of two tests.

A directory with a magic '+' file represents a test that combines all
other items in the directory into a single yaml fragment.  For example:

 suites/foo/bar/+
 suites/foo/bar/a.yaml
 suites/foo/bar/b.yaml
 suites/foo/bar/c.yaml

is a single test consisting of a + b + c.

A directory with a magic '%' file represents a test matrix formed from
all other items in the directory.  For example,

 suites/baz/%
 suites/baz/a.yaml
 suites/baz/b/b1.yaml
 suites/baz/b/b2.yaml
 suites/baz/c.yaml
 suites/baz/d/d1.yaml
 suites/baz/d/d2.yaml

is a 4-dimensional test matrix.  Two dimensions (a, c) are trivial (1
item), so this is really 2x2 = 4 tests, which are

  a + b1 + c + d1
  a + b1 + c + d2
  a + b2 + c + d1
  a + b2 + c + d2

A directory with a magic '$' file, or a directory whose name ends with '$',
represents a test where one of the non-magic items is chosen randomly.  For
example, both

 suites/foo/$
 suites/foo/a.yaml
 suites/foo/b.yaml
 suites/foo/c.yaml

and

 suites/foo$/a.yaml
 suites/foo$/b.yaml
 suites/foo$/c.yaml

is a single test, either a, b or c.  This can be used in conjunction with the
'%' file in the same (see below) or other directories to run a series of tests
without causing an unwanted increase in the total number of jobs run.

Symlinks are okay.

One particular use of symlinks is to combine '%' and the latter form of '$'
feature.  Consider supported_distros directory containing fragments that define
os_type and os_version:

 supported_distros/%
 supported_distros/centos.yaml
 supported_distros/rhel.yaml
 supported_distros/ubuntu.yaml

A test that links supported_distros as distros (a name that doesn't end with
'$') will be run three times: on centos, rhel and ubuntu.  A test that links
supported_distros as distros$ will be run just once: either on centos, rhel or
ubuntu, chosen randomly.

The teuthology code can be found in https://github.com/ceph/teuthology.git