ceph/qa
Tatjana Dehler a747efad29 mgr/dashboard: comment questionable suites out
We're currently facing some issues with our integration
tests. Because of that we agreed on commenting questionable
suites out to be able to run all other suites on open pull
requests.

'test_health' and 'test_perf_counters' are commented out
because they led to issues in relation to
https://tracker.ceph.com/issues/41538
As soon as the issue has been fixed, we need to re-add
these two suites again.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-10-11 10:58:41 +02:00
..
archs
btrfs
cephfs qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning 2019-09-19 09:15:29 -04:00
client
clusters
config
crontab qa/tests - upped priority for upgrades on master, otherwise they never lock nodes for testing and fail 2019-08-14 09:43:02 -07:00
debug
distros qa/distros/all: add openSUSE 15.1, drop openSUSE 12.2 2019-09-26 17:09:32 +02:00
erasure-code
libceph
machine_types
mds
mon/bootstrap
msgr
nightlies
objectstore
objectstore_cephfs
overrides
packages qa: add ceph-daemon 2019-10-04 20:33:35 -05:00
qa_scripts
rbd Merge pull request #30502 from idryomov/wip-krbd-avoid-hexdump-s 2019-09-21 11:12:28 +02:00
releases qa/suites/upgrade: set pg_autoscale_mode=off on existing pools 2019-07-19 09:46:37 -05:00
rgw_frontend
rgw_pool_type
standalone osd: change trigger_[deep_]scrub tommands to a pg tell command 2019-10-04 09:07:02 -05:00
suites mgr/dashboard: comment questionable suites out 2019-10-11 10:58:41 +02:00
tasks Merge pull request #30400 from rhcs-dashboard/fix-41867-master 2019-10-10 11:45:13 +01:00
timezone
workunits Merge pull request #30711 from dillaman/wip-41938 2019-10-07 11:30:02 +03:00
.gitignore
find-used-ports.sh
loopall.sh
Makefile
README
run_xfstests_qemu.sh
run_xfstests-obsolete.sh
run_xfstests.sh
run-standalone.sh qa/run-standalone.sh: fix python path 2019-08-19 12:33:05 -05:00
runallonce.sh
runoncfuse.sh
runonkclient.sh
setup-chroot.sh
tox.ini
valgrind.supp qa/valgrind.supp: drop boost::lockfree::queue suppression 2019-06-28 10:56:16 -04:00

ceph-qa-suite
-------------

clusters/    - some predefined cluster layouts
suites/      - set suite

The suites directory has a hierarchical collection of tests.  This can be
freeform, but generally follows the convention of

  suites/<test suite name>/<test group>/...

A test is described by a yaml fragment.

A test can exist as a single .yaml file in the directory tree.  For example:

 suites/foo/one.yaml
 suites/foo/two.yaml

is a simple group of two tests.

A directory with a magic '+' file represents a test that combines all
other items in the directory into a single yaml fragment.  For example:

 suites/foo/bar/+
 suites/foo/bar/a.yaml
 suites/foo/bar/b.yaml
 suites/foo/bar/c.yaml

is a single test consisting of a + b + c.

A directory with a magic '%' file represents a test matrix formed from
all other items in the directory.  For example,

 suites/baz/%
 suites/baz/a.yaml
 suites/baz/b/b1.yaml
 suites/baz/b/b2.yaml
 suites/baz/c.yaml
 suites/baz/d/d1.yaml
 suites/baz/d/d2.yaml

is a 4-dimensional test matrix.  Two dimensions (a, c) are trivial (1
item), so this is really 2x2 = 4 tests, which are

  a + b1 + c + d1
  a + b1 + c + d2
  a + b2 + c + d1
  a + b2 + c + d2

A directory with a magic '$' file represents a test where one of the other
items is chosen randomly. For example,

suites/foo/$
suites/foo/a.yaml
suites/foo/b.yaml
suites/foo/c.yaml

is a single test.  It will be either a.yaml, b.yaml or c.yaml.  This can be
used in conjunction with the '%' file in other directories to run a series of
tests without causing an unwanted increase in the total number of jobs run.

Symlinks are okay.

The teuthology code can be found in https://github.com/ceph/teuthology.git