Commit Graph

2738 Commits

Author SHA1 Message Date
Ilya Dryomov
28fe52ab8c
Merge pull request #55797 from ajarr/wip-64574
qa: add diff-continuous and compare-mirror-image tests to rbd and krbd suites respectively

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-03-01 18:56:26 +01:00
Ramana Raja
92b254138d qa/suites: add diff-continuous and compare-mirror-image tests
... to rbd and krbd suites respectively.

This allows the compare-mirror-image tests introduced in ea3a567
to be run against various kernel branches, e.g., testing branch.
And allows diff_continuous test in rbd_suite to run against distro
kernel.

Fixes: https://tracker.ceph.com/issues/64574
Signed-off-by: Ramana Raja <rraja@redhat.com>
2024-02-29 12:12:19 -05:00
Ramana Raja
af43f61624 qa/suites/rbd: rename nbd folder to device folder
Signed-off-by: Ramana Raja <rraja@redhat.com>
2024-02-29 11:55:08 -05:00
Adam King
58ba7e54c5
Merge pull request #55600 from adk3798/no-agent-workunits
qa/cephadm: don't test certain workunits with agent

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-02-28 14:34:11 -05:00
Yuri Weinstein
80feaec5a1
Merge pull request #52891 from kamoltat/wip-ksirivad-fix-59172
qa/tasks/ceph_manager.py: Rewrite test_pool_min_size

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-27 08:37:34 -08:00
Venky Shankar
a302e3b67e Merge PR #55435 into main
* refs/pull/55435/head:
	qa: Fix fs/full suite

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-02-27 11:17:13 +05:30
Ilya Dryomov
fa5ef874ac
Merge pull request #54802 from ajarr/wip-61617
qa: Add tests to validate synced images on rbd-mirror

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-02-23 23:47:42 +01:00
Ramana Raja
b7aae5c3c5 qa: Add tests to validate syncing of images using rbd-mirror
Introduce functional tests to validate that the images under
workloads are correctly mirrored between two clusters using snapshot
based mirroring.

Run workload on a primary image using a krbd or nbd client. Take
mirror snapshots of the image under workload. Unmount the mapped image
and calculate its MD5 checksum before demoting it. After demotion,
wait for the mirror status of the image to be 'up+unknown' in both
the clusters. This is to make sure that the non-primary image in the
other cluster is ready to be promoted. Now promote the non-primary
image in the other cluster. Map the promoted image and calculate its
MD5 checksum. Verify that the checksums of the demoted and promoted
images in the two clusters are the same.

The above test is run as part of two different workunits:
 - a workunit that validates the syncing of multiple mirrored images
   with workloads running on them
 - another workunit that validates the syncing of a single mirrored
   image with workload running on it and the image is set as primary
   alternatively between the two clusters, as it happens during
   failover and failback scenarios.

Fixes: https://tracker.ceph.com/issues/61617
Signed-off-by: Ramana Raja <rraja@redhat.com>
Co-authored-by: Ilya Dryomov <idryomov@redhat.com>
Co-authored-by: Christopher Hoffman <choffman@redhat.com>
2024-02-22 11:44:36 -05:00
Yuval Lifshitz
6f28930602 test/rgw/notifications: split tests between basic, kafka and amqp
see comment: https://tracker.ceph.com/issues/64184#note-3

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-02-22 09:58:00 +00:00
Patrick Donnelly
182f4c0f54
qa: test fuse/kclient for mds upgrade seq
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-19 21:20:08 -05:00
Patrick Donnelly
4bcaaa45eb
qa: ignore OSD_DOWN during cephadm upgrades
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-19 21:20:08 -05:00
Patrick Donnelly
52c09aa1e5
qa: do upgrades from quincy and older reef minor releases
Fixes: https://tracker.ceph.com/issues/64441
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-19 21:20:04 -05:00
Adam King
7953fe1b39 qa/cephadm: don't test certain workunits with agent
There are a handful of workunits that don't work
with or don't make sense with the agent.
The test for the cephadm timeout only works if
the mgr directly runs ceph-volume inventory which
it won't do with the agent present. The adoption
test is just running direct cephadm commands that
are irrelevant to the agent. The test_orch_cli tests
rely on refresh timings that are different with
the agent running, causing spurious failures.

Signed-off-by: Adam King <adking@redhat.com>
2024-02-15 09:30:40 -05:00
Ali Maredia
639ea51a71 qa: enable test_awssdkv4_sig workunit to run in teuthology
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2024-02-14 13:04:23 -05:00
Matt Benjamin
e2a65f1d07 rgw_cksum: add junit5-based unit test suite
This can be run by hand with:

./mvnw clean package
./mvnw test -Dtest=PutObjects

The following properties are sourced from the environment:

    AWS_ACCESS_KEY_ID
    AWS_SECRET_ACCESS_KEY

    RGW_HTTP_ENDPOINT_URL
    RGW_HTTPS_ENDPOINT_URL

Then adds:

qa/workunits/rgw: add test driver script for maven suite

Launch it fromn cls.yaml, as with test_librgw_file.h.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2024-02-13 13:28:33 -05:00
Vallari Agrawal
c8116c65df
Merge pull request #54959 from VallariAg/wip-nvmeof-test-v2
qa: add qa/tasks/nvmeof.py
2024-02-13 13:20:42 +05:30
Casey Bodley
4cc75f8f6d
Merge pull request #55487 from cbodley/wip-qa-rgw-hadoop-distro
qa/rgw: hadoop-s3a uses supported-random-distro$

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2024-02-12 17:05:33 +00:00
Vallari Agrawal
1713c4852c
qa: add qa/tasks/nvmeof.py and rbd/nvmeof_basic_task and fio workunits
This is v2 of the rbd/nvmeof test: It deploys 1 gateway and 1 initiator.
Then does basic verification on nvme commands and runs fio.

This commit creates:
1. qa/tasks/nvmeof.py: adds a new 'Nvmeof' task which deploys
    the gateway and shares config with the initiator hosts.
    Sharing config was previously done by 'nvmeof_gateway_cfg' task
    in qa/tasks/cephadm.py (that task is removed in this commit).
2. qa/workunits/rbd/nvmeof_basic_tests.sh:
    Runs nvme commands (discovery, connect, connect-all, disconnect-all,
    and list-subsys) and does basic verification of the output.
3. qa/workunits/rbd/nvmeof_fio_test.sh:
    Runs fio command. Also runs iostat in parallel if IOSTAT_INTERVAL
    variable is set. This variable configures the delay between each iostat
    print.

nvmeof-cli upgrade from v0.0.6 to v0.0.7 introduced major changes
to all nvmeof commands. This commit changes v0.0.6 commands to
v0.0.7 in qa/workunits/rbd/nvmeof_initiator.sh

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-02-12 13:00:09 +05:30
Laura Flores
00fc7960f6 qa/suites/orch: whitelist warnings that are expected in test environments
Fixes: https://tracker.ceph.com/issues/64343
Signed-off-by: Laura Flores <lflores@ibm.com>
2024-02-09 13:52:47 -06:00
Casey Bodley
6fce88edb0 qa/rgw: hadoop-s3a uses supported-random-distro$
without this, teuthology-suite tries to schedule against centos8 which
is not supported for squid

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 16:08:51 -05:00
Matan Breizman
ad212a5c83
Merge pull request #55276 from Matan-B/wip-matanb-crimson-alienstore-cores
crimson: rework CPU pinning

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-02-04 11:45:43 +02:00
Kotresh HR
27e9a15a53 qa: Fix fs/full suite
Fix fs/full suite. The tests in the suite were failing
in release branches, quincy and pacific because of change
in the rados bluefs pre allocation (PR 51774). The change
affected main/quincy differently than quincy/pacific.

Fixes: https://tracker.ceph.com/issues/63132
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2024-02-03 13:01:37 +05:30
Casey Bodley
862b2eeb5b
Merge pull request #54867 from BBoozmen/oozmen_lc_subsystem
rgw/common: add rgw lifecycle specific debug log subsystem

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Jiffin Tony Thottan <jthottan@redhat.com>
2024-02-02 15:42:00 +00:00
Casey Bodley
3a05c6f0f3
Merge pull request #53901 from cbodley/wip-qa-container-distros-s
qa/distros: bump container host distros from centos 8->9

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-02-01 19:40:57 +00:00
Matan Breizman
e547768fed crimson: introduce crimson_seastar_cpu_cores
seastar::smp::count is deduced from the cpuset provided.

from seastar/src/core/reactor:
```
   if (smp_opts.smp) {
        smp::count = smp_opts.smp.get_value();
    } else {
        smp::count = cpu_set.size();
    }
```

Co-authored-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-02-01 16:42:51 +00:00
Casey Bodley
8e554bf639
Merge pull request #47723 from mdw-at-linuxbox/wip-master-tempurl
rgw: swift: tempurl fixes for ceph

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-31 22:15:33 +00:00
Casey Bodley
849a58b087 qa/distros: add supported-container-hosts for cephadm and upgrade suites
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-30 10:02:52 -05:00
Venky Shankar
40cb741902 Merge PR #53734 into main
* refs/pull/53734/head:
	qa: refactor client upgrade yamls and other minor touchups
	qa/upgrade/nofs: upgrade pacific->reef
	qa/upgrade/upgraded_client: upgrade nautilus->pacific and pacific->reef

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-29 18:42:36 +05:30
Venky Shankar
52b20eb584 Merge PR #55309 into main
* refs/pull/55309/head:
	qa: `fs volume rename` requires `fs fail` and `refuse_client_session` set

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-01-29 18:41:23 +05:30
Laura Flores
33b5f3ddbb qa/suites/rados/thrash/d-balancer: add read and upmap-read modes to balancer testing
Here, we turn the balancer mgr module to read and upmap read mode
during various thrashing scenarios.

Signed-off-by: Laura Flores <lflores@ibm.com>
2024-01-28 13:15:49 -06:00
Casey Bodley
5d0477eb1b qa/tempest: use default tempurl_digest_hashlib=sha256
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-25 11:26:07 -05:00
Venky Shankar
2a6c1dc36d qa: fs volume rename requires fs fail and refuse_client_session set
Introduced-by: fe3a4b9683
Fixes: http://tracker.ceph.com/issues/64174
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-01-25 12:08:50 +05:30
Adam King
c8873c6591 qa: remove container hosts install from centos 9 distros
We needed the container-hosts version of podman on centos 8,
but there's no need to keep using it in centos 9

Additionally, changes from crun variants to runc variants since
crun is now the default container runtime on centos 9

Signed-off-by: Adam King <adking@redhat.com>
2024-01-18 10:56:39 -05:00
Casey Bodley
12254d8f54 qa/distros: bump container-hosts from ubuntu 20 to 22
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-18 10:56:39 -05:00
Casey Bodley
b9ba9642fe qa/suites/fs: workload suite uses centos 9 instead of rhel
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-18 10:56:38 -05:00
Casey Bodley
00b3eef5b8 qa/distros: bump podman from centos 8 to 9
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-18 10:56:38 -05:00
Casey Bodley
bac9e74abf qa/distros: bump container-hosts from centos 8 to 9
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-18 10:56:38 -05:00
Matan Breizman
b99ffc4f3e test/neorados/aio_cxx: Seperate NeoRadosECTest from NeoRadosTest
SKIP_IF_CRIMSON won't work here since we try to create EC pools
prior to the test being run.
Skip if the entire test instead by seperating EC tests.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Ronen Friedman
bba3be3b47
Merge pull request #55175 from ronen-fr/wip-rf-max-test-options
qa/suites/rados/thrash: modify selection of max-scrubs configuration values

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 10:48:33 +02:00
Rishabh Dave
4b39dedc5d
Merge pull request #54406 from vshankar/wip-63482
qa: enable debug mds/client for fs/nfs suite

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:42:37 +05:30
Ronen Friedman
f5e6b607b9 test/scrub: modify selection of max-scrubs configuration values
As the osd-max-scrubs default was increased from 1 to (currently) 3, the
original set of optional values under rados/thrash/3-scrub-overrides are
no longer useful.  This commits changes the set of optional values to
reflect the current default.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-14 20:53:38 +02:00
Casey Bodley
49c27499af
Merge pull request #53678 from cbodley/wip-qa-rgw-upgrade-reef
qa/rgw/upgrade: add reef as a starting release

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-01-11 16:08:24 +00:00
Milind Changire
f14f60afd5
Merge PR #53999 into main
* refs/pull/53999/head:
	PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
	snap_schedule/tests: fix db upgrade issue
	qa: add yaml for on demand subvol version testing
	qa: add test cases for testing --subvol and --group arguments
	mgr/volumes: conditionalize subvolume upgrade
	mgr/volumes: ensure correct init of v1 subvol
	mgr/snap_schedule: add subvol and subvol group arguments to cli
	mds/snap_schedule: add subvolume group column management
	mgr/volumes: add remote helper methods to fetch subvolume info

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-11 10:31:31 +05:30
Adam King
aacb91f60c
Merge pull request #52815 from adk3798/upgrade-nfs-migration-check
qa/cephadm: mgr-nfs-upgrade, match any migration > 2

Reviewed-by: Michael Fritch <mfritch@suse.com>
2024-01-10 09:01:12 -05:00
Adam King
71f706dbb4
Merge pull request #51963 from adk3798/async-timeout-fixup
mgr/cephadm: fixups for asyncio based timeout

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-01-10 08:59:51 -05:00
Adam King
df2e42c02f qa/cephadm: mgr-nfs-upgrade, match any migration > 2
I believe this check was originally added because
the 2->3 migration migrated some nfs related bits. Since
then we've had to update the migration this checks
for every time we bump the max migration. This change
is intended to instead just have it check for a
miration > 2 so we don't have to keep updating it.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 10:07:03 -05:00
Adam King
967716f2e6 qa/upgrade/reef-x: pull compiled cephadm to start upgrades from reef
The compiled zipapp cephadm that began in reef needs
to be pulled differently than the old single python script
cephadm from earlier releases. This commit updates the reef-x
upgrade suite to pull cephadm in this new way.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 09:51:52 -05:00
Milind Changire
2533ac5b90
qa: add yaml for on demand subvol version testing
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Yuri Weinstein
556bd56b70
Merge pull request #48175 from amathuria/wip-add-test-case-bz-2011756
DaemonServer.cc: fix config show command for RGW daemons

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 07:37:54 -08:00
Casey Bodley
1e905d2c41 qa/rgw/upgrade: add reef as a starting release
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-04 09:37:56 -05:00