Commit Graph

2703 Commits

Author SHA1 Message Date
Venky Shankar
40cb741902 Merge PR #53734 into main
* refs/pull/53734/head:
	qa: refactor client upgrade yamls and other minor touchups
	qa/upgrade/nofs: upgrade pacific->reef
	qa/upgrade/upgraded_client: upgrade nautilus->pacific and pacific->reef

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-29 18:42:36 +05:30
Venky Shankar
52b20eb584 Merge PR #55309 into main
* refs/pull/55309/head:
	qa: `fs volume rename` requires `fs fail` and `refuse_client_session` set

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-01-29 18:41:23 +05:30
Laura Flores
33b5f3ddbb qa/suites/rados/thrash/d-balancer: add read and upmap-read modes to balancer testing
Here, we turn the balancer mgr module to read and upmap read mode
during various thrashing scenarios.

Signed-off-by: Laura Flores <lflores@ibm.com>
2024-01-28 13:15:49 -06:00
Venky Shankar
2a6c1dc36d qa: fs volume rename requires fs fail and refuse_client_session set
Introduced-by: fe3a4b9683
Fixes: http://tracker.ceph.com/issues/64174
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-01-25 12:08:50 +05:30
Matan Breizman
b99ffc4f3e test/neorados/aio_cxx: Seperate NeoRadosECTest from NeoRadosTest
SKIP_IF_CRIMSON won't work here since we try to create EC pools
prior to the test being run.
Skip if the entire test instead by seperating EC tests.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Ronen Friedman
bba3be3b47
Merge pull request #55175 from ronen-fr/wip-rf-max-test-options
qa/suites/rados/thrash: modify selection of max-scrubs configuration values

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 10:48:33 +02:00
Rishabh Dave
4b39dedc5d
Merge pull request #54406 from vshankar/wip-63482
qa: enable debug mds/client for fs/nfs suite

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:42:37 +05:30
Ronen Friedman
f5e6b607b9 test/scrub: modify selection of max-scrubs configuration values
As the osd-max-scrubs default was increased from 1 to (currently) 3, the
original set of optional values under rados/thrash/3-scrub-overrides are
no longer useful.  This commits changes the set of optional values to
reflect the current default.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-14 20:53:38 +02:00
Casey Bodley
49c27499af
Merge pull request #53678 from cbodley/wip-qa-rgw-upgrade-reef
qa/rgw/upgrade: add reef as a starting release

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-01-11 16:08:24 +00:00
Milind Changire
f14f60afd5
Merge PR #53999 into main
* refs/pull/53999/head:
	PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
	snap_schedule/tests: fix db upgrade issue
	qa: add yaml for on demand subvol version testing
	qa: add test cases for testing --subvol and --group arguments
	mgr/volumes: conditionalize subvolume upgrade
	mgr/volumes: ensure correct init of v1 subvol
	mgr/snap_schedule: add subvol and subvol group arguments to cli
	mds/snap_schedule: add subvolume group column management
	mgr/volumes: add remote helper methods to fetch subvolume info

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-11 10:31:31 +05:30
Adam King
aacb91f60c
Merge pull request #52815 from adk3798/upgrade-nfs-migration-check
qa/cephadm: mgr-nfs-upgrade, match any migration > 2

Reviewed-by: Michael Fritch <mfritch@suse.com>
2024-01-10 09:01:12 -05:00
Adam King
71f706dbb4
Merge pull request #51963 from adk3798/async-timeout-fixup
mgr/cephadm: fixups for asyncio based timeout

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-01-10 08:59:51 -05:00
Adam King
df2e42c02f qa/cephadm: mgr-nfs-upgrade, match any migration > 2
I believe this check was originally added because
the 2->3 migration migrated some nfs related bits. Since
then we've had to update the migration this checks
for every time we bump the max migration. This change
is intended to instead just have it check for a
miration > 2 so we don't have to keep updating it.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 10:07:03 -05:00
Adam King
967716f2e6 qa/upgrade/reef-x: pull compiled cephadm to start upgrades from reef
The compiled zipapp cephadm that began in reef needs
to be pulled differently than the old single python script
cephadm from earlier releases. This commit updates the reef-x
upgrade suite to pull cephadm in this new way.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 09:51:52 -05:00
Milind Changire
2533ac5b90
qa: add yaml for on demand subvol version testing
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Yuri Weinstein
556bd56b70
Merge pull request #48175 from amathuria/wip-add-test-case-bz-2011756
DaemonServer.cc: fix config show command for RGW daemons

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 07:37:54 -08:00
Casey Bodley
1e905d2c41 qa/rgw/upgrade: add reef as a starting release
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-04 09:37:56 -05:00
Samuel Just
066953050c
Merge pull request #54214 from athanatos/sjust/wip-crimson-scrub
crimson: add initial scrub support

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-03 15:26:45 -08:00
Adam King
efb69ee350 qa/cephadm: add test for cephadm asyncio based timeout
Adds a test that will set the default cephadm command
timeout and then force a timeout to occur by holding
the cephadm lock and triggering a device refresh.
This works because cephadm ceph-volume commands
require the cephadm lock to run, so the command will
timeout waiting for the lock to become available.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-03 08:40:47 -05:00
Laura Flores
0a2572c78c
Merge pull request #53191 from rzarzynski/wip-all-kickoff-s-2
kickoff v19 squid
2023-12-22 14:16:49 -06:00
Casey Bodley
5ccc8f3b29
Merge pull request #54739 from cbodley/wip-qa-rgw-upgrade-distros
qa/rgw/upgrade: stop testing upgrade from pacific

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-12-16 16:24:57 +00:00
Patrick Donnelly
ca7230d1d8
Merge PR #52196 into main
* refs/pull/52196/head:
	qa: configure balancer for multi-mds workloads
	qa: create qa subvolumes in named subvolumegroup
	qa: do not rely on default max_mds value
	qa: add automate_balance to dashboard qa schema
	doc/cephfs: add docs for balance_automate
	doc/cephfs: use bash prompt for shell code
	mds: add balance_automate fs setting

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2023-12-15 08:18:28 -05:00
Casey Bodley
525282254e
Merge pull request #54840 from cbodley/wip-qa-rgw-crypt-disable-kmip
qa/rgw/crypt: disable failing kmip testing

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-12-15 04:10:13 +00:00
Casey Bodley
6b3f7423ab qa/rgw/upgrade: stop testing upgrade from pacific
squid won't support upgrades from pacific. stop all testing against
centos8 and ubuntu20

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-12-14 09:38:09 -05:00
Venky Shankar
982a1b4cf2 Merge PR #54628 into main
* refs/pull/54628/head:
	qa/fscrypt: enable debug log for bluestore

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-12-13 20:49:52 +05:30
Patrick Donnelly
5f51fc3147
qa: configure balancer for multi-mds workloads
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-12 11:45:28 -05:00
Patrick Donnelly
e4f14d449d
qa: do not rely on default max_mds value
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-12 11:45:27 -05:00
Patrick Donnelly
23af075146
Merge PR #54726 into main
* refs/pull/54726/head:
	PendingReleaseNotes: announce cephfs-shell avail. on rhel9
	qa: test fs:shell on all distros
	qa: add cephfs-shell to installed rpm packages
	ceph.spec.in: enable support for cephfs-shell by default via EPEL9

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-12-11 08:37:39 -05:00
Samuel Just
070fa43328 qa/.../crimson-rados/.../thrashers/default.yaml: disable reset_purged_snaps for crimson
Signed-off-by: Samuel Just <sjust@redhat.com>
2023-12-11 04:10:17 +00:00
Samuel Just
41f930ae26 qa/.../crimson-rados/perf/.../fixed-2.yaml: fix ignorelist
It's common during cluster setup for there to be periods with
degraded/recovering PGs.  Ignore those errors.

Signed-off-by: Samuel Just <sjust@redhat.com>
2023-12-11 04:10:17 +00:00
Samuel Just
6397b1cae9 qa/.../crimson-rados/.../thrashers/default.yaml: enable wait-for-scrub
Signed-off-by: Samuel Just <sjust@redhat.com>
2023-12-11 04:10:17 +00:00
Casey Bodley
5df7b44727 qa/rgw/crypt: disable failing kmip testing
kmip tests have been failing all year and are not being maintained:

https://tracker.ceph.com/issues/58751
https://tracker.ceph.com/issues/58523

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-12-08 13:07:41 -05:00
Ilya Dryomov
d9147a14c4
Merge pull request #54205 from VallariAg/wip-nvmeof-test
qa: add rbd/nvmeof integration test

Reviewed-by: Zack Cerza <zack@redhat.com>
Reviewed-by: Aviv Caro <Aviv.Caro@ibm.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-12-04 18:14:38 +01:00
Radoslaw Zarzynski
7fc77efe2b qa: qa/suites/rados/upgrade/parallel points to reef
```
$ git rm qa/suites/rados/upgrade/parallel
$ ln -s ../../upgrade/reef-x/parallel qa/suites/rados/upgrade/parallel
$ git add qa/suites/rados/upgrade/parallel
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radosław Zarzyński
def898c5a2 qa: drop filestore-remove-check from upgrade/reef-x
FileStore is removed in Reef.

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
7af05d0944 qa: bring qa/suites/upgrade/reef-x
Bases on quincy-x.

```
$ cp -R qa/suites/upgrade/quincy-x/ qa/suites/upgrade/reef-x
$ git add qa/suites/upgrade/reef-x
$ git mv qa/suites/upgrade/reef-x/filestore-remove-check/1-ceph-install/quincy.yaml qa/suites/upgrade/reef-x/filestore-remove-check/1-ceph-install/reef.yaml
$ find qa/suites/upgrade/reef-x/ -type f -exec sed -i 's/quincy/reef/g' {} +
```

A note from rebase: changes from 05e24270a2
have been pulled in.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
081177f6a4 qa: stubs and clean up for reef
- remove upgrades from octopus
- stubs for completing upgrade to reef

Still missing the quincy-x upgrade tests.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Vallari Agrawal
42e121a42a
qa: add rbd/nvmeof test
A basic test for ceph-nvmeof[1] where
nvmeof initiator is created.
It requires use of a new task "nvmeof_gateway_cfg"
under cephadm which shares config information
between two remote hosts.

[1] https://github.com/ceph/ceph-nvmeof/

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2023-12-04 19:27:54 +05:30
Patrick Donnelly
215d96c1d1
qa: test fs:shell on all distros
This is a simple sub-suite that has one job. Always schedule on all supported distros.

Fixes: https://tracker.ceph.com/issues/43393
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-11-29 20:23:03 -05:00
Vallari Agrawal
b896bebf38
Merge pull request #54209 from VallariAg/wip-xml-scanner
qa: use Remote.run_unit_test and ValgrindScanner
2023-11-29 12:21:02 +05:30
Yuval Lifshitz
213923165c
Merge pull request #52931 from yuvalif/wip-yuval-lua-teuthology
rgw/test/lua: add lua integration tests suite

reviewed-by: TRYTOBE8TME, cbodley
2023-11-24 11:38:51 +02:00
Jane Zhu
96ca98a169 rgw/swift: preserve dashes/underscores in swift user metadata names
Signed-off-by: Juan Zhu <jzhu116@bloomberg.net>
2023-11-23 17:40:04 -05:00
Yuval Lifshitz
46500cace6 rgw/test/lua: add lua integration tests suite
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

Fixes: https://tracker.ceph.com/issues/63616
2023-11-23 16:36:28 +00:00
Xiubo Li
21a1e1cd95 qa/fscrypt: enable debug log for bluestore
We need to get more debug logs from bluestore to know what exactly
has happened for the extent map.

URL: https://tracker.ceph.com/issues/63586
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-11-23 15:22:53 +08:00
Dhairya Parmar
c556c73247 qa: refactor client upgrade yamls and other minor touchups
* start testing new_ops and stress_tests with both the drivers(i.e. fuse and kclient)
therefore moved 0-clients/ from tasks/3-workload/new_ops/ to tasks/ and renamed it to
2-clients/

* since new_ops/ and stress_tests/ now share the common upgrade yaml, moved the
tests yamls(in stress_tests/1-tests) directly under 3-workload/stress_tests/

* renamed 1-client-sanity.yaml in new_ops/ to newops.yaml

Fixes: https://tracker.ceph.com/issues/62953
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2023-11-22 14:30:41 +05:30
Casey Bodley
b0b050d31c
Merge pull request #52813 from cbodley/wip-59424
qa/rgw: run s3tests against keystone ec2

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-11-21 13:33:58 +00:00
Suyashd999
9b773eec4a qa/suites/rbd: Cleanup of MIRROR_IMAGE_MODE
Fixes: https://tracker.ceph.com/issues/63431
Signed-off-by: Suyash Dongre <suyashd999@gmail.com>
2023-11-14 18:28:02 +05:30
Adam King
9e2d5c4972
Merge pull request #49914 from adk3798/monitoring-teuth-test
qa/cephadm: basic test for monitoring stack

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-11-10 17:09:12 -05:00
Adam King
b4db5e4ffc qa/cephadm: adjust host drain test to handle explicit placement warning
Since we're adding a warning if any host is listed explicitly
in the placement of any service when removing the host,
we need to adjust the host drain test that removes a host
without the --force flag to not have the explicit hostname
in the placement for the mon service.

Signed-off-by: Adam King <adking@redhat.com>
2023-11-09 14:31:48 -05:00
Rishabh Dave
50aab7dadb
Merge pull request #50212 from rishabh-d-dave/fs-swap-subcmd
cephfs: add command "ceph fs swap"

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-11-08 21:18:27 +05:30