Commit Graph

10496 Commits

Author SHA1 Message Date
Samuel Just
31f7971eaf
Merge pull request #55188 from cyx1231st/wip-crimson-increase-obc-lru
common/options/crimson: increase crimson_osd_obc_lru_size to 512

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-18 08:52:15 -08:00
Matan Breizman
914b986610
Merge pull request #55172 from Matan-B/wip-matanb-crimson-neorados
rados_api_tests: Crimson Skip unsupported

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-18 12:22:49 +02:00
Venky Shankar
aeb75b5e4a Merge PR #54511 into main
* refs/pull/54511/head:
	test/libcephfs: move the snapdiff to a dedicated binary

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:29:04 +05:30
Venky Shankar
433fe34047 Merge PR #54682 into main
* refs/pull/54682/head:
	qa: drop mon_host check from test_cephfs_mirror_peer_bootstrap
	pybind/mgr/mirroring: drop mon_host from peer_list

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:25:47 +05:30
Venky Shankar
b5d0337092 Merge PR #54041 into main
* refs/pull/54041/head:
	qa: fix error reporting string in assert_cluster_log

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-17 19:59:22 +05:30
Matan Breizman
19e943627d qa/config/crimson_qa_overrides.yaml: Decrease lru_size for testing
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:51:50 +00:00
Matan Breizman
73b5e8c15d test/neorados/list: Seperate NeoRadosECTest from NeoRadosTest
otherwise SKIP_IF_CRIMSON won't work in this case

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
b99ffc4f3e test/neorados/aio_cxx: Seperate NeoRadosECTest from NeoRadosTest
SKIP_IF_CRIMSON won't work here since we try to create EC pools
prior to the test being run.
Skip if the entire test instead by seperating EC tests.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Ronen Friedman
bba3be3b47
Merge pull request #55175 from ronen-fr/wip-rf-max-test-options
qa/suites/rados/thrash: modify selection of max-scrubs configuration values

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 10:48:33 +02:00
Laura Flores
d38b2ba335
Merge pull request #55115 from ljflores/wip-tracker-63967
qa/tasks: fix syntax for deep-scrub command
2024-01-16 13:07:10 -06:00
Rishabh Dave
158f916f25
Merge pull request #54208 from neesingh-rh/json_asok_fix
qa: fix rank_asok() to handle errors from asok commands

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:45:09 +05:30
Rishabh Dave
4b39dedc5d
Merge pull request #54406 from vshankar/wip-63482
qa: enable debug mds/client for fs/nfs suite

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:42:37 +05:30
Rishabh Dave
bdd0c89185
Merge pull request #54590 from vshankar/wip-57087
qa: set mds config with `config set` for a particular test

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:39:21 +05:30
Ronen Friedman
f5e6b607b9 test/scrub: modify selection of max-scrubs configuration values
As the osd-max-scrubs default was increased from 1 to (currently) 3, the
original set of optional values under rados/thrash/3-scrub-overrides are
no longer useful.  This commits changes the set of optional values to
reflect the current default.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-14 20:53:38 +02:00
Casey Bodley
49c27499af
Merge pull request #53678 from cbodley/wip-qa-rgw-upgrade-reef
qa/rgw/upgrade: add reef as a starting release

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-01-11 16:08:24 +00:00
Milind Changire
f14f60afd5
Merge PR #53999 into main
* refs/pull/53999/head:
	PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
	snap_schedule/tests: fix db upgrade issue
	qa: add yaml for on demand subvol version testing
	qa: add test cases for testing --subvol and --group arguments
	mgr/volumes: conditionalize subvolume upgrade
	mgr/volumes: ensure correct init of v1 subvol
	mgr/snap_schedule: add subvol and subvol group arguments to cli
	mds/snap_schedule: add subvolume group column management
	mgr/volumes: add remote helper methods to fetch subvolume info

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-11 10:31:31 +05:30
Adam King
aacb91f60c
Merge pull request #52815 from adk3798/upgrade-nfs-migration-check
qa/cephadm: mgr-nfs-upgrade, match any migration > 2

Reviewed-by: Michael Fritch <mfritch@suse.com>
2024-01-10 09:01:12 -05:00
Adam King
71f706dbb4
Merge pull request #51963 from adk3798/async-timeout-fixup
mgr/cephadm: fixups for asyncio based timeout

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-01-10 08:59:51 -05:00
Laura Flores
25c16d7883 qa/tasks: fix syntax for deep-scrub command
Fixes: https://tracker.ceph.com/issues/63967
Signed-off-by: Laura Flores <lflores@ibm.com>
2024-01-09 10:54:01 -06:00
Adam King
df2e42c02f qa/cephadm: mgr-nfs-upgrade, match any migration > 2
I believe this check was originally added because
the 2->3 migration migrated some nfs related bits. Since
then we've had to update the migration this checks
for every time we bump the max migration. This change
is intended to instead just have it check for a
miration > 2 so we don't have to keep updating it.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 10:07:03 -05:00
Adam King
967716f2e6 qa/upgrade/reef-x: pull compiled cephadm to start upgrades from reef
The compiled zipapp cephadm that began in reef needs
to be pulled differently than the old single python script
cephadm from earlier releases. This commit updates the reef-x
upgrade suite to pull cephadm in this new way.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 09:51:52 -05:00
Adam King
67c5669157 qa/cephadm: support to pull stable branch compiled cephadm
This is to allow us to pull the latest build of
cephadm off of a stable branch (currently the only
valid option for that is reef, although this hopefully
will work with squid, T release, etc. in the future).

This should allow us to bootstrap cliusters based on
those stable branches for use in upgrade testing

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 09:51:52 -05:00
Milind Changire
2533ac5b90
qa: add yaml for on demand subvol version testing
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Milind Changire
006c68f492
qa: add test cases for testing --subvol and --group arguments
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Yuri Weinstein
556bd56b70
Merge pull request #48175 from amathuria/wip-add-test-case-bz-2011756
DaemonServer.cc: fix config show command for RGW daemons

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 07:37:54 -08:00
Casey Bodley
1e905d2c41 qa/rgw/upgrade: add reef as a starting release
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-04 09:37:56 -05:00
Samuel Just
066953050c
Merge pull request #54214 from athanatos/sjust/wip-crimson-scrub
crimson: add initial scrub support

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-03 15:26:45 -08:00
Adam King
efb69ee350 qa/cephadm: add test for cephadm asyncio based timeout
Adds a test that will set the default cephadm command
timeout and then force a timeout to occur by holding
the cephadm lock and triggering a device refresh.
This works because cephadm ceph-volume commands
require the cephadm lock to run, so the command will
timeout waiting for the lock to become available.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-03 08:40:47 -05:00
Ilya Dryomov
d17c1332d1
Merge pull request #54644 from idryomov/wip-63607
librados: make querying pools for selfmanaged snaps reliable

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-28 18:03:24 +01:00
Laura Flores
0a2572c78c
Merge pull request #53191 from rzarzynski/wip-all-kickoff-s-2
kickoff v19 squid
2023-12-22 14:16:49 -06:00
Ronen Friedman
5c0ae99be5 test/osd: log scrub performance counters in osd-scrub-test.sh
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-12-20 18:56:06 +02:00
Ronen Friedman
b7ff3fcd72
Merge pull request #54828 from ronen-fr/wip-rf-dec-fixes-1
osd/scrub: don't block high-priority scrubs on local resources

Reviewed-by: Samuel Just <sjust@redhat.com>-
2023-12-20 18:53:27 +02:00
Casey Bodley
ac48f16d85
Merge pull request #52495 from adamemerson/wip-neorados-learning-from-experience
neorados: Learning from experience

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-12-18 18:28:45 +00:00
Matan Breizman
e78ed2e7ab
Merge pull request #53227 from Matan-B/wip-matanb-cleanup-stale-osdmap
osd/OSD: introduce trim_stale_maps

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-12-18 16:36:49 +02:00
Matan Breizman
7ea40f0ee6 qa/tasks/ceph_manager: thrash - add trim stale osdmaps
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-12-18 12:56:24 +00:00
Casey Bodley
5ccc8f3b29
Merge pull request #54739 from cbodley/wip-qa-rgw-upgrade-distros
qa/rgw/upgrade: stop testing upgrade from pacific

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-12-16 16:24:57 +00:00
Patrick Donnelly
ca7230d1d8
Merge PR #52196 into main
* refs/pull/52196/head:
	qa: configure balancer for multi-mds workloads
	qa: create qa subvolumes in named subvolumegroup
	qa: do not rely on default max_mds value
	qa: add automate_balance to dashboard qa schema
	doc/cephfs: add docs for balance_automate
	doc/cephfs: use bash prompt for shell code
	mds: add balance_automate fs setting

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2023-12-15 08:18:28 -05:00
Casey Bodley
525282254e
Merge pull request #54840 from cbodley/wip-qa-rgw-crypt-disable-kmip
qa/rgw/crypt: disable failing kmip testing

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-12-15 04:10:13 +00:00
Casey Bodley
6b3f7423ab qa/rgw/upgrade: stop testing upgrade from pacific
squid won't support upgrades from pacific. stop all testing against
centos8 and ubuntu20

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-12-14 09:38:09 -05:00
Venky Shankar
5365d997ce Merge PR #48895 into main
* refs/pull/48895/head:
	qa: test cases for checking the health status after scrub repair
	mds: scrub repair does not clear earlier damage health status

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-12-13 20:53:13 +05:30
Venky Shankar
982a1b4cf2 Merge PR #54628 into main
* refs/pull/54628/head:
	qa/fscrypt: enable debug log for bluestore

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-12-13 20:49:52 +05:30
Venky Shankar
bbf35d1f94 Merge PR #54704 into main
* refs/pull/54704/head:
	qa: don't fail on gather_mount_info() failure

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2023-12-13 20:38:51 +05:30
Patrick Donnelly
5f51fc3147
qa: configure balancer for multi-mds workloads
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-12 11:45:28 -05:00
Patrick Donnelly
e555ab774b
qa: create qa subvolumes in named subvolumegroup
So we can twiddle the subvolumegroup settings (like pins).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-12 11:45:28 -05:00
Patrick Donnelly
e4f14d449d
qa: do not rely on default max_mds value
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-12 11:45:27 -05:00
Patrick Donnelly
7a2f59562c
qa: add automate_balance to dashboard qa schema
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-12 11:45:27 -05:00
Casey Bodley
37ccf0efab
Merge pull request #53830 from alimaredia/wip-test-librgw-file-sh-vstart
qa: enable test_librgw_file.sh to be run with vstart cluster

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-12-11 14:43:28 +00:00
Patrick Donnelly
23af075146
Merge PR #54726 into main
* refs/pull/54726/head:
	PendingReleaseNotes: announce cephfs-shell avail. on rhel9
	qa: test fs:shell on all distros
	qa: add cephfs-shell to installed rpm packages
	ceph.spec.in: enable support for cephfs-shell by default via EPEL9

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-12-11 08:37:39 -05:00
Ronen Friedman
eb5a5e990a test/scrub: fix osd-recovery-scrub.sh to look for correct log message
... matching the code changes in the previous commit.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-12-11 01:30:06 -06:00
Samuel Just
77fe84c095 qa/tasks/ceph: use tell <pgid> deep_scrub in osd_scrub_pgs
This is the more modern variant.  Crimson doesn't currently
support the pg <pgid> deep_scrub variant, so let's just use
this one generally.

Signed-off-by: Samuel Just <sjust@redhat.com>
2023-12-11 04:10:17 +00:00