Commit Graph

11211 Commits

Author SHA1 Message Date
Casey Bodley
630f8e04c0
Merge pull request #59241 from tobias-urdin/openstack-upperconstraints
qa: barbican: restrict python packages with upper-constraints

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-08-19 13:10:57 -04:00
Yuri Weinstein
959a4c3017
Merge pull request #58961 from NitzanMordhai/wip-nitzan-dencoder-test-forward-incompat-fix
workunit/dencoder: dencoder test forward incompat fix

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-08-19 07:25:47 -07:00
Tobias Urdin
bbcb820c77 qa: barbican: restrict python packages with upper-constraints
We install barbican by doing a pip install directly on the
cloned git repository but we don't honor the upper-constraints
from the OpenStack Requirements project that handles what
versions is supported.

This changes the pip install command that we issue when
installing barbican to honor the requirements for the
version (derived from the branch) that we use, in
this case it's the 2023.1 release upper-constraints [1].

This prevents us from pulling in untested Python packages.

This only updates Barbican because for the Keystone job
we dont directly issue pip but install using tox using the
`venv` environment which already by default sets the
constraints as you can see in [2].

[1] https://releases.openstack.org/constraints/upper/2023.1
[2] https://github.com/openstack/keystone/blob/stable/2023.1/tox.ini#L12

Fixes: https://tracker.ceph.com/issues/67444
Signed-off-by: Tobias Urdin <tobias.urdin@binero.com>
2024-08-19 15:02:16 +02:00
Yuval Lifshitz
7d2cf2cabc
Merge pull request #59239 from yuvalif/wip-yuval-67513
Reviewed-By: Casey Bodley <cbodley@ibm.com>


test/rgw/notification: use real ip address instead of localhost

based on that comment:
https://tracker.ceph.com/issues/67206#note-6
the address used by the endpoint is taken as the real IP address of the
host where the test script is running and not localhost.

we also changed the rabbitmq-server conf to allow "guest"
user to connect over non localhost address

Fixes: https://tracker.ceph.com/issues/67206

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-08-19 13:37:07 +03:00
Nizamudeen A
60be38e077
Merge pull request #58995 from rhcs-dashboard/fix-66844-main
qa/mgr/dashboard: fix test race condition

Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-08-19 11:19:52 +05:30
Yuval Lifshitz
cdd75b499f test/rgw/notification: use real ip address instead of localhost
based on that comment:
https://tracker.ceph.com/issues/67206#note-6
the address used by the endpoint is taken as the real IP address of the
host where the test script is running and not localhost.

we also changed the rabbitmq-server conf to allow "guest"
user to connect over non localhost address

Fixes: https://tracker.ceph.com/issues/67206

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-08-16 14:36:17 +03:00
Laura Flores
cd8bdbeb9f
Merge pull request #58415 from ljflores/wip-tracker-66809
qa/suites/upgrade: ignore PG_AVAILABILITY and MON_DOWN for quincy-x and reef-x upgrade suites
2024-08-15 14:02:36 -05:00
Yuval Lifshitz
cb8d669457
Merge pull request #58911 from yuvalif/wip-yuval-67229
test/cls_2pc_queue: prevent list+remove race between consumers

Reviewed-By: Casey Bodley <cbodley@ibm.com>
2024-08-15 11:00:20 +03:00
Casey Bodley
5000b233c1
Merge pull request #59169 from cbodley/wip-67464
rgw: revert account-related changes to get_iam_policy_from_attr()

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2024-08-14 09:14:13 -04:00
Ronen Friedman
3a1e3054be
Merge pull request #57888 from liangmingyuanneo/wip-standalone-test-pg-repair
qa/standalone: bugfix for latecy repair after scrub

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-08-14 16:12:28 +03:00
Laura Flores
e225b127ea qa/suites/upgrade: ignore MON_DOWN and PG_AVAILABILITY warnings in upgrade tests
Signed-off-by: Laura Flores <lflores@ibm.com>
2024-08-13 17:58:17 -05:00
Casey Bodley
f38429b857 qa/s3tests: configure tenant name for 's3 tenant' section
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-13 13:06:50 -04:00
Ilya Dryomov
53b533f635
Merge pull request #59112 from idryomov/wip-67353
qa: adjust expected io_opt in krbd_discard_granularity.t

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-08-13 16:39:05 +02:00
Adam Kupczyk
a787a91719
Merge pull request #54504 from aclamk/wip-aclamk-bs-refactor-write-path
os/bluestore: Recompression, part 2. New write path.
2024-08-13 15:15:50 +02:00
Patrick Donnelly
8017ef589d
Merge PR #58532 into main
* refs/pull/58532/head:
	qa: improve and add commit ID to comment for context

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-12 12:11:16 -04:00
Ilya Dryomov
efba8044e8
Merge pull request #58573 from idryomov/wip-selinux-drop-ignore-agetty
qa: agetty entry in selinux allowlist is redundant now

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-09 20:22:12 +02:00
Ilya Dryomov
e8126bf2f6 qa: cover a custom object size in krbd_discard_granularity.t
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-08-09 18:00:40 +02:00
Ilya Dryomov
144270eb73 qa: adjust expected io_opt in krbd_discard_granularity.t
With linux.git commit a00d4bfce7c6 ("rbd: increase io_opt again"),
io_opt is set to object set size.

Fixes: https://tracker.ceph.com/issues/67353
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-08-09 18:00:31 +02:00
Adam King
528a1eb204
Merge pull request #58605 from adk3798/upgrade-suite-upgrade-in-progress-checks
qa/upgrade: fix checks to make sure upgrade is still in progress

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-09 10:00:31 -04:00
Laura Flores
bd1082daaa
Merge pull request #58736 from amathuria/wip-66922-amat
qa/rados/dashboard: Add PG_DEGRADED to ignorelist
2024-08-08 15:41:18 -05:00
Guillaume Abrioux
1924efd8db
Merge pull request #57037 from adk3798/cephadm-limit-shell-mounts
cephadm: limit mounts for shell and ceph-volume commands
2024-08-08 21:12:38 +02:00
Laura Flores
ad8264e889
Merge pull request #59030 from ljflores/wip-fix-crontab-2
qa/crontab: force priority for main rados nightlies
2024-08-08 09:53:36 -05:00
Venky Shankar
052cb8deb1
Merge pull request #58583 from lxbsz/wip-66946
qa/cephfs: fix TestRenameCommand and unmount the clinet before failin…

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-08 17:55:24 +05:30
Patrick Donnelly
cfed7c0baa
Merge PR #59029 into main
* refs/pull/59029/head:
	qa: simplify postmerge construction

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2024-08-07 20:58:17 -04:00
Ilya Dryomov
d5a061e68b
Merge pull request #44366 from orozery/rbd-crypto-migration
librbd/crypto: fix issue when live-migrating from encrypted export

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-08-08 00:30:24 +02:00
Kamoltat (Junior) Sirivadhna
6a0d503a59
Merge pull request #56233 from kamoltat/wip-ksirivad-fix-64802
RADOS: Generalize stretch mode pg temp handling to be usable without stretch mode
Samuel Just <sjust@redhat.com>
2024-08-07 09:45:54 -04:00
Adam Kupczyk
8bd233bef5 qa/bluestore: Add write_v1/v2 selection
Add framework for various random options for debug bluestore.
Use framework to select:
- write_v1
- write_v2
- write_v1 / write_v2 selected at random

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
2024-08-07 10:55:46 +00:00
Ilya Dryomov
0000c34474 librbd/migration: make ImageDispatch handle encryption for non-native formats
With NativeFormat now being handled via dispatch, handling encryption
for non-native formats (i.e. mapping to raw image extents and performing
decryption/mapping back on completion) in the migration layer is really
straightforward.

Note that alignment doesn't need to be performed in the migration layer
because it happens on the destination image -- the "align and resubmit"
logic in C_UnalignedObjectReadRequest should kick in before the call to
read_parent().

Fixes: https://tracker.ceph.com/issues/53674
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-08-07 12:35:34 +02:00
Ilya Dryomov
82d26909cb qa/workunits/rbd: perform cleanup in test_clone_encryption()
... so that RAW_DEV can be unmapped and future tests can reuse testimg
and other image names without bumping into watchers and older snapshots.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-08-07 12:35:34 +02:00
Ilya Dryomov
830cbee7a5 qa/workunits/rbd: no need to chmod in luks-encryption.sh
Most workunits expect the user to be a member of "disk" group, so we
can pretty much rely on that being the case at this point.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-08-07 12:35:34 +02:00
Xiubo Li
ae3faac004 qa/cephfs: fix TestRenameCommand and unmount the clinet before failing fs
We should else bring and wait for MDS to be up since it is needed
for unmounting of CephFS in CephFSTestCase.tearDown() to be successful,
or just unmount the mountpoints before failing the filesystem.

Since the mountpoint won't be used in later tests so we just unmount
it.

Fixes: https://tracker.ceph.com/issues/66946
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2024-08-07 13:23:07 +08:00
Venky Shankar
c9ab079494
Merge pull request #56782 from joscollin/wip-B65171-support-replication-start-end-notifications
cephfs_mirror: provide metrics for last successful snapshot sync

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-07 09:51:36 +05:30
Venky Shankar
92ad0c83aa
Merge pull request #57458 from lxbsz/wip-session-evict
qa/cephfs: add test_session_evict_non_blocklisted test case

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-07 09:50:00 +05:30
Venky Shankar
f9d1924036
Merge pull request #57987 from joscollin/wip-B64752-valgrind-report-leaks
qa/suites: drop --show-reachable=yes from fs:valgrind tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-07 09:49:03 +05:30
Patrick Donnelly
95dffdcbbd
Merge PR #58582 into main
* refs/pull/58582/head:
	test: add a test for `fs set down` on online cluster
	mon: fix `fs set down` to adjust max_mds only when cluster is not down

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-06 17:03:25 -04:00
NitzanMordhai
58a668dba4
Merge pull request #58282 from NitzanMordhai/wip-nitzan-daemonwatchdog-should-terminate-thrasher-when-bark
qa/tasks: watchdog should terminate thrasher
2024-08-06 14:26:47 +03:00
Adam Kupczyk
e88ab6547e
Merge pull request #58664 from aclamk/wip-aclamk-qa-less-bluestore-debug
qa/suites/rados: Reduced BlueStore log levels
2024-08-06 12:53:02 +02:00
Nitzan Mordechai
a035b5a22f thrashers: standardize stop and join method names
Thrashers that do not inherit from ThrasherGreenlet previously used a
method called do_join, which combined stop and join functionality. To
ensure consistency and clarity, we want all thrashers to use separate
stop, join, and stop_and_join methods.

This commit renames methods and implements missing stop and stop_and_join
methods in thrashers that did not inherit from ThrasherGreenlet.

Fixes: https://tracker.ceph.com/issues/66698
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2024-08-06 06:57:40 +00:00
Nitzan Mordechai
21b4b89e52 qa/tasks: watchdog terminate thrasher
If a thrasher exception occurs, the do_dump_ops thread will continue
looping until the Teuthology timeout is reached.
The watchdog should terminate the thrasher to free up resources.

Fixes: https://tracker.ceph.com/issues/66698
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2024-08-06 06:56:00 +00:00
Patrick Donnelly
382357dcd4
qa: simplify postmerge construction
and avoid errors when "clusternodes" is not defined.

Fixes: https://tracker.ceph.com/issues/67352
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-05 21:07:24 -04:00
Laura Flores
126184fcc9 qa/crontab: force priority for main rados nightlies
Followup to 3f62db0393.
The suite is large, so we need to force the priority. This is warranted
since the rados team makes a lot of use of the main runs.

Signed-off-by: Laura Flores <lflores@ibm.com>
2024-08-05 17:56:39 -05:00
Ernesto Puerta
6c7253be6f
qa/mgr/dashboard: fix test race condition
Fixes: https://tracker.ceph.com/issues/66844

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2024-08-05 18:48:14 +02:00
kyr
01a9f08544
Merge pull request #58373 from ceph/wip-tasks-ceph-mkfs-has-no-f
qa: ceph.py mkfs.ext4 has no -f
2024-08-05 17:44:14 +02:00
Yuval Lifshitz
03c839e14f test/cls_2pc_queue: prevent list+remove race between consumers
* make sure that the queue full condition is covered
* add cls debugging to test

Fixes: https://tracker.ceph.com/issues/67229

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-08-05 08:34:56 +00:00
Adam King
8164efe5d0 qa/cephadm: use cephadm ceph-volume directly to zap devs
This was running ceph-volume through the
cephadm shell previously, but as we are trying
to remove mount points from cephadm shell, this
no longer works (specifically without the /dev mount)

Signed-off-by: Adam King <adking@redhat.com>
2024-08-02 12:32:51 -04:00
Yuri Weinstein
dd87d573cf
Merge pull request #58635 from badone/wip-tracker-50371-rados_api_test-timeout-failures
qa: Restrict rados api tests to large clusters and increase timeout

Reviewed-by: Laura Flores <lflores@redhat.com>
2024-08-01 06:44:34 -07:00
Yuri Weinstein
a2c60161de
Merge pull request #57863 from NitzanMordhai/wip-nitzan-thrash-erasure-code-crush-4-nodes-8-6-overrides
suites/ec-rados-plugin=jerasure-k=8-m=6-crush: roles set with overrides

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2024-08-01 06:42:09 -07:00
Venky Shankar
f4b5465815 Merge PR #51332 into main
* refs/pull/51332/head:
	qa: add test for ceph tell with unknown cephtype
	pybind/ceph_argparse: fixing error message for ceph tell command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2024-08-01 12:19:52 +05:30
Shilpa Jagannath
4f18f8a607
Merge pull request #56792 from cbodley/wip-qa-rgw-notifications-valgrind
qa/rgw: enable valgrind in rgw/notifications suite
2024-07-31 10:10:26 -07:00
Yuri Weinstein
1a2a617edd
Merge pull request #54671 from baum/ceph-nvmeof-mon
mon: add NVMe-oF gateway monitor and HA

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-07-31 09:05:41 -07:00