Commit Graph

11310 Commits

Author SHA1 Message Date
Patrick Donnelly
95e8c42f4c
qa: print config dump after setting
For debugging.

Fixes: https://tracker.ceph.com/issues/67737
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-09-16 15:39:11 -04:00
Pedro Gonzalez Gomez
82e3d5962b
Merge pull request #58456 from rhcs-dashboard/auth2-sso
mgr/dashboard: Add SSO through oauth2 protocol

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2024-09-16 17:20:12 +02:00
Pedro Gonzalez Gomez
a3767525d8 mgr/dashboard: add SSO through oauth2 protocol
Fixes: https://tracker.ceph.com/issues/66900
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-09-16 14:03:24 +02:00
Rishabh Dave
4d96f4339f
Merge pull request #57459 from mchangir/mds-snap_schedule-relocate-test-and-overrides-to-correct-location
qa: relocate subvol creation overrides and test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-09-16 15:53:56 +05:30
Matan Breizman
f81f728f57
Merge pull request #59506 from Matan-B/wip-matanb-crimson-seastore-logs
qa/config/seastore: enable all subsystem debug

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-09-12 13:40:53 +03:00
Ronen Friedman
8b5058caae
Merge pull request #59590 from ronen-fr/wip-rf-delay-conf
osd/scrub: add configuration parameters to control delay duration

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-09-08 16:59:22 +03:00
Ilya Dryomov
7f24e58932
Merge pull request #44640 from effi-ofer/live-migration-nbd
librbd/migration: add NBD stream

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-09-07 12:07:27 +02:00
Venky Shankar
485717a0e3
Merge pull request #57388 from mchangir/mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds
mgr/snap_schedule: correctly fetch mds_max_snaps_per_dir from mds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-06 19:33:52 +05:30
Rishabh Dave
29650c2e00
Merge pull request #44359 from mchangir/mds-uninline-file-during-scrub
mds: un-inline data on scrub

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2024-09-06 18:31:13 +05:30
Ilya Dryomov
3260b8fbea qa/suites/rbd: add snippets for migration import from NBD
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-09-06 14:14:12 +02:00
Ilya Dryomov
90b55cfdc2 librbd/migration/NBDStream: switch to NBD URIs
This removes the constraint on the transport being TCP, allowing to
use a Unix domain socket or other options.  It also allows specifying
export names which a) are needed in case of serving different content
on different exports and b) some servers may require regardless.

Additionally, NBD URIs are future proof as all that NBDStream needs to
do is forward the string to libnbd.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-09-06 14:14:12 +02:00
Effi Ofer
dc8eed68ce librbd/migration: add nbd stream
Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
Signed-off-by: Effi Ofer <effio@il.ibm.com>
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-09-06 14:14:12 +02:00
Milind Changire
ef68253a87
qa: relocate subvol creation overrides and test
Fixes: https://tracker.ceph.com/issues/65829
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-09-06 10:11:02 +05:30
Casey Bodley
4ee8e591f3
Merge pull request #56597 from liangmingyuanneo/optimize-reshard
rgw reshard: optimize reshard process to minimum blocking time

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-09-05 13:21:47 -04:00
Milind Changire
1fda7cb7e2
qa: test fetching foreign config item
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-09-05 11:59:38 +05:30
Laura Flores
c2456be1ff
Merge pull request #59474 from athanatos/sjust/for-review/wip-67755-fix-msr-feature
osd: fix require_min_compat_client handling for msr rules
2024-09-04 20:03:28 -05:00
Nizamudeen A
93ba7b05d0
Merge pull request #59530 from rhcs-dashboard/api_test_mgr_module_failure
qa/tests: fix test_list_enabled_modules timeout error

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2024-09-04 19:27:52 +05:30
Ronen Friedman
ec8f61ffa6 test/osd: fix 'recovery scrub' standalone test
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-09-04 07:07:46 -05:00
Ronen Friedman
c0a52a5969 test/osd/scrub: set new scrub-related config options to test values
shortening the delay times following various scrub events.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-09-04 07:07:46 -05:00
Ilya Dryomov
f7168600a8
Merge pull request #59551 from idryomov/wip-67845
librbd/migration: prune snapshot extents in RawFormat::list_snaps()

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-09-04 13:03:04 +02:00
Nizamudeen A
b2da7394ee qa/tests: fix test_list_enabled_modules timeout error
This test deals with enabling/disabling the modules. The assumption I
have is after enabling the
module test will wait for an active mgr but its not able to find it in
time and it fails. so taking inspiration from 6c7253be6f adding retries and logs to see if that's the case

Fixes: https://tracker.ceph.com/issues/62972
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-09-04 14:51:07 +05:30
liangmingyuan
196a73cbd4 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key()
Add some testing cases and do cleanup too.

Signed-off-by: Mingyuan Liang <liangmingyuan@baidu.com>
2024-09-04 09:49:18 +08:00
Casey Bodley
a10155d43e
Merge pull request #59535 from cbodley/wip-qa-rgw-multisite-account-zone
qa/rgw/multisite: specify realm/zonegroup/zone args for 'account create'

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2024-09-03 20:43:34 -04:00
Vallari Agrawal
53cc78b222
Merge pull request #59178 from VallariAg/wip-nvmeof-teuthology-v6
qa: add namespace and scale testing for nvmeof teuthology suite
2024-09-03 11:29:01 +05:30
Vallari Agrawal
da8e95c392
qa/suites/nvmeof: wait for service "nvmeof.mypool.mygroup0"
This is because nvmeof gateway group names are now
part of service id.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-09-02 19:42:34 +05:30
Vallari Agrawal
4d97b1aa6b
qa/suites/nvmeof: increase hosts in cluster setup
In "nvmeof" task, change "client" config to "installer"
which allows to take inputs like "host.a".

nvmeof/basic: change 2-gateway-2-initiator to
	       4-gateway-2-inititator cluster
nvmeof/thrash: change 3-gateway-1-initiator to
	        4-gateway-1-inititaor cluster

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-09-02 19:42:12 +05:30
Vallari Agrawal
2ed818ebd8
qa: move nvmeof shell scripts to qa/workunits/nvmeof
Move all scripts qa/workunits/rbd/nvmeof_*.sh
to qa/workunits/nvmeof/*.sh

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-09-02 17:04:55 +05:30
Venky Shankar
f070510eb3
Merge pull request #58543 from rishabh-d-dave/tracker-65808
cephfs: disallow removing root_squash via "fs authorize" cmd

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-02 15:13:34 +05:30
Ilya Dryomov
d9192b5aca librbd/migration: prune snapshot extents in RawFormat::list_snaps()
list-snaps is exempt from clipping in ImageDispatcher::PreprocessVisitor
because it's considered to be an internal API.  Further, reads issued
by ObjectCopyRequest based on list-snaps results may also be exempt
because of READ_FLAG_DISABLE_CLIPPING.

Since RawFormat allows specifying a set of snapshots (possibly of
varying size!) to be imported, it needs to compensate for that in its
list-snaps implementation.  Otherwise, an out-of-bounds read will
eventually be submitted to the stream.

Fixes: https://tracker.ceph.com/issues/67845
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-09-01 19:37:30 +02:00
Casey Bodley
15df7efca5 qa/rgw/multisite: add optional --default arg to 'realm pull'
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-30 13:52:01 -04:00
Casey Bodley
7bbaa31664 qa/rgw/multisite: fix spelling of is_default in realm configs
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-30 11:32:38 -04:00
Casey Bodley
e4157c8e98 qa/rgw/multisite: specify realm/zonegroup/zone args for 'account create'
in the rgw/multisite suite, jobs fail on user creation:

> radosgw-admin --cluster c1 account create --account-id RGW11111111111111111
> radosgw-admin --cluster c1 user create --uid rgw-multisite-test-user --account-id RGW11111111111111111 --account-root --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name TestUser --gen-access-key --gen-secret
> could not create user: unable to create user, Failed to load account by id

realms/two-zones.yaml misspells `is_default` as `is default` for the
realm, so it doesn't get set as default. the `account create` command
doesn't specify a realm/zonegroup/zone, so operates on the "default"
zone and zonegroup

use `zone_args()` to add the explicit realm/zonegroup/zone arguments

Fixes: https://tracker.ceph.com/issues/67839

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-30 11:32:29 -04:00
Venky Shankar
1650722139 Merge PR #59309 into main
* refs/pull/59309/head:
	qa: ignore warnings variations

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-30 17:53:31 +05:30
Venky Shankar
52deba6b14 Merge PR #58547 into main
* refs/pull/58547/head:
	qa: failfast mount for better performance

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-30 11:03:26 +05:30
Samuel Just
4f9289e11a qa/tasks/ceph_manager: set-require-min-compat-client to squid for msr profiles
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-08-30 00:34:46 +00:00
Patrick Donnelly
0a05dacc07
Merge PR #59310 into main
* refs/pull/59310/head:
	qa: load all dirfrags before testing altname recovery

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-08-29 13:39:56 -04:00
Matan Breizman
dbebf1a3db qa/config/seastore: enable all subsystem debug
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-08-29 08:34:49 +00:00
Adam King
f597caacea
Merge pull request #59419 from phlogistonjohn/jjm-smb-ctdb-vips
smb: cluster public ip addresses support

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Michael Adam <obnox@samba.org>
2024-08-28 08:45:43 -04:00
Vallari Agrawal
e5a9cda326
qa/suites/nvmeof/basic: add nvmeof_scalability test
Add test to upscale/downscale nvmeof
gateways.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-08-28 18:12:29 +05:30
Vallari Agrawal
58d8be9fd8
qa: Expand nvmeof thrasher and add nvmeof_namespaces.yaml job
1. qa/tasks/nvmeof.py: add other methods to stop nvmeof daemons
2. add qa/workunits/rbd/nvmeof_namespace_test.sh which adds and
   deletes new namespaces. It is run in nvmeof_namespaces.yaml
   job where fio happens to other namespaces in background.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-08-28 18:12:28 +05:30
Vallari Agrawal
02fe44ac60
Merge pull request #59434 from VallariAg/fix-nvmeof-apply-teuthology
qa/tasks/nvmeof.py: add nvmeof gw-group to deployment
2024-08-28 18:07:35 +05:30
Milind Changire
277423c15a
qa: add test for data uninlining
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-08-28 13:28:27 +05:30
John Mulligan
dc09d17eca qa/suites/orch: add test for smb with ctdb and cluster public ips
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2024-08-27 17:12:56 -04:00
Patrick Donnelly
782c88aa96
qa: ignore warnings variations
Fixes: https://tracker.ceph.com/issues/67601
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-27 16:51:52 -04:00
Adam King
601fcfa918
Merge pull request #58380 from adk3798/squid-base-mds-upgrade-sequence-cephadm
qa/suites/fs: pull compiled cephadm for squid branch in mds_upgrade_sequence

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-08-27 13:33:15 -04:00
Adam King
639916859f
Merge pull request #59421 from phlogistonjohn/jjm-teuth-cephadm-from-ctr
qa/tasks: add a new cephadm_from_container feature to cephadm task

Reviewed-by: Adam King <adking@redhat.com>
2024-08-27 13:32:43 -04:00
Patrick Donnelly
64e2bd347b
Merge PR #58419 into main
* refs/pull/58419/head:
	mds: generate correct path for unlinked snapped files
	qa: add test for cephx path check on unlinked snapped dir tree
	mds: add debugging for stray_prior_path

Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-08-27 13:10:54 -04:00
Patrick Donnelly
925c1f9fb1
Merge PR #58987 into main
* refs/pull/58987/head:
	qa/cephfs: update ignorelist

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-27 13:10:10 -04:00
Patrick Donnelly
305235f11e
Merge PR #59095 into main
* refs/pull/59095/head:
	qa: wait for file creation before changing mode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-27 13:09:11 -04:00
Adam King
418b53c1a3
Merge pull request #59409 from adk3798/teuth-reinstall-nvme-cli
qa/distros: reinstall nvme-cli on centos 9 nodes

Reviewed-by: Guillaume Abrioux <gabrioux@ibm.com>
2024-08-27 08:48:26 -04:00