Commit Graph

4416 Commits

Author SHA1 Message Date
Venky Shankar
635b554107
Merge pull request #56118 from joscollin/wip-B64711-qa-failure_cancel-mirroring-and-readd
cephfs_mirror, qa: fix test failure test_cephfs_mirror_cancel_mirroring_and_readd

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-07 12:38:40 +05:30
Casey Bodley
f601351451
Merge pull request #59770 from cbodley/wip-qa-unpin-tox
qa/tasks/tox: unpin tox version

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2024-10-04 14:04:18 -04:00
Ilya Dryomov
731cee700d
Merge pull request #60005 from idryomov/wip-68213
qa/suites/rbd/iscsi: enable all supported container hosts

Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2024-10-02 07:50:27 +02:00
Casey Bodley
b39ee67429 qa/tasks/tox: unpin tox version
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-10-01 13:57:52 -04:00
Venky Shankar
592a19993c
Merge pull request #59875 from joscollin/wip-B68131-revert-sync-duration
cephfs_mirror: revert sync_duration to seconds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-01 09:38:40 +05:30
Venky Shankar
d31541dc8e Merge PR #59874 into main
* refs/pull/59874/head:
	mds: invalid id for client eviction is to be treated as success

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
2024-09-30 15:38:04 +05:30
Ilya Dryomov
9022ef19a5 qa/tasks/ceph_iscsi_client: don't use mpathconf
... since it's not available on Ubuntu.  In this case mpathconf just
sets a couple of default values and defines an empty blacklist section,
so it's easy enough to replicate.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-09-26 18:17:05 +02:00
Kamoltat (Junior) Sirivadhna
abfff2b714
Merge pull request #57146 from kamoltat/wip-ksirivad-fix-connection-score-json
src/mon/ConnectionTracker.cc: Fix dump function
Reviewed-by Kamoltat Sirivadhna <ksirivad@redhat.com>
2024-09-26 10:15:04 -04:00
Patrick Donnelly
34748207aa
Merge PR #59467 into main
* refs/pull/59467/head:
	qa: correct daemon for warning conf
	qa: print config dump after setting

Reviewed-by: Adam King <adking@redhat.com>
2024-09-25 17:02:41 -04:00
Jos Collin
46e3e28a2e
qa: update test for last_sync_duration
Fixes: https://tracker.ceph.com/issues/68131
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-09-23 14:43:33 +05:30
Venky Shankar
4277cd2989 mds: invalid id for client eviction is to be treated as success
Introduced-by: 0ef5941a2e
Fixes: http://tracker.ceph.com/issues/68132
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-09-23 08:29:59 +00:00
Guillaume Abrioux
902a45a23c qa: remove all bluestore signatures on devices
We must ensure BlueStore signatures are removed altogether since
multiple BlueStore label replications have been introduced.

Fixes: https://tracker.ceph.com/issues/68171

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
2024-09-20 22:34:07 +00:00
Venky Shankar
d0a3655d57 Merge PR #59111 into main
* refs/pull/59111/head:
	doc: document earmark option for subvolume and new commands
	qa/cephfs: update tests for test_volumes & unit-test for earmarking
	mgr/volumes: add earmarking for subvol

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-09-18 11:03:58 +05:30
Adam King
4adee01313
Merge pull request #54277 from rhcs-dashboard/nfs-export-apply-fix
mgr/nfs: generate user_id & access_key for apply_export(CephFS)

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-09-17 09:08:01 -04:00
Venky Shankar
8bd63f8818 Merge PR #55421 into main
* refs/pull/55421/head:
	qa/cephfs: add test to verify backtrace update failure on deleted data pool
	mds: batch backtrace updates by pool-id when expiring a log segment
	mds: dump log segment in segment expiry callback
	mds: dump log segment end along with offset

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-09-17 16:48:03 +05:30
Venky Shankar
b57eb17e35
Merge pull request #59093 from joscollin/wip-fix-get-set-dirty-snap-id
qa: do the set/get attribute on the remote filesystem

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-17 16:46:06 +05:30
Avan Thakkar
d2f8d10221 qa/cephfs: update tests for test_volumes & unit-test for earmarking
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-09-17 13:18:25 +05:30
Patrick Donnelly
95e8c42f4c
qa: print config dump after setting
For debugging.

Fixes: https://tracker.ceph.com/issues/67737
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-09-16 15:39:11 -04:00
Avan Thakkar
b895e596a8 doc: nit fixes for nfs doc
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Fixes some doc lint and also fixed qa tests for having both 3 & 4 protocols
by default in expot config.
2024-09-17 00:46:00 +05:30
Pedro Gonzalez Gomez
82e3d5962b
Merge pull request #58456 from rhcs-dashboard/auth2-sso
mgr/dashboard: Add SSO through oauth2 protocol

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2024-09-16 17:20:12 +02:00
Pedro Gonzalez Gomez
a3767525d8 mgr/dashboard: add SSO through oauth2 protocol
Fixes: https://tracker.ceph.com/issues/66900
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-09-16 14:03:24 +02:00
Venky Shankar
485717a0e3
Merge pull request #57388 from mchangir/mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds
mgr/snap_schedule: correctly fetch mds_max_snaps_per_dir from mds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-06 19:33:52 +05:30
Rishabh Dave
29650c2e00
Merge pull request #44359 from mchangir/mds-uninline-file-during-scrub
mds: un-inline data on scrub

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2024-09-06 18:31:13 +05:30
Milind Changire
1fda7cb7e2
qa: test fetching foreign config item
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-09-05 11:59:38 +05:30
Laura Flores
c2456be1ff
Merge pull request #59474 from athanatos/sjust/for-review/wip-67755-fix-msr-feature
osd: fix require_min_compat_client handling for msr rules
2024-09-04 20:03:28 -05:00
Nizamudeen A
93ba7b05d0
Merge pull request #59530 from rhcs-dashboard/api_test_mgr_module_failure
qa/tests: fix test_list_enabled_modules timeout error

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2024-09-04 19:27:52 +05:30
Nizamudeen A
b2da7394ee qa/tests: fix test_list_enabled_modules timeout error
This test deals with enabling/disabling the modules. The assumption I
have is after enabling the
module test will wait for an active mgr but its not able to find it in
time and it fails. so taking inspiration from 6c7253be6f adding retries and logs to see if that's the case

Fixes: https://tracker.ceph.com/issues/62972
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-09-04 14:51:07 +05:30
Casey Bodley
a10155d43e
Merge pull request #59535 from cbodley/wip-qa-rgw-multisite-account-zone
qa/rgw/multisite: specify realm/zonegroup/zone args for 'account create'

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2024-09-03 20:43:34 -04:00
Vallari Agrawal
53cc78b222
Merge pull request #59178 from VallariAg/wip-nvmeof-teuthology-v6
qa: add namespace and scale testing for nvmeof teuthology suite
2024-09-03 11:29:01 +05:30
Vallari Agrawal
4d97b1aa6b
qa/suites/nvmeof: increase hosts in cluster setup
In "nvmeof" task, change "client" config to "installer"
which allows to take inputs like "host.a".

nvmeof/basic: change 2-gateway-2-initiator to
	       4-gateway-2-inititator cluster
nvmeof/thrash: change 3-gateway-1-initiator to
	        4-gateway-1-inititaor cluster

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-09-02 19:42:12 +05:30
Venky Shankar
f070510eb3
Merge pull request #58543 from rishabh-d-dave/tracker-65808
cephfs: disallow removing root_squash via "fs authorize" cmd

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-02 15:13:34 +05:30
Casey Bodley
15df7efca5 qa/rgw/multisite: add optional --default arg to 'realm pull'
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-30 13:52:01 -04:00
Casey Bodley
e4157c8e98 qa/rgw/multisite: specify realm/zonegroup/zone args for 'account create'
in the rgw/multisite suite, jobs fail on user creation:

> radosgw-admin --cluster c1 account create --account-id RGW11111111111111111
> radosgw-admin --cluster c1 user create --uid rgw-multisite-test-user --account-id RGW11111111111111111 --account-root --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name TestUser --gen-access-key --gen-secret
> could not create user: unable to create user, Failed to load account by id

realms/two-zones.yaml misspells `is_default` as `is default` for the
realm, so it doesn't get set as default. the `account create` command
doesn't specify a realm/zonegroup/zone, so operates on the "default"
zone and zonegroup

use `zone_args()` to add the explicit realm/zonegroup/zone arguments

Fixes: https://tracker.ceph.com/issues/67839

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-30 11:32:29 -04:00
Samuel Just
4f9289e11a qa/tasks/ceph_manager: set-require-min-compat-client to squid for msr profiles
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-08-30 00:34:46 +00:00
Patrick Donnelly
0a05dacc07
Merge PR #59310 into main
* refs/pull/59310/head:
	qa: load all dirfrags before testing altname recovery

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-08-29 13:39:56 -04:00
Avan Thakkar
b8f3db5b40 mgr/nfs: add additional tests for cmount_path & user_id deletion
Add unit tests for unique user ID generation, deletion and `cmount_path` handling in FSAL exports

- Ensure unique user ID generation for different FSAL blocks when creating exports.
- Test deletion behavior when multiple exports share the same user ID and one has a unique ID.
- Test default behavior when no `cmount_path` is provided (defaults to `/`).
- Add tests to validate error handling for invalid `cmount_path` values.

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-08-29 17:45:55 +05:30
Vallari Agrawal
e5a9cda326
qa/suites/nvmeof/basic: add nvmeof_scalability test
Add test to upscale/downscale nvmeof
gateways.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-08-28 18:12:29 +05:30
Vallari Agrawal
58d8be9fd8
qa: Expand nvmeof thrasher and add nvmeof_namespaces.yaml job
1. qa/tasks/nvmeof.py: add other methods to stop nvmeof daemons
2. add qa/workunits/rbd/nvmeof_namespace_test.sh which adds and
   deletes new namespaces. It is run in nvmeof_namespaces.yaml
   job where fio happens to other namespaces in background.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-08-28 18:12:28 +05:30
Vallari Agrawal
02fe44ac60
Merge pull request #59434 from VallariAg/fix-nvmeof-apply-teuthology
qa/tasks/nvmeof.py: add nvmeof gw-group to deployment
2024-08-28 18:07:35 +05:30
Milind Changire
277423c15a
qa: add test for data uninlining
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-08-28 13:28:27 +05:30
Adam King
639916859f
Merge pull request #59421 from phlogistonjohn/jjm-teuth-cephadm-from-ctr
qa/tasks: add a new cephadm_from_container feature to cephadm task

Reviewed-by: Adam King <adking@redhat.com>
2024-08-27 13:32:43 -04:00
Patrick Donnelly
64e2bd347b
Merge PR #58419 into main
* refs/pull/58419/head:
	mds: generate correct path for unlinked snapped files
	qa: add test for cephx path check on unlinked snapped dir tree
	mds: add debugging for stray_prior_path

Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-08-27 13:10:54 -04:00
Avan Thakkar
1abb4113ca mgr/nfs: adopt API & unit tests for nfs exports
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-08-27 12:03:17 +05:30
Venky Shankar
409001969e
Merge pull request #54620 from rishabh-d-dave/mgr-vol-clone-stats
mgr/vol: show progress and stats for the subvolume snapshot clones

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-26 15:44:53 +05:30
Vallari Agrawal
c9a6fedbfa
qa/tasks/nvmeof.py: add nvmeof gw-group to deployment
Groups was made a required parameter to be
`ceph orch apply nvmeof <pool> <group>` in
https://github.com/ceph/ceph/pull/58860.
That broke the `nvmeof` suite so this PR fixes that.

Right now, all gateway are deployed in a single group.
Later, this would be changed to have multi groups for a better test.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-08-26 15:15:10 +05:30
John Mulligan
0baf2e4f19 qa/tasks: add a new cephadm_from_container feature to cephadm task
The cephadm_from_container allows one to do a single container build
and then point teuthology at that image as the "single source of truth".
I find this extremely convenient when running teuthology locally and
I keep carrying this patch around - I figure having it upstream will
simplify my workflow. Maybe someday it'll benefit others too.

To use it I set up a yaml overrides file with the following content:
```yaml
overrides:
  cephadm:
    image: "quay.io/phlogistonjohn/ceph:dev"
    cephadm_from_container: true
  verify_ceph_hash: false
verify_ceph_hash: false
```

This let's me test my custom builds fairly easily!

Signed-off-by: John Mulligan <phlogistonjohn@asynchrono.us>
2024-08-23 14:35:55 -04:00
Venky Shankar
db4959e44f Merge PR #58487 into main
* refs/pull/58487/head:
	qa/suites/fs/workload: drop mgrmodules stanza
	qa/tasks/ceph: fix "ceph mgr module enable" command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-08-23 22:02:34 +05:30
Ilya Dryomov
9ac05d9030
Merge pull request #44470 from orozery/rbd-external-migrate
librbd/migration: add external clusters support

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-08-23 10:20:47 +02:00
Venky Shankar
6b1d0de80e Merge PR #56816 into main
* refs/pull/56816/head:
	doc: mention the peer status failed when snapshot created on the remote filesystem.
	qa: add test_cephfs_mirror_remote_snap_corrupt_fails_synced_snapshot
	cephfs_mirror: update peer status for invalid metadata in remote snapshot

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2024-08-22 14:52:33 +05:30
Venky Shankar
76226b35ce Merge PR #59166 into main
* refs/pull/59166/head:
	mon/thrasher: set stopping

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-22 14:50:51 +05:30