Commit Graph

1654 Commits

Author SHA1 Message Date
Adam King
81e274bd05
Merge pull request #55693 from adk3798/cephadm-nfsv3
mgr/nfs: add NFSv3 protocol to default protocols

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-10-30 13:26:38 -04:00
Venky Shankar
7809b0e57d
Merge pull request #50105 from zhsgao/mds_export_state
mds: add an asok command to dump export states

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-30 07:16:11 +05:30
Rishabh Dave
adc6f2dbb5
Merge pull request #58898 from neesingh-rh/wip-fix-strict-iec-cast
src/common : proper handling of units in `strict_iec_cast`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-10-24 19:46:48 +05:30
Adam King
b39be5abe0 mgr/nfs: add NFSv3 protocol to exports
To allow users to use NFSv3 by default with
exports created through the nfs module

Signed-off-by: Adam King <adking@redhat.com>
2024-10-21 11:58:16 -04:00
Rishabh Dave
0abc227131 qa/cephfs: test enable/disable of volumes plugin
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-19 16:57:13 +05:30
Rishabh Dave
8978b85bb0
Merge pull request #59420 from rishabh-d-dave/max-mds-confirm
mon,cephfs: require confirmation when changing max_mds on unhealthy cluster

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-18 20:04:18 +05:30
Rishabh Dave
f9c9a15876
Merge pull request #59712 from rishabh-d-dave/mgr-vol-clone-stats-snap
qa/cephfs: test clone progress reporter after subvol is deleted but...      

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-10-18 17:15:40 +05:30
Venky Shankar
739670290e Merge PR #60219 into main
* refs/pull/60219/head:
	qa/cephfs: update earmark values to valid ones in test_volumes.py

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-14 15:21:15 +05:30
Venky Shankar
43012083f4
Merge pull request #59987 from kotreshhr/licephfs-aio-nfsganesha
client: Fix libcephfs aio metadata corruption.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-10 17:41:49 +05:30
Avan Thakkar
78ae3b1350 qa/cephfs: update earmark values to valid ones in test_volumes.py
smb.test is an invalid earmark now it should be either smb or
smb.cluster.<cluster_id>. Update the test_volumes.py to set
valid earmarks wherever used.

Fixes: https://tracker.ceph.com/issues/68448
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-10-09 18:34:10 +05:30
Zhansong Gao
5506ed63c2 qa: add test for 'dump_export_states'
Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
2024-10-08 20:30:15 +08:00
Venky Shankar
eb2183136d Merge PR #58966 into main
* refs/pull/58966/head:
	qa: test 'ceph fs snapshot mirror ls' command
	doc: update docs for 'fs snapshot mirror ls' command
	cephfs_mirror: ceph fs snapshot mirror ls command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-10-07 12:48:52 +05:30
Venky Shankar
9f1311f900 Merge PR #59699 into main
* refs/pull/59699/head:
	mgr/status: Fix 'fs status' json output
	qa: Add test for 'fs status' in standby-replay mds setup

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-10-07 12:47:15 +05:30
Venky Shankar
635b554107
Merge pull request #56118 from joscollin/wip-B64711-qa-failure_cancel-mirroring-and-readd
cephfs_mirror, qa: fix test failure test_cephfs_mirror_cancel_mirroring_and_readd

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-07 12:38:40 +05:30
Kotresh HR
6d8f61015f qa: Add data read/write test for nfs-ganesha
Fixes: https://tracker.ceph.com/issues/68146
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2024-10-04 22:35:36 +05:30
Rishabh Dave
4d5ec87ab4 qa/cephfs: add tests for confirmationn required to change max_mds
Add tests to ensure that when cluster has any health warning, especially
MDS_TRIM, confirmation flag is mandatory to change max_mds.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-01 12:45:31 +05:30
Venky Shankar
592a19993c
Merge pull request #59875 from joscollin/wip-B68131-revert-sync-duration
cephfs_mirror: revert sync_duration to seconds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-01 09:38:40 +05:30
Rishabh Dave
9e3449995f qa/cephfs: test clone progress reporter after subvol is deleted but...
snapshot is retained despite of deletion (using --retain-snapshots
option of "subvolume rm" command).

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-09-26 21:05:48 +05:30
neeraj pratap singh
0b09d16f10 qa: modify test_human_readable_quota_invalid_values
Fixes: https://tracker.ceph.com/issues/67169
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2024-09-24 13:33:40 +05:30
Jos Collin
46e3e28a2e
qa: update test for last_sync_duration
Fixes: https://tracker.ceph.com/issues/68131
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-09-23 14:43:33 +05:30
Venky Shankar
4277cd2989 mds: invalid id for client eviction is to be treated as success
Introduced-by: 0ef5941a2e79
Fixes: http://tracker.ceph.com/issues/68132
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-09-23 08:29:59 +00:00
Venky Shankar
d0a3655d57 Merge PR #59111 into main
* refs/pull/59111/head:
	doc: document earmark option for subvolume and new commands
	qa/cephfs: update tests for test_volumes & unit-test for earmarking
	mgr/volumes: add earmarking for subvol

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-09-18 11:03:58 +05:30
Adam King
4adee01313
Merge pull request #54277 from rhcs-dashboard/nfs-export-apply-fix
mgr/nfs: generate user_id & access_key for apply_export(CephFS)

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-09-17 09:08:01 -04:00
Venky Shankar
8bd63f8818 Merge PR #55421 into main
* refs/pull/55421/head:
	qa/cephfs: add test to verify backtrace update failure on deleted data pool
	mds: batch backtrace updates by pool-id when expiring a log segment
	mds: dump log segment in segment expiry callback
	mds: dump log segment end along with offset

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-09-17 16:48:03 +05:30
Venky Shankar
b57eb17e35
Merge pull request #59093 from joscollin/wip-fix-get-set-dirty-snap-id
qa: do the set/get attribute on the remote filesystem

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-17 16:46:06 +05:30
Avan Thakkar
d2f8d10221 qa/cephfs: update tests for test_volumes & unit-test for earmarking
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-09-17 13:18:25 +05:30
Avan Thakkar
b895e596a8 doc: nit fixes for nfs doc
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Fixes some doc lint and also fixed qa tests for having both 3 & 4 protocols
by default in expot config.
2024-09-17 00:46:00 +05:30
Kotresh HR
8f96936006 qa: Add test for 'fs status' in standby-replay mds setup
Fixes: https://tracker.ceph.com/issues/67978
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2024-09-10 14:23:40 +05:30
Venky Shankar
485717a0e3
Merge pull request #57388 from mchangir/mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds
mgr/snap_schedule: correctly fetch mds_max_snaps_per_dir from mds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-06 19:33:52 +05:30
Rishabh Dave
29650c2e00
Merge pull request #44359 from mchangir/mds-uninline-file-during-scrub
mds: un-inline data on scrub

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2024-09-06 18:31:13 +05:30
Milind Changire
1fda7cb7e2
qa: test fetching foreign config item
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-09-05 11:59:38 +05:30
Venky Shankar
f070510eb3
Merge pull request #58543 from rishabh-d-dave/tracker-65808
cephfs: disallow removing root_squash via "fs authorize" cmd

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-09-02 15:13:34 +05:30
Patrick Donnelly
0a05dacc07
Merge PR #59310 into main
* refs/pull/59310/head:
	qa: load all dirfrags before testing altname recovery

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-08-29 13:39:56 -04:00
Avan Thakkar
b8f3db5b40 mgr/nfs: add additional tests for cmount_path & user_id deletion
Add unit tests for unique user ID generation, deletion and `cmount_path` handling in FSAL exports

- Ensure unique user ID generation for different FSAL blocks when creating exports.
- Test deletion behavior when multiple exports share the same user ID and one has a unique ID.
- Test default behavior when no `cmount_path` is provided (defaults to `/`).
- Add tests to validate error handling for invalid `cmount_path` values.

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-08-29 17:45:55 +05:30
Jos Collin
6b24da78ab
qa: test 'ceph fs snapshot mirror ls' command
Fixes: https://tracker.ceph.com/issues/67292
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-08-29 17:19:22 +05:30
Milind Changire
277423c15a
qa: add test for data uninlining
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-08-28 13:28:27 +05:30
Patrick Donnelly
64e2bd347b
Merge PR #58419 into main
* refs/pull/58419/head:
	mds: generate correct path for unlinked snapped files
	qa: add test for cephx path check on unlinked snapped dir tree
	mds: add debugging for stray_prior_path

Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-08-27 13:10:54 -04:00
Avan Thakkar
1abb4113ca mgr/nfs: adopt API & unit tests for nfs exports
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-08-27 12:03:17 +05:30
Venky Shankar
409001969e
Merge pull request #54620 from rishabh-d-dave/mgr-vol-clone-stats
mgr/vol: show progress and stats for the subvolume snapshot clones

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-26 15:44:53 +05:30
Patrick Donnelly
9296c2a36f
qa: load all dirfrags before testing altname recovery
The journal reset effectively cleared the cache so the rank may not have the
dirfrag in memory when we verify alternate name recovery.

Fixes: https://tracker.ceph.com/issues/67511
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-08-21 10:10:36 -04:00
Jos Collin
db9825d314
qa: make all replayer threads busy and query 'syncing' status
* Make all replayer threads busy and then query for 'syncing' state
instead of just fetching the current status.

* Dropped 'current_syncing_snap' check, as it's not compulsory for
this test. The actual intension is to make threads in 'syncing' status
and 'current_syncing_snap' check is not necessary for that.

* Drop 'snaps_deleted' metrics check in test_cephfs_mirror_cancel_mirroring_and_readd.
test_cephfs_mirror_cancel_mirroring_and_readd primarily focusses
on the synchronization of the newly added directory paths post removal
of the previously added/syncing directory paths. So checking of 'snaps_deleted'
metrics is unnecessary here.

* Wait for more time to finish the new snapshot creations and the sync backoff.
We need to wait for more time in test_cephfs_mirror_cancel_mirroring_and_readd,
as the test makes all replayer threads busy.

Fixes: https://tracker.ceph.com/issues/64711
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-08-20 13:20:07 +05:30
Venky Shankar
9f27bde0b9 qa/cephfs: add test to verify backtrace update failure on deleted data pool
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-08-20 07:07:47 +00:00
Rishabh Dave
a6b95a5a69 qa/cephfs: update a test in test_volumes.py
Test name is test_subvolume_snapshot_info_if_clone_pending_for_no_group,
located in class TestSubvolumeSnapshotClones in test_volumes.py

5 seconds can (sometimes) be insufficient as value of the config option
"snapshot_clone_delay" in this. Increase it to avoid unnecessary race
conditions which leads to irrelevant failures.

Following is an example where 5 seconds was insufficient as waiting
period since instead it took 8 seconds -

2024-07-28T18:16:10.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait False
...
2024-07-28T18:16:18.694 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol79370 subvol_snap40980

This issue was seen during testing of PR to which this commit belongs.

This commit has been separated from the commit that adds tests for clone
progress reporting so that it's easy to document need for this code
patch and also track it.

This commit is not being moved to a different PR and been kept on the
same PR since it can't be reproduced otherwise. This also ensures that
commit is backported to older release along with code that caused this
issue, causing no one to need to find this commit while backporting
effort.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:32:46 +05:30
Rishabh Dave
e0c85b86ae qa/cephfs: add tests for clone progress
Clone progress is shown to user through "ceph fs clone status" output
and through "ceph status" output. Test both these features.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:05:46 +05:30
Rishabh Dave
92aecabdb2 qa/cephfs: return size of data generated in _do_subvolume_io()
TestVolumesHelper._do_subvolume_io() is a helper method that allows
users to generate data for testing. mgr/vol code that reports progress
made by clone jobs depends on the value set for xattr rbytes. It takes
a bit of a time for rbytes to be set.

And, therefore, all tests in TestCloneProgressReporter needs to wait for
subvolume's rbytes xattr's value to be set to the actual amount of data
present on the subvolume before proceeding to actually testing.

So that this can be achieved make _do_subvolume_io() return size of the
data it has generated.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:05:46 +05:30
Rishabh Dave
db0e736d4a qa/cephfs: use safe_while in test_volumes.py
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:05:46 +05:30
Rishabh Dave
9f60848df4 qa/cephfs: add method to run and get shell cmd stdout
Add a helper method that accepts command arguments (along with rest of
paramters accepted by the method run_shell()) and return the stdout of
the command.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:05:46 +05:30
Rishabh Dave
10949bf68d qa/cephfs: improvements for helper methods for clone state
1. Let caller check for multiple states. It might happen that clone
   finishes while it is being cancelled, in such cases user might want
    to check for both.
2. Add a helper method to check if clone is in pending state and add a
   separate method to check if clone is in cancelled state.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:05:46 +05:30
Jos Collin
9a46c52387
qa: do the set/get attribute on the remote filesystem
Fixes: https://tracker.ceph.com/issues/67435
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-08-14 13:13:08 +05:30
Jos Collin
db65867f77
qa: add test_cephfs_mirror_remote_snap_corrupt_fails_synced_snapshot
Fixes: https://tracker.ceph.com/issues/65226
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-08-12 11:48:04 +05:30