Commit Graph

348 Commits

Author SHA1 Message Date
Rishabh Dave
d5ab255225
Merge pull request #46988 from rishabh-d-dave/qa-suites-upgraded-client
qa/cephfs: clean up evicted client in 4-compat_client.yaml

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-02 17:51:25 +05:30
Venky Shankar
78871e59c0
Merge pull request #46599 from kotreshhr/rename_config_on_flush
mgr/volumes: Better handle config file on osd full scenario

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-08-23 13:25:02 +05:30
Venky Shankar
5e1625fa7c
Merge pull request #47063 from lxbsz/wip-56529
mds/client: fail the request if the peer MDS doesn't support getvxattr op

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2022-08-23 13:22:09 +05:30
Patrick Donnelly
a8a86789c7
Revert "Merge pull request #47092 from dparmar18/wip-dparmar-cephadm-simple-1"
This reverts commit 1c4da3dbd2, reversing
changes made to ee1e163b1e.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-08-22 13:10:27 -04:00
Rishabh Dave
125535621a qa/suites/fs: add a note in 4-compat_client.yaml
Add a note explaining the reason behind the eviction of "client.1"
during this test.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-08-19 19:40:38 +05:30
Rishabh Dave
775ed5fe64
Merge pull request #45869 from neesingh-rh/fix_55234
mgr/snap_schedule: replace .snap with the client configured snap dir name

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-19 18:38:51 +05:30
Kotresh HR
a64f049614 qa: Add subvolume clone and snapshot rm tests when osd is full
Fixes: https://tracker.ceph.com/issues/55976
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-08-16 17:08:36 +05:30
Xiubo Li
eae0a16002 qa: add a upgrade test suite from nautilus and test the new getvxattr op
For new OPs the old ceph may will crash the MDSs when receiving
unknow OPs. As a workaround the new clients will check the sessions
feature bits to decide to send the new OPs or not.

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-08-16 08:30:52 +08:00
dparmar18
6b4a8263a5 qa/suites/fs/upgrade: added upgrade_without_reducing_max_mds for testing the fail_fs option
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
Rishabh Dave
15ccc52a81
Merge pull request #46861 from ajarr/fix-54108
qa/suites/fs: skip check-counters for iogen workload

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2022-07-08 19:36:22 +05:30
Venky Shankar
01e0a9a7e2
Merge pull request #46746 from vshankar/wip-fs-snaps-timeout
qa: increase fs/snaps workunit timeout to 6h

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2022-07-04 20:41:51 +05:30
Venky Shankar
c37bd10303
Merge pull request #46575 from batrick/i51332
qa: exercise metadata replication in workloads

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-04 08:25:15 +05:30
Neeraj Pratap Singh
9fb85b02f3 qa: test the correctness of snap dir name
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-06-29 15:22:41 +05:30
Ramana Raja
69b29008fb qa/suites/fs: skip check-counters for iogen workload
We currently run "iogen -n 5 -s 2g" for about 10 minutes. This workload
does not always generate export/import of subtrees that is being checked
by iogen.yaml. iogen workload is suited for running heavily fragmented I/O
on a file system, and not for growing directory trees.

Fixes: https://tracker.ceph.com/issues/54108
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-06-27 13:34:28 -04:00
Venky Shankar
8c50e1ee2c qa: increase fs/snaps workunit timeout to 6h
commit 4fbf4c4f58 increases the
number of tags used in snaptest-git-ceph.sh tests. This makes
the tests run longer (than default 3h) thereby timing out.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-06-20 07:21:22 +05:30
Zack Cerza
d9e7c1b797
Merge pull request #46582 from ceph/rhel86
qa: Default to RHEL8.6 instead of 8.5
2022-06-15 15:05:55 -06:00
David Galloway
b8c4488c55 qa: Default to RHEL8.6 instead of 8.5
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-06-15 14:13:35 -04:00
Venky Shankar
27f4729256
Merge pull request #45556 from mchangir/qa-add-subvolume-option-flavors
qa: add subvolume option flavors

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-06-13 12:29:43 +05:30
Patrick Donnelly
7d3982201f
qa: move export yaml to separate file
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-06-11 20:17:41 -04:00
Patrick Donnelly
0208513273
qa: exercise metadata replication in workloads
Fixes: https://tracker.ceph.com/issues/51332
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-06-11 20:17:41 -04:00
Venky Shankar
45c9fd6187
Merge pull request #46078 from kotreshhr/fuse-directory-dacs-issue
client/fuse: Fix directory DACs overriding for root

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-07 22:45:05 +05:30
Patrick Donnelly
6606d91ace
Merge commit 'b76b6ea16899861d6c266797b3c11d9f68f924d7' into main
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-05-25 16:02:14 -04:00
Venky Shankar
b76b6ea168
Merge pull request #44486 from batrick/fs-workload-kclient-switches
qa: reduce fs:workload use of random selection

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-25 06:54:53 +05:30
David Galloway
805d2320b3
Merge pull request #46385 from ceph/inclusive-rename-yaml
Rename/re-symlink whitelist_*.yaml
2022-05-24 17:04:50 -04:00
Zack Cerza
0666dd34cf Rename/re-symlink whitelist_*.yaml
whitelist_health.yaml -> ignorelist_health.yaml
whitelist_wrongly_marked_down.yaml -> ignore_wrongly_marked_down.yaml

This was mostly addressed in
2ee9365d0b,
but the rename wasn't done there.

Signed-off-by: Zack Cerza <zack@cerza.org>
2022-05-24 14:14:04 -06:00
David Galloway
ae2e93f5f1 qa: Pull from quay.io not docker.io
We are pushing to quay.io now due to docker.io rate limiting.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-05-18 14:22:52 -04:00
Kotresh HR
2e1f43c99b client/fuse: Fix directory DACs overriding for root
DACs are overridable for directories. For files,
Read/write DACs are always overridable but executable
DACs are overridable when there is at least one exec bit
set.

The files and directory DACS overriding were handled the
same way for root which is incorrect. This patch fixes
DACs overriding as described above for the root.

Fixes: https://tracker.ceph.com/issues/55313
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-05-17 12:15:41 +05:30
Ramana Raja
898240c8ee qa/suites/fs/upgrade: change octopus installations and references
... to pacific.

Fixes: https://tracker.ceph.com/issues/53996
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-05-02 14:53:18 -04:00
Milind Changire
8d9bf97a58 qa: replace subvolume.sh with test_subvolume.py
qa/workunits/fs/misc/subvolume.sh is getting in the way of fs:workload
testing with subvolumes. Hence moved this script to a python test.

Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-04-10 21:35:23 +05:30
Milind Changire
f6c68c32aa qa: add test fragments to test subvols
Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-04-07 14:18:06 +05:30
David Galloway
fcd512b50b qa: Latest RHEL8 -> RHEL8.5
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-04-01 15:00:01 -04:00
Adam King
37019aad80 qa/suites/fs: stop looping in mds upgrade test if upgrade failed
Signed-off-by: Adam King <adking@redhat.com>
2022-03-22 08:05:31 -04:00
Patrick Donnelly
c2f132140d
qa: reduce fs:workload use of random selection
It's more appropriate to use --subset to reduce the scheduling size. It
was previously laid out this way because we wanted to link to the common
`qa/cephfs/mount` directory so that ceph-fuse mounts are not needlessly
multiplied. We should just organize it correctly so that is not an
issue.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-14 13:52:14 -05:00
Venky Shankar
43b3a7c845
Merge pull request #39315 from shenhang/fetchkey
mds: fetch single dentry instead of complete dirfrag for lookup

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-14 09:53:10 +05:30
Patrick Donnelly
e883dc3b82
Merge PR #42000 into master
* refs/pull/42000/head:
	qa: update rhel kclient to setup container tools
	qa: stop overriding distro for k-testing
	qa: only use RHEL for workload testing
	qa: convert fs:workload to use cephadm
	qa: split fs begin task
	qa/tasks/cephadm: setup CephManager when OSDs are provisioned
	qa/tasks/cephadm: setup file system if MDS are provisioned

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 09:34:49 -05:00
shenhang
d7feb89823 mds: add an option to decide whether prefetching entire dir or not.
Accessing one single dentry could be fastened by set this option to
false, when dir is not in the memory.
Signed-off-by: "Shen, Hang" <shenhang@kuaishou.com>
2022-02-09 17:31:46 +08:00
Venky Shankar
b7af2a94a4
Merge pull request #42549 from ajarr/wip-add-volume-rename
mgr/volumes: Add `fs volume rename` command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:34:32 +05:30
Venky Shankar
0e37e6a7be
Merge pull request #44851 from batrick/i54081
mds: add inline flag to MDS bootstrap compat in MDSMap

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-05 18:04:29 +05:30
Patrick Donnelly
445cdd4120
qa: test inline compat set on older MDSMap
Reproduced here:

    /ceph/teuthology-archive/pdonnell-2022-01-31_19:13:02-fs:upgrade-master-distro-default-smithi/6651572/teuthology.log

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-03 11:01:59 -05:00
Patrick Donnelly
1f714da814
qa: fix or add missing .qa links
Using this command:

    find qa/suites/ -type d -execdir ln -sfT ../.qa/ {}/.qa \;

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-03 10:08:30 -05:00
Patrick Donnelly
0fcf8922dc
qa: update rhel kclient to setup container tools
To fix [1,2].

[1] https://github.com/ceph/ceph/pull/42000#issuecomment-905628920
[2] https://github.com/ceph/ceph/pull/42000#issuecomment-906276775

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Patrick Donnelly
017ccd21e6
qa: only use RHEL for workload testing
It's not useful testing workloads with different distributions; it just
adds to the maintenance burden of this qa suite as distro upgrades often
break compilation of various tests.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Patrick Donnelly
405bb2e48e
qa: convert fs:workload to use cephadm
Note: it's important to keep the install task which supplies packages
needed for some workloads.

Fixes: https://tracker.ceph.com/issues/51333
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Patrick Donnelly
50c39dc007
qa: split fs begin task
To allow switching to cephadm task.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Ramana Raja
0ccb9595f6 qa/suite/fs/cephadm: switch to using recommended distro
See https://github.com/ceph/ceph/pull/43934

Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-01-13 11:17:17 -05:00
Ramana Raja
0043a9e58c qa/suites: fs volume rename cephadm tests
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-01-13 11:12:34 -05:00
Venky Shankar
8939d8c14b qa: adjust for MDSs to get deployed before verifying their availability
The check happens when some MDSs are *just* deployed by cephadm causing
jobs to fail with:

     Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm \
     --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k \
     /etc/ceph/ceph.client.admin.keyring --fsid 403bfcae-706b-11ec-8c32-001a4aab830c \
     -- bash -c \'ceph --format=json mds versions | jq -e ". | add == 4"\''

Fixes: http://tracker.ceph.com/issues/53857
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:25:58 +05:30
Venky Shankar
9c659f228e
Merge pull request #44067 from MrFreezeex/dirfrags-test
qa/suites/fs: add prefetch_dirfrags false to thrasher suite

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-04 15:15:41 +05:30
Patrick Donnelly
bc2eaba8c6
qa: set quincy require-osd-release to avoid health warning
Fixes: https://tracker.ceph.com/issues/53615
Fixes: bd815bd9d6
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-15 15:32:42 -05:00
Venky Shankar
66763fc588
Merge pull request #43850 from batrick/i53194
mds: defer messages to bootstrapping ranks

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-12-01 09:37:00 +05:30