Commit Graph

336 Commits

Author SHA1 Message Date
Venky Shankar
01e0a9a7e2
Merge pull request #46746 from vshankar/wip-fs-snaps-timeout
qa: increase fs/snaps workunit timeout to 6h

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2022-07-04 20:41:51 +05:30
Venky Shankar
c37bd10303
Merge pull request #46575 from batrick/i51332
qa: exercise metadata replication in workloads

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-04 08:25:15 +05:30
Venky Shankar
8c50e1ee2c qa: increase fs/snaps workunit timeout to 6h
commit 4fbf4c4f58 increases the
number of tags used in snaptest-git-ceph.sh tests. This makes
the tests run longer (than default 3h) thereby timing out.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-06-20 07:21:22 +05:30
Zack Cerza
d9e7c1b797
Merge pull request #46582 from ceph/rhel86
qa: Default to RHEL8.6 instead of 8.5
2022-06-15 15:05:55 -06:00
David Galloway
b8c4488c55 qa: Default to RHEL8.6 instead of 8.5
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-06-15 14:13:35 -04:00
Venky Shankar
27f4729256
Merge pull request #45556 from mchangir/qa-add-subvolume-option-flavors
qa: add subvolume option flavors

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-06-13 12:29:43 +05:30
Patrick Donnelly
7d3982201f
qa: move export yaml to separate file
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-06-11 20:17:41 -04:00
Patrick Donnelly
0208513273
qa: exercise metadata replication in workloads
Fixes: https://tracker.ceph.com/issues/51332
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-06-11 20:17:41 -04:00
Venky Shankar
45c9fd6187
Merge pull request #46078 from kotreshhr/fuse-directory-dacs-issue
client/fuse: Fix directory DACs overriding for root

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-07 22:45:05 +05:30
Patrick Donnelly
6606d91ace
Merge commit 'b76b6ea16899861d6c266797b3c11d9f68f924d7' into main
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-05-25 16:02:14 -04:00
Venky Shankar
b76b6ea168
Merge pull request #44486 from batrick/fs-workload-kclient-switches
qa: reduce fs:workload use of random selection

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-25 06:54:53 +05:30
David Galloway
805d2320b3
Merge pull request #46385 from ceph/inclusive-rename-yaml
Rename/re-symlink whitelist_*.yaml
2022-05-24 17:04:50 -04:00
Zack Cerza
0666dd34cf Rename/re-symlink whitelist_*.yaml
whitelist_health.yaml -> ignorelist_health.yaml
whitelist_wrongly_marked_down.yaml -> ignore_wrongly_marked_down.yaml

This was mostly addressed in
2ee9365d0b,
but the rename wasn't done there.

Signed-off-by: Zack Cerza <zack@cerza.org>
2022-05-24 14:14:04 -06:00
David Galloway
ae2e93f5f1 qa: Pull from quay.io not docker.io
We are pushing to quay.io now due to docker.io rate limiting.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-05-18 14:22:52 -04:00
Kotresh HR
2e1f43c99b client/fuse: Fix directory DACs overriding for root
DACs are overridable for directories. For files,
Read/write DACs are always overridable but executable
DACs are overridable when there is at least one exec bit
set.

The files and directory DACS overriding were handled the
same way for root which is incorrect. This patch fixes
DACs overriding as described above for the root.

Fixes: https://tracker.ceph.com/issues/55313
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-05-17 12:15:41 +05:30
Ramana Raja
898240c8ee qa/suites/fs/upgrade: change octopus installations and references
... to pacific.

Fixes: https://tracker.ceph.com/issues/53996
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-05-02 14:53:18 -04:00
Milind Changire
8d9bf97a58 qa: replace subvolume.sh with test_subvolume.py
qa/workunits/fs/misc/subvolume.sh is getting in the way of fs:workload
testing with subvolumes. Hence moved this script to a python test.

Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-04-10 21:35:23 +05:30
Milind Changire
f6c68c32aa qa: add test fragments to test subvols
Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-04-07 14:18:06 +05:30
David Galloway
fcd512b50b qa: Latest RHEL8 -> RHEL8.5
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-04-01 15:00:01 -04:00
Adam King
37019aad80 qa/suites/fs: stop looping in mds upgrade test if upgrade failed
Signed-off-by: Adam King <adking@redhat.com>
2022-03-22 08:05:31 -04:00
Patrick Donnelly
c2f132140d
qa: reduce fs:workload use of random selection
It's more appropriate to use --subset to reduce the scheduling size. It
was previously laid out this way because we wanted to link to the common
`qa/cephfs/mount` directory so that ceph-fuse mounts are not needlessly
multiplied. We should just organize it correctly so that is not an
issue.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-14 13:52:14 -05:00
Venky Shankar
43b3a7c845
Merge pull request #39315 from shenhang/fetchkey
mds: fetch single dentry instead of complete dirfrag for lookup

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-14 09:53:10 +05:30
Patrick Donnelly
e883dc3b82
Merge PR #42000 into master
* refs/pull/42000/head:
	qa: update rhel kclient to setup container tools
	qa: stop overriding distro for k-testing
	qa: only use RHEL for workload testing
	qa: convert fs:workload to use cephadm
	qa: split fs begin task
	qa/tasks/cephadm: setup CephManager when OSDs are provisioned
	qa/tasks/cephadm: setup file system if MDS are provisioned

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 09:34:49 -05:00
shenhang
d7feb89823 mds: add an option to decide whether prefetching entire dir or not.
Accessing one single dentry could be fastened by set this option to
false, when dir is not in the memory.
Signed-off-by: "Shen, Hang" <shenhang@kuaishou.com>
2022-02-09 17:31:46 +08:00
Venky Shankar
b7af2a94a4
Merge pull request #42549 from ajarr/wip-add-volume-rename
mgr/volumes: Add `fs volume rename` command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:34:32 +05:30
Venky Shankar
0e37e6a7be
Merge pull request #44851 from batrick/i54081
mds: add inline flag to MDS bootstrap compat in MDSMap

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-05 18:04:29 +05:30
Patrick Donnelly
445cdd4120
qa: test inline compat set on older MDSMap
Reproduced here:

    /ceph/teuthology-archive/pdonnell-2022-01-31_19:13:02-fs:upgrade-master-distro-default-smithi/6651572/teuthology.log

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-03 11:01:59 -05:00
Patrick Donnelly
1f714da814
qa: fix or add missing .qa links
Using this command:

    find qa/suites/ -type d -execdir ln -sfT ../.qa/ {}/.qa \;

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-03 10:08:30 -05:00
Patrick Donnelly
0fcf8922dc
qa: update rhel kclient to setup container tools
To fix [1,2].

[1] https://github.com/ceph/ceph/pull/42000#issuecomment-905628920
[2] https://github.com/ceph/ceph/pull/42000#issuecomment-906276775

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Patrick Donnelly
017ccd21e6
qa: only use RHEL for workload testing
It's not useful testing workloads with different distributions; it just
adds to the maintenance burden of this qa suite as distro upgrades often
break compilation of various tests.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Patrick Donnelly
405bb2e48e
qa: convert fs:workload to use cephadm
Note: it's important to keep the install task which supplies packages
needed for some workloads.

Fixes: https://tracker.ceph.com/issues/51333
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Patrick Donnelly
50c39dc007
qa: split fs begin task
To allow switching to cephadm task.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-02 10:44:35 -05:00
Ramana Raja
0ccb9595f6 qa/suite/fs/cephadm: switch to using recommended distro
See https://github.com/ceph/ceph/pull/43934

Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-01-13 11:17:17 -05:00
Ramana Raja
0043a9e58c qa/suites: fs volume rename cephadm tests
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-01-13 11:12:34 -05:00
Venky Shankar
8939d8c14b qa: adjust for MDSs to get deployed before verifying their availability
The check happens when some MDSs are *just* deployed by cephadm causing
jobs to fail with:

     Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm \
     --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k \
     /etc/ceph/ceph.client.admin.keyring --fsid 403bfcae-706b-11ec-8c32-001a4aab830c \
     -- bash -c \'ceph --format=json mds versions | jq -e ". | add == 4"\''

Fixes: http://tracker.ceph.com/issues/53857
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:25:58 +05:30
Venky Shankar
9c659f228e
Merge pull request #44067 from MrFreezeex/dirfrags-test
qa/suites/fs: add prefetch_dirfrags false to thrasher suite

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-04 15:15:41 +05:30
Patrick Donnelly
bc2eaba8c6
qa: set quincy require-osd-release to avoid health warning
Fixes: https://tracker.ceph.com/issues/53615
Fixes: bd815bd9d6
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-15 15:32:42 -05:00
Venky Shankar
66763fc588
Merge pull request #43850 from batrick/i53194
mds: defer messages to bootstrapping ranks

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-12-01 09:37:00 +05:30
Venky Shankar
4441450a38
Merge pull request #43297 from yongseokoh/test-dir-max-entries
qa: add mds_dir_max_entries workunit test case

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-12-01 09:34:54 +05:30
Venky Shankar
065301a458 qa: use v1 mount-syntax for upgrade tests
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-30 01:13:34 -05:00
Arthur Outhenin-Chalandre
d3946e36f8
qa/suites/fs: add prefetch_dirfrags tests
Fixes: https://tracker.ceph.com/issues/52591
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
2021-11-24 17:22:18 +01:00
Patrick Donnelly
402919cbe6
mds: test connections to bootstrapping MDS
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-23 09:23:09 -05:00
Patrick Donnelly
dcda5cb9ce
qa: disable metrics on kernel client during upgrade
v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-19 13:32:04 -05:00
Sebastian Wagner
0eb651ca7f
Merge pull request #43874 from liewegas/qa-podman-add-stream
qa/suites/orch/cephadm: add 8.stream + container_tools

Reviewed-by: Adam King <adking@redhat.com>
2021-11-11 16:43:34 +01:00
Sage Weil
eb43f2be9c qa/suites/orch/cephadm: add 8.stream + container_tools
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-10 10:42:33 -06:00
Venky Shankar
e7bdf7fb35 test: add cephfs-mirror HA active/active workunit and test yamls
Fixes: http://tracker.ceph.com/issues/50372
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 02:03:32 -05:00
Yongseok Oh
1bb9abbe5d qa: add mds_dir_max_entries workunit test case
Fixes: https://tracker.ceph.com/issues/52725

Signed-off-by: Yongseok Oh <yongseok.oh@linecorp.com>
2021-11-03 12:37:04 +00:00
Patrick Donnelly
abd19aa215
qa: reduce frag split confs for dir_split counter test
Fixes: https://tracker.ceph.com/issues/52949
Fixes: a5675535ba
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-17 21:52:23 -04:00
Patrick Donnelly
e55381c105
Merge PR #43430 into master
* refs/pull/43430/head:
	qa: skip c-v install on pacific start

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-10-15 11:16:25 -04:00
Sebastian Wagner
d4783f5a65
Merge pull request #43214 from batrick/i52654
pybind/mgr/cephadm: set allow_standby_replay during CephFS upgrade

Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-14 16:28:30 +02:00