Commit Graph

302 Commits

Author SHA1 Message Date
Venky Shankar
8939d8c14b qa: adjust for MDSs to get deployed before verifying their availability
The check happens when some MDSs are *just* deployed by cephadm causing
jobs to fail with:

     Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm \
     --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k \
     /etc/ceph/ceph.client.admin.keyring --fsid 403bfcae-706b-11ec-8c32-001a4aab830c \
     -- bash -c \'ceph --format=json mds versions | jq -e ". | add == 4"\''

Fixes: http://tracker.ceph.com/issues/53857
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:25:58 +05:30
Venky Shankar
9c659f228e
Merge pull request #44067 from MrFreezeex/dirfrags-test
qa/suites/fs: add prefetch_dirfrags false to thrasher suite

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-04 15:15:41 +05:30
Patrick Donnelly
bc2eaba8c6
qa: set quincy require-osd-release to avoid health warning
Fixes: https://tracker.ceph.com/issues/53615
Fixes: bd815bd9d6ecdecaab3d2dd9e0f5a18aa795d749
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-15 15:32:42 -05:00
Venky Shankar
66763fc588
Merge pull request #43850 from batrick/i53194
mds: defer messages to bootstrapping ranks

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-12-01 09:37:00 +05:30
Venky Shankar
4441450a38
Merge pull request #43297 from yongseokoh/test-dir-max-entries
qa: add mds_dir_max_entries workunit test case

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-12-01 09:34:54 +05:30
Venky Shankar
065301a458 qa: use v1 mount-syntax for upgrade tests
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-30 01:13:34 -05:00
Arthur Outhenin-Chalandre
d3946e36f8
qa/suites/fs: add prefetch_dirfrags tests
Fixes: https://tracker.ceph.com/issues/52591
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
2021-11-24 17:22:18 +01:00
Patrick Donnelly
402919cbe6
mds: test connections to bootstrapping MDS
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-23 09:23:09 -05:00
Patrick Donnelly
dcda5cb9ce
qa: disable metrics on kernel client during upgrade
v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-19 13:32:04 -05:00
Sebastian Wagner
0eb651ca7f
Merge pull request #43874 from liewegas/qa-podman-add-stream
qa/suites/orch/cephadm: add 8.stream + container_tools

Reviewed-by: Adam King <adking@redhat.com>
2021-11-11 16:43:34 +01:00
Sage Weil
eb43f2be9c qa/suites/orch/cephadm: add 8.stream + container_tools
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-10 10:42:33 -06:00
Venky Shankar
e7bdf7fb35 test: add cephfs-mirror HA active/active workunit and test yamls
Fixes: http://tracker.ceph.com/issues/50372
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 02:03:32 -05:00
Yongseok Oh
1bb9abbe5d qa: add mds_dir_max_entries workunit test case
Fixes: https://tracker.ceph.com/issues/52725

Signed-off-by: Yongseok Oh <yongseok.oh@linecorp.com>
2021-11-03 12:37:04 +00:00
Patrick Donnelly
abd19aa215
qa: reduce frag split confs for dir_split counter test
Fixes: https://tracker.ceph.com/issues/52949
Fixes: a5675535ba
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-17 21:52:23 -04:00
Patrick Donnelly
e55381c105
Merge PR #43430 into master
* refs/pull/43430/head:
	qa: skip c-v install on pacific start

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-10-15 11:16:25 -04:00
Sebastian Wagner
d4783f5a65
Merge pull request #43214 from batrick/i52654
pybind/mgr/cephadm: set allow_standby_replay during CephFS upgrade

Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-14 16:28:30 +02:00
Patrick Donnelly
a5675535ba
qa: only set frag confs for workloads
Otherwise these local conf overrides prevent functional testing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-07 15:08:34 -04:00
Patrick Donnelly
97f9f5362b
qa: skip c-v install on pacific start
Continuation of 4e525127fb.

Fixes: https://tracker.ceph.com/issues/52822
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-05 20:01:05 -04:00
Patrick Donnelly
b1420e5771
qa: add test for cephfs upgrade sequence
This also checks max_mds>1 and allow_standby_replay are restored to
previous values.

Future work can add tests for multiple file systems (or volumes).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-05 13:32:15 -04:00
Patrick Donnelly
c8a900c6c6 Merge PR #42763 into master
* refs/pull/42763/head:
	mon/FSCommands: add 'recover' flag in `fs new` command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-20 20:46:25 -04:00
Ramana Raja
67bb13859a mon/FSCommands: add 'recover' flag in fs new command
Currently, to recover a file system after recovering monitor store, you
need to stop all the MDSs; create FSMap with defaults using `fs new`
command; execute `fs reset` command to get the file system's rank 0 into
existing but failed state; and then restart MDSs.

Add 'recover' flag to the `fs new` command that sets the file system's
rank 0 to existing but failed state, and sets the file system's
'joinable' setting to False. Using the `fs new` command with 'recover'
flag gets rid of the steps to stop all the MDSs and execute `fs reset`
command when recovering the file system after recoving monitor store.

Fixes: https://tracker.ceph.com/issues/51716
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-09-13 00:15:39 -04:00
Patrick Donnelly
f4a11a3290
qa: add test for standby-replay marking rank damaged
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-09 20:16:03 -04:00
Patrick Donnelly
297fcdce24 Merge PR #42687 into master
* refs/pull/42687/head:
	qa: test the "ms_mode" options in kclient workflows

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-08-27 21:29:17 -04:00
Patrick Donnelly
1b1f108449 Merge PR #42530 into master
* refs/pull/42530/head:
	qa: ignore expected metadata cluster log error

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2021-08-26 22:36:28 -04:00
Jeff Layton
cd41b1c150 qa: test the "ms_mode" options in kclient workflows
Note that I didn't bother adding the prefer-* options, as I figure it's
better to be definite.

Fixes: https://tracker.ceph.com/issues/52068
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2021-08-18 09:24:13 -04:00
Patrick Donnelly
c99a5e56a6 Merge PR #42201 into master
* refs/pull/42201/head:
	qa: fold frag confs into conf/mds.yaml

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-07-30 14:00:19 -07:00
Patrick Donnelly
665b36de4e Merge PR #42349 into master
* refs/pull/42349/head:
	mon/MDSMonitor: propose if FSMap struct_v is too old
	mon/MDSMonitor: give a proper error message if FSMap struct_v is too old
	mds/FSMap: use DECODE_OLDEST to gate FSMap version
	qa: add tests for fs dump of epoch and trimming
	qa: add file system support for dumping epoch
	mon/MDSMonitor: return mon_mds_force_trim_to even if equal to current epoch
	mon: add debugging for trimming methods
	mon: fix debug spacing
	qa: add nofs upgrade suite

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-07-28 10:45:08 -07:00
Patrick Donnelly
8116b95a34 qa: ignore expected metadata cluster log error
Fixes: https://tracker.ceph.com/issues/51905
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-28 09:17:19 -07:00
Patrick Donnelly
9941188116 qa: add nofs upgrade suite
This adds an upgrade suite to ensure that a Ceph cluster without a
CephFS file system does not blow up on upgrade (in particular, that the
MDSMonitor does not trip). This was developed to potentially reproduce
tracker 51673 but the actual cause for that issue was an old encoding
for the MDSMap which was obsoleted in Pacific. You must create a cluster
older than the FSMap (~Hammer or Infernalis) to reproduce. In any case,
this upgrade suite may be useful in the future so let's keep it!

Related-to: https://tracker.ceph.com/issues/51673
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-28 07:07:05 -07:00
Xiubo Li
3456ff2628 qa: ignore PG_RECOVERY_FULL and PG_DEGRADED for mds-full
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-07-27 09:48:56 +08:00
Patrick Donnelly
83d252cc30 qa: fold frag confs into conf/mds.yaml
These overrides are standard for all configurations. The config to
enable fragmentation is also long removed.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-26 07:14:38 -07:00
Patrick Donnelly
b946d5a6b2
qa: use centos latest for fs:upgrade
Fixes: https://tracker.ceph.com/issues/51250
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-16 12:16:36 -07:00
Patrick Donnelly
03674f5197
Merge PR #41821 into master
* refs/pull/41821/head:
	qa: specify distro for fs:bugs

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-06-15 10:33:38 -07:00
Patrick Donnelly
95f0e9c959
Merge PR #39505 into master
* refs/pull/39505/head:
	qa: test nowsync option in kernel client workflows
	qa: deep merge top level overrides for fuse/kclient

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-06-11 17:10:41 -07:00
Patrick Donnelly
8eeb1455ee
qa: specify distro for fs:bugs
Fixes: https://tracker.ceph.com/issues/51184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 16:25:50 -07:00
Patrick Donnelly
26605723cf
qa: update cephfs-shell distro to ubuntu 20.04
18.04 is no longer built.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-09 16:51:49 -07:00
Patrick Donnelly
84ae38594d
qa: test nowsync option in kernel client workflows
Fixes: https://tracker.ceph.com/issues/49341
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-04 19:15:12 -07:00
Patrick Donnelly
a52712f955
Merge PR #41443 into master
* refs/pull/41443/head:
	test: update log-ignorelist for fs:mirror test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-03 13:23:17 -07:00
Venky Shankar
d01b8c8566 test: update log-ignorelist for fs:mirror test
Also, have a fs:mirror specific whitelist override since
the current one is a symlink to a common YAML probably used
by other tests.

Fixes: http://tracker.ceph.com/issues/50867
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-05-25 04:43:48 -04:00
Kotresh HR
2bd6ba8026 test: Add test for mgr hang when osd is full
Add fs suite for tests requiring one node as well.

Fixes: https://tracker.ceph.com/issues/50532
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2021-05-22 19:09:07 +05:30
Patrick Donnelly
4702be4f47
qa: test standby-replay with fs:workloads
Fixes: https://tracker.ceph.com/issues/50045
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-08 11:37:56 -07:00
Patrick Donnelly
d0e3b7129d
Merge PR #40418 into master
* refs/pull/40418/head:
	test: unmount when finished ino_release_cb
	test: wait a time for inode release
	qa: move ino_release_cb to libcephfs sub-suite
	qa: simplify recall triggers for bug
	qa: fix name for qa task referencing tracker issue

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-04-06 10:45:00 -07:00
Kefu Chai
9541a97605
Merge pull request #40316 from batrick/i49605
pybind/mgr/volumes: avoid deadlock in ceph-mgr Finisher thread

Reviewed-by: Kotresh HR <khiremat@redhat.com>
2021-04-03 22:24:22 +08:00
Patrick Donnelly
892b8410bc
qa: move ino_release_cb to libcephfs sub-suite
It is not testing a bug. Also, fix cap recall configs so this test is
properly triggered.

Fixes: https://tracker.ceph.com/issues/49500
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-25 13:25:19 -07:00
Patrick Donnelly
020fb9611c
qa: simplify recall triggers for bug
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-25 13:25:19 -07:00
Patrick Donnelly
f96e4f0ff7
qa: fix name for qa task referencing tracker issue
The issue number was for an rbd backport. It should be [1].

[1] https://tracker.ceph.com/issues/24137

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-25 10:58:54 -07:00
Patrick Donnelly
17b291e57d
qa: bump debugging for mgr
Hunting [1].

[1] https://tracker.ceph.com/issues/49605
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-24 11:37:24 -07:00
Patrick Donnelly
d06689e16e
qa: wait for daemons to come up via cephadm
Rather than waiting for a set amount of time.

Fixes: https://tracker.ceph.com/issues/49684
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:07 -07:00
Sage Weil
6901edc5d1 qa/suites/fs/multiclient: use clients: not all: for pexec
This matches the setup work we are trying to tear down.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-16 20:51:36 -04:00
Venky Shankar
3e13f48937 test: add tests for mirroring bootstrap interfaces
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-11 03:41:52 -05:00