RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-03-04 23:40:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
119,304 Commits 219 Branches 396 Tags 2.8 GiB
d4088d8313
Commit Graph

231 Commits

Author SHA1 Message Date
Jos Collin
8367448765
qa: test DispatchQueue throttling 
Fixes: https://tracker.ceph.com/issues/46226
Signed-off-by: Jos Collin <jcollin@redhat.com>
 2021-01-25 11:18:04 +05:30
Venky Shankar
3478b2a062 test: cephfs-mirror teuthology task and test yamls 
Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2021-01-19 01:08:10 -05:00
Patrick Donnelly
a6891a0c8a
qa: add new client tests 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-15 17:30:40 -08:00
Patrick Donnelly
78a7df1500
Merge PR #38846 into master 
* refs/pull/38846/head:
	*: remove legacy ceph_volume_client.py library

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
 2021-01-14 08:10:19 -08:00
Patrick Donnelly
bc57344ded
Merge PR #38889 into master 
* refs/pull/38889/head:
	qa: add delays only for osd/mds

Reviewed-by: Jeff Layton <jlayton@redhat.com>
 2021-01-14 08:07:40 -08:00
Patrick Donnelly
ef19481399
qa: add delays only for osd/mds 
The delays were applied everywhere and needlessly interfere with test
commands sent to mons from the ceph admin command. Furthermore, the
delays would not affect the kernel client. Now the delays are performed
by the MDS on clients.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-13 07:54:09 -08:00
Patrick Donnelly
a3db265ad5
*: remove legacy ceph_volume_client.py library 
This library is obsolete with the mgr volumes plugin since Nautilus.

The last remaining user of this library was Manila which will be using
the volumes plugin with Pacific and onwards.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-12 06:54:29 -08:00
Patrick Donnelly
b66ca823fe
qa: ignore MDS_SLOW_METADATA_IO with osd thrasher 
Fixes: https://tracker.ceph.com/issues/48834
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-11 10:10:04 -08:00
Patrick Donnelly
318d3f4d80
Merge PR #38108 into master 
* refs/pull/38108/head:
	doc, man: man page for `cephfs-top` utility
	doc: document `cephfs-top` utility
	test: selftest for `cephfs-top` utility
	spec, deb: package cephfs-top utility
	cephfs-top: top(1) like utility for Ceph Filesystem
	mgr/stats: include kernel version (for kclients) in `perf stats` command output
	mgr/stats: include version with `perf stats` output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-11 08:38:52 -08:00
Venky Shankar
0329d9b884 test: selftest for cephfs-top utility 
Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2021-01-11 06:15:53 -05:00
Patrick Donnelly
14b4787de1
client: add debug messages for osdmap wait 
To help debug i47294.

See-also: https://tracker.ceph.com/issues/47294
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-10 21:11:06 -08:00
Patrick Donnelly
f7617cf4d7
qa: bump scrub timeout 
To avoid timeouts for large workloads.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-07 12:55:25 -08:00
Patrick Donnelly
488f10c62f
qa: move cephfs_ec_profile under cephfs 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-07 12:55:25 -08:00
Patrick Donnelly
4a45b9eb3e
qa: skip check-counters for light workloads 
None of these are likely to generate exports.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-07 12:55:25 -08:00
Patrick Donnelly
7f449dd09f
qa: merge multimds:verify with fs:verify 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
 2021-01-07 12:55:25 -08:00
Patrick Donnelly
cb45fc085c
qa: merge multimds:thrash to fs:thrash 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
 2021-01-07 12:55:25 -08:00
Patrick Donnelly
474cb0a9ca
qa: move functional multimds tests to fs:functional 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
 2021-01-07 12:55:24 -08:00
Patrick Donnelly
a32462fe4d
qa: migrate multimds workloads to fs:workloads 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
 2021-01-07 12:55:24 -08:00
Patrick Donnelly
36d731c6f3
qa: only run valgrind on cephfs daemons 
OSD valgrind slows things down too much to the point where some tasks
fail to complete.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-01-07 12:55:24 -08:00
Milind Changire
a4757451f2 qa: forward scrubbing background task 
Add forward scrubbing thrasher task to scrub file-system while a long
running IO is taking place.

Fixes: https://tracker.ceph.com/issues/17856
Signed-off-by: Milind Changire <mchangir@redhat.com>
 2020-12-14 03:32:38 +05:30
Ramana Raja
a38b836589 qa/suites/fs: enable thrashing in multifs environment 
Fixes: https://tracker.ceph.com/issues/15134
Co-authored-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Ramana Raja <rraja@redhat.com>
 2020-11-27 15:55:01 +05:30
Venky Shankar
a8c8b3ade2 tests: add snap schedule tests 
Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2020-11-17 08:39:09 -05:00
Patrick Donnelly
a4941c1d5b
qa: ignore skip errors for kclient 
To avoid this failure:

	2020-11-01T07:21:35.117 INFO:tasks.cephfs_test_runner:test_volume_without_namespace_isolation (tasks.cephfs.test_volume_client.TestVolumeClient) ... ok
	2020-11-01T07:21:35.118 INFO:tasks.cephfs_test_runner:
	2020-11-01T07:21:35.118 INFO:tasks.cephfs_test_runner:======================================================================
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:FAIL: test_evict_client (tasks.cephfs.test_volume_client.TestVolumeClient)
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:Requires FUSE client to inject client metadata
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:Ran 18 tests in 732.749s
	2020-11-01T07:21:35.120 INFO:tasks.cephfs_test_runner:
	2020-11-01T07:21:35.120 INFO:tasks.cephfs_test_runner:FAILED (failures=1)

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:19 -08:00
Patrick Donnelly
f9ca58a3f3
qa: add more clients for test_volume_client 
It requires 4.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:16 -08:00
Patrick Donnelly
6afc98bd20
qa: ignore expected warning about client missing features 
2020-10-30T22:54:14.842 INFO:teuthology.orchestra.run.smithi168.stdout:2020-10-30T22:43:34.067194+0000 mds.a (mds.0) 1 : cluster [WRN] evicting session smithi168:0 (8757), missing required features '0x0000000000000400'

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:10 -08:00
Patrick Donnelly
eb3d38ccf7
qa: do not fail on skip 
Avoiding these failures:

	2020-10-30T22:49:00.248 INFO:tasks.cephfs_test_runner:test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) ...
	2020-10-30T22:49:00.248 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.248 INFO:tasks.cephfs_test_runner:FAIL: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.249 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.249 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.249 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.250 INFO:tasks.cephfs_test_runner:FAIL: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.250 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.251 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.251 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:FAIL: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:Ran 8 tests in 368.825s
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:FAILED (failures=3)
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:FAIL: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:FAIL: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:FAIL: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.256 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:06 -08:00
Patrick Donnelly
3e25a080bc
qa: fix mount directory 
Otherwise we get this error:

	2020-10-30T03:57:44.256 INFO:teuthology.run_tasks:Running task exec...
	2020-10-30T03:57:44.265 INFO:teuthology.task.exec:Executing custom commands...
	2020-10-30T03:57:44.266 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi095.front.sepia.ceph.com
	2020-10-30T03:57:44.266 INFO:teuthology.orchestra.run.smithi095:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'cd $TESTDIR/mnt.* && dd if=/dev/zero of=./foo count=100'
	2020-10-30T03:57:44.380 INFO:teuthology.orchestra.run.smithi095.stderr:bash: line 0: cd: too many arguments

From: /ceph/teuthology-archive/pdonnell-2020-10-30_02:26:51-fs-master-distro-basic-smithi/5573179/teuthology.log

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:03 -08:00
Patrick Donnelly
c495b23090
qa: rename distro link to distros 
This needs to become any overrides present in "mount". Otherwise kclient
distro overrides have no effect.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:00 -08:00
Patrick Donnelly
83c361ff04
qa: some sessionmap tests require fuse 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:50 -08:00
Patrick Donnelly
6d880eac3f
qa: do not fail on test skip 
test_client_config only works with ceph-fuse.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:45 -08:00
Patrick Donnelly
a6ac673fc0
qa: use more OSDs for workload tests 
Running out of space / slow requests are less likely this way.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:42 -08:00
Patrick Donnelly
9861420771
qa: relocate tasks 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:37 -08:00
Patrick Donnelly
2e493a1d74
qa: rename workload suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:37 -08:00
Patrick Donnelly
9cacc92756
qa: relocate new tasks from fs:basic_functional 
These were not tested with kcephfs before, let's see if there's any
bugs!

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:37 -08:00
Patrick Donnelly
dbdb6537e2
qa: move kcephfs:mixed-clients to fs 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
276de433d6
qa: merge snap tests for kcephfs/fs 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
218daa9a38
qa: add new fs:shell sub-suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
024d5b37f4
qa: add new fs:volumes sub-suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
73c8c900bc
qa: merge fs:basic_functional and kcephfs:recovery 
These functional tests can be run with both clients.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
5bbd97fac1
qa: move kcephfs:thrash to fs:thrash 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
742d75a7fe
qa: reorganize thrash tasks 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
a9b7df2ebc
qa: move multifs/failover tests 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
e8642c742a
qa: run norstats workunit for klient 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
99bfa7cfe8
qa: merge workload tests from kcephfs with fs 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
43875d7bee
qa: remove inline testing 
inline feature is now deprecated and TBR.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
f719ebb305
qa: remove fuse default permissions config 
It is the default.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:34 -08:00
Patrick Donnelly
c4eaceaead
qa: fix whitespace 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:34 -08:00
Xiubo Li
0422673b61 qa/cephfs: add session_timeout option support 
When the mds revoking the Fwbl caps, the clients need to flush
the dirty data back to the OSDs, but the flush may make the OSDs
to be overloaded and slow, which may take more than 60 seconds to
finish. Then the MDS daemons will report the WRN messages.

For the teuthology test cases, let's just increase the timeout
value to make it work.

Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
 2020-10-23 14:27:37 +08:00
Xiubo Li
3b5303482f qa/cephfs: add 'cephfs:' section support 
Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
 2020-10-23 14:27:30 +08:00
Ramana Raja
d1d5d61884 qa/tasks/cephfs: Refactor test_volumes 
... into smaller test classes. This enables breaking up the volumes yaml
into smaller yaml fragments.

Fixes: https://tracker.ceph.com/issues/47160
Signed-off-by: Ramana Raja <rraja@redhat.com>
 2020-10-12 13:54:40 +05:30