Commit Graph

61 Commits

Author SHA1 Message Date
Patrick Donnelly
a6ac673fc0
qa: use more OSDs for workload tests
Running out of space / slow requests are less likely this way.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-03 13:00:42 -08:00
Patrick Donnelly
726c00f069
qa: use 4 clients for volumes testing
The test_volume_client.py tests require 4 clients.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-03 13:00:37 -08:00
Patrick Donnelly
ca0d99b135
qa: use consistent syntax
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-03 13:00:35 -08:00
Patrick Donnelly
49abce2290
qa: move log-rotate config to common yaml
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-03 13:00:34 -08:00
Patrick Donnelly
c569036c5d
Merge PR #37629 into master
* refs/pull/37629/head:
	qa/cephfs: add session_timeout option support
	qa/cephfs: move the cephfs's opertions setting to create()
	qa/cephfs: add 'cephfs:' section support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-25 16:26:36 -07:00
Xiubo Li
0422673b61 qa/cephfs: add session_timeout option support
When the mds revoking the Fwbl caps, the clients need to flush
the dirty data back to the OSDs, but the flush may make the OSDs
to be overloaded and slow, which may take more than 60 seconds to
finish. Then the MDS daemons will report the WRN messages.

For the teuthology test cases, let's just increase the timeout
value to make it work.

Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-23 14:27:37 +08:00
Xiubo Li
3b5303482f qa/cephfs: add 'cephfs:' section support
Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-23 14:27:30 +08:00
Patrick Donnelly
d060c9a768
qa: set rados op timeouts for mds/ceph-fuse
Now that the osdc Objecter obeys updates to these configs, let's use
them to avoid having them block forever on operations that may never
complete (or should complete in a timely manner).

Fixes: https://tracker.ceph.com/issues/47734
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:16:40 -07:00
Sage Weil
2ee9365d0b qa: log-whitelist -> log-ignorelist
Signed-off-by: Sage Weil <sage@newdream.net>
2020-08-24 19:53:08 +00:00
Patrick Donnelly
d791daa732
qa: move fsx deps into common cephfs install yaml
The double install task causes errors during unwind.

Fixes: fe3961fc36
Fixes: https://tracker.ceph.com/issues/45387
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-05 09:35:44 -07:00
Xiubo Li
f0c67256b9 qa/vstart_runner: add unsharing network namespace support
This will isolate the network namespace for each mount point with
a private ip address and iptables, etc.

For the kill() stuff it will just do DOWN the veth interface instead
of sending ipmi request for kernel mount and kill the fuse processes
for the fuse mount. This could avoid sending the socket FIN to the
ceph cluster.

Fixes: https://tracker.ceph.com/issues/44044
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-14 07:47:03 -04:00
Xiubo Li
e7f3cf3497 unshare-ns-mount: add isolating netns for mount helper support
This helper script will help to unshare the network namespace from
the os and with its own private veth interface, IP, iptable rules,etc.

It could help us to simulate some test case like client node crash.

Fixes: https://tracker.ceph.com/issues/44044
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-14 07:47:02 -04:00
Patrick Donnelly
0c8899c985
qa: add upgrade test for volume upgrade from legacy
This tests that volumes created using the ceph_volume_client.py library
continue to be accessible/function via the Nautilus/Octopus ceph-mgr
volumes plugin.

Fixes: https://tracker.ceph.com/issues/42723
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-03-02 20:27:15 -08:00
Sridhar Seshasayee
e527067666 qa: Whitelist 'slow request' within a bunch of tests
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2020-02-24 19:59:56 +05:30
Patrick Donnelly
4810d68a30
qa: install some dependencies for xfstests
These are needed for CentOS 8 / RHEL8.

Also organize the YAML to use the cleaner array syntax.

Fixes: https://tracker.ceph.com/issues/43459
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-23 15:37:47 -08:00
Patrick Donnelly
6109e67d93
Merge PR #32639 into master
* refs/pull/32639/head:
	qa: rename kcephfs distro overrides

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-20 11:08:47 -08:00
Patrick Donnelly
d4b5a9ec60
qa: ignore slow ops for ffsb workunit
EC pools typically cause this.

Fixes: https://tracker.ceph.com/issues/42637
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-15 16:12:13 -08:00
Patrick Donnelly
059c7a2925
qa: rename kcephfs distro overrides
This is just a naming refactor.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-14 14:15:56 -08:00
Rishabh Dave
853504bf8e qa/cephfs: don't run kclient tests on latest RHEL
Fixes: https://tracker.ceph.com/issues/43541
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-13 10:27:02 +05:30
Rishabh Dave
e0335ee6e9 qa/cephfs: don't test kclient on RHEL 7
https://tracker.ceph.com/issues/43539
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-13 10:27:02 +05:30
Sage Weil
667d70b6fc qa/cephfs/begin: libaio-devel on el8
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 13:39:08 -06:00
Rishabh Dave
a80c2390e9 qa/cephfs: allow running tests from xfstests-dev
Add code to get and configure xfstests-dev repository so that tests from
this repository can be executed for CephFS.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-11-06 16:16:39 +05:30
Jeff Layton
6b5baba2f5 qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning
Some of our tests still enable this, so just ignore this warning
globally.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-19 09:15:29 -04:00
Patrick Donnelly
fd358e73c0
qa: fix kclient symlink to use latest rhel7
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-03 14:39:57 -07:00
Patrick Donnelly
b9984c31d8
Merge PR #26662 into master
* refs/pull/26662/head:
	qa: update kclient testing to RHEL 7.6

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-03-19 13:16:07 -07:00
Patrick Donnelly
a2dac30db5
Merge PR #26700 into master
* refs/pull/26700/head:
	qa: bump fsstress timeout to 6h

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-03-01 06:44:36 -08:00
Patrick Donnelly
f9146f2acc
qa: bump fsstress timeout to 6h
When run with valgrind, it takes a significant amount of time to complete.

Fixes: http://tracker.ceph.com/issues/38520
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-28 09:35:53 -08:00
Patrick Donnelly
8cbdad9f9b
qa: update testing for standby-replay
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-27 21:39:12 -08:00
Patrick Donnelly
3e98b5e582
qa: update kclient testing to RHEL 7.6
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-26 13:10:58 -08:00
Sage Weil
269910fc8b qa/suites: fix bluestore links
Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-05 10:30:14 -06:00
Patrick Donnelly
6ac1882dc4
qa: automate distro/kernel matrix for kclient
It's no longer necessary to pass `-k testing` to teuthology-suite. We're also
now regularly testing RHEL 7.5 kernel in upstream testing.

This work is prep for eventually integrating kclient into fs.

Fixes: http://tracker.ceph.com/issues/26995

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-06 10:23:59 -07:00
Patrick Donnelly
f0fe0936e6
qa: use recent kernel to kernel build testing
Fixes: http://tracker.ceph.com/issues/24679

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:16:39 -07:00
Patrick Donnelly
0b5df6e00a
qa: add cephfs-shell skeleton test case
Right now just tests that "help" works.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:13:36 -07:00
Patrick Donnelly
47e60908a3
qa: fix mon config section
Fixes: fc6e683832

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 19:13:06 -07:00
Patrick Donnelly
fc6e683832
qa: ignore normal slow IO warnings for cephfs
Generally the slow warnings we get are just over the threshold. These warnings
are related to deploying multiple Ceph daemons side-by-side. Let's see how we
do with two minutes.

Ignoring the warnings entirely is unsatisfactory as they serve as a useful
canary in the coal mine when you see warnings for ops > some unreasonably large
amount of time.

Fixes: http://tracker.ceph.com/issues/26900

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 13:59:59 -07:00
Kefu Chai
9754b3769b qa/suites/fs: add python3-cephfs to packages
the default set of packages to install is in
$suite/qa/packages/packages.yaml . see get_package_list() in
teuthology/teuthology/task/install/__init__.py for how we prepare a
package list for install task.

for running python3 tests in
fs/basic_functional/tasks/volume-client, we need to install
python3-cephfs. please note that,
_package_override() in teuthology/teutholoy/task/install/rpm.py will
take care of the different naming on centos/rhel, where the python3
packages are named python34-*.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-03 20:29:49 +08:00
Patrick Donnelly
333444e8aa
Merge PR #21885 into master
* refs/pull/21885/head:
	qa: update cluster log health warning message
	qa: add tests for client features
	mds: evict clients that lack required features
	mds: cleanup MDSRank::evict_client
	mds: infer client version by client metadata and connection's features
	mds: introduce "ceph fs set <fs_name> min_compat_client <release_name>"
	mds: tell client why it's rejected
	mds: introduce cephfs' own feature bits
	mds: make Server::prepare_force_open_sessions() update client metadata

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 13:57:17 -07:00
Patrick Donnelly
3b7233a402
qa: use 4 mds cluster for multifs tests
Fixes: http://tracker.ceph.com/issues/24899

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 12:11:44 -07:00
Patrick Donnelly
441a2730e5
qa: add tests for client features
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-12 10:12:12 -07:00
Patrick Donnelly
86c817febc
Merge PR #22740 into master
* refs/pull/22740/head:
	qa: create common conf for all cephfs suites
	qa: remove wrongly created random distro conf

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-07-08 20:56:09 -07:00
Patrick Donnelly
73fa0efcbb
qa: create common conf for all cephfs suites
This will be followed by removing common CephFS configurations in the
ceph.conf.template in teuthology.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-04 13:08:10 -07:00
Patrick Donnelly
654aaa90ed
qa: add one-off clusters to qa/cephfs/clusters
To consistently handle openstack configuration.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:33:53 -07:00
Patrick Donnelly
5d4a1f232b
qa: allocate more space for VM disk
Otherwise daemons may run out of space due to logging.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:30:29 -07:00
Sage Weil
aa3dcb2b26
qa/cephfs/clusters/*: bigger cinder volumses
Fixes: http://tracker.ceph.com/issues/24238
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-29 09:27:59 -07:00
Patrick Donnelly
fbc25b4486
mds: check for session import race
Credit to Yan Zheng for identifying the race condition [1].

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1572555#c7

Test-for: http://tracker.ceph.com/issues/24072

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-14 12:52:50 -07:00
Patrick Donnelly
95762d6375
qa: whitelist mds down wrn during cephfs testing
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-17 14:40:36 -07:00
Patrick Donnelly
7dabdf526d
Merge PR #19856 into master
* refs/pull/19856/head:
	qa: synchronize kcephfs suites with fs/multimds

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-02-01 14:50:12 -08:00
Patrick Donnelly
3689c0c4e1
qa: synchronize kcephfs suites with fs/multimds
Fixes: http://tracker.ceph.com/issues/22627

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-10 10:38:47 -08:00
Patrick Donnelly
f8c275b8b6
qa: increase osd count for ec testing
Missing in d0732fc96f.

Fixes: http://tracker.ceph.com/issues/22646
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-09 16:48:18 -08:00
Patrick Donnelly
e8a0f1c554
qa: add missing openstack configs
First introduced in: ec6fb28eaf

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-09 16:48:02 -08:00