Commit Graph

452 Commits

Author SHA1 Message Date
Patrick Donnelly
a7d273cef7
Merge PR #31200 into master
* refs/pull/31200/head:
	qa/cephfs: test case for auto reconnect after blacklisted

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-26 06:26:13 -08:00
Patrick Donnelly
aebc88c31e
Merge PR #33427 into master
* refs/pull/33427/head:
	qa/cephfs: rewrite a bit of code xfstests_dev.py
	qa/cephfs: update xfstests-dev deps for RHEL 8

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-25 11:05:57 -08:00
Patrick Donnelly
1d3ed17dcb
Merge PR #32657 into master
* refs/pull/32657/head:
	test: query using mds id, not rank
	mgr: re-enable mds `scrub status` info in ceph status
	mon: filter out ceph normal ceph entity types when dumping service metadata
	mgr: filter out normal ceph services when processing service map
	mgr: helper function to check if a service is a normal ceph service

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-25 11:04:06 -08:00
Patrick Donnelly
c0c0b5a265
Merge PR #33078 into master
* refs/pull/33078/head:
	qa: avoid subtree rep in test_version_splitting

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-02-25 09:14:37 -08:00
Patrick Donnelly
a80921307e
qa: avoid subtree rep in test_version_splitting
Root subtree may be replicated which would open client sessions early.

Fixes: https://tracker.ceph.com/issues/43796
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-24 12:28:15 -08:00
Venky Shankar
92b2008936 test: verify purge queue w/ large number of subvolumes
Fixes: http://tracker.ceph.com/issues/44207
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-02-24 04:27:02 -05:00
Venky Shankar
5ec09a228c test: pass timeout argument to mount::wait_for_dir_empty()
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-02-24 04:27:02 -05:00
Rishabh Dave
0c1dd0a51d qa/cephfs: rewrite a bit of code xfstests_dev.py
The variable storing the major version number plays an important role
while updating deps, therefore use a better name that is more
descriptive and makes spotting thereby easier.

Also, add an explanation for why we we have list of deps for fedora and
remove a redundant line of code.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-02-20 20:13:06 +05:30
Rishabh Dave
0f88a21267 qa/cephfs: update xfstests-dev deps for RHEL 8
btrfs-progs-devel is not availble on RHEL 8 anymore.

Fixes: https://tracker.ceph.com/issues/43964
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-02-20 20:10:11 +05:30
Venky Shankar
fb4cd42cbc test: query using mds id, not rank
Fixes: http://tracker.ceph.com/issues/42835
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-02-18 02:23:13 -05:00
Patrick Donnelly
2c9642131f
qa: add tests for mds_join_fs cluster affinity
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-13 07:51:10 -08:00
Patrick Donnelly
e5dbe0b366
qa: accept operation on current fs status
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-13 07:51:10 -08:00
Patrick Donnelly
d21b651352
qa: add method to enable multifs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-13 07:51:09 -08:00
Patrick Donnelly
92e5b7b15b
qa: fix nested generator use
Apparently Python doesn't allow nested generator calls. Hurray.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-13 07:51:09 -08:00
Patrick Donnelly
8729281121
qa: manage config changes through mons
This provides a generic framework for modifying Ceph configuration
changes in tests through the monitors rather than the asok interface or
local ceph.conf changes. Any changes are reverted during test teardown.

A future patch will convert existing tests manipulating the local
ceph.conf or admin socket.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-13 07:51:09 -08:00
Patrick Donnelly
29d850fb7e
Merge PR #32570 into master
* refs/pull/32570/head:
	cephfs-shell: Add tests for setxattr, getxattr and listxattr
	cephfs-shell: Add listxattr command
	cephfs-shell: Add getxattr command
	cephfs-shell: Add setxattr command
	doc: Update about extended attributes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:56:50 -08:00
Patrick Donnelly
3a6f107331
Merge PR #31633 into master
* refs/pull/31633/head:
	cephfs-shell: Instead of assert use stat for tests in rmdir
	cephfs-shell: Add function for common rmdir test code
	cephfs-shell: Add rmdir test for non empty directory
	cephfs-shell: Add rmdir -p test for non empty directory
	cephfs-shell: Add rmdir -p test for non existing dir
	cephfs-shell: Add rmdir -p test to delete all dirs in given path
	cephfs-shell: Add rmdir -p test for root directory with empty directories
	cephfs-shell: Add rmdir test for valid file
	cephfs-shell: Add rmdir test for invalid directory
	cephfs-shell: Add rmdir test for valid directory
	cephfs-shell: Fix rmdir '-p' issues

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:52:23 -08:00
Venky Shankar
b5970ff80d test: add subvolume clone tests
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Varsha Rao
e601242afe cephfs-shell: Add tests for setxattr, getxattr and listxattr
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-30 01:16:27 +05:30
Patrick Donnelly
1a0258ed3c
Merge PR #32644 into master
* refs/pull/32644/head:
	qa: ignore trimmed cache items for dead cache drop
	qa: use unit test comparisons

Reviewed-by: Zheng Yan <zyan@redhat.com>
2020-01-22 08:21:04 -08:00
Varsha Rao
d4b6a5c2d4 cephfs-shell: Instead of assert use stat for tests in rmdir
Using assert causes the tests to fail on teuthology due to this test being run
separately from the ceph cluster. Instead use stat for testing.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
d21df7560e cephfs-shell: Add function for common rmdir test code
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
c512b94127 cephfs-shell: Add rmdir test for non empty directory
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
0ef7c6e849 cephfs-shell: Add rmdir -p test for non empty directory
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
32be18e239 cephfs-shell: Add rmdir -p test for non existing dir
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
dec171dddb cephfs-shell: Add rmdir -p test to delete all dirs in given path
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
31710d037c cephfs-shell: Add rmdir -p test for root directory with empty directories
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
5236f76a19 cephfs-shell: Add rmdir test for valid file
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
b93d91b171 cephfs-shell: Add rmdir test for invalid directory
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Varsha Rao
00c052fec5 cephfs-shell: Add rmdir test for valid directory
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-22 16:30:11 +05:30
Patrick Donnelly
6637200cac
Merge PR #31232 into master
* refs/pull/31232/head:
	test: test case for openfiletable MAX_ITEMS_PER_OBJ value verification
	mds/OpenFileTable: match MAX_ITEMS_PER_OBJ to osd_deep_scrub_large_omap_object_key_threshold

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-21 20:00:43 -08:00
Patrick Donnelly
590368e956
qa: ignore trimmed cache items for dead cache drop
Fixes: https://tracker.ceph.com/issues/42986
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 17:52:12 -08:00
Patrick Donnelly
a37eda7612
Merge PR #32642 into master
* refs/pull/32642/head:
	qa: save MDS epoch barrier
	qa: prefer rank_asok

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 17:29:57 -08:00
Patrick Donnelly
8d9caddca6
qa: save MDS epoch barrier
Rather than verify the latest OSDMap is the same as the rank's
osdmap_epoch_barrier, just use the rank's version. The OSDMap may change
out-of-band with the test startup and thus the epoch's would diverge.
The file system and rank is fresh for each test so there's no reason to
care if the MDS barrier is one epoch behind the latest.

Fixes: https://tracker.ceph.com/issues/43554
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 17:20:57 -08:00
Patrick Donnelly
b89f3ca941
qa: prefer rank_asok
This is a trivial refactor.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 17:20:57 -08:00
Patrick Donnelly
a8a19501b7
qa: use unit test comparisons
So they show values on failure.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 17:08:44 -08:00
Patrick Donnelly
458f383cf2
mds: track high water mark for purges
This makes the corresponding test not racy.

Fixes: https://tracker.ceph.com/issues/16881
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 17:06:19 -08:00
Patrick Donnelly
096a5cad38
qa: use correct variable for exception debug
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 17:06:19 -08:00
Patrick Donnelly
f3f6f56cd5
Merge PR #32524 into master
* refs/pull/32524/head:
	qa/xfstests_dev: change deps for xfstests-dev on ubuntu
	qa/cephfs: change deps for xfstests-dev on centos8
	vstart_runnner: add sh method to LocalRemote

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-20 11:13:06 -08:00
Rishabh Dave
b9e006a4db qa/xfstests_dev: change deps for xfstests-dev on ubuntu
Rename python to python2 if Ubuntu distro release is 19 or later.

Fixes: https://tracker.ceph.com/issues/43522
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-18 11:45:13 +05:30
Vikhyat Umrao
e0abf8c13a test: test case for openfiletable MAX_ITEMS_PER_OBJ value verification
Signed-off-by: Vikhyat Umrao <vikhyat@redhat.com>
2020-01-17 19:35:46 -08:00
Venky Shankar
c158a13342 mgr/volumes: fail removing subvolume with snapshots
Fixes: http://tracker.ceph.com/issues/43645
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-17 05:00:29 -05:00
Rishabh Dave
00dad3304d qa/cephfs: change deps for xfstests-dev on centos8
btrfs-progs-devel is not available anymore on CentOS 8, update
dependency for xfstests-dev in xfstests_dev.py accordingly.

Also, let's make minor changes to improve readability since we are
around.

Fixes: https://tracker.ceph.com/issues/43486
Signed-off-by: Rishabh Dave <ridave@gmail.com>
2020-01-16 23:35:11 +05:30
Yan, Zheng
261a456439 qa/cephfs: test case for auto reconnect after blacklisted
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/42085
2020-01-15 15:43:17 +08:00
Patrick Donnelly
dc018d8b79
Merge PR #31763 into master
* refs/pull/31763/head:
	test: auto-upgrade subvolume test
	mgr/volumes: tie everything together to implement versioned subvolumes
	mgr/volumes: provide subvolume create/remove/open APIs
	mgr/volumes: implement subvolume based on subvolume template
	mgr/volumes: implement subvolume group based on group template
	mgr/volumes: implement trash as a subvolume group
	mgr/volumes: snapshot util module
	mgr/volumes: template for implementing groups and subvolumes
	mgr/volumes: implement filesystem volume module
	mgr/volumes: lock module to serialize volume operations
	mgr/volumes: introduce volume specification module
	mgr/volumes: add fs_util helper module

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-14 20:32:44 -08:00
Patrick Donnelly
cf2d411251
Merge PR #32532 into master
* refs/pull/32532/head:
	qa: only restart MDS between tests

Reviewed-by: Jos Collin <jcollin@redhat.com>
2020-01-09 12:24:28 -08:00
Patrick Donnelly
bae0c67395
Merge PR #32533 into master
* refs/pull/32533/head:
	qa: fix various py3 cephfs qa bugs x2

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
2020-01-09 11:13:53 -08:00
Patrick Donnelly
148e99be09
Merge PR #32507 into master
* refs/pull/32507/head:
	qa: detect RHEL8 for yum package installation

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-09 11:12:32 -08:00
Venky Shankar
03ee966b6c test: auto-upgrade subvolume test
Fixes: https://tracker.ceph.com/issues/43349
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-09 06:33:31 -05:00
Patrick Donnelly
423dcb4c54
qa: only restart MDS between tests
"fs fail" will only fail the MDS that are part of the file system which
will generally allow us to avoid spurious MDS_INSUFFICIENT_STANDBY
warnings. Further, only restart the MDS, there's no reason to leave them
offline.

Fixes: https://tracker.ceph.com/issues/43514
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 18:47:23 -08:00