Commit Graph

327 Commits

Author SHA1 Message Date
John Spray
d6d9715ddd tasks/cephfs: skip volumeclient client test on kcephfs
This relies on quota-ish stuff that doesn't exist
in kclient.  We can still run the outer part
of the test though.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
0bd95f72a2 tasks/cephfs: fix unmount call in volumeclient test
Should have been to umount_wait, not umount (i.e.
the blocking foreground version).  This happened
to matter because umount_wait is more tolerant
of being called if the client is not already mounted.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
45eb4bf716 tasks/cephfs: special case for kcephfs behaviour
It does not generate EIOs in all the cases that
the fuse client does.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
1eabbbda25 tasks/cephfs: skip TestVolumeClient.test_evict on kcephfs
This test was probably buggy and only happened to work
with ceph-fuse, because it expects the MDS to immediately
respond to updates to the client's auth caps, but that
doesn't happen.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
14f3a688a2 tasks/cephfs: fix race in TestStrays.test_dirfrag_limit
With the kernel client, this was proceeding to attempt
a split before the directory had persisted, because
there was no fsync after creating it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
1aa7ad6a7a tasks/cephfs: skip test_client_abort on kclient
This tests a fuse-only feature, ticket for adding
it in kclient is:
http://tracker.ceph.com/issues/17805

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:10 +00:00
John Spray
bc680e7a1e tasks/cephfs: support multi-fs in kernel client
Change the Mount interface to take it as an
argument to mount() instead of setting it
out of band in a config file as we used to
for the fuse client.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
d1277afd08 tasks/cephfs: fix eviction test for volumeclient
It was not correct to expect a client to block after
eviction unless it was also deauthorised.  I guess
this was working with fuse because fuse does a less
good job at re-establishing a session than the kclient?

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
507cfebbc7 tasks/cephfs: update test_journal_repair for kclient
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
28aed55875 tasks/cephfs: skip ENOSPC testing on kclient
Ticket #17204 exists to revive the old patchset, until then
we skip the tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
2f6b034d09 tasks/cephfs: add a skip for non-fuse
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
04951c8ae3 tasks/cephfs: skip test_session_reject cleanly
Instead of asserting in configure_auth (which in fact
works fine with KernelMount.write_secret_file), raise
a SkipTest in test_session_reject (because the kernel
client cannot handle the client_metadata setting to
inject bogus data)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
b21b825d7f tasks/cephfs: make KernelMount.umount_wait idempotent
Some places (notably CephFSTestCase.setUp) don't check
for mountedness before calling this.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
a3c3e78468 Merge pull request #1275 from jcsp/wip-17853
Directory fragmentation tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-07 00:17:16 +00:00
Ramakrishnan
399617bead tasks/cephfs: add test_standby_for_invalid_fscid
Signed-off-by: Ramakrishnan Periyasamy <rperiyas@redhat.com>
2016-12-06 23:34:22 +00:00
John Spray
8047f8ce37 tasks/cephfs: add test_fragment
Fixes: http://tracker.ceph.com/issues/17853
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:09 +00:00
John Spray
e69d78cbc7 tasks: mark start and end of tests in clog
This makes it much easier to associate e.g. slow
requests messages with which test was running.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
John Spray
797a4e7765 tasks/cephfs: reinstate ctx.filesystem
This got lost in the multi-filesystem
refactor.  It's just a debug convenience.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
Patrick Donnelly
a9b51c3e6d
cephfs: get new fsmap after marking clusters down
Credit to John Spray for identifying the problem/cause.

Fixes: http://tracker.ceph.com/issues/17894

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-15 14:42:08 -05:00
Patrick Donnelly
9832beac85
tasks/mds_thrash: support multimds
This commit amends the MDS thrasher task to also work on multimds
clusters. Main changes:

o New FSStatus class in tasks/cephfs/filesystem.py which gets a snapshot
  of the fsmap (`ceph fs dump`). This allows consecutive operations on
  the same fsmap without repeated fs dumps.

o Only one MDSThrasher is started for each file system.

o The MDSThrasher operates on ranks instead of names (and groups of
  standbys following the initial active).

o The MDSThrasher also will change the max_mds for the cluster to a new
  value [1, current) or (current, starting max_mds]. When reduced,
  randomly selected MDSs other than rank 0 will be deactivated to reach
  the new max_mds. The likelihood of changing max_mds in a given cycle of
  the MDSThrasher is set by the "thrash_max_mds" config.

o The MDSThrasher prints out stats on completion, e.g. number of
  mds deactivated or mds_max changed.

Pre-requisite for: http://tracker.ceph.com/issues/10792
Partially fixes: http://tracker.ceph.com/issues/15134

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-07 21:24:09 -05:00
John Spray
a9df9e088d tasks/cephfs: refactor test case class
A more generic CephTestCase and CephCluster, for
writeing non-cephfs test cases.

This avoids overloading one class with the functionality
needed by lots of different subsystems.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:41 +01:00
John Spray
f3b5acd737 Merge pull request #1219 from ceph/wip-cephfs-scan-links
tasks/cephfs: add TestDataScan.test_scan_links

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-28 11:03:43 +01:00
John Spray
57226b979a tasks/cephfs: fixup test_backtrace_repair
The branches got mixed up and the merged one wasn't
the same one that was tested.  This is the one that
works!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-28 10:33:17 +01:00
John Spray
b454cc9d32 Merge pull request #1145 from michaelsevilla/mantle
mds: add tests for mantle (programmable balancer)

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-26 20:31:44 +01:00
Yan, Zheng
cd9421f1c1 tasks/cephfs: add TestDataScan.test_scan_links
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-10-25 21:37:08 +08:00
John Spray
5fe0d6e241 Merge pull request #1218 from jcsp/wip-backtrace-repair
tasks/cephfs: add TestForwardScrub.test_backtrace_repair

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-25 11:55:33 +01:00
John Spray
5f77f09b01 tasks/cephfs: add TestForwardScrub.test_backtrace_repair
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-24 11:37:47 +01:00
Gregory Farnum
9a30b55f46 Merge pull request #1216 from ceph/wip-pg-files
tasks/cephfs: add TestDataScan.test_pg_files

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-21 14:48:47 -07:00
John Spray
b2588f7cf5 tasks/cephfs: add TestDataScan.test_pg_files
Fixes: http://tracker.ceph.com/issues/17249
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-19 23:19:21 +01:00
John Spray
257827012f Merge pull request #1202 from ajarr/wip-check-volume-size
test_volume_client: check volume size

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-19 15:19:14 +02:00
John Spray
5f3435e17b Merge pull request #1166 from ajarr/wip-17216
tasks/cephfs : test recovery of partial auth update

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-19 15:18:52 +02:00
Ramana Raja
bb60e01904 test_volume_client: remove superfluous arguments
Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-10-11 14:38:11 +05:30
Ramana Raja
91c74f4778 test_volume_client: check volume size
Check that the total size shown by the df output of a mounted volume
is same as the volume size and the quota set on the volume.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-10-11 14:23:38 +05:30
Michael Sevilla
de749df561 mds: add tests for mantle (programmable balancer)
- rebased to add block rados pull test

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-03 12:16:01 -07:00
John Spray
4d6953a46e tasks/cephfs: add default paths to vstart_runner
So that for folks with sources in typical locations
(or typical on my workstation at least!) invoking
vstart_runner is less of a mouthful.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-09-28 16:38:30 +01:00
Ramana Raja
f0134a3db5 tasks/cephfs: test recovery of partial auth update
... in ceph_volume_client.

Signed-off-by: Ramana Raja <rraja@redhat.com>

Update test_volume_client.py
2016-09-06 17:59:22 +05:30
Gregory Farnum
c2efbd39c1 Merge pull request #1112 from jcsp/wip-16909
tasks/cephfs: test standby replay teardown on rank stop

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:03:24 -07:00
John Spray
f23e15c9fa tasks/cephfs: test standby replay teardown on rank stop
Fixes: http://tracker.ceph.com/issues/16909
Signed-off-by: John Spray <john.spray@redhat.com>
2016-08-09 14:29:13 +01:00
Douglas Fuller
e01ff2e3c1 cephfs/vstart_runner: add -ww option to ps
vstart_runner can't find arguments to ceph daemons to identify them with
ps -x because commands are cut off at terminal width. Add -ww for wide
output.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2016-08-09 06:19:14 -07:00
John Spray
05a6c839e0 tasks/cephfs: check cache size health warning
Fortunately we already have a test that creates the condition,
so just tweak it to exceed the 150% threshold for the health warning,
and check that the health message appears.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-07-29 12:42:30 +01:00
Josh Durgin
cee7a24183 cephfs/filesystem: remove unused var
flake8 passes now

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-07-28 14:45:25 -07:00
Douglas Fuller
c669f1ecd5 cephfs: add test for dump tree admin socket command
Add test_dump_tree to validate the MDS admin socket command
dump tree. Add a parameter for path_to_ino to enable the use of
lstat() instead of stat()

See: http://tracker.ceph.com/issues/11171
See: https://github.com/ceph/ceph/pull/9925
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2016-07-28 11:35:56 +01:00
Vishal Kanaujia
ce99bcac2c cephfs: Added a inotable repair case to the test 2016-07-28 11:31:55 +01:00
Ramana Raja
08e3a49fa5 tasks/cephfs/test_volume_client: test authentication metadata
Test the usecases for the authentication metadata stored
by the volume client:

* Obtain the list of auth IDs having access to a volume.

* Restrict volume access to auth IDs of a single (OpenStack)
  tenant to enforce strong tenant isolation of volumes.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-07-13 16:56:26 +05:30
Ramana Raja
335872355d vstart_runner: fix misleading log message
Message is logged as, filesystem is mounted,
despite the vstart_runner just trying to mount
at this stage.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-06-30 23:44:55 +01:00
Ramana Raja
6d074bdb4c tasks/cephfs: rename 'long_running' decorator
Rename 'long_running' decorator as 'for_teuthology',
which is more intuitive.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-06-30 23:44:54 +01:00
John Spray
5553e9c943 tasks/cephfs: use "blacklist clear"
... instead of iterating over all blacklist entries.  Fall
back to the old way if the new way doesn't work (i.e. on
old ceph)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:44:20 +01:00
John Spray
adfb757c89 tasks/cephfs: fix race while mounting
This could fail if the mount hadn't finished
coming up.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:44:20 +01:00
John Spray
bb517c6415 tasks/cephfs: fix vstart_runner with cmake
This needed updating for the CLI living in bin/ now

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:44:19 +01:00
John Spray
9d3eee3461 tasks/cephfs: disable setuid test in vstart environ
``long_running`` needs a better name, it's really just a
marker that says a test is for use in teuthology but not vstart.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:44:19 +01:00