Commit Graph

1070 Commits

Author SHA1 Message Date
John Spray
1f7d2ef746 tasks/ceph: handle down nodes in log rotation
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
28aed55875 tasks/cephfs: skip ENOSPC testing on kclient
Ticket #17204 exists to revive the old patchset, until then
we skip the tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
2f6b034d09 tasks/cephfs: add a skip for non-fuse
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
e5264ec5b4 tasks/kclient: unmount conditionally
Don't assume the workload left the mount up and
running.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
04951c8ae3 tasks/cephfs: skip test_session_reject cleanly
Instead of asserting in configure_auth (which in fact
works fine with KernelMount.write_secret_file), raise
a SkipTest in test_session_reject (because the kernel
client cannot handle the client_metadata setting to
inject bogus data)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
b21b825d7f tasks/cephfs: make KernelMount.umount_wait idempotent
Some places (notably CephFSTestCase.setUp) don't check
for mountedness before calling this.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
0676444e62 Merge pull request #1282 from batrick/fs-reorg
fs: unify common parts of sub-suites

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-12-07 00:44:31 +00:00
John Spray
a3c3e78468 Merge pull request #1275 from jcsp/wip-17853
Directory fragmentation tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-07 00:17:16 +00:00
Ramakrishnan
399617bead tasks/cephfs: add test_standby_for_invalid_fscid
Signed-off-by: Ramakrishnan Periyasamy <rperiyas@redhat.com>
2016-12-06 23:34:22 +00:00
Sage Weil
377f239f52 Merge pull request #532 from ceph/wip-12378
Adds task to wrap the aver utility
2016-12-06 13:38:44 -05:00
Vasu Kulkarni
16144d8e54 Fix infinite wait during monitor quorum check
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2016-12-05 15:42:14 -08:00
Sage Weil
68e08c7ac4 Merge pull request #535 from ceph/wip-12376
tasks/radosbenchsweep task
2016-12-05 17:53:51 -05:00
Sage Weil
d06a5feda4 Merge pull request #1024 from ceph/wip-default-fs
tasks/ceph: default to xfs instead of root dir
2016-12-05 17:53:01 -05:00
Dan Mick
47cd4f4608 Merge pull request #1293 from ceph/wip-17977-fix
qemu: Set permissions on /dev/kvm

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-11-30 15:15:15 -08:00
David Galloway
7abc768941 qemu: Set permissions on /dev/kvm
Hack until fix in https://bugzilla.redhat.com/show_bug.cgi?id=1333159
makes it into CentOS repos.

Fixes: http://tracker.ceph.com/issues/17977

Signed-off-by: David Galloway <dgallowa@redhat.com>
2016-11-30 18:05:24 -05:00
Nathan Cutler
862b47faac thrashosds: try ceph-objectstore-tool for 10 minutes
If ceph-objectstore-tool binary is not present, it's likely because we're in
the middle of an upgrade. Do not try to run the binary until we verify that
it's really present. If it is absent, spend up to 10 minutes waiting for it to
appear.

Before this patch there was quite a large window for a race to occur. This
patch doesn't entirely eliminate it, but drastically reduces it.

Fixes: http://tracker.ceph.com/issues/18014
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2016-11-25 22:50:31 +01:00
Patrick Donnelly
6336f83d5f
suites/fs: add ceph-fuse disable override
Some tests require fuse mounts to not be unmounted. This avoids the need
to manually specify clients as unmounted.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:07 -05:00
John Spray
60d9a77aa0 Merge pull request #1262 from batrick/cephfs-delete-bugfix
cephfs: get new fsmap after marking clusters down

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-21 12:51:53 +00:00
John Spray
8047f8ce37 tasks/cephfs: add test_fragment
Fixes: http://tracker.ceph.com/issues/17853
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:09 +00:00
John Spray
e69d78cbc7 tasks: mark start and end of tests in clog
This makes it much easier to associate e.g. slow
requests messages with which test was running.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
John Spray
797a4e7765 tasks/cephfs: reinstate ctx.filesystem
This got lost in the multi-filesystem
refactor.  It's just a debug convenience.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
John Spray
fc9d0198e4 tasks/cephfs: fix wait_until_true logging
The success log message was in the wrong
place (and unreachable)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
David Zafman
21dde0f865 Merge pull request #1274 from ceph/wip-16064
Improve scrub analysis, list-inconsistent-obj output and osd-scrub-repair test
2016-11-17 13:49:39 -08:00
Sage Weil
0eb2dd8931 Merge pull request #1227 from athanatos/wip-ec-overwrites
ec overwrites tests (and bonus fix to fast reads)
2016-11-17 12:56:13 -06:00
Owen Synge
ef1d2a6aab tasks.rgw: 'time' imported but unused
flake8 was failing.

Signed-off-by: Owen Synge <osynge@suse.com>
2016-11-17 11:37:59 +01:00
David Zafman
e000ab2f46 tasks/scrub_test.py: Make test deterministic by updating digests
ceph_test_rados: Get coverage of digest updates in deep-scrub/repair

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5fe8522df4 repair_test, scrub_test: Fix whitelists for scrub changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5ae0f5c75a scrub_test: Fix for list-inconsistent-obj output changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
Casey Bodley
3e68bfdbb2 rgw: remove unnecessary sleeps
remove the sleeps that were added to address radosgw startup races

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
5e6538e623 rgw: start_rgw() polls gateway until it accepts connections
resolves various races between radosgw startup and further operations -
both within the rgw task itself (such as the 'radosgw-admin realm pull'),
and in later tasks

Fixes: http://tracker.ceph.com/issues/17794
Fixes: http://tracker.ceph.com/issues/17872

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
69bbafa804 rgw: add retry/backoff to sync agent requests
resolves an issue where startup of the radosgw-agent races with the
requests we send to it to run sync. uses the requests package with
urllib3 to add retry with backoff to these requests

Fixes: http://tracker.ceph.com/issues/16129

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:33:18 -05:00
Samuel Just
66836c957f thrash-erasure-code: disable ceph-objectstore-tool testing for now
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
fd39fa52ef rados,thrash-erasure-code: add overwrites workloads
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Patrick Donnelly
a9b51c3e6d
cephfs: get new fsmap after marking clusters down
Credit to John Spray for identifying the problem/cause.

Fixes: http://tracker.ceph.com/issues/17894

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-15 14:42:08 -05:00
John Spray
530d03d3f8 tasks/vstart_runner: fix default run-all
This broke when path changed.  It's a bit
weird to run the cephfs tests by default
now that vstart_runner is not cephfs-specific,
but for the moment just restore the old
behaviour.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-08 12:15:19 +00:00
John Spray
f748226843 tasks/vstart_runner: update for Filesystem changes
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-08 12:15:19 +00:00
Patrick Donnelly
9832beac85
tasks/mds_thrash: support multimds
This commit amends the MDS thrasher task to also work on multimds
clusters. Main changes:

o New FSStatus class in tasks/cephfs/filesystem.py which gets a snapshot
  of the fsmap (`ceph fs dump`). This allows consecutive operations on
  the same fsmap without repeated fs dumps.

o Only one MDSThrasher is started for each file system.

o The MDSThrasher operates on ranks instead of names (and groups of
  standbys following the initial active).

o The MDSThrasher also will change the max_mds for the cluster to a new
  value [1, current) or (current, starting max_mds]. When reduced,
  randomly selected MDSs other than rank 0 will be deactivated to reach
  the new max_mds. The likelihood of changing max_mds in a given cycle of
  the MDSThrasher is set by the "thrash_max_mds" config.

o The MDSThrasher prints out stats on completion, e.g. number of
  mds deactivated or mds_max changed.

Pre-requisite for: http://tracker.ceph.com/issues/10792
Partially fixes: http://tracker.ceph.com/issues/15134

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-07 21:24:09 -05:00
John Spray
fa3098e0b7 tasks/ceph_test_case: only construct needed parts
Don't construct Filesystem and MDSCluster if there
are no MDSs in the system, don't construct MgrCluster
if there are no mgrs in the system.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 14:20:19 +00:00
John Spray
42a59fc1b6 tasks/vstart_runner: fix paths in docstring
Should have been updated when this file moved.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 14:20:19 +00:00
John Spray
9583ab6545 tasks/mgr: remove duplicated method definition
This was already defined in parent CephCluster class.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 10:58:33 +00:00
Sage Weil
4ae6b36964 tasks: use new generic objectstore_blackhole option
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-04 11:30:40 -04:00
John Spray
b1412ccbdb tasks: update cephfs_test_runner for mgr
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
326a33b4fa tasks: update to run ceph-mgr daemons
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
38c23c1841 tasks: create ceph-mgr tests
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
a9df9e088d tasks/cephfs: refactor test case class
A more generic CephTestCase and CephCluster, for
writeing non-cephfs test cases.

This avoids overloading one class with the functionality
needed by lots of different subsystems.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:41 +01:00
John Spray
f3b5acd737 Merge pull request #1219 from ceph/wip-cephfs-scan-links
tasks/cephfs: add TestDataScan.test_scan_links

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-28 11:03:43 +01:00
John Spray
57226b979a tasks/cephfs: fixup test_backtrace_repair
The branches got mixed up and the merged one wasn't
the same one that was tested.  This is the one that
works!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-28 10:33:17 +01:00
John Spray
b454cc9d32 Merge pull request #1145 from michaelsevilla/mantle
mds: add tests for mantle (programmable balancer)

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-26 20:31:44 +01:00
Yan, Zheng
cd9421f1c1 tasks/cephfs: add TestDataScan.test_scan_links
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-10-25 21:37:08 +08:00
John Spray
5fe0d6e241 Merge pull request #1218 from jcsp/wip-backtrace-repair
tasks/cephfs: add TestForwardScrub.test_backtrace_repair

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-25 11:55:33 +01:00