Commit Graph

1044 Commits

Author SHA1 Message Date
David Zafman
21dde0f865 Merge pull request #1274 from ceph/wip-16064
Improve scrub analysis, list-inconsistent-obj output and osd-scrub-repair test
2016-11-17 13:49:39 -08:00
Sage Weil
0eb2dd8931 Merge pull request #1227 from athanatos/wip-ec-overwrites
ec overwrites tests (and bonus fix to fast reads)
2016-11-17 12:56:13 -06:00
Owen Synge
ef1d2a6aab tasks.rgw: 'time' imported but unused
flake8 was failing.

Signed-off-by: Owen Synge <osynge@suse.com>
2016-11-17 11:37:59 +01:00
David Zafman
e000ab2f46 tasks/scrub_test.py: Make test deterministic by updating digests
ceph_test_rados: Get coverage of digest updates in deep-scrub/repair

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5fe8522df4 repair_test, scrub_test: Fix whitelists for scrub changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5ae0f5c75a scrub_test: Fix for list-inconsistent-obj output changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
Casey Bodley
3e68bfdbb2 rgw: remove unnecessary sleeps
remove the sleeps that were added to address radosgw startup races

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
5e6538e623 rgw: start_rgw() polls gateway until it accepts connections
resolves various races between radosgw startup and further operations -
both within the rgw task itself (such as the 'radosgw-admin realm pull'),
and in later tasks

Fixes: http://tracker.ceph.com/issues/17794
Fixes: http://tracker.ceph.com/issues/17872

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
69bbafa804 rgw: add retry/backoff to sync agent requests
resolves an issue where startup of the radosgw-agent races with the
requests we send to it to run sync. uses the requests package with
urllib3 to add retry with backoff to these requests

Fixes: http://tracker.ceph.com/issues/16129

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:33:18 -05:00
Samuel Just
66836c957f thrash-erasure-code: disable ceph-objectstore-tool testing for now
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
fd39fa52ef rados,thrash-erasure-code: add overwrites workloads
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
John Spray
530d03d3f8 tasks/vstart_runner: fix default run-all
This broke when path changed.  It's a bit
weird to run the cephfs tests by default
now that vstart_runner is not cephfs-specific,
but for the moment just restore the old
behaviour.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-08 12:15:19 +00:00
John Spray
f748226843 tasks/vstart_runner: update for Filesystem changes
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-08 12:15:19 +00:00
Patrick Donnelly
9832beac85
tasks/mds_thrash: support multimds
This commit amends the MDS thrasher task to also work on multimds
clusters. Main changes:

o New FSStatus class in tasks/cephfs/filesystem.py which gets a snapshot
  of the fsmap (`ceph fs dump`). This allows consecutive operations on
  the same fsmap without repeated fs dumps.

o Only one MDSThrasher is started for each file system.

o The MDSThrasher operates on ranks instead of names (and groups of
  standbys following the initial active).

o The MDSThrasher also will change the max_mds for the cluster to a new
  value [1, current) or (current, starting max_mds]. When reduced,
  randomly selected MDSs other than rank 0 will be deactivated to reach
  the new max_mds. The likelihood of changing max_mds in a given cycle of
  the MDSThrasher is set by the "thrash_max_mds" config.

o The MDSThrasher prints out stats on completion, e.g. number of
  mds deactivated or mds_max changed.

Pre-requisite for: http://tracker.ceph.com/issues/10792
Partially fixes: http://tracker.ceph.com/issues/15134

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-07 21:24:09 -05:00
John Spray
fa3098e0b7 tasks/ceph_test_case: only construct needed parts
Don't construct Filesystem and MDSCluster if there
are no MDSs in the system, don't construct MgrCluster
if there are no mgrs in the system.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 14:20:19 +00:00
John Spray
42a59fc1b6 tasks/vstart_runner: fix paths in docstring
Should have been updated when this file moved.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 14:20:19 +00:00
John Spray
9583ab6545 tasks/mgr: remove duplicated method definition
This was already defined in parent CephCluster class.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 10:58:33 +00:00
Sage Weil
4ae6b36964 tasks: use new generic objectstore_blackhole option
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-04 11:30:40 -04:00
John Spray
b1412ccbdb tasks: update cephfs_test_runner for mgr
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
326a33b4fa tasks: update to run ceph-mgr daemons
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
38c23c1841 tasks: create ceph-mgr tests
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
a9df9e088d tasks/cephfs: refactor test case class
A more generic CephTestCase and CephCluster, for
writeing non-cephfs test cases.

This avoids overloading one class with the functionality
needed by lots of different subsystems.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:41 +01:00
John Spray
f3b5acd737 Merge pull request #1219 from ceph/wip-cephfs-scan-links
tasks/cephfs: add TestDataScan.test_scan_links

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-28 11:03:43 +01:00
John Spray
57226b979a tasks/cephfs: fixup test_backtrace_repair
The branches got mixed up and the merged one wasn't
the same one that was tested.  This is the one that
works!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-28 10:33:17 +01:00
John Spray
b454cc9d32 Merge pull request #1145 from michaelsevilla/mantle
mds: add tests for mantle (programmable balancer)

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-26 20:31:44 +01:00
Yan, Zheng
cd9421f1c1 tasks/cephfs: add TestDataScan.test_scan_links
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-10-25 21:37:08 +08:00
John Spray
5fe0d6e241 Merge pull request #1218 from jcsp/wip-backtrace-repair
tasks/cephfs: add TestForwardScrub.test_backtrace_repair

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-25 11:55:33 +01:00
John Spray
5f77f09b01 tasks/cephfs: add TestForwardScrub.test_backtrace_repair
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-24 11:37:47 +01:00
Gregory Farnum
9a30b55f46 Merge pull request #1216 from ceph/wip-pg-files
tasks/cephfs: add TestDataScan.test_pg_files

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-21 14:48:47 -07:00
Gregory Farnum
4afdb4301c Merge pull request #1217 from ceph/wip-17558
mon-seesaw: add mon-seesaw test and mon_seesaw task

Reviewed-by: Sam Just <sjust@redhat.com>
2016-10-21 14:40:58 -07:00
Kefu Chai
569bb035f5 mon-seesaw: add mon-seesaw test and mon_seesaw task
mon_seesaw task replaces a monitor with a newly reployed one, in a
single-mon test including this task OSDs will not be able to connect
to cluster if the tracker#17558 is not fixed on the monitor side.

http://tracker.ceph.com/issues/17558
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-20 10:47:49 +08:00
John Spray
b2588f7cf5 tasks/cephfs: add TestDataScan.test_pg_files
Fixes: http://tracker.ceph.com/issues/17249
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-19 23:19:21 +01:00
Zack Cerza
01dab7fc65 Merge pull request #1213 from jcsp/wip-generate-caps
tasks/ceph: move generate_caps from teuthology
2016-10-19 11:35:51 -06:00
John Spray
257827012f Merge pull request #1202 from ajarr/wip-check-volume-size
test_volume_client: check volume size

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-19 15:19:14 +02:00
John Spray
5f3435e17b Merge pull request #1166 from ajarr/wip-17216
tasks/cephfs : test recovery of partial auth update

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-19 15:18:52 +02:00
John Spray
298cc8f932 tasks/ceph: move generate_caps from teuthology
This was only used in this task, and it is much too
ceph-specific to belong in teuthology.

Fixes: http://tracker.ceph.com/issues/17614
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-19 13:05:36 +01:00
Ramana Raja
bb60e01904 test_volume_client: remove superfluous arguments
Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-10-11 14:38:11 +05:30
Ramana Raja
91c74f4778 test_volume_client: check volume size
Check that the total size shown by the df output of a mounted volume
is same as the volume size and the quota set on the volume.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-10-11 14:23:38 +05:30
Kefu Chai
a3bd4fc557 tasks/rebuild_mondb.py: fill up the caps in the keyring
we will fail 'ceph-monstore-tool' command if the caps is empty so user
won't assign a key without any caps when rebuilding the monstore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-10 18:02:33 +08:00
Sage Weil
7620323559 Merge pull request #1196 from ceph/wip-dump-stuck
tasks/dump_stuck: fix failure

/home/teuthworker/archive/sage-dump-stuck/457624
2016-10-06 11:11:26 -05:00
Sage Weil
f0dffe567d tasks/dump_suck: mark down osds one at a time
This forces them to be unclean, *then* stale.  This ensures
that after they are both down they are both *always* unclean,
whereas previously it would be possible for them to be only
stale and not unclean.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 15:30:23 -04:00
Sage Weil
5ef07c32f8 tasks/dump_stuck: fix unclean count
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 15:24:11 -04:00
Sage Weil
50f2022412 tasks/dump_stuck: more verbose
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 15:24:10 -04:00
David Zafman
c7bcb2bd54 multibench: Fixed so I can use this standalone
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-04 21:30:31 -07:00
David Zafman
60cdb05380 ceph_manager: do_pg_scrub() don't resubmit a request for 2 minutes
Add 6 minute fatal timeout
Warn when repair is being resubmitted because it causes races

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-04 21:30:31 -07:00
Michael Sevilla
de749df561 mds: add tests for mantle (programmable balancer)
- rebased to add block rados pull test

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-03 12:16:01 -07:00
Patrick Donnelly
84dd1a6283
Merge remote-tracking branch 'upstream/pull/1176/head'
* upstream/pull/1176/head:
  tasks/cephfs: add default paths to vstart_runner

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2016-09-28 12:53:41 -04:00
John Spray
4d6953a46e tasks/cephfs: add default paths to vstart_runner
So that for folks with sources in typical locations
(or typical on my workstation at least!) invoking
vstart_runner is less of a mouthful.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-09-28 16:38:30 +01:00
Kefu Chai
176811f8e1 Revert "ceph_manager: lower mon_reweight_min_bytes_per_osd to 10" 2016-09-26 23:15:46 +08:00
Gregory Farnum
652d9b65da Merge pull request #1185 from jcsp/wip-dirfrags-2
tasks/ceph: enable dirfrags in cephfs
2016-09-23 14:12:39 -07:00