Commit Graph

1032 Commits

Author SHA1 Message Date
John Spray
f748226843 tasks/vstart_runner: update for Filesystem changes
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-08 12:15:19 +00:00
Patrick Donnelly
9832beac85
tasks/mds_thrash: support multimds
This commit amends the MDS thrasher task to also work on multimds
clusters. Main changes:

o New FSStatus class in tasks/cephfs/filesystem.py which gets a snapshot
  of the fsmap (`ceph fs dump`). This allows consecutive operations on
  the same fsmap without repeated fs dumps.

o Only one MDSThrasher is started for each file system.

o The MDSThrasher operates on ranks instead of names (and groups of
  standbys following the initial active).

o The MDSThrasher also will change the max_mds for the cluster to a new
  value [1, current) or (current, starting max_mds]. When reduced,
  randomly selected MDSs other than rank 0 will be deactivated to reach
  the new max_mds. The likelihood of changing max_mds in a given cycle of
  the MDSThrasher is set by the "thrash_max_mds" config.

o The MDSThrasher prints out stats on completion, e.g. number of
  mds deactivated or mds_max changed.

Pre-requisite for: http://tracker.ceph.com/issues/10792
Partially fixes: http://tracker.ceph.com/issues/15134

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-07 21:24:09 -05:00
John Spray
fa3098e0b7 tasks/ceph_test_case: only construct needed parts
Don't construct Filesystem and MDSCluster if there
are no MDSs in the system, don't construct MgrCluster
if there are no mgrs in the system.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 14:20:19 +00:00
John Spray
42a59fc1b6 tasks/vstart_runner: fix paths in docstring
Should have been updated when this file moved.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 14:20:19 +00:00
John Spray
9583ab6545 tasks/mgr: remove duplicated method definition
This was already defined in parent CephCluster class.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-06 10:58:33 +00:00
Sage Weil
4ae6b36964 tasks: use new generic objectstore_blackhole option
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-04 11:30:40 -04:00
John Spray
b1412ccbdb tasks: update cephfs_test_runner for mgr
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
326a33b4fa tasks: update to run ceph-mgr daemons
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
38c23c1841 tasks: create ceph-mgr tests
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:51 +01:00
John Spray
a9df9e088d tasks/cephfs: refactor test case class
A more generic CephTestCase and CephCluster, for
writeing non-cephfs test cases.

This avoids overloading one class with the functionality
needed by lots of different subsystems.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-01 12:21:41 +01:00
John Spray
f3b5acd737 Merge pull request #1219 from ceph/wip-cephfs-scan-links
tasks/cephfs: add TestDataScan.test_scan_links

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-28 11:03:43 +01:00
John Spray
57226b979a tasks/cephfs: fixup test_backtrace_repair
The branches got mixed up and the merged one wasn't
the same one that was tested.  This is the one that
works!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-28 10:33:17 +01:00
John Spray
b454cc9d32 Merge pull request #1145 from michaelsevilla/mantle
mds: add tests for mantle (programmable balancer)

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-26 20:31:44 +01:00
Yan, Zheng
cd9421f1c1 tasks/cephfs: add TestDataScan.test_scan_links
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-10-25 21:37:08 +08:00
John Spray
5fe0d6e241 Merge pull request #1218 from jcsp/wip-backtrace-repair
tasks/cephfs: add TestForwardScrub.test_backtrace_repair

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-25 11:55:33 +01:00
John Spray
5f77f09b01 tasks/cephfs: add TestForwardScrub.test_backtrace_repair
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-24 11:37:47 +01:00
Gregory Farnum
9a30b55f46 Merge pull request #1216 from ceph/wip-pg-files
tasks/cephfs: add TestDataScan.test_pg_files

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-10-21 14:48:47 -07:00
Gregory Farnum
4afdb4301c Merge pull request #1217 from ceph/wip-17558
mon-seesaw: add mon-seesaw test and mon_seesaw task

Reviewed-by: Sam Just <sjust@redhat.com>
2016-10-21 14:40:58 -07:00
Kefu Chai
569bb035f5 mon-seesaw: add mon-seesaw test and mon_seesaw task
mon_seesaw task replaces a monitor with a newly reployed one, in a
single-mon test including this task OSDs will not be able to connect
to cluster if the tracker#17558 is not fixed on the monitor side.

http://tracker.ceph.com/issues/17558
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-20 10:47:49 +08:00
John Spray
b2588f7cf5 tasks/cephfs: add TestDataScan.test_pg_files
Fixes: http://tracker.ceph.com/issues/17249
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-19 23:19:21 +01:00
Zack Cerza
01dab7fc65 Merge pull request #1213 from jcsp/wip-generate-caps
tasks/ceph: move generate_caps from teuthology
2016-10-19 11:35:51 -06:00
John Spray
257827012f Merge pull request #1202 from ajarr/wip-check-volume-size
test_volume_client: check volume size

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-19 15:19:14 +02:00
John Spray
5f3435e17b Merge pull request #1166 from ajarr/wip-17216
tasks/cephfs : test recovery of partial auth update

Reviewed-by: John Spray <john.spray@redhat.com>
2016-10-19 15:18:52 +02:00
John Spray
298cc8f932 tasks/ceph: move generate_caps from teuthology
This was only used in this task, and it is much too
ceph-specific to belong in teuthology.

Fixes: http://tracker.ceph.com/issues/17614
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-19 13:05:36 +01:00
Ramana Raja
bb60e01904 test_volume_client: remove superfluous arguments
Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-10-11 14:38:11 +05:30
Ramana Raja
91c74f4778 test_volume_client: check volume size
Check that the total size shown by the df output of a mounted volume
is same as the volume size and the quota set on the volume.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-10-11 14:23:38 +05:30
Kefu Chai
a3bd4fc557 tasks/rebuild_mondb.py: fill up the caps in the keyring
we will fail 'ceph-monstore-tool' command if the caps is empty so user
won't assign a key without any caps when rebuilding the monstore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-10-10 18:02:33 +08:00
Sage Weil
7620323559 Merge pull request #1196 from ceph/wip-dump-stuck
tasks/dump_stuck: fix failure

/home/teuthworker/archive/sage-dump-stuck/457624
2016-10-06 11:11:26 -05:00
Sage Weil
f0dffe567d tasks/dump_suck: mark down osds one at a time
This forces them to be unclean, *then* stale.  This ensures
that after they are both down they are both *always* unclean,
whereas previously it would be possible for them to be only
stale and not unclean.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 15:30:23 -04:00
Sage Weil
5ef07c32f8 tasks/dump_stuck: fix unclean count
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 15:24:11 -04:00
Sage Weil
50f2022412 tasks/dump_stuck: more verbose
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-05 15:24:10 -04:00
David Zafman
c7bcb2bd54 multibench: Fixed so I can use this standalone
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-04 21:30:31 -07:00
David Zafman
60cdb05380 ceph_manager: do_pg_scrub() don't resubmit a request for 2 minutes
Add 6 minute fatal timeout
Warn when repair is being resubmitted because it causes races

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-10-04 21:30:31 -07:00
Michael Sevilla
de749df561 mds: add tests for mantle (programmable balancer)
- rebased to add block rados pull test

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-03 12:16:01 -07:00
Patrick Donnelly
84dd1a6283
Merge remote-tracking branch 'upstream/pull/1176/head'
* upstream/pull/1176/head:
  tasks/cephfs: add default paths to vstart_runner

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2016-09-28 12:53:41 -04:00
John Spray
4d6953a46e tasks/cephfs: add default paths to vstart_runner
So that for folks with sources in typical locations
(or typical on my workstation at least!) invoking
vstart_runner is less of a mouthful.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-09-28 16:38:30 +01:00
Kefu Chai
176811f8e1 Revert "ceph_manager: lower mon_reweight_min_bytes_per_osd to 10" 2016-09-26 23:15:46 +08:00
Gregory Farnum
652d9b65da Merge pull request #1185 from jcsp/wip-dirfrags-2
tasks/ceph: enable dirfrags in cephfs
2016-09-23 14:12:39 -07:00
John Spray
cc8198d8eb tasks/ceph: enable dirfrags in cephfs
Otherwise places we set mds_bal_frag have
no effect.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-09-23 11:04:54 +01:00
Sage Weil
dccdb2eb0f tasks/ceph_manager: add bdev_inject_crash_probability support
Only do the failure injection 50% of the time; otherwise, just
kill as usual.

Signed-off-by: Sage Weil <sage@redhat.com>

# Conflicts:
#	tasks/ceph_manager.py
2016-09-21 17:07:28 -04:00
Sage Weil
f4de41c24f inject bdev failures when killing osd on bluestore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-21 17:01:33 -04:00
Sage Weil
2ae53848cf tasks/ceph_manager: respect bdev_inject_crash in kill_osd()
Note that this will only work with bluestore osds.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-21 17:01:29 -04:00
Sage Weil
4936d40438 tasks/thrashosds: fix powercycle, bdev_inject_crash
The CephManager.kill_osd expects these in its config, not
Thrasher's.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-21 16:28:00 -04:00
Kefu Chai
affccb1a6c Merge pull request #1169 from ceph/wip-kefu-17179
tasks: add rebuild_mondb

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-09-17 21:29:54 +08:00
Casey Bodley
f51a65523a Merge pull request #1136 from ceph/wip-16129
rgw: add sleep to let the sync agent init

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-09-16 10:43:52 -04:00
Kefu Chai
525d9899ce Merge pull request #1118 from ceph/wip-scrub
tasks/scrub_test: use fuse path (do not assume filestore!)

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-13 14:41:06 +08:00
Kefu Chai
3f0ab86d26 Merge pull request #1124 from ceph/wip-offline-split
ceph_manager: test offline split via ceph-objectstore-tool

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-11 11:33:03 +08:00
Sage Weil
a61dc2a1c1 tasks/scrub_test: use fuse path (do not assume filestore!)
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-08 10:13:28 -04:00
Kefu Chai
a192c786b3 tasks: add rebuild_mondb
* tasks/rebuild_mondb.py: this task
  1. removes all store.db on all monitors
  2. rebuild the store.db for the first mon
  3. start the first mon
  4. run mkfs on other mon
  5. and revive them
* suites/rados/singleton/all/rebuild-mon-db.yaml
  1. run rados/test.sh
  2. run rebuild_mondb task

Fixes: http://tracker.ceph.com/issues/17179
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-09-08 21:35:01 +08:00
Zack Cerza
eb3abfcd9d Merge pull request #1153 from ceph/wip-manager-construct
tasks/ceph: construct CephManager earlier
2016-09-06 14:35:27 -06:00