Commit Graph

2586 Commits

Author SHA1 Message Date
David Zafman
54af8b2be3 Tasks are failing since using "data" pool no longer part of default install
Create a pool specifically for each task

Fixes: 8930

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-08-01 16:06:39 -07:00
Sage Weil
f84458bd93 ceph_manager: increase osd revival timeout from 75 -> 150 seconds
Saw this fail on a firefly run just bc of valgrind slowness.  Make the
timeout higher!

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-30 21:34:45 -07:00
Sage Weil
7c3fc404d6 valgrind: ignore ec plugin factory leaks
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-30 18:14:08 -07:00
John Spray
9e2c82824b Merge pull request #300 from ceph/wip-mpi-vers
task/mpi: Explicit check for version mismatch
2014-07-30 23:37:39 +01:00
Zack Cerza
094cd5b3ba Merge pull request #302 from ceph/wip-8850
tell us if you are really not running any more
2014-07-30 14:31:27 -06:00
Alfredo Deza
4686115c48 add another call to use "ps aux"
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-07-30 16:28:02 -04:00
Alfredo Deza
ec342d8146 tell us if you are really not running any more
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-07-30 16:17:01 -04:00
John Spray
491817961a task/mpi: Explicit check for version mismatch
Instead of proceeding to have mpiexec fail or hang,
do an up-front check that the MPI version is the same
on all of the nodes in the test.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-30 14:29:11 +01:00
Zack Cerza
b8687a54aa Fix package_version_for_hash() call
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-29 14:43:41 -06:00
John Spray
0147c74671 task/mds_journal_migration: fix cleanup
Previously this was remounting in the background
which meant that if a workunit was executed immediately
afterwards it could put files in the mount dir before
the FS was mounted, causing the mount to fail.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-29 13:11:12 +01:00
John Spray
cc7c9b2e8b task/workunit: add sudo to dir delete
This failure to delete used to be hidden in
a catch-all exception handler that was
removed in 396dc073.

This was causing failures in kcephfs suite
like:
Command failed on plana96 with status 1: 'rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0'

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-27 12:04:23 +01:00
Zack Cerza
2999a4d492 Merge pull request #296 from ceph/wip-standby-mds
Wip standby mds
2014-07-25 16:44:34 -06:00
Sage Weil
883f2a76f4 task/osd_recovery: use rbd instead of metadata pool
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-25 11:39:42 -07:00
Sage Weil
4e56521ebe task/osd_backfill: use 'rbd' instead of 'data' pool
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-25 11:33:25 -07:00
John Spray
2ed1131fc9 task/workunit: general tidy
* PEP8-ize whitespace
* specialize a catch-all except:
* don't alias 'misc' to 'teuthology'

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-25 13:33:31 +01:00
John Spray
396dc073cb task/workunit: clean up dir deletion
This was always trying to remove the mountpoint,
and then swallowing the exception and printing
it to the log.

Instead:
 * Ensure it's only trying to delete mnt if it created it
 * Don't swallow those exceptions: if deleting the dirs
   fails then something has gone wrong and it should bubble
   up.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-25 13:33:31 +01:00
John Spray
a96a7b027c task/cephfs: generalise Filesystem for multi-MDS
This enables tasks like mds_journal_migration to be
run in an environment with standby-replay MDSs present.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-25 13:33:31 +01:00
Zack Cerza
c2fc561427 Remove oddly-placed, broken import
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-24 10:03:38 -06:00
Zack Cerza
479a1fe676 Rename CephState to DaemonGroup and move to orchestra
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-23 19:59:16 -06:00
Zack Cerza
7d0adcee2d Move DaemonState to teuthology.orchestra
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-23 19:59:16 -06:00
Zack Cerza
efce34186c Fail sooner if an invalid config_yaml is passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-22 15:47:53 -06:00
Zack Cerza
0e2149c86e Remove kcon_most
It was unused.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-22 13:57:40 -06:00
Zack Cerza
d6e5895fb2 Merge pull request #293 from ceph/wip-ship-utilities
move ship_utilities to install task (from ceph test)
2014-07-22 13:49:57 -06:00
Sage Weil
828bb2a6ea ceph_deploy: use new ship_utilities location
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-22 10:55:10 -07:00
John Spray
72b3417890 task/mds_journal_migration: use existing clients
Since refactoring ceph_fuse and kclient tasks
to store Mount objects on ctx, the mds_journal_migration
task can use those instead of explicitly instantiating its own.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-21 12:56:05 +01:00
Sage Weil
2dad906f4a move ship_utilities to install task (from ceph test)
No need to install ceph just to get daemon-helper, adjust-ulimits, etc..
These utilities are used by lots of tasks, not just ceph.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-19 09:22:27 -07:00
Zack Cerza
b8c443b44f Fix get_hash() arg ordering
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-16 12:07:55 -06:00
Zack Cerza
fccc6adb7f Merge pull request #287 from ceph/wip-mds-sessions
Wip mds sessions
2014-07-15 16:27:56 -06:00
Zack Cerza
443b782d39 Merge pull request #288 from ceph/wip-upgrade-fix
task/ceph: Make cephfs_setup cuttlefish-compatible
2014-07-15 16:22:29 -06:00
Sage Weil
d5a4998b3d Merge pull request #291 from ceph/wip-rgw-pools
rgw: set data extra pool correctly

Backport: next, firefly
Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-15 14:57:49 -07:00
Yehuda Sadeh
63fb271b7e rgw: set data extra pool correctly
When configuring multiregion zone, set the data extra pool

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-07-15 13:02:20 -07:00
Zack Cerza
29c06f00d9 Add and use new fetch() method
The old fetch_branch() wasn't behaving properly with the ceph.com git
mirror. This method works with github.com and ceph.com. Add a couple
unit tests, and leave the old fetch_branch() in place for now, even
though nothing uses it.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-15 12:02:32 -06:00
Sage Weil
7262effc12 Merge pull request #290 from ceph/wip-deep-scrub
task/ceph.py: deep-scrub instead of scrub
2014-07-15 12:02:32 -06:00
Zack Cerza
79da400dcf Fix a bug where results_email was being ignored
Referring to the setting in ~/.teuthology.yaml

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-15 12:02:32 -06:00
Samuel Just
26c49ec26e task/ceph.py: deep-scrub instead of scrub
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-07-15 10:28:11 -07:00
Sage Weil
36441a27d6 README: teuthology-suite
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-15 10:08:09 -07:00
John Spray
9c8dd98a38 task/kclient: remove redundant double loop
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
403ba2c892 task/cephfs: use dedent for embedded python
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
785a272bab task: fix admin_socket for non-int ids
This was working for OSDs and for my config
where MDS happened to have numeric ID, but
in general service IDs are strings, not ints.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
8bb77ed9e1 task: add mds_client_recovery
This task exercises the CephFS session recovery
behavior.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
91e56bb995 task/mds_journal_migration: only mount my client
Pass explicit client ID list to ceph_fuse context so
that it doesn't try to mount all clients in the config,
in case there are other clients.

Also allow configuration to specify which client
this task should use.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
d91f028e26 task: refactor kclient into KernelMount
Additionally make both kclient and ceph_fuse
tasks yield a collection of CephFSMount
objects so that subsequent tasks can
retrieve them.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
6cba4973c3 task: create FuseMount class from ceph_fuse
This is for use by other tasks that need filesystem
mounts under their own control.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:11 +01:00
Zack Cerza
657bd369d0 Fix the incomplete substitute_placeholders() fix
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 15:16:55 -06:00
Zack Cerza
f557ac5f8c Add a debug statement to reset_repo()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 14:48:31 -06:00
Zack Cerza
56ad957534 Be smarter about choosing branches
Part of this is also about failing sooner, and not allowing invalid
configurations to enter the queue. This commit also fixes an obscure bug
in substitute_placeholders(). Finally, it adds unit tests for all bugs
fixed.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 14:30:31 -06:00
John Spray
6c05747da7 task: move Filesystem class to shared location
...in preparation for tests other than mds_journal_migration
to use it.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 16:37:41 +01:00
Zack Cerza
47087ff7fb Fall back to master for suite_branch
The reason for this is that last-in-suite jobs don't have suite_branch
or branch set. We just want to use master for those.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 09:35:20 -06:00
Zack Cerza
c68b5fc9dd Add a flag to dump the entire job body.
... with a warning.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 14:55:09 -06:00
Zack Cerza
4f61db90ec Add missing placeholder
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 14:40:45 -06:00