Commit Graph

2605 Commits

Author SHA1 Message Date
Zack Cerza
f7d882c24e Reimplement the file locker as a context manager
Also give it a 'noop' flag to enable its callers to optionally not use
locking.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
14015af475 Move exception into a new exceptions module
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
6807a10d27 Move functions into repo_utils
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:41 -06:00
Zack Cerza
76a93fd3e1 Fix NameError
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:23 -06:00
Zack Cerza
a677b4f2a9 Correctly find both internal and external tasks
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-06 10:06:35 -06:00
Zack Cerza
5b5f02ecd2 Remove most ceph-specific tasks. They are in ceph-qa-suite now.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-06 10:06:34 -06:00
Zack Cerza
d5f26aaf6a Merge pull request #306 from ceph/wip-9024
ignore errors if 'ps aux' fails
2014-08-06 09:42:49 -06:00
Alfredo Deza
f9aa9c1e64 ignore errors if 'ps aux' fails
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-08-06 10:53:21 -04:00
Zack Cerza
b93abaf5d3 Merge pull request #305 from ceph/wip-8640
implement `--version` and improve `setup.py`
2014-08-04 14:38:29 -06:00
Alfredo Deza
fe6f46114a create a --version flag for teuthology
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-08-04 15:12:06 -04:00
Alfredo Deza
7d0a072da1 pull the version and description in setup.py
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-08-04 15:11:47 -04:00
Alfredo Deza
a2bb186fe3 add an initial version to teuthology
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-08-04 15:11:26 -04:00
Zack Cerza
0d1fe79b70 Tweak usage statement
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-04 11:50:22 -06:00
Zack Cerza
ef21080605 Merge pull request #304 from ceph/wip-fix-build-matrix
suite: fix build_matrix when non-yaml present in % dir
2014-08-04 10:10:02 -06:00
Sage Weil
21e27637d3 suite: fix build_matrix when non-yaml present in % dir
First, if we get a non-yaml file, return an empty list.

Second, if we are in a % mode, exclude an empty raw result from the
combination.  Otherwise, we get no resulting jobs.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-04 09:07:08 -07:00
David Zafman
9f7107b3a9 Merge pull request #303 from ceph/wip-8930
Tasks are failing since using "data" pool no longer part of default install

Reviewed-by: Sage Weil <sage@redhat.com>
2014-08-01 18:28:05 -07:00
David Zafman
54af8b2be3 Tasks are failing since using "data" pool no longer part of default install
Create a pool specifically for each task

Fixes: 8930

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-08-01 16:06:39 -07:00
Zack Cerza
3440d664e7 Expand '~' in ssh key paths
... since paramiko doesn't bother to do this

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-01 14:27:59 -06:00
Zack Cerza
f4c953c1fa Merge pull request #301 from ceph/wip-nuke-vpm
nuke: allow nuking vpm hosts
2014-08-01 13:25:18 -06:00
Sage Weil
f84458bd93 ceph_manager: increase osd revival timeout from 75 -> 150 seconds
Saw this fail on a firefly run just bc of valgrind slowness.  Make the
timeout higher!

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-30 21:34:45 -07:00
Sage Weil
7c3fc404d6 valgrind: ignore ec plugin factory leaks
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-30 18:14:08 -07:00
John Spray
9e2c82824b Merge pull request #300 from ceph/wip-mpi-vers
task/mpi: Explicit check for version mismatch
2014-07-30 23:37:39 +01:00
Zack Cerza
094cd5b3ba Merge pull request #302 from ceph/wip-8850
tell us if you are really not running any more
2014-07-30 14:31:27 -06:00
Alfredo Deza
4686115c48 add another call to use "ps aux"
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-07-30 16:28:02 -04:00
Alfredo Deza
ec342d8146 tell us if you are really not running any more
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-07-30 16:17:01 -04:00
Sage Weil
1c7c2eb4b9 nuke: allow nuking vpm hosts
Skip the console check, though.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-30 11:12:09 -07:00
John Spray
491817961a task/mpi: Explicit check for version mismatch
Instead of proceeding to have mpiexec fail or hang,
do an up-front check that the MPI version is the same
on all of the nodes in the test.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-30 14:29:11 +01:00
Zack Cerza
b8687a54aa Fix package_version_for_hash() call
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-29 14:43:41 -06:00
John Spray
0147c74671 task/mds_journal_migration: fix cleanup
Previously this was remounting in the background
which meant that if a workunit was executed immediately
afterwards it could put files in the mount dir before
the FS was mounted, causing the mount to fail.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-29 13:11:12 +01:00
John Spray
cc7c9b2e8b task/workunit: add sudo to dir delete
This failure to delete used to be hidden in
a catch-all exception handler that was
removed in 396dc073.

This was causing failures in kcephfs suite
like:
Command failed on plana96 with status 1: 'rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0'

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-27 12:04:23 +01:00
Zack Cerza
2999a4d492 Merge pull request #296 from ceph/wip-standby-mds
Wip standby mds
2014-07-25 16:44:34 -06:00
Sage Weil
883f2a76f4 task/osd_recovery: use rbd instead of metadata pool
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-25 11:39:42 -07:00
Sage Weil
4e56521ebe task/osd_backfill: use 'rbd' instead of 'data' pool
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-25 11:33:25 -07:00
John Spray
2ed1131fc9 task/workunit: general tidy
* PEP8-ize whitespace
* specialize a catch-all except:
* don't alias 'misc' to 'teuthology'

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-25 13:33:31 +01:00
John Spray
396dc073cb task/workunit: clean up dir deletion
This was always trying to remove the mountpoint,
and then swallowing the exception and printing
it to the log.

Instead:
 * Ensure it's only trying to delete mnt if it created it
 * Don't swallow those exceptions: if deleting the dirs
   fails then something has gone wrong and it should bubble
   up.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-25 13:33:31 +01:00
John Spray
a96a7b027c task/cephfs: generalise Filesystem for multi-MDS
This enables tasks like mds_journal_migration to be
run in an environment with standby-replay MDSs present.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-25 13:33:31 +01:00
Zack Cerza
c2fc561427 Remove oddly-placed, broken import
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-24 10:03:38 -06:00
Zack Cerza
479a1fe676 Rename CephState to DaemonGroup and move to orchestra
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-23 19:59:16 -06:00
Zack Cerza
7d0adcee2d Move DaemonState to teuthology.orchestra
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-23 19:59:16 -06:00
Zack Cerza
efce34186c Fail sooner if an invalid config_yaml is passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-22 15:47:53 -06:00
Zack Cerza
0e2149c86e Remove kcon_most
It was unused.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-22 13:57:40 -06:00
Zack Cerza
d6e5895fb2 Merge pull request #293 from ceph/wip-ship-utilities
move ship_utilities to install task (from ceph test)
2014-07-22 13:49:57 -06:00
Sage Weil
828bb2a6ea ceph_deploy: use new ship_utilities location
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-22 10:55:10 -07:00
John Spray
72b3417890 task/mds_journal_migration: use existing clients
Since refactoring ceph_fuse and kclient tasks
to store Mount objects on ctx, the mds_journal_migration
task can use those instead of explicitly instantiating its own.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-21 12:56:05 +01:00
Sage Weil
2dad906f4a move ship_utilities to install task (from ceph test)
No need to install ceph just to get daemon-helper, adjust-ulimits, etc..
These utilities are used by lots of tasks, not just ceph.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-19 09:22:27 -07:00
Zack Cerza
b8c443b44f Fix get_hash() arg ordering
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-16 12:07:55 -06:00
Zack Cerza
fccc6adb7f Merge pull request #287 from ceph/wip-mds-sessions
Wip mds sessions
2014-07-15 16:27:56 -06:00
Zack Cerza
443b782d39 Merge pull request #288 from ceph/wip-upgrade-fix
task/ceph: Make cephfs_setup cuttlefish-compatible
2014-07-15 16:22:29 -06:00
Sage Weil
d5a4998b3d Merge pull request #291 from ceph/wip-rgw-pools
rgw: set data extra pool correctly

Backport: next, firefly
Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-15 14:57:49 -07:00
Yehuda Sadeh
63fb271b7e rgw: set data extra pool correctly
When configuring multiregion zone, set the data extra pool

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-07-15 13:02:20 -07:00