Commit Graph

119 Commits

Author SHA1 Message Date
Zack Cerza
29d3299497 Consolidate log file setup into shared function
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Zack Cerza
5dbce8b68f Use Unicode format strings
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Gregory Meno
ce778848a5 Changes invocation of serialize_remote_roles to internal task to avoid being run during nuke 2014-04-29 05:09:07 -07:00
Zack Cerza
625f479b68 When starting a job, tell paddles it's running
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-12-12 11:47:45 -06:00
Zack Cerza
3d6feb4b60 Merge pull request #151 from ceph/wip-distro-kernel
Wip distro kernel
2013-12-09 13:16:33 -08:00
Sandon Van Ness
ce8ff0a3c8 Added additional comments.
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-12-09 11:35:23 -08:00
Zack Cerza
f8150d44d0 Add optional 'use_existing_cluster' flag
If this flag is present, skip a few unnecessary steps

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-11-20 16:23:07 -06:00
Sandon Van Ness
f0e01ad0e5 Distro kernel bug-fixes.
Fixed some things that were being done incorrectly.

Some distro kernels have no debug so added | true when disabling
kdb. Also changed what was skipping kernels if non-ubuntu to also
schedule kernel install if a distro kernel.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-11-08 14:35:51 -08:00
Zack Cerza
59d14b8b4b Make nuke use its own logger
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-16 16:20:24 -05:00
Zack Cerza
494c3b1fbe Make verbosity propagate correctly to modules
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 17:10:57 -05:00
Zack Cerza
f5729051ab Fix a circular import
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 12:48:55 -05:00
Zack Cerza
f28a7ebc2c Move imports to top-level
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 12:48:55 -05:00
Zack Cerza
01b81b7820 Move monkey patching to __init__.py
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:15:01 -05:00
Zack Cerza
f34f3b3baf Move teuthology's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:35 -05:00
Zack Cerza
84b2e55b93 Move schedule() to new schedule module 2013-10-10 19:09:34 -05:00
Zack Cerza
c784c79f1d Move teuthology-schedule's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
a6b57cc136 PEP-8
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
972ab1cf22 Tweak logic of try_push_job_info()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 15:01:16 -05:00
Zack Cerza
5482ba81d1 Make teuthology-schedule also print the job's name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 13:11:03 -05:00
Zack Cerza
08efeb7b9e Store the job_id as a str, not an int.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 13:11:03 -05:00
Zack Cerza
f160ab6487 Move teuthology.report import; add large warning
Because of the monkey patching, if we get the import order wrong bad
things happen.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 12:08:33 -05:00
Zack Cerza
2270db724d Add (and use) try_push_job_info() for easy pushin'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 11:07:33 -05:00
Zack Cerza
760fe6b1c9 Move new imports to inside main()
The monkey patch stuff was causing problems again.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 10:54:47 -05:00
Zack Cerza
77b65c7f3c Report results synchronously.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Sage Weil
2860e9d797 schedule: show priority on -s
Make output a bit nicer too.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-27 12:02:37 -07:00
Sage Weil
acdaf3d419 schedule: priority option
Default to 1000.  Note that beanstalk priority is 2^31, so this
won't mix well with older code scheduling things at the
beanstalk default priority.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-27 11:57:55 -07:00
Zack Cerza
fe51db6fc0 Merge job_config and ctx.config 2013-09-11 15:14:58 -05:00
Zack Cerza
4e9c5378ba Don't fail if there's no job_id 2013-09-11 13:58:19 -05:00
Zack Cerza
713fa52455 Add job id and actual archive dir to job config
Also add job id to info.yaml
2013-09-11 13:44:28 -05:00
Zack Cerza
c9db15e67c s/jobid/job_id/ 2013-09-11 10:03:30 -05:00
Sage Weil
4857a2a0f0 Merge pull request #74 from ceph/wip-5954
Wip 5954
2013-09-05 15:16:32 -07:00
Zack Cerza
d6e8b2337f Add internal.sudo subtask. 2013-09-05 16:56:11 -05:00
Sage Weil
f3db12f025 schedule: strip out targets
If the user feeds in a yaml with targets, the worker will launch the job
but fail with

2013-09-03T11:18:34.333 CRITICAL:root:AssertionError: You cannot specify targets in a config file when using the --lock option

Just strip them out before scheduling.  This eases my personal workflow
where I have a test I'm running manually against some prelocked machines
but also want to schedule it.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-03 12:05:38 -07:00
Sage Weil
f342baeb22 run: do not import at top level
This makes a run with --lock hang when connecting, for some
reason.  E.g.,

 $ teuthology -v a.yaml --lock
 ...
 INFO:teuthology.task.internal:Opening connections...
 DEBUG:teuthology.task.internal:connecting to ubuntu@plana06.front.sepia.ceph.com
 <hangs>

No clue what is going on here, but this fixes it!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 20:27:40 -07:00
Zack Cerza
40f1d4fc58 Don't print colon if there's no exception message. Also, remove testing
exception.
2013-08-29 15:05:33 -05:00
Zack Cerza
83a5ab19b0 Pretty-up write_initial_metadata; s/run/name/ 2013-08-29 15:05:33 -05:00
Zack Cerza
9550b49921 Add exception hook 2013-08-29 15:04:50 -05:00
Sage Weil
f6430df250 run: write info.yaml on job start
Include basic metadata bout the job.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 15:04:50 -05:00
Zack Cerza
a0e86c05bd Move logging setup out of main() 2013-08-29 15:03:30 -05:00
Sage Weil
27eea4ad5e test 2013-08-29 15:03:30 -05:00
Sage Weil
649bddf71b run: set up archive dir and logger output sooner
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 15:03:30 -05:00
Sandon Van Ness
41cafb1a10 Merge remote-tracking branch 'origin/wip-sandon-vm'
Conflicts:
	teuthology/lock.py
	teuthology/misc.py
	teuthology/task/install.py
2013-07-25 19:50:02 -07:00
Sandon Van Ness
c2c8a080c7 Added --os-type argument to run.py
Because for some reason it was never there before?

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-07-25 15:33:11 -07:00
Sandon Van Ness
810cca1daf Added get_distro() to misc.py
Since getting the ostype is used multiple places I made a
function for it and modified the existing code to use
said function. I also added tests for the function.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-07-25 14:45:02 -07:00
Sandon Van Ness
5f9a1d8a0f Worker processes by machine type instead of teuthology branch.
teuthology-suite and schedulewill now take --worker instead of
--branch. The branch is set by setting teuthology_branch in the
yaml used to schedule the job.

The teuthology branches are assumed to be in ~/teuthology-$branch
of whatever user is running the workers.
2013-07-18 12:04:08 -07:00
Sandon Van Ness
e3a0742156 Don't install kernels on non-ubuntu VPS
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-07-12 20:20:45 -07:00
Warren Usui
8129bffb17 Implement full reinstallation of a VM system.
Downburst create is used to reinstall a VM when it is locked.
Downburst destroy is used to remove a VM when it is unlocked.
Host keys are regenerated on each vm instantiation, so the keys
need to be checked prior to use.
If needed, qa-ceph-chef is run on newly installed systems to insure that
they are fully functional.

Signed-off-by: Warren Usui <warren.usui@inktank.com>
2013-04-03 12:29:47 -07:00
Sage Weil
9f46f47b6b run: clean up machine_type thing
Signed-off-by: Sage Weil <sage@inktank.com>
2013-03-29 12:19:05 -07:00
Sage Weil
b815268b58 run: machine-type: foo, not machine_type: foo
Signed-off-by: Sage Weil <sage@inktank.com>
2013-03-28 15:25:10 -07:00
Sage Weil
4e68c2033c verify /var/lib/ceph not present on start
Verify there is no /var/lib/ceph, just like we do with the cephtest
directory.  We will need to change this (or make it optional) when we
allow runs against an existing cluster, but then a whole bunch of other
things will need to change then as well.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-03-23 20:58:46 -07:00