Commit Graph

146 Commits

Author SHA1 Message Date
Warren Usui
171cb69f13 Fix return from schedule_suite.
Schedule_suite returns the number of jobs scheduled (accounting for
filters).  Information displayed also indicates how many jobs were
run and how many were filtered out.

Fixes: 9183
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-20 13:19:13 -07:00
Warren Usui
8346ac4363 Add filter and filter-off suite options.
Filter only runs suite jobs that contain the text passed as part of
their description or in the names of the composite set of yaml files.
Filter-off only runs suite jobs that do not contain the text passed
as either their description or in the names of the composite set of
yaml files.
Fixes: 8954
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-18 20:55:01 -07:00
Zack Cerza
ba7a2dad39 Make teuthology-{suite,worker} share repo code
Repo-fetching code, that is.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
14015af475 Move exception into a new exceptions module
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Sage Weil
21e27637d3 suite: fix build_matrix when non-yaml present in % dir
First, if we get a non-yaml file, return an empty list.

Second, if we are in a % mode, exclude an empty raw result from the
combination.  Otherwise, we get no resulting jobs.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-04 09:07:08 -07:00
Zack Cerza
b8687a54aa Fix package_version_for_hash() call
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-29 14:43:41 -06:00
Zack Cerza
efce34186c Fail sooner if an invalid config_yaml is passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-22 15:47:53 -06:00
Zack Cerza
b8c443b44f Fix get_hash() arg ordering
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-16 12:07:55 -06:00
Zack Cerza
79da400dcf Fix a bug where results_email was being ignored
Referring to the setting in ~/.teuthology.yaml

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-15 12:02:32 -06:00
Zack Cerza
657bd369d0 Fix the incomplete substitute_placeholders() fix
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 15:16:55 -06:00
Zack Cerza
56ad957534 Be smarter about choosing branches
Part of this is also about failing sooner, and not allowing invalid
configurations to enter the queue. This commit also fixes an obscure bug
in substitute_placeholders(). Finally, it adds unit tests for all bugs
fixed.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 14:30:31 -06:00
Zack Cerza
4f61db90ec Add missing placeholder
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 14:40:45 -06:00
Zack Cerza
9257b8706f Use config.src_base_path
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:37 -06:00
Zack Cerza
c105827d5e Store the suite_branch in the job config
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
fb97e85aec Use the new JobConfig object
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
0f69e3d4c6 Use a dict for a job template instead of a string.
This makes later modifications far easier.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
b82c9e156e Merge pull request #276 from dachary/wip-typo
documentation typo
2014-07-07 15:35:45 -06:00
Zack Cerza
b7eecd446d Don't mess with ~/src/teuthology by default
Setting 'automated_scheduling: True' in ~/.teuthology.yaml enables it.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-03 10:18:01 -06:00
Zack Cerza
dbadcd0d56 Allow setting results_email in teuthology.yaml
(Instead of passing --email to teuthology-suite)

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 18:39:47 -06:00
Zack Cerza
34a7b31823 Don't remove the teuthology repo if errors occur
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 18:27:09 -06:00
Zack Cerza
ec95ee25c3 Rename suite_base to suite_dir
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-01 12:21:45 -06:00
Zack Cerza
434348aa49 Add --suite-branch and --suite-base
The former lets you specify a specific ceph-qa-suite branch to use for
testing. The latter lets you specify an as-is directory to use, for
example if you want ro run tests that you don't want to commit yet.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-01 11:45:10 -06:00
Loic Dachary
b9f26eda9a documentation typo
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-30 23:29:48 +02:00
Zack Cerza
5a61f449d1 Split up repo helper into separate functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 10:10:31 -06:00
Zack Cerza
a4c3a02547 Add a note about teuthology scheduling
Specifically, that we always schedule using the master branch.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
807d6fd715 Use 'ceph-qa-suite.git' for the repo name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
b16c48a8f8 Also handle teuthology repo checkouts
Our shell script did this also.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
88d26e4ae4 Handle ceph-qa-suite checkouts
Previously we had an internally-maintained shell script that did this.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:06 -06:00
Zack Cerza
484693c2e9 Fix linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:06 -06:00
Zack Cerza
f4321b0519 Skip the kernel stanza if the branch passed is '-'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
ba1eae988e Add more docstrings
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
e1597a036f No need to explicitly return None here
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
7082a3dff0 Add a few more docstrings and a debug statement
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
743edd6b70 Fix a couple linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
173c7b84f6 Fix bug where the base yaml wasn't being merged
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
fd13a18c83 With dry_run, quote any individual args
So that individual commands can be copied and pasted
in order to execute them individually.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
91c7385988 Raise ScheduleFailError even if not sending email
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
356ab7e06d Do everything that schedule_suite.sh does
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
89b38dd347 Don't schedule an email job if email isn't set
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
26fdef0a75 Split prepare_and_schedule() out of main()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
1be15edbcb Use the return value of schedule_suite()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
19d73071d1 Don't reread the entire yaml file...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
d92f538549 Remove unused functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
0aabafd65f 'and' is a thing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
675f087b28 Take machine_type instead of worker
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
d14c44f4e2 Add functions for querying gitbuilder repos
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
43505b2ace Only allow scheduling one suite per call.
Also remove all traces of the extra and confusing term 'collection'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
f5af797ce3 Port to docopt
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
1ccbff8dbf Refactor collection scheduling out of main()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:22 -06:00
Zack Cerza
2a7de82498 Move teuthology-ls's implementation to ls.py
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-06 16:15:15 -05:00