Commit Graph

1533 Commits

Author SHA1 Message Date
Zack Cerza
d6e8b2337f Add internal.sudo subtask. 2013-09-05 16:56:11 -05:00
Zack Cerza
6d1ed573f3 Let execute() accept a string for args. 2013-09-05 16:55:38 -05:00
Zack Cerza
6406a1ecc8 Add Cluster.write_file() 2013-09-05 16:55:37 -05:00
Zack Cerza
8f2fb9da32 Use misc.get_archive_dir() 2013-09-05 16:55:37 -05:00
Zack Cerza
90f9a6ada1 Add get_archive_dir() 2013-09-05 16:55:37 -05:00
Alfredo Deza
a9522ae245 add the missing for fedora links in install task
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2013-09-04 09:03:28 -04:00
Sage Weil
d5e265dc5b schedule_suite.sh: turn up osd logging a little
We have a collectin of bugs that we haven't been able to
reproduce but crop up regularly in the nightlies.  Sam's best
guess is a dropped message, so let's try to catch that.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-03 21:56:32 -07:00
Warren Usui
a455b16fc1 Add missing sudo from command.
Fixes: #6218
2013-09-03 14:35:00 -07:00
Alfredo Deza
2d7054d1f9 Merge pull request #67 from ceph/wip-3791
Wip 3791
2013-09-03 14:07:36 -07:00
Zack Cerza
5985c9d5ab Add note about public teuthology logs. 2013-09-03 16:05:02 -05:00
Zack Cerza
516406324a Wrap paragraphs. 2013-09-03 16:02:17 -05:00
Alfredo Deza
21b5dbd4e4 Merge pull request #66 from ceph/wip-specific-exceptions
Catch CommandFailedError and print debug info
2013-09-03 13:24:45 -07:00
Zack Cerza
f744c4ce53 Catch CommandFailedError and print debug info 2013-09-03 14:40:31 -05:00
Zack Cerza
f36f16a669 Logs and Sentry links are public now. 2013-09-03 13:46:31 -05:00
Sage Weil
4ba3d52018 Revert "Use install -d for /var/log/ceph."
This reverts commit 8f29b3f9f1.

Reviewed-by: Warren Usui <warren.usui@inktank.com>
2013-09-03 11:09:39 -07:00
Sage Weil
38169979e4 schedule_suite.sh: default email to ceph-qa@ceph.com
Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-01 08:48:41 -07:00
Sage Weil
3d64322cdb Revert "get_scratch_devices(): catch CommandFailedError, log "dev in use""
This reverts commit 416508de9c.

NameError: global name 'CommandFailedError' is not defined
2013-08-30 23:22:24 -07:00
Sage Weil
80b6140682 README: add deps
Reported-by: Loic Dachary <loic@dachary.org>
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-30 17:35:36 -07:00
tamil
35b9beab06 s/ceph-debug/ceph-debuginfo for rpms
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-08-30 17:35:15 -07:00
Dan Mick
416508de9c get_scratch_devices(): catch CommandFailedError, log "dev in use"
Signed-off-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-08-30 15:42:53 -07:00
Alfredo Deza
e0d42c820e Merge pull request #63 from ceph/wip-logger
Never use 'except:' without specifying an Exception.
2013-08-30 09:15:45 -07:00
Zack Cerza
3981a8f1af Never use 'except:' without specifying an Exception. 2013-08-30 11:10:05 -05:00
Alfredo Deza
fbd7fe466a Merge pull request #62 from ceph/wip-logger
Add hung job description to email
2013-08-30 07:50:30 -07:00
Sage Weil
f342baeb22 run: do not import at top level
This makes a run with --lock hang when connecting, for some
reason.  E.g.,

 $ teuthology -v a.yaml --lock
 ...
 INFO:teuthology.task.internal:Opening connections...
 DEBUG:teuthology.task.internal:connecting to ubuntu@plana06.front.sepia.ceph.com
 <hangs>

No clue what is going on here, but this fixes it!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 20:27:40 -07:00
Zack Cerza
24991c4ae0 Add hung job description to email 2013-08-29 17:08:51 -05:00
Alfredo Deza
47f16bd934 Merge pull request #61 from ceph/wip-logger
Log all the things! (Things like exceptions.)
2013-08-29 14:26:30 -07:00
Zack Cerza
44401f9a0e Workers: only log child's stderr, not stdout 2013-08-29 16:12:36 -05:00
Zack Cerza
40f1d4fc58 Don't print colon if there's no exception message. Also, remove testing
exception.
2013-08-29 15:05:33 -05:00
Zack Cerza
83a5ab19b0 Pretty-up write_initial_metadata; s/run/name/ 2013-08-29 15:05:33 -05:00
Zack Cerza
9550b49921 Add exception hook 2013-08-29 15:04:50 -05:00
Sage Weil
f6430df250 run: write info.yaml on job start
Include basic metadata bout the job.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 15:04:50 -05:00
Zack Cerza
a0e86c05bd Move logging setup out of main() 2013-08-29 15:03:30 -05:00
Sage Weil
27eea4ad5e test 2013-08-29 15:03:30 -05:00
Sage Weil
649bddf71b run: set up archive dir and logger output sooner
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 15:03:30 -05:00
Alfredo Deza
ed575251db Merge pull request #58 from ceph/queue
Don't assume anything about the base path here.
2013-08-29 06:07:44 -07:00
Sage Weil
ef85facbcf schedule_suite.sh: allow partial 'suite' names
Mangle the name (/ -> :) in the run name.  Separate base from
relative path so that the job names don't include a full path.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 21:54:26 -07:00
Sage Weil
4fbec83490 suite: return [] for build_matrix base case
This gives us an empty list instead of a crash on an empty dir
or bad symlink

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 21:53:41 -07:00
Alfredo Deza
d3f1369812 Merge pull request #60 from ceph/sentry
Add run name to first line of email.
2013-08-28 18:52:29 -07:00
Zack Cerza
778c0857ad Merge pull request #59 from ceph/wip-collections
redo the way we describe test collections
2013-08-28 14:26:08 -07:00
Zack Cerza
df73f503a3 Add run name to first line of email. 2013-08-28 15:41:14 -05:00
Sage Weil
7ce6696249 suite: build_matrix as a list of filenames, not file content
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 13:25:36 -07:00
Sage Weil
7163e89b83 suite: allow individual files to be scheduled
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 13:25:36 -07:00
Sage Weil
b829543388 suite: generalize collection expansion
Previous, a collection was a directory like this:

 mycollection/
 mycollection/facet1/
 mycollection/facet1/1a.yaml
 mycollection/facet1/1b.yaml
 mycollection/facet2/
 mycollection/facet2/2a.yaml
 mycollection/facet3/
 mycollection/facet3/3a.yaml
 mycollection/facet3/3b.yaml

and this would expand to

 1a + 2a + 3a
 1a + 2a + 3b
 1b + 2a + 3a
 1b + 2a + 3b

The fixed directory depth and requirement for a subdir even
when there is only 1 item is annoying.  Instead, allow an
arbitrary directory structure, with the following rules:

 - a .yaml file is a taken as-is (duh); other files still
   ignored
 - a directory is normally just a way to organize files.  We
   recursively descend and build a list of what we fine.
 - a directory with a '%' file in it is special:
     - take the product of every item in the dir (much like
       we did before)
 - a directory with a '+' file in it is special:
     - concatenate everything in the dir into one job

Note that this is equivalent to the previous structure if we
do:

 for facet in mycollection/* ; do touch $facet/% ; done

We can clean up slightly be taking any dir with only one yaml
file in it and replacing the dir with the bare .yaml.

Once this is done, we can reorganize directories however we
like.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 13:25:36 -07:00
Sage Weil
8314140dd6 suite: clean up imports
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:41:31 -07:00
Sage Weil
2dd889e4fd suite: make collection args (optionally) relative to a base dir
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:40:42 -07:00
Sage Weil
802fa51dae suite: make names a bit more friendly
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:40:41 -07:00
Sage Weil
8894ff6b9f suite: add --dry-run
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:40:41 -07:00
Zack Cerza
6175a133f4 Don't assume anything about the base path here. 2013-08-28 13:36:15 -05:00
Alfredo Deza
a472f5017a Merge pull request #54 from ceph/sentry
Add logs and Sentry events to suite emails
2013-08-28 09:38:20 -07:00
Zack Cerza
38a47ecef0 Don't return inside __init__ 2013-08-28 11:36:36 -05:00