Commit Graph

1665 Commits

Author SHA1 Message Date
Dan Mick
416508de9c get_scratch_devices(): catch CommandFailedError, log "dev in use"
Signed-off-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-08-30 15:42:53 -07:00
Sage Weil
dcbf50b86c nuke: get pid, owner from info.yaml (if present)
Fall back to the old files if info.yaml is missing.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-30 10:02:27 -07:00
Alfredo Deza
e0d42c820e Merge pull request #63 from ceph/wip-logger
Never use 'except:' without specifying an Exception.
2013-08-30 09:15:45 -07:00
Zack Cerza
3981a8f1af Never use 'except:' without specifying an Exception. 2013-08-30 11:10:05 -05:00
Alfredo Deza
fbd7fe466a Merge pull request #62 from ceph/wip-logger
Add hung job description to email
2013-08-30 07:50:30 -07:00
Sage Weil
f342baeb22 run: do not import at top level
This makes a run with --lock hang when connecting, for some
reason.  E.g.,

 $ teuthology -v a.yaml --lock
 ...
 INFO:teuthology.task.internal:Opening connections...
 DEBUG:teuthology.task.internal:connecting to ubuntu@plana06.front.sepia.ceph.com
 <hangs>

No clue what is going on here, but this fixes it!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 20:27:40 -07:00
Zack Cerza
24991c4ae0 Add hung job description to email 2013-08-29 17:08:51 -05:00
Alfredo Deza
47f16bd934 Merge pull request #61 from ceph/wip-logger
Log all the things! (Things like exceptions.)
2013-08-29 14:26:30 -07:00
Zack Cerza
44401f9a0e Workers: only log child's stderr, not stdout 2013-08-29 16:12:36 -05:00
Zack Cerza
40f1d4fc58 Don't print colon if there's no exception message. Also, remove testing
exception.
2013-08-29 15:05:33 -05:00
Zack Cerza
83a5ab19b0 Pretty-up write_initial_metadata; s/run/name/ 2013-08-29 15:05:33 -05:00
Zack Cerza
9550b49921 Add exception hook 2013-08-29 15:04:50 -05:00
Sage Weil
f6430df250 run: write info.yaml on job start
Include basic metadata bout the job.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 15:04:50 -05:00
Zack Cerza
a0e86c05bd Move logging setup out of main() 2013-08-29 15:03:30 -05:00
Sage Weil
27eea4ad5e test 2013-08-29 15:03:30 -05:00
Sage Weil
649bddf71b run: set up archive dir and logger output sooner
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-29 15:03:30 -05:00
Alfredo Deza
ed575251db Merge pull request #58 from ceph/queue
Don't assume anything about the base path here.
2013-08-29 06:07:44 -07:00
Sage Weil
ef85facbcf schedule_suite.sh: allow partial 'suite' names
Mangle the name (/ -> :) in the run name.  Separate base from
relative path so that the job names don't include a full path.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 21:54:26 -07:00
Sage Weil
4fbec83490 suite: return [] for build_matrix base case
This gives us an empty list instead of a crash on an empty dir
or bad symlink

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 21:53:41 -07:00
Alfredo Deza
d3f1369812 Merge pull request #60 from ceph/sentry
Add run name to first line of email.
2013-08-28 18:52:29 -07:00
Zack Cerza
778c0857ad Merge pull request #59 from ceph/wip-collections
redo the way we describe test collections
2013-08-28 14:26:08 -07:00
Zack Cerza
df73f503a3 Add run name to first line of email. 2013-08-28 15:41:14 -05:00
Sage Weil
7ce6696249 suite: build_matrix as a list of filenames, not file content
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 13:25:36 -07:00
Sage Weil
7163e89b83 suite: allow individual files to be scheduled
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 13:25:36 -07:00
Sage Weil
b829543388 suite: generalize collection expansion
Previous, a collection was a directory like this:

 mycollection/
 mycollection/facet1/
 mycollection/facet1/1a.yaml
 mycollection/facet1/1b.yaml
 mycollection/facet2/
 mycollection/facet2/2a.yaml
 mycollection/facet3/
 mycollection/facet3/3a.yaml
 mycollection/facet3/3b.yaml

and this would expand to

 1a + 2a + 3a
 1a + 2a + 3b
 1b + 2a + 3a
 1b + 2a + 3b

The fixed directory depth and requirement for a subdir even
when there is only 1 item is annoying.  Instead, allow an
arbitrary directory structure, with the following rules:

 - a .yaml file is a taken as-is (duh); other files still
   ignored
 - a directory is normally just a way to organize files.  We
   recursively descend and build a list of what we fine.
 - a directory with a '%' file in it is special:
     - take the product of every item in the dir (much like
       we did before)
 - a directory with a '+' file in it is special:
     - concatenate everything in the dir into one job

Note that this is equivalent to the previous structure if we
do:

 for facet in mycollection/* ; do touch $facet/% ; done

We can clean up slightly be taking any dir with only one yaml
file in it and replacing the dir with the bare .yaml.

Once this is done, we can reorganize directories however we
like.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 13:25:36 -07:00
Sage Weil
8314140dd6 suite: clean up imports
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:41:31 -07:00
Sage Weil
2dd889e4fd suite: make collection args (optionally) relative to a base dir
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:40:42 -07:00
Sage Weil
802fa51dae suite: make names a bit more friendly
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:40:41 -07:00
Sage Weil
8894ff6b9f suite: add --dry-run
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-28 11:40:41 -07:00
Zack Cerza
6175a133f4 Don't assume anything about the base path here. 2013-08-28 13:36:15 -05:00
Alfredo Deza
a472f5017a Merge pull request #54 from ceph/sentry
Add logs and Sentry events to suite emails
2013-08-28 09:38:20 -07:00
Zack Cerza
38a47ecef0 Don't return inside __init__ 2013-08-28 11:36:36 -05:00
Zack Cerza
53cea02a00 Add apology for non-public links 2013-08-28 11:15:27 -05:00
Zack Cerza
25defd40cc Indent wrapped exceptions. 2013-08-28 11:12:10 -05:00
Joe Buck
ffac4ad22d s3tests: extend for multi-region tests
Added code to the s3tests task to extract
multi-region info so that that data
can be added to the S3TEST_CONF file
used to run S3 tests.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-08-28 09:01:16 -07:00
Joe Buck
db518885c9 rgw: persist the region info
The rgw task deletes the region info
from the config structure. The s3tests
task needs this info, so we persist
it by sticking it in the ctx object.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewd-by: Josh Durgin <josh.durgin@inktank.com>
2013-08-28 09:00:52 -07:00
Joe Buck
2877e2722b radosgw-agent: store radosgw_agent server/port
Persist the hostname and port number used
by the radosgw-agent http server.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-08-28 09:00:03 -07:00
Joe Buck
6c5a7af1b4 move multi_region_enabled() into util class
Moving a helper function into a more general
location so that it can be used by other
classes.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-08-28 08:59:15 -07:00
Sage Weil
951177b8e5 internal: whitelist btrfs lock imbalance bug 6097
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-27 21:41:39 -07:00
Samuel Just
c30310af5a ceph.conf.template: add osd_debug_pg_log_writeout = true
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-08-27 18:48:48 -07:00
Josh Durgin
4d1de2a615 Merge pull request #55 from ceph/wip-undefined
Reviewed-by: Sage Weil <sage.weil@inktank.com>
2013-08-27 16:02:44 -07:00
Josh Durgin
232e3d32bc Fix undefined symbol errors
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-08-27 15:58:14 -07:00
Zack Cerza
6afb238aba Time is an integer, in seconds. 2013-08-27 17:26:46 -05:00
Zack Cerza
dfdac24f27 Make email formatting way, way nicer. 2013-08-27 17:22:27 -05:00
Zack Cerza
eb585d19a7 Move job listing logic to get_jobs() 2013-08-27 14:51:27 -05:00
Zack Cerza
7e49cd1722 Merge pull request #53 from ceph/wip-asok-retry
fix admin_socket retry
2013-08-27 08:15:27 -07:00
Sage Weil
502714ba2e admin_socket: fix retry-on-error behavior
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-26 18:14:37 -07:00
Zack Cerza
81709ed13d Avoid double slashes in sentry event URL 2013-08-26 18:12:20 -05:00
Zack Cerza
a1a261a886 Add tags! Task name and owner to start. 2013-08-26 17:38:23 -05:00
Zack Cerza
0503803111 Add sentry events to suite email. 2013-08-26 17:21:48 -05:00