RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-02-21 09:57:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,781 Commits 216 Branches 395 Tags 1.3 GiB
704b72eb0b
Commit Graph

1545 Commits

Author SHA1 Message Date
Alfredo Deza
06be66b33f Merge pull request #87 from ceph/sentry 
Add logs URL to sentry reports
 2013-09-11 14:06:24 -07:00
Zack Cerza
1228d8cb5a Add teuthology branch to sentry report tags 2013-09-11 15:45:45 -05:00
Zack Cerza
0ad9c8751e Ensure teuthology_branch is stored in job_config 2013-09-11 15:40:14 -05:00
Zack Cerza
5b3ce84596 Add ctx.config to sentry info. 2013-09-11 15:31:31 -05:00
Zack Cerza
fe51db6fc0 Merge job_config and ctx.config 2013-09-11 15:14:58 -05:00
Zack Cerza
725ba83c04 Add test for misc.get_http_log_path() 2013-09-11 14:49:15 -05:00
Zack Cerza
38a1a6dde5 Use sentry.get_ident() again 2013-09-11 14:00:58 -05:00
Zack Cerza
4e9c5378ba Don't fail if there's no job_id 2013-09-11 13:58:19 -05:00
Zack Cerza
df4925703e Passing job_id to get_http_log_path() is optional 2013-09-11 13:47:49 -05:00
Zack Cerza
f7537f9c34 Add logs URL to sentry reports 2013-09-11 13:44:28 -05:00
Zack Cerza
713fa52455 Add job id and actual archive dir to job config 
Also add job id to info.yaml
 2013-09-11 13:44:28 -05:00
Zack Cerza
4699ad1c11 Don't "import misc as teuthology" 2013-09-11 10:50:42 -05:00
Zack Cerza
c1ba276321 Move get_http_log_path 2013-09-11 10:50:42 -05:00
Zack Cerza
c9db15e67c s/jobid/job_id/ 2013-09-11 10:03:30 -05:00
Sage Weil
89df90f68f rados: add --op copy_from ... support 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-10 16:53:18 -07:00
Sage Weil
748fa5e559 Merge pull request #85 from ceph/wip-testdir 
remove basedir/testdir distinction
 2013-09-10 12:20:29 -07:00
Sage Weil
5acc57f5ad remove basedir/testdir distinction 
We should never run with a conflicting testdir in the basedir, and the
code to do this is confusing and buggy.  Go back to a single testdir and
simple checks.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-10 10:53:41 -07:00
Joe Buck
d47ae37e93 Adding in erroneously removed args 
The 'kill' argument was accidentially removed
as part of patch
53b8e27da9

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-09-09 12:37:05 -07:00
Sage Weil
922aa09b4c fix a few missing adjust-ulimits users 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-08 15:12:51 -07:00
Sage Weil
6b4014452f rgw: fix valgrind when no valgrind 
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-09-06 17:38:29 -07:00
Sage Weil
9e03c73775 misc: valgrind: fix cd behavior 
The cd needs to happen at the beginning of the command, not at the end, or
else the funky wrapper scripts don't work right.

This also cleans up the command line construction a bit so that it is more
flexible, explicit, and hopefully less fragile.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-06 16:09:27 -07:00
Sage Weil
19324c63d2 misc: valgrind: fix valgrind.supp path 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-06 16:09:27 -07:00
Zack Cerza
82cfa848b4 Get rid of chdir-coredump. 2013-09-06 17:11:44 -05:00
Sage Weil
a60e84d43f ceph: fix daemon-helper typo 
Broken in edc5ef8860

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-06 14:49:38 -07:00
Sage Weil
2214fe1845 misc: valgrind --num-callers=50 
Default is 12, which isn't quite enough.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-06 14:05:29 -07:00
Sage Weil
c6d7ae0fa5 Merge pull request #78 from ceph/wip-6247 
Move helper scripts to /usr/local/bin to clean up logs.
 2013-09-06 13:24:34 -07:00
Zack Cerza
53b8e27da9 Helper scripts live in /usr/local/bin now! 2013-09-06 15:10:11 -05:00
Zack Cerza
edc5ef8860 Move helper scripts to /usr/local/bin 2013-09-06 15:09:41 -05:00
Sage Weil
1a05f9d0a2 queue: fix stderr redirect 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-06 09:39:30 -07:00
Alfredo Deza
a4f0551fda Merge pull request #75 from ceph/wip-tube 
queue: include tube name in worker logs
 2013-09-06 09:27:43 -07:00
Sage Weil
1a03b17568 Merge pull request #76 from ceph/wip-5954 
Be polite and restore /etc/sudoers when done
 2013-09-06 09:23:51 -07:00
Sage Weil
5cd2f08132 queue: include tube name in worker logs 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-06 09:19:30 -07:00
Zack Cerza
f0eabc970f Be polite and restore /etc/sudoers when done 2013-09-06 11:18:17 -05:00
Sage Weil
4857a2a0f0 Merge pull request #74 from ceph/wip-5954 
Wip 5954
 2013-09-05 15:16:32 -07:00
Sage Weil
7db9311ab7 Merge pull request #73 from ceph/wip-5954-alt 
Via automagic, only call ulimit -n if running as root.
 2013-09-05 15:15:55 -07:00
Zack Cerza
d6e8b2337f Add internal.sudo subtask. 2013-09-05 16:56:11 -05:00
Zack Cerza
6d1ed573f3 Let execute() accept a string for args. 2013-09-05 16:55:38 -05:00
Zack Cerza
6406a1ecc8 Add Cluster.write_file() 2013-09-05 16:55:37 -05:00
Zack Cerza
8f2fb9da32 Use misc.get_archive_dir() 2013-09-05 16:55:37 -05:00
Zack Cerza
90f9a6ada1 Add get_archive_dir() 2013-09-05 16:55:37 -05:00
Zack Cerza
91fd0413cc Put sudo in front of adjust-ulimits if it's used 2013-09-05 16:41:27 -05:00
Zack Cerza
8e37361b9a Via automagic, only call ulimit -n if running as root. 
Also, add comments because comments are cool.
 2013-09-05 16:30:28 -05:00
Sandon Van Ness
d34ba1647f Run yum clean all after installing new ceph-release. 
In order to get around the issue of repomd.xml being older than
the previously installed one depending on when the gitbuilder
built the repo.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
 2013-09-05 11:58:27 -07:00
Sage Weil
c155dce1b2 drop obsolete PYTHONPATH settings 
These are left over from when we were extracting a tarball in the test dir.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-04 14:21:01 -07:00
Zack Cerza
89f1139d83 Append '/' to the end of the log directory path 2013-09-04 15:16:33 -05:00
Zack Cerza
a26c831398 Merge pull request #64 from ceph/wip-nuke-info 
nuke: get pid, owner from info.yaml (if present)
 2013-09-04 09:16:04 -07:00
Zack Cerza
7dee3a1321 Merge pull request #65 from ceph/wip-schedule 
schedule: strip out targets
 2013-09-04 09:13:39 -07:00
Alfredo Deza
a9522ae245 add the missing for fedora links in install task 
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
 2013-09-04 09:03:28 -04:00
Warren Usui
a455b16fc1 Add missing sudo from command. 
Fixes: #6218
 2013-09-03 14:35:00 -07:00
Zack Cerza
f744c4ce53 Catch CommandFailedError and print debug info 2013-09-03 14:40:31 -05:00
Sage Weil
f3db12f025 schedule: strip out targets 
If the user feeds in a yaml with targets, the worker will launch the job
but fail with

2013-09-03T11:18:34.333 CRITICAL:root:AssertionError: You cannot specify targets in a config file when using the --lock option

Just strip them out before scheduling.  This eases my personal workflow
where I have a test I'm running manually against some prelocked machines
but also want to schedule it.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-09-03 12:05:38 -07:00
Zack Cerza
f36f16a669 Logs and Sentry links are public now. 2013-09-03 13:46:31 -05:00
Sage Weil
4ba3d52018 Revert "Use install -d for /var/log/ceph." 
This reverts commit 8f29b3f9f1.

Reviewed-by: Warren Usui <warren.usui@inktank.com>
 2013-09-03 11:09:39 -07:00
Sage Weil
3d64322cdb Revert "get_scratch_devices(): catch CommandFailedError, log "dev in use"" 
This reverts commit 416508de9c.

NameError: global name 'CommandFailedError' is not defined
 2013-08-30 23:22:24 -07:00
tamil
35b9beab06 s/ceph-debug/ceph-debuginfo for rpms 
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
 2013-08-30 17:35:15 -07:00
Dan Mick
416508de9c get_scratch_devices(): catch CommandFailedError, log "dev in use" 
Signed-off-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
 2013-08-30 15:42:53 -07:00
Sage Weil
dcbf50b86c nuke: get pid, owner from info.yaml (if present) 
Fall back to the old files if info.yaml is missing.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-30 10:02:27 -07:00
Alfredo Deza
e0d42c820e Merge pull request #63 from ceph/wip-logger 
Never use 'except:' without specifying an Exception.
 2013-08-30 09:15:45 -07:00
Zack Cerza
3981a8f1af Never use 'except:' without specifying an Exception. 2013-08-30 11:10:05 -05:00
Alfredo Deza
fbd7fe466a Merge pull request #62 from ceph/wip-logger 
Add hung job description to email
 2013-08-30 07:50:30 -07:00
Sage Weil
f342baeb22 run: do not import at top level 
This makes a run with --lock hang when connecting, for some
reason.  E.g.,

 $ teuthology -v a.yaml --lock
 ...
 INFO:teuthology.task.internal:Opening connections...
 DEBUG:teuthology.task.internal:connecting to ubuntu@plana06.front.sepia.ceph.com
 <hangs>

No clue what is going on here, but this fixes it!

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-29 20:27:40 -07:00
Zack Cerza
24991c4ae0 Add hung job description to email 2013-08-29 17:08:51 -05:00
Zack Cerza
44401f9a0e Workers: only log child's stderr, not stdout 2013-08-29 16:12:36 -05:00
Zack Cerza
40f1d4fc58 Don't print colon if there's no exception message. Also, remove testing 
exception.
 2013-08-29 15:05:33 -05:00
Zack Cerza
83a5ab19b0 Pretty-up write_initial_metadata; s/run/name/ 2013-08-29 15:05:33 -05:00
Zack Cerza
9550b49921 Add exception hook 2013-08-29 15:04:50 -05:00
Sage Weil
f6430df250 run: write info.yaml on job start 
Include basic metadata bout the job.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-29 15:04:50 -05:00
Zack Cerza
a0e86c05bd Move logging setup out of main() 2013-08-29 15:03:30 -05:00
Sage Weil
27eea4ad5e test 2013-08-29 15:03:30 -05:00
Sage Weil
649bddf71b run: set up archive dir and logger output sooner 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-29 15:03:30 -05:00
Alfredo Deza
ed575251db Merge pull request #58 from ceph/queue 
Don't assume anything about the base path here.
 2013-08-29 06:07:44 -07:00
Sage Weil
4fbec83490 suite: return [] for build_matrix base case 
This gives us an empty list instead of a crash on an empty dir
or bad symlink

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 21:53:41 -07:00
Alfredo Deza
d3f1369812 Merge pull request #60 from ceph/sentry 
Add run name to first line of email.
 2013-08-28 18:52:29 -07:00
Zack Cerza
df73f503a3 Add run name to first line of email. 2013-08-28 15:41:14 -05:00
Sage Weil
7ce6696249 suite: build_matrix as a list of filenames, not file content 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 13:25:36 -07:00
Sage Weil
7163e89b83 suite: allow individual files to be scheduled 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 13:25:36 -07:00
Sage Weil
b829543388 suite: generalize collection expansion 
Previous, a collection was a directory like this:

 mycollection/
 mycollection/facet1/
 mycollection/facet1/1a.yaml
 mycollection/facet1/1b.yaml
 mycollection/facet2/
 mycollection/facet2/2a.yaml
 mycollection/facet3/
 mycollection/facet3/3a.yaml
 mycollection/facet3/3b.yaml

and this would expand to

 1a + 2a + 3a
 1a + 2a + 3b
 1b + 2a + 3a
 1b + 2a + 3b

The fixed directory depth and requirement for a subdir even
when there is only 1 item is annoying.  Instead, allow an
arbitrary directory structure, with the following rules:

 - a .yaml file is a taken as-is (duh); other files still
   ignored
 - a directory is normally just a way to organize files.  We
   recursively descend and build a list of what we fine.
 - a directory with a '%' file in it is special:
     - take the product of every item in the dir (much like
       we did before)
 - a directory with a '+' file in it is special:
     - concatenate everything in the dir into one job

Note that this is equivalent to the previous structure if we
do:

 for facet in mycollection/* ; do touch $facet/% ; done

We can clean up slightly be taking any dir with only one yaml
file in it and replacing the dir with the bare .yaml.

Once this is done, we can reorganize directories however we
like.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 13:25:36 -07:00
Sage Weil
8314140dd6 suite: clean up imports 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 11:41:31 -07:00
Sage Weil
2dd889e4fd suite: make collection args (optionally) relative to a base dir 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 11:40:42 -07:00
Sage Weil
802fa51dae suite: make names a bit more friendly 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 11:40:41 -07:00
Sage Weil
8894ff6b9f suite: add --dry-run 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-28 11:40:41 -07:00
Zack Cerza
6175a133f4 Don't assume anything about the base path here. 2013-08-28 13:36:15 -05:00
Alfredo Deza
a472f5017a Merge pull request #54 from ceph/sentry 
Add logs and Sentry events to suite emails
 2013-08-28 09:38:20 -07:00
Zack Cerza
38a47ecef0 Don't return inside __init__ 2013-08-28 11:36:36 -05:00
Zack Cerza
53cea02a00 Add apology for non-public links 2013-08-28 11:15:27 -05:00
Zack Cerza
25defd40cc Indent wrapped exceptions. 2013-08-28 11:12:10 -05:00
Joe Buck
ffac4ad22d s3tests: extend for multi-region tests 
Added code to the s3tests task to extract
multi-region info so that that data
can be added to the S3TEST_CONF file
used to run S3 tests.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-28 09:01:16 -07:00
Joe Buck
db518885c9 rgw: persist the region info 
The rgw task deletes the region info
from the config structure. The s3tests
task needs this info, so we persist
it by sticking it in the ctx object.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewd-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-28 09:00:52 -07:00
Joe Buck
2877e2722b radosgw-agent: store radosgw_agent server/port 
Persist the hostname and port number used
by the radosgw-agent http server.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-28 09:00:03 -07:00
Joe Buck
6c5a7af1b4 move multi_region_enabled() into util class 
Moving a helper function into a more general
location so that it can be used by other
classes.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-28 08:59:15 -07:00
Sage Weil
951177b8e5 internal: whitelist btrfs lock imbalance bug 6097 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-27 21:41:39 -07:00
Samuel Just
c30310af5a ceph.conf.template: add osd_debug_pg_log_writeout = true 
Signed-off-by: Samuel Just <sam.just@inktank.com>
 2013-08-27 18:48:48 -07:00
Josh Durgin
232e3d32bc Fix undefined symbol errors 
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-27 15:58:14 -07:00
Zack Cerza
6afb238aba Time is an integer, in seconds. 2013-08-27 17:26:46 -05:00
Zack Cerza
dfdac24f27 Make email formatting way, way nicer. 2013-08-27 17:22:27 -05:00
Zack Cerza
eb585d19a7 Move job listing logic to get_jobs() 2013-08-27 14:51:27 -05:00
Sage Weil
502714ba2e admin_socket: fix retry-on-error behavior 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-26 18:14:37 -07:00
Zack Cerza
81709ed13d Avoid double slashes in sentry event URL 2013-08-26 18:12:20 -05:00
Zack Cerza
a1a261a886 Add tags! Task name and owner to start. 2013-08-26 17:38:23 -05:00
Zack Cerza
0503803111 Add sentry events to suite email. 2013-08-26 17:21:48 -05:00
Zack Cerza
489c1660f2 Also leave a list of sentry events in the summary 2013-08-26 17:11:51 -05:00
Zack Cerza
4007173278 Add URL to Sentry event to traceback output. 2013-08-26 16:33:04 -05:00
Zack Cerza
6f00939053 Use os.path.join, not urlparse.urljoin 2013-08-26 16:17:31 -05:00
Zack Cerza
300374bb07 For failures, add http links to log directories. 2013-08-26 16:17:31 -05:00
Zack Cerza
fedc91c07f Add a catch-all __getattr__(); add comments 2013-08-26 16:17:31 -05:00
Zack Cerza
12cb686070 Rewrite email-generating code. 2013-08-26 16:17:31 -05:00
Zack Cerza
6c486ab067 Tweak logging 2013-08-26 16:17:31 -05:00
Sage Weil
77706c674c internal: remove (hopefully obsolete) kern.log checks 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-26 13:48:32 -07:00
Sage Weil
711a02449f internal: unbreak syslog BUG checks and gz 
This broke back in ace4cb07b2

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-26 13:47:07 -07:00
Zack Cerza
ff1fcc7151 Merge pull request #51 from ceph/wip-queue 
queue: only git fetch once per minute per branch
 2013-08-26 10:14:16 -07:00
Sage Weil
5ec5e2c0e2 ceph_manager: wait for dump_ops_in_flight on osd revival 
Wait for a command that implies a complete startup instead of
'version' (which does not).

Fixes: #5924
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-24 22:01:45 -07:00
Sage Weil
c861e2d70b queue: only git fetch once per minute per branch 
This takes 1-2 seconds and makes launching jobs slow.  Only do it once
every 60 seconds per branch.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-23 15:43:35 -07:00
Sage Weil
973d5aff1c queue: only let one worker update the teuthology checkouts at a time 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-23 13:43:18 -07:00
Sandon Van Ness
c107adeb68 Fix for blank yaml. 
As well as fix variabl variable naming.
 2013-08-23 10:38:13 -07:00
Zack Cerza
7930f661a3 Update call to get_sentry_client() 2013-08-23 11:40:44 -05:00
Zack Cerza
609086366d Use teuthology.config 2013-08-23 11:40:22 -05:00
Zack Cerza
d8d2ef931c Add teuthology.config, the start of a better system 2013-08-23 11:39:02 -05:00
Sage Weil
9115663a74 Merge pull request #49 from ceph/sentry 
Rewrite branch fetching.
 2013-08-23 09:34:44 -07:00
Sage Weil
86caebbed7 nuke: clean up stray firmware.git locks 
These get lost occasionally and cause all firmware.git updates to
fail when the kernel task runs.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-23 09:00:47 -07:00
Zack Cerza
eafd591ab1 Move git stuff to fetch_teuthology_branch() 2013-08-23 10:08:01 -05:00
Zack Cerza
307284c2ed Rewrite branch fetching. 2013-08-23 09:59:48 -05:00
Sage Weil
22fc733770 queue: fetch origin, not branch 
Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-22 22:20:26 -07:00
Sage Weil
f8f4c2d0e4 suite: only skip on non-vps if os-type is actually defined 
If it's not defined, as it is (not) with most of the nightlies,
proceed!

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-22 22:18:55 -07:00
Sage Weil
c39ec60d48 queue: only bootstrap new checkouts 
Until we figure out why bootstrap is getting stuck like this:

 9851 pts/7    S      0:03 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
 2075 pts/7    Z      0:00  \_ [git] <defunct>
 2112 pts/7    Z      0:00  \_ [git] <defunct>
 2138 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 9852 pts/7    S      0:03 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
 2153 pts/7    Z      0:00  \_ [git] <defunct>
 2177 pts/7    Z      0:00  \_ [git] <defunct>
 2264 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 9853 pts/7    S      0:03 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
 2141 pts/7    Z      0:00  \_ [git] <defunct>
 2276 pts/7    Z      0:00  \_ [git] <defunct>
 2305 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 9854 pts/7    S      0:03 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
 7448 pts/7    Z      0:00  \_ [git] <defunct>
 7449 pts/7    Z      0:00  \_ [git] <defunct>
 7450 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 7452 pts/7    Z      0:00  \_ [teuthology-resu] <defunct>
 9855 pts/7    S      0:01 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
 7712 pts/7    Z      0:00  \_ [git] <defunct>
 7713 pts/7    Z      0:00  \_ [git] <defunct>
 7714 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 7716 pts/7    Z      0:00  \_ [teuthology-resu] <defunct>
 9856 pts/7    S      0:03 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
 2316 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 9857 pts/7    S      0:03 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
 2340 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 9858 pts/7    S      0:01 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs
23188 pts/7    Z      0:00  \_ [bootstrap] <defunct>
 9859 pts/7    S      0:03 /home/teuthworker/teuthology-master/virtualenv/bin/python ./teuthology-master/virtualenv/bin/teuthology-worker -v --archive-dir /var/lib/teuthworker/archive --tube plana --log-dir /var/lib/teuthworker/archive/worker_logs

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-22 22:14:41 -07:00
Sandon Van Ness
dad8d1aa3a Do not run multiple tests (for distros) on baremetal. 
Teuthology doesnt care about os_type for baremetal (ATM). This
change makes it so you can run tests that have been switched over
to run on multiple distros (on vms) on baremetal as well as all
non-ubuntu tests will be skiped (to avoid running the same test
multiple times on baremetal.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
 2013-08-22 19:36:46 -07:00
Sandon Van Ness
2ea841cdd3 Allow exclude_arch and exclude_os_type in qa-suite yamls 
Adding the option:

exclude_arch:

or

exclude_os_type:

in the ceph-qa-suite yaml allows tests to be skipped for certain
types of hardware or distros.

Example:

exclude_arch: armv7l

This will make said test not run on arm machines.

exclude_os_type: rhel

Would make multi-distro tests skip a specific test on RHEL.
 2013-08-22 19:36:37 -07:00
Zack Cerza
98160c5c99 Fix SyntaxError 2013-08-22 18:31:18 -05:00
Sage Weil
f93b26b983 Merge pull request #47 from ceph/sentry 
Make the worker obtain the correct teuthology branch
 2013-08-22 16:09:14 -07:00
Zack Cerza
a9df6c2a6a Worker shouldn't attempt to rebuild an existing virtualenv 2013-08-22 18:02:22 -05:00
Zack Cerza
c773060914 Use the ceph.com git mirror. 2013-08-22 15:51:39 -05:00
Zack Cerza
73de8b7734 Use fetch and reset --hard, not checkout and pull 2013-08-22 15:30:31 -05:00
Zack Cerza
c6293a4ee4 Make the worker obtain the correct teuthology branch 2013-08-22 14:47:18 -05:00
Zack Cerza
0e872533f2 Fix upgrading edge-ish case 2013-08-22 09:49:53 -05:00
Sage Weil
de270b080b install: use get() in _get_config_value_for_remote 
Fixes: #6080
Signed-off-by: Sage Weil <sage@inktank.com>
Tested-by: Tamil Muthamizhan <tamil.muthamizhan@inktank.com>
 2013-08-21 16:45:46 -07:00
Alfredo Deza
ab16813ea9 Merge pull request #44 from ceph/sentry 
Add initial support for sentry
 2013-08-21 14:28:37 -07:00
Joe Buck
520a9384c5 radosgw-admin: use check_status for task success 
Alter the code to use the 'check_status=True'
option in rgwadmin() rather than following the
call with 'assert not err'. Should make the
tests a bit more clear and result in a more
useful error (throw the call stack rather than
just 'assert new err failed').

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-21 12:38:53 -07:00
Joe Buck
ff2a209f8d radosgw-admin: adding radosgw-admin tests 
Adding tests for syncing buckets between
RGWs. Fulfills ticket #5605.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-21 12:38:44 -07:00
Zack Cerza
df8ae0415f Make client a global variable 2013-08-21 10:27:51 -05:00
Zack Cerza
0af6a8a6f2 Beginnings of support for Sentry. 2013-08-21 10:07:12 -05:00
Joe Buck
549bac3ede radosgw-admin: use dynamic ports for testing 
The rgw.py task was extended to  dynamically
assign port numbers to radosgateways.
This patch extends the radosgw-admin task
to use those ports rather than making out-dated
assumptions of port numbering.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-20 21:21:17 -07:00
Zack Cerza
71a77f2908 Add get_test_user(), because hardcoding is bad 2013-08-20 16:25:25 -05:00
Alfredo Deza
0a8a1c98b0 Merge pull request #41 from ceph/wip-3791 
Various usability and documentation fixes
 2013-08-19 14:10:18 -07:00
Zack Cerza
5bd7f620b8 Add comment about portability to get_testdir_base() 2013-08-19 09:59:54 -05:00
Zack Cerza
657a070bd3 Merge pull request #37 from ceph/wip-fix5957-wusui 
Display error message when locking a vpm fails due to downburst errors.
 2013-08-19 07:03:02 -07:00
Joe Buck
558237e5f5 Detect multi-region test cases 
Enable multi-region calls and tests only if
the configuration has specified a
radosgw-agent tastk.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-17 08:47:58 -07:00
Sage Weil
e625316d02 kernel: fix sha1 
6f8910eca4 inadvertantly started
using the ceph sha1 for the kernel.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-16 22:34:26 -07:00
Joe Buck
bbf7c71183 radosgw-agent: adding debug logging 
Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-16 19:26:41 -07:00
Joe Buck
8a47230d82 rename variables and log messages to be more clear 
A few edits to make logging and variable names
more clear.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-16 19:26:33 -07:00
Joe Buck
7061e3c6dc rgw: fix domain root pool name assignment 
Do not make the domain root pool the same
as the zone root pool. That causes sync issues.
Also, clarify a logging message.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-16 19:26:21 -07:00
Joe Buck
b883e338cd radosgw-admin: correct white space mistake 
Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-16 19:26:09 -07:00
Warren Usui
a899b58095 Display error message when locking a vpm fails due to downburst errors. 
When doing a lock-many, do not lock any of the vpms when downburst errors
occur.   Made error messages more accurate, and removed a destroy_if_vm call
because the destroy was alreadly called in unlock.  Changed some print
messages to be log.info displays.

Fix: 5957
Signed-off-by: Warren Usui <warren.usui@inktank.com>
 2013-08-16 16:23:09 -07:00
Warren Usui
694cd67048 Fix ARM releases to be quantal armv7l releases. 
Made grub execution conditional and not done when ARM.
Use ctx parameter to change machine type to tala.
Fix kernel assignments when running ARM systems.

Fixes: #5000
Signed-off-by: Warren Usui <warren.usui@inktank.com>
 2013-08-16 15:44:54 -07:00
Warren Usui
47224f2da3 Revert "Fix ARM releases to be quantal armv7l releases." 
This reverts commit aabfabc34c.
 2013-08-16 15:01:01 -07:00
wusui
666b2a4834 Merge pull request #40 from ceph/wip-teutharm-wusui 
Wip teutharm wusui
 2013-08-16 14:47:59 -07:00
Warren Usui
aabfabc34c Fix ARM releases to be quantal armv7l releases. 
Made grub execution conditional and not done when ARM.
Use ctx parameter to change machine type to tala.
Fix kernel assignments when running ARM systems.

Fixes: #5000
Signed-off-by: Warren Usui <warren.usui@inktank.com>
 2013-08-16 14:39:00 -07:00
Joe Buck
a39e7f1b09 Adding multi-region tests 
Adding tests for ticket #5604 to test
user propagation via the radosgw-agent.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-16 10:38:12 -07:00
Zack Cerza
d74eefd9eb Use the json format for raw_cluster_status(). 2013-08-16 11:24:55 -05:00
Joe Buck
2c9ac3e0ee Detect multi-region test cases 
Enable multi-region calls and tests only if
the configuration has specified a
radosgw-agent tastk.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-16 09:09:46 -07:00
Zack Cerza
6115d456f2 Do more than just sleep and raise an exception. 2013-08-16 10:17:18 -05:00
Sandon Van Ness
4a47eedce7 Fixing assumed typo. 
Assuming this has to be a typo but its breaking the ceph-deploy
task.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
 2013-08-15 19:00:54 -07:00
Zack Cerza
17667301f3 Don't raise an exception if apt-key list fails 2013-08-15 12:42:47 -05:00
Zack Cerza
c17a18efdc Don't assume the ubuntu user when getting the test dir. 2013-08-15 10:58:45 -05:00
Zack Cerza
3afc7d9b41 If get_testdir_base() exists, might as well use it... 2013-08-15 10:17:32 -05:00
Zack Cerza
f41436abd5 Tweak regex to work for non-FQDN hostnames 2013-08-15 09:57:27 -05:00
Zack Cerza
5746efbbc2 Fix some instances where print is being used instead of log 2013-08-15 08:49:35 -05:00
Zack Cerza
ab2d2fad3c Default to log level INFO. 2013-08-15 08:29:09 -05:00
Zack Cerza
63b64e2969 Don't bail if ~/.teuthology.yaml doesn't exist. 2013-08-14 14:48:45 -05:00
Zack Cerza
ebf476d390 Obligatory automatic vim whitespace cleanup commit 2013-08-14 14:46:22 -05:00
Zack Cerza
f1c9125f27 Fix a case where _get_config_value_for_remote could return None mistakenly 2013-08-13 13:30:22 -05:00
Sage Weil
0f3d9eddd9 Merge remote-tracking branch 'gh/next' 2013-08-13 11:03:00 -07:00
Sage Weil
000efc658d samba: wait longer for smbd to start 
sleep(1) is occasionally not long enough, it seems!
 2013-08-13 11:02:40 -07:00
Zack Cerza
2797d8d82d Merge pull request #27 from dachary/wip-5946 
do not check the jobid if check-locks is False
 2013-08-13 10:46:30 -07:00
Loic Dachary
9d4104f45b do not check the jobid if check-locks is False 
Because it relies on the lock server which is presumably not available
since check-locks was set to False. It matters when using teuthology
on a minimal installation.

http://tracker.ceph.com/issues/5946 fixes #5946

Signed-off-by: Loic Dachary <loic@dachary.org>
 2013-08-13 19:32:01 +02:00
Zack Cerza
13edfe6bdf Merge pull request #28 from alfredodeza/5887 
Allow a user to define a ceph-deploy branch to use (instead of master)
 2013-08-13 09:10:45 -07:00
Alfredo Deza
ac78bc9069 Merge pull request #24 from ceph/wip-5937 
Don't hit an AttributeError if ctx.config['overrides'] is set to None
 2013-08-13 08:57:18 -07:00
Alfredo Deza
643da65e83 remove fallback of the fallback. so silly 
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
 2013-08-13 11:56:37 -04:00
Zack Cerza
3aa995a62a Remove three characters just for Alfredo 2013-08-13 10:45:53 -05:00
Alfredo Deza
70cd884f42 safer fallback. Updates docstring 
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
 2013-08-13 11:42:22 -04:00
Joe Buck
d4c2576c34 radosgw-agent.py: refactor, enable overrides 
Refactored the radosgw-agent.py code so that it
is structured more like existing teuthology
tasks.
Additionally, added code to enable:
using the override field in YAML files,
specifying which radosgw-agent github branch
to use checkout and for the YAML file to
specify one of the following: a full sync,
an incremental sync and the starting of the
test radosgw-agent server (previously the
server was always started by this task).

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2013-08-12 23:25:57 -07:00
Joe Buck
1d90d7bc83 rgw.py: fix example config 
In the example config, the region root and
zone root where pointing to the same pool,
which is not a best practice. Updated the
example to show them pointing to different pools.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-12 23:25:43 -07:00
Joe Buck
9ee6452404 rgw.py: add a better error message 
When pulling region info from the config
structure, if the region info isn't there,
log a more helpful message.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-12 23:25:33 -07:00
Joe Buck
e517cd4cfc s3readwrite.py: make user creation optional 
Extend the s3readwrite.py task to enable the
creation and deletion of users for the s3readwrite
tests to be independently specified with the default
assumption to both being true.
This is needed for tests that will create a user and
data in one execution and read it in another.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-12 23:25:24 -07:00
Joe Buck
e3b9add3fb rgw.py: refactor configure 
Extend the rados pool configuration options to
specify all pools (if desired).
Also, reordered zone and region configuration
so that they're configure (per client) in
this order: zone, region, set default region

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-12 23:25:16 -07:00
Joe Buck
18e80147f3 rgy.py: make log_(data|metadata) configurable 
The log_data and log_metadata are made configurable
via the YAML file and default to false
(meaning neither data nor metadata operations are
logged).

Signed-off-by: Joe Buck <jbbuck@gmail.com>
 2013-08-12 23:25:06 -07:00
Yehuda Sadeh
3fb53189d0 agent name should also contain port number 
otherwise multiple agents per machines will have the same id

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
 2013-08-12 23:24:13 -07:00
Yehuda Sadeh
4adc1da58a radosgw-admin: various multiregion related fixes and changes 
Go to the master zone in the master region for radosgw-admin
operations. Trigger metadata sync. Other fixes.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
 2013-08-12 23:24:04 -07:00
Dan Mick
fa733e43d3 Change "Exception" to "RuntimeError" as advised by zackc 
Signed-off-by: Dan Mick <dan.mick@inktank.com>
 2013-08-12 15:43:02 -07:00
Dan Mick
28e42197d8 tasks/ceph-deploy: allow configurations with no mds 
Signed-off-by: Dan Mick <dan.mick@inktank.com>
 2013-08-12 14:55:14 -07:00
Zack Cerza
93b532f0bf Don't hit an AttributeError if ctx.config['overrides'] is set to None 2013-08-12 16:18:42 -05:00
Zack Cerza
cabb4142d1 Make this module pep8-clean. 2013-08-12 11:40:04 -05:00
Sage Weil
5aee4a8b6c Merge pull request #22 from ceph/rpm-upgrades 
Fix rpm upgrades for nested branch configs
 2013-08-10 11:35:05 -07:00
Zack Cerza
7c377cb77c Make _get_baseurlinfo_and_dist() provide the correct uri 2013-08-10 12:45:21 -05:00
Zack Cerza
251cbf7fd7 Merge pull request #21 from ceph/rpm-upgrades 
Make install.upgrade work on RPM-based systems.
 2013-08-09 16:26:39 -07:00
Zack Cerza
b78a6c779b Make install.upgrade work with CentOS/RHEL/Fedora. 2013-08-09 17:01:36 -05:00
Zack Cerza
2a7a61cd17 Add Remote.system_type property. Also, clean up whitespace. 2013-08-09 13:28:38 -05:00
Sage Weil
a0e74a9614 admin_socket: split command into multiple arguments 
We were passing the command as a single string, but that does not work the
same way it used to.

Signed-off-by: Sage Weil <sage@inktank.com>
 2013-08-09 09:04:25 -07:00
Sage Weil
a739206666 ceph.conf: open osd classes on start 
This is the default for master, but needs to be explicitly enabled for
cuttlefish.
 2013-08-07 14:01:00 -07:00
Sage Weil
77b63f0425 Merge remote-tracking branch 'gh/next' 2013-08-07 09:03:51 -07:00
Alfredo Deza
6acee41c07 add a key for ceph-deploy-branch detection 
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
 2013-08-06 15:20:56 -07:00
Zack Cerza
7a14a93d91 Add a useful error message in case of an invalid hostname 2013-08-06 15:21:34 -05:00