Commit Graph

1488 Commits

Author SHA1 Message Date
Zack Cerza
93b6fa10a7 Clarify job vs. run
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
f0604496e0 Create a FakeArchive class to forge test results
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
ff120d7fb5 Escape reserved characters in URIs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
77b65c7f3c Report results synchronously.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
f0b35fca70 Add more documentation.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
058a27bf59 Add create_run() and push_job_info() with docs.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
fe64887ec6 s/submit_/report_/g
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
555e55ff61 Rename ResultsPoster to ResultsReporter
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
79e27abfe9 Add create_run; allow passing json to submit_job
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
52282fb7f4 Overhaul posting logic to avoid some corner cases
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
4bcae4b18b Add flag for refreshing already-pushed runs
Also tweak implementation of save_last_run

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
da4a7b860d Remove old method used for testing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
8b9a69138e Add --server flag
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
cf68a3ac3a Reuse connection objects.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
f77ee6e0ef Add argument parsing to make this a proper script.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
e3e0775c0d A first pass at integration with paddles
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Dan Mick
149b98e572 rest-api.py: test that ceph-rest-api is up and servicing requests
Wait for the daemon to actually be ready before continuing with other
tasks.  Loop 12 times, waiting 5s, before deciding something's wrong.

Fixes: #6243
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-10-02 14:58:11 -07:00
Dan Mick
0ce72d7f01 rest-api.py: fix up client identification
The code to extract which clients to start the API on was confused;
fix it up.  Also, strip off 'client.' instead of 'clients' (since it
was done with len(), the result was the same, but confusing)

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-10-02 14:25:34 -07:00
Sage Weil
759bbb4bdb Revert "ceph.conf: filestore sloppy crc = true"
This reverts commit 631476b979.

This fails on ext4 because of xattr size limits.
2013-10-02 13:22:10 -07:00
Sage Weil
e17928d588 nuke: s/run_name/name/
This matches an existing argument (with the same meaning) and
avoids an error like

2013-10-01T17:20:35.395 CRITICAL:root:  File "/var/lib/teuthworker/teuthology-master/virtualenv/bin/teuthology", line 9, in <module>
    load_entry_point('teuthology==0.0.1', 'console_scripts', 'teuthology')()
  File "/home/teuthworker/teuthology-master/teuthology/run.py", line 235, in main
    nuke(ctx, log, ctx.lock)
  File "/home/teuthworker/teuthology-master/teuthology/nuke.py", line 391, in nuke
    if ctx.run_name:

2013-10-01T17:20:35.395 CRITICAL:root:AttributeError: 'Namespace' object has no attribute 'run_name'

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 20:57:53 -07:00
Zack Cerza
efd5ccbc4b Merge pull request #118 from ceph/wip-nukeskip
Check description of machines before nuking when -a is passed
2013-10-01 16:40:44 -07:00
Zack Cerza
e80f112456 Merge pull request #95 from ceph/wip-empty
don't summarize an empty run
2013-10-01 16:39:35 -07:00
Sandon Van Ness
6b248e80a6 Check description of machines before nuking when -a is passed
When teuthology-nuke is passed with --archive/-a to kill and nuke
machines from an archive folder it blindly will nuke all the
targets it grabs from the config.yaml in the archive dir. This
change will check the description of locked machines and make sure
the run name is in the description. if not it removes the target
from the list passed to nuke().

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-10-01 16:12:31 -07:00
Sage Weil
431d264447 suite: don't schedule follow-on summary job for an empty run
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 16:09:54 -07:00
Sage Weil
504195a0d9 suite: fix num_jobs count
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 16:09:54 -07:00
Josh Durgin
f77a9190b7 Merge pull request #116 from ceph/wip-sudoers-sync
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-01 16:08:05 -07:00
Zack Cerza
f3047be423 Merge pull request #115 from ceph/wip-priority
add priorities to scheduling
2013-10-01 09:59:53 -07:00
Sage Weil
3e31c49344 nuke: make half-hearted attempt to sync before reboot
We don't want to block on sync for fear of a hung kernel
mount.  However, we can give it a try and wait a few seconds
to get what we can.

This fixes a problem where our recent modifications to the
sudoers file are lost, with a 0 byte file left in its place,
because the task fails and we do a reboot -f -n.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 09:57:34 -07:00
Alfredo Deza
d05c8ed8b3 Merge pull request #117 from ceph/wip-tests
Port tests to py.test; add a couple tests
2013-10-01 07:11:44 -07:00
Zack Cerza
4135960eb6 Fix test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:50 -05:00
Zack Cerza
69ea83904f Add test for skipping host key verification
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:48 -05:00
Zack Cerza
589560e6c9 Port from nosetests to py.test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:45 -05:00
Zack Cerza
f91f792c91 Add another config test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:39 -05:00
Zack Cerza
757b298870 Don't use properties
They're quite inconvenient for this use-case.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:13 -05:00
Sage Weil
631476b979 ceph.conf: filestore sloppy crc = true
Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-30 16:22:45 -07:00
Sage Weil
2860e9d797 schedule: show priority on -s
Make output a bit nicer too.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-27 12:02:37 -07:00
Sage Weil
acdaf3d419 schedule: priority option
Default to 1000.  Note that beanstalk priority is 2^31, so this
won't mix well with older code scheduling things at the
beanstalk default priority.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-27 11:57:55 -07:00
Sage Weil
2acceef699 valgrind: suppress inet_ntop noise
See #6240

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-26 13:37:49 -07:00
Zack Cerza
21765ce4f8 Move 'import os' to inside main()
This is necessary because of the monkey-patching.
2013-09-26 14:03:44 -05:00
Zack Cerza
962a9ae2bb Add '# noqa' to suppress a linter error
Fixing this would require some more significant changes... and tempt me
with rewriting every module in the directory.
(cherry picked from commit 3fc39a59fd415a4e4e6f2a0354fe900477167e51)
2013-09-26 14:02:51 -05:00
Zack Cerza
622ce1115d Don't redefine variable
(cherry picked from commit 083717c1b4022289806030faf23ff7c4aa371f19)
2013-09-26 14:02:41 -05:00
Zack Cerza
8a11e4d053 Remove unused variables
(cherry picked from commit 581b6b3e977b99fc58fe25e66c933c65e38dc87c)
2013-09-26 14:01:56 -05:00
Zack Cerza
8497437003 Remove unused imports
(cherry picked from commit 586817481119c4fc4a39f8804e7871a43491e01f)
2013-09-26 14:01:37 -05:00
Zack Cerza
a2c9bdc7ba Fix undefined name errors
(cherry picked from commit f59497ef2214f29d5995435d83766c7994e8f2cd)
2013-09-26 14:01:17 -05:00
Zack Cerza
b301a741f0 Make teuthology.locker a module 2013-09-26 14:00:01 -05:00
Zack Cerza
e30f1fa745 Merge pull request #110 from ceph/wip-nuke-import-os
nuke: add missing import os
2013-09-25 13:49:23 -07:00
Sage Weil
25bc62dec1 nuke: add missing import os
$ teuthology-nuke  -a . -r -u
Traceback (most recent call last):
  File "/home/ubuntu/bin/teuthology-nuke", line 9, in <module>
    load_entry_point('teuthology==0.0.1', 'console_scripts', 'teuthology-nuke')()
  File "/home/ubuntu/teuthology/teuthology/nuke.py", line 343, in main
    ifn = os.path.join(ctx.archive, 'info.yaml')
UnboundLocalError: local variable 'os' referenced before assignment

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-25 13:42:03 -07:00
Alfredo Deza
80dcab7fe4 only use host_key if it is not None
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2013-09-25 09:25:35 -04:00
Sage Weil
2870ec5086 rbd: move xfstest TESTDIR=... bit to front of command
2013-09-24T11:32:49.169 DEBUG:teuthology.orchestra.run:Running [10.214.132.4]: "/usr/bin/sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage TESTDIR=/home/ubuntu/cephtest /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f xfs -t /dev/rbd1 -s /dev/rbd2 '1-9 11-15 17 19-21 26-29 31-34 41 46-
54 56 61 63-67 69-70 74-76 78-79 84-89 91'"
2013-09-24T11:32:49.211 INFO:teuthology.task.rbd.client.1.err:[10.214.131.22]: /usr/bin/ceph-coverage: 25: exec: TESTDIR=/home/ubuntu/cephtest: not found

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-24 16:50:07 -07:00
Zack Cerza
218776b219 Fix namespace collision 2013-09-24 15:04:39 -05:00