Commit Graph

1771 Commits

Author SHA1 Message Date
Alfredo Deza
fe497fd910 Merge pull request #124 from ceph/wip-store-results
Various fixes related to reporting
2013-10-04 13:08:55 -07:00
Zack Cerza
972ab1cf22 Tweak logic of try_push_job_info()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 15:01:16 -05:00
Zack Cerza
f18c8f7e28 Make most of lock_machines() PEP-8 clean.
Also, use some better variable names.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 14:11:16 -05:00
Zack Cerza
5482ba81d1 Make teuthology-schedule also print the job's name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 13:11:03 -05:00
Zack Cerza
08efeb7b9e Store the job_id as a str, not an int.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 13:11:03 -05:00
Zack Cerza
f160ab6487 Move teuthology.report import; add large warning
Because of the monkey patching, if we get the import order wrong bad
things happen.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 12:08:33 -05:00
Alfredo Deza
52e2fc9b21 Merge pull request #123 from ceph/wip-store-results
Fix issue with monkey patching
2013-10-04 09:22:10 -07:00
Zack Cerza
2270db724d Add (and use) try_push_job_info() for easy pushin'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 11:07:33 -05:00
Zack Cerza
760fe6b1c9 Move new imports to inside main()
The monkey patch stuff was causing problems again.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 10:54:47 -05:00
Sage Weil
84e8651d36 schedule_suite.sh: include default machine type in job name
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-03 16:34:09 -07:00
Alfredo Deza
f28643c397 Merge pull request #121 from ceph/wip-store-results
Submit teuthology results to a paddles instance
2013-10-03 14:14:01 -07:00
Zack Cerza
e786e16220 Add test for test_all_runs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
93b6fa10a7 Clarify job vs. run
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
f0604496e0 Create a FakeArchive class to forge test results
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
ff120d7fb5 Escape reserved characters in URIs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
77b65c7f3c Report results synchronously.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
f0b35fca70 Add more documentation.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
058a27bf59 Add create_run() and push_job_info() with docs.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
fe64887ec6 s/submit_/report_/g
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
555e55ff61 Rename ResultsPoster to ResultsReporter
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
79e27abfe9 Add create_run; allow passing json to submit_job
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
52282fb7f4 Overhaul posting logic to avoid some corner cases
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
4bcae4b18b Add flag for refreshing already-pushed runs
Also tweak implementation of save_last_run

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
da4a7b860d Remove old method used for testing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
8b9a69138e Add --server flag
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
cf68a3ac3a Reuse connection objects.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
f77ee6e0ef Add argument parsing to make this a proper script.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
e3e0775c0d A first pass at integration with paddles
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
5acd88b9d5 Merge pull request #120 from ceph/wip-6243
Wip 6243
2013-10-02 15:01:57 -07:00
Dan Mick
149b98e572 rest-api.py: test that ceph-rest-api is up and servicing requests
Wait for the daemon to actually be ready before continuing with other
tasks.  Loop 12 times, waiting 5s, before deciding something's wrong.

Fixes: #6243
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-10-02 14:58:11 -07:00
Dan Mick
0ce72d7f01 rest-api.py: fix up client identification
The code to extract which clients to start the API on was confused;
fix it up.  Also, strip off 'client.' instead of 'clients' (since it
was done with len(), the result was the same, but confusing)

Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-10-02 14:25:34 -07:00
Sage Weil
759bbb4bdb Revert "ceph.conf: filestore sloppy crc = true"
This reverts commit 631476b979.

This fails on ext4 because of xattr size limits.
2013-10-02 13:22:10 -07:00
Sage Weil
e17928d588 nuke: s/run_name/name/
This matches an existing argument (with the same meaning) and
avoids an error like

2013-10-01T17:20:35.395 CRITICAL:root:  File "/var/lib/teuthworker/teuthology-master/virtualenv/bin/teuthology", line 9, in <module>
    load_entry_point('teuthology==0.0.1', 'console_scripts', 'teuthology')()
  File "/home/teuthworker/teuthology-master/teuthology/run.py", line 235, in main
    nuke(ctx, log, ctx.lock)
  File "/home/teuthworker/teuthology-master/teuthology/nuke.py", line 391, in nuke
    if ctx.run_name:

2013-10-01T17:20:35.395 CRITICAL:root:AttributeError: 'Namespace' object has no attribute 'run_name'

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 20:57:53 -07:00
Zack Cerza
efd5ccbc4b Merge pull request #118 from ceph/wip-nukeskip
Check description of machines before nuking when -a is passed
2013-10-01 16:40:44 -07:00
Zack Cerza
e80f112456 Merge pull request #95 from ceph/wip-empty
don't summarize an empty run
2013-10-01 16:39:35 -07:00
Sandon Van Ness
6b248e80a6 Check description of machines before nuking when -a is passed
When teuthology-nuke is passed with --archive/-a to kill and nuke
machines from an archive folder it blindly will nuke all the
targets it grabs from the config.yaml in the archive dir. This
change will check the description of locked machines and make sure
the run name is in the description. if not it removes the target
from the list passed to nuke().

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-10-01 16:12:31 -07:00
Sage Weil
431d264447 suite: don't schedule follow-on summary job for an empty run
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 16:09:54 -07:00
Sage Weil
504195a0d9 suite: fix num_jobs count
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 16:09:54 -07:00
Josh Durgin
f77a9190b7 Merge pull request #116 from ceph/wip-sudoers-sync
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-01 16:08:05 -07:00
Zack Cerza
f3047be423 Merge pull request #115 from ceph/wip-priority
add priorities to scheduling
2013-10-01 09:59:53 -07:00
Sage Weil
3e31c49344 nuke: make half-hearted attempt to sync before reboot
We don't want to block on sync for fear of a hung kernel
mount.  However, we can give it a try and wait a few seconds
to get what we can.

This fixes a problem where our recent modifications to the
sudoers file are lost, with a 0 byte file left in its place,
because the task fails and we do a reboot -f -n.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-01 09:57:34 -07:00
Alfredo Deza
d05c8ed8b3 Merge pull request #117 from ceph/wip-tests
Port tests to py.test; add a couple tests
2013-10-01 07:11:44 -07:00
Zack Cerza
4135960eb6 Fix test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:50 -05:00
Zack Cerza
69ea83904f Add test for skipping host key verification
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:48 -05:00
Zack Cerza
589560e6c9 Port from nosetests to py.test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:45 -05:00
Zack Cerza
f91f792c91 Add another config test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:39 -05:00
Zack Cerza
757b298870 Don't use properties
They're quite inconvenient for this use-case.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-01 09:07:13 -05:00
Sage Weil
631476b979 ceph.conf: filestore sloppy crc = true
Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-30 16:22:45 -07:00
Sage Weil
2860e9d797 schedule: show priority on -s
Make output a bit nicer too.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-27 12:02:37 -07:00
Sage Weil
acdaf3d419 schedule: priority option
Default to 1000.  Note that beanstalk priority is 2^31, so this
won't mix well with older code scheduling things at the
beanstalk default priority.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-27 11:57:55 -07:00