Commit Graph

1622 Commits

Author SHA1 Message Date
Sandon Van Ness
84d8b49f63 Initial ugly commit.
Definitely some enhancements can be done. I think I have everything
needed but I have not been able to test this yet. If this needs to
get done before I am back feel free to work on it.

Completely untested and probably a few mistakes somewhere...

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-10-30 17:06:14 -07:00
Samuel Just
ed1d11ba9e ceph_manager: remove 6116 workaround
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-10-30 12:26:42 -07:00
Josh Durgin
b77a7785f2 Merge branch 'next' 2013-10-30 09:58:10 -07:00
Josh Durgin
9ae3fce513 radosgw-agent: add metadata-only option to task config
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-30 09:57:56 -07:00
Josh Durgin
96835e9c94 radosgw-agent: move positional argument last
Other args are treated as positional after the first one.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-30 09:57:54 -07:00
Josh Durgin
7f136578ae internal: fix log for python 2.6
{} was introduced to format strings in 2.7

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-30 09:57:53 -07:00
Josh Durgin
5f01bcba4c rgw: fix whitespace
Replace tabs with spaces and remove trailing spaces.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-30 09:57:52 -07:00
Josh Durgin
db98afe471 rgw: remove unused variables
Region name isn't needed for the new radosgw-agent
command line args.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-30 09:57:50 -07:00
Christophe Courtaut
d65a0b9efa Reflect radosgw-agent option changes in teuthology
Signed-off-by: Christophe Courtaut <christophe.courtaut@gmail.com>
2013-10-30 09:57:49 -07:00
Zack Cerza
b2af06920e Merge pull request from ceph/wip-doc5939-wusui
Added docstrings, and improved some of the comments on several tasks.
2013-10-28 14:20:44 -07:00
Sandon Van Ness
90161a371e Fixed errors. Tests pass.
Since the default OS version is different for each distro the
argument default is None instead of explicity set to a value
like with get_distro. Fixed some logic around that and the tests
making the arugment always take precidence.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-10-28 11:04:28 -07:00
Sandon Van Ness
d4a632df5f Support --os-version as argument.
You can use --os-type as an argument when not running teuthology
tests but instead just using teuthology-lock. This adds the ability
to also use --os-version so you can specify the version of the
distro without having to run an actual test with a yaml like you
normally would have had to do setting os_version in the yaml.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-10-25 17:48:50 -07:00
Zack Cerza
bcc58eb1aa Fix some PEP-8 issues
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-25 16:04:38 -05:00
Zack Cerza
ad836b1062 Fix param docstring format to be more Sphinx-y
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-25 16:04:34 -05:00
Zack Cerza
2cac388140 Add docstrings to every function. And a few other comments.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-25 16:04:28 -05:00
Sandon Van Ness
6dbb11db9c Use worker httpd instead of prefork (like ubuntu) on rpm distros.
Ubuntu's default apache uses worker instead of prefork like rpm
based distro's. If rpm use httpd.worker instead of httpd so that
the -X behavior will not be blocked by a single request.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-10-25 13:23:10 -07:00
Sandon Van Ness
c9774893a9 Use worker httpd instead of prefork (like ubuntu) on rpm distros.
Ubuntu's default apache uses worker instead of prefork like rpm
based distro's. If rpm use httpd.worker instead of httpd so that
the -X behavior will not be blocked by a single request.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-10-25 13:14:21 -07:00
Josh Durgin
6f27694a63 Merge pull request from ceph/wip-6576
fix rbd fsx on 32-bit

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-23 23:22:18 -07:00
Sage Weil
705a77f5d1 rbd_fsx: do not exceed 250GB for fsx image
This breaks on 32-bit architectures because fsx can't allocate the
in-memory buffer or hit some other limit.  500MG also seems to run out of
memory (tho it at least does not segfault).

Fixes: 

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-23 19:24:20 -07:00
Samuel Just
625d9b257c ceph_manager: workaround for 6116
This is an annoying race, we really should delay going
clean until the backfill peer has acknoledged the clean
info, but we currently don't.  In order to prevent this
bug from messing up the nightlies, we'll delay killing
the peer for 20s to make it likely that the backfill
peer has gotten the clean info.

Workaround: 
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-10-23 10:52:58 -07:00
Sage Weil
6a2dd66d6b rgw: revert to -X for apache2
-DNO_DETACH doesn't seem to work.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-22 14:36:35 -07:00
Sage Weil
c8ec9feca1 valgrind: fix libleveldb suppression on dynamically linked leveldb
(The function names don't show up here)

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-18 16:26:35 -07:00
Zack Cerza
26930c9396 More robust machine_type and pid detection
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-17 13:22:15 -05:00
Alfredo Deza
341f1c9ce6 Merge pull request from ceph/wip-6342
Add teuthology-kill
2013-10-17 09:43:12 -07:00
Sage Weil
704b72eb0b nuke: remove old log arg to nuke_one call
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-17 09:20:51 -07:00
Zack Cerza
26803da18d Rewrite portions of teuthology.kill
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-17 10:31:10 -05:00
tamil
01ce92c497 replacing -X option with -DNO_DETACH to ensure the
apache process is detached at the end of run.

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-10-16 17:14:49 -07:00
Zack Cerza
ded5c219fc Remove needless arg from list_locks()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-16 16:20:24 -05:00
Zack Cerza
59d14b8b4b Make nuke use its own logger
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-16 16:20:24 -05:00
Zack Cerza
40e5d1eee0 Add teuthology-kill
Currently implements killing suites-runs.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-16 16:19:15 -05:00
Zack Cerza
f527ba3389 Merge pull request from ceph/wip-upgrade
install: allow use of overrides for upgrade version
2013-10-16 13:40:37 -07:00
Zack Cerza
e896ee3af0 Merge pull request from ceph/wip-nuke
nuke: fix import
2013-10-16 13:34:43 -07:00
Sage Weil
d79552ecc8 nuke: fix import
I think broken by f28a7ebc2c3662a8a9b8eebf09c47b6c710e4d26

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-16 13:32:45 -07:00
Sage Weil
280f783c2e install: allow use of overrides for upgrade version
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-16 13:24:01 -07:00
Zack Cerza
c31d747640 Fix broken logic in running_jobs_for_run()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-16 13:43:05 -05:00
Zack Cerza
b2367851b8 Fix typo
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-16 12:11:47 -05:00
Zack Cerza
8b89e839f9 Make check for running jobs part of the loop
Use a new, tested implementation to check for running jobs.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-14 16:35:51 -05:00
Zack Cerza
bac2965af6 ResultsSerializer.running_jobs_for_run() and test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-14 16:34:45 -05:00
Warren Usui
a1d8225b7d Added docstrings, and improved some of the comments on several tasks. 2013-10-12 01:35:34 -07:00
Zack Cerza
3191e32c66 Put machine_type in config.yaml
Reason being, if --worker is passed to teuthology-schedule, we are
already placing the job in the tube for that machine type. If the job
config doesn't specify a machine_type, it will later be assigned to
'plana' by teuthology-run without actually modifying the config. This
can result in jobs running on hardware other than what was requested.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 17:41:22 -05:00
Zack Cerza
494c3b1fbe Make verbosity propagate correctly to modules
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 17:10:57 -05:00
Zack Cerza
3905ab993f Debug output for all http requests
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 16:29:42 -05:00
Zack Cerza
3ca9092c64 Fix broken lambda
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 16:24:54 -05:00
Zack Cerza
61dec6f36c Be more verbose when waiting for free machines
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 16:24:54 -05:00
Zack Cerza
7d99de72bd Give reporting a verbose flag
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 16:24:54 -05:00
Zack Cerza
2e3e127e72 Lack of a job_id should be a warning
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 14:32:21 -05:00
Zack Cerza
d341b588a7 Ignore the exit code of ssh-keyscan
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 12:48:55 -05:00
Zack Cerza
f5729051ab Fix a circular import
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 12:48:55 -05:00
Zack Cerza
f28a7ebc2c Move imports to top-level
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 12:48:55 -05:00
Zack Cerza
636dc8676e Move part of report_all_runs() into report_runs()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 10:48:02 -05:00
Zack Cerza
61606fe0fa Set a default timeout of 20s for HTTP connections
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-11 10:23:00 -05:00
Zack Cerza
01b81b7820 Move monkey patching to __init__.py
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:15:01 -05:00
Zack Cerza
bd9cbdba03 Don't attempt to report if there's no job_id
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:35 -05:00
Zack Cerza
098389da82 Properly express conflicting options
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:35 -05:00
Zack Cerza
f34f3b3baf Move teuthology's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:35 -05:00
Zack Cerza
8351a3abfa PEP-8
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
e4753215ea PEP-8
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
45d1b0eb18 Move teuthology-coverage's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
f4d655bbed PEP-8
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
193b3112a3 Move teuthology-results' arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
477e4ae2ce PEP-8
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
7ab9726737 Move teuthology-report's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
755ac2f129 Move teuthology-updatekeys' arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
84b2e55b93 Move schedule() to new schedule module 2013-10-10 19:09:34 -05:00
Zack Cerza
c784c79f1d Move teuthology-schedule's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
a6b57cc136 PEP-8
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
974898597f Move teuthology-lock's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
6b2f2780e0 PEP-8
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
1bf3a3dadb Move teuthology-worker's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
5fd1cd0bed Move teuthology-ls's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
e847b1075a Move teuthology-suite's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
7ce4dfd97a Move teuthology-nuke's arg parsing to scripts/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
Zack Cerza
4902bfabf3 PEP-8 cleanup
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-10 19:09:34 -05:00
tamil
7b889797c3 ignoring -X option in apache as it was causing s3test failures on the rpms.
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-10-09 17:12:16 -07:00
Zack Cerza
1c32b1b886 Reflect paddles API change: jobs in jobs/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-07 10:01:48 -05:00
Zack Cerza
f78f3163c0 Add more tests for ReportSerializer
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 15:22:21 -05:00
Zack Cerza
972ab1cf22 Tweak logic of try_push_job_info()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 15:01:16 -05:00
Zack Cerza
f18c8f7e28 Make most of lock_machines() PEP-8 clean.
Also, use some better variable names.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 14:11:16 -05:00
Zack Cerza
5482ba81d1 Make teuthology-schedule also print the job's name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 13:11:03 -05:00
Zack Cerza
08efeb7b9e Store the job_id as a str, not an int.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 13:11:03 -05:00
Zack Cerza
f160ab6487 Move teuthology.report import; add large warning
Because of the monkey patching, if we get the import order wrong bad
things happen.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 12:08:33 -05:00
Zack Cerza
2270db724d Add (and use) try_push_job_info() for easy pushin'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 11:07:33 -05:00
Zack Cerza
760fe6b1c9 Move new imports to inside main()
The monkey patch stuff was causing problems again.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-04 10:54:47 -05:00
Zack Cerza
e786e16220 Add test for test_all_runs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
93b6fa10a7 Clarify job vs. run
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
f0604496e0 Create a FakeArchive class to forge test results
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
ff120d7fb5 Escape reserved characters in URIs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
77b65c7f3c Report results synchronously.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
f0b35fca70 Add more documentation.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-03 16:08:12 -05:00
Zack Cerza
058a27bf59 Add create_run() and push_job_info() with docs.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
fe64887ec6 s/submit_/report_/g
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
555e55ff61 Rename ResultsPoster to ResultsReporter
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
79e27abfe9 Add create_run; allow passing json to submit_job
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
52282fb7f4 Overhaul posting logic to avoid some corner cases
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
4bcae4b18b Add flag for refreshing already-pushed runs
Also tweak implementation of save_last_run

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
da4a7b860d Remove old method used for testing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
8b9a69138e Add --server flag
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
cf68a3ac3a Reuse connection objects.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
f77ee6e0ef Add argument parsing to make this a proper script.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00
Zack Cerza
e3e0775c0d A first pass at integration with paddles
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2013-10-02 18:34:04 -05:00