Commit Graph

2048 Commits

Author SHA1 Message Date
John Spray
79dfe2cbef tasks: Use '_' instead of '-' in names
Python modules are not allowed to contain hyphens
in the name.  Using hyphens only works here because
we're using low level __import__.

Change run_tasks to replace '-' with '_' when reading
configs, and rename the task modules to have valid
python module names.

Aside from general hygiene, the motivation to do this
is to allow one task to build on code in another
task by importing it.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-05-28 14:39:41 +01:00
Zack Cerza
d3c230071a Don't crash when an invalid branch is passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-22 12:26:50 -05:00
Zack Cerza
a6aebe2bbc Set results_server by default
So that queued jobs get pushed to paddles

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-22 08:49:26 -05:00
Zack Cerza
3b382b7011 Process queued jobs synchronously
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-21 16:18:00 -05:00
Zack Cerza
08ace5465e Add exception hook to teuthology-worker
Workers processes are dying occasionally, and this should cause the
exceptions to be logged.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-21 11:34:11 -05:00
Zack Cerza
d58d2c152e Merge pull request #258 from ceph/wip-fix-format-samba
Fixed formatting and added a better variable for time out
2014-05-19 18:33:22 -05:00
Yuri Weinstein
c8881bb7fa Fixed broken quotations
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-19 16:18:48 -07:00
Yuri Weinstein
6e893ad219 Fixed formatting and added a better variable for time out
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-19 16:03:30 -07:00
Samuel Just
216e5c9a80 task/: add populate_rbd_pool for quickly spinning up a pool with rbd stuff
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-05-19 15:04:54 -07:00
Samuel Just
8d9d724b7f ceph_manager: reset timeout if we are making progress in wait_for_recovery
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-05-19 14:10:20 -07:00
Zack Cerza
33dbffff1d Avoid calling yaml.safe_load() twice on each job
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-19 11:12:07 -05:00
Zack Cerza
debf84ed88 Split progress indicator out to separate functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-19 11:12:07 -05:00
Yuri Weinstein
a24218463d increased sleep to 100 as 90 seemed insufficient
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-19 08:11:20 -07:00
Yuri Weinstein
6eac0baf88 Added more logging
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-17 10:15:57 -07:00
Yuri Weinstein
686c01b58b Added sleep log info line
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-17 10:07:52 -07:00
Yuri Weinstein
1a503afff4 increased time wait to 90 sec so tests does not fail 2014-05-15 09:33:44 -07:00
Zack Cerza
d8c74392cd Add Pulpito links to teuthology emails
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-15 11:08:10 -05:00
Warren Usui
5dfc570004 Add missng docstrings to repair_test.py
Fixes: 6542
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-13 14:02:13 -07:00
Zack Cerza
010f83f19b Fix unit tests under Jenkins
os.getlogin() was throwing:
  OSError: [Errno 25] Inappropriate ioctl for device

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-13 13:09:04 -05:00
Zack Cerza
de32179028 Use VersionNotFoundError packages are missing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-13 10:21:18 -05:00
Zack Cerza
971c0652f5 Use config.archive_base if one isn't passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:25:31 -05:00
Zack Cerza
d945e56405 Add retries to orchestra.connection.connect()
This is an attempt to fix: http://tracker.ceph.com/issues/8314

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:09:30 -05:00
Zack Cerza
dfb2352d07 Fix typo
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:03:54 -05:00
Zack Cerza
2b8232a3f4 Better logging
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:03:54 -05:00
Zack Cerza
47f5d83519 Use try_mark_run_dead()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
456a1148b7 Add try_mark_run_dead()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
ad012469d1 Move list of exceptions to catch
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
756a6bfc93 Move "no results server" warning
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
e0e012659f Fix name parsing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:21 -05:00
Zack Cerza
b1859c7993 Merge pull request #255 from ceph/wip-6921-wusui
Allow .teuthology.yaml to set downburst path
2014-05-12 12:50:56 -05:00
Zack Cerza
0465bdbb13 Don't pass a custom logger anymore
We already use the hostname in command execution calls

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00
Zack Cerza
22b51be46c Use 'stderr' and 'stdout' as logger names
We were using just 'err' and 'out', which isn't very intuitive.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00
Zack Cerza
470f824c6b Catch any Unicode errors that manage to sneak in
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00
Zack Cerza
60bba80e41 Express hostnames as child logger names
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
a58174d752 Use Remote.user
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3e65d18261 Add Remote.user attribute
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3352b58d30 Use Remote.shortname in logs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
30d1d518d5 Make Remote.shortname actually short
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
36fe6a5830 Remote.hostname doesn't have to be a property
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
b2648b21af Fix PEP-8 issues
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
8567352360 Pass hostname to execute()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
429553053f Use 'true' instead of 'echo online'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
d0f7a47bf9 Add Remote.ensure_online()
If the connection is alive, do nothing. If not, reconnect. Allow any
exceptions to bubble up to the caller. This is intended to fix unhelpful
'Bad File Descriptor' errors we were seeing when VMs go down.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3adb7d4629 Use Remote.hostname in logs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
29d3299497 Consolidate log file setup into shared function
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Zack Cerza
5dbce8b68f Use Unicode format strings
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Zack Cerza
085c508fd4 Revert "Revert "Show hostname instead of IP in errors""
This reverts commit 10fee0e368750cf4cd953db5700df59c7f611119.

Conflicts:
	teuthology/orchestra/run.py
2014-05-10 09:10:21 -05:00
Warren Usui
b7a7383d75 Allow .teuthology.yaml to set downburst path
If .teuthology.yaml defines downburst, _get_downburst_exec()
now returns that value as the path to the downburst executable.

Also cleaned up code in create_if_vm.  ctx.downburst_conf was
never defined, so the code that handled the AttributeError
was always being executed.

Fixes: 6921

Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-09 17:20:26 -07:00
Zack Cerza
e2adb1fce1 Merge pull request #254 from ceph/wip-7707-wusui
Use master as default for debian upgrade.
2014-05-09 13:17:31 -05:00
Zack Cerza
8460c7a8d9 Force log lines to be interpreted as UTF-8
Any invalid UTF-8 byte will be replaced with a Unicode replacement
character: U+FFFD or '�'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-09 10:45:01 -05:00