Commit Graph

2343 Commits

Author SHA1 Message Date
Yuri Weinstein
1a503afff4 increased time wait to 90 sec so tests does not fail 2014-05-15 09:33:44 -07:00
Zack Cerza
d8c74392cd Add Pulpito links to teuthology emails
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-15 11:08:10 -05:00
Zack Cerza
c3dccbf29a Downgrade paramiko to work around an SFTP bug
See http://tracker.ceph.com/issues/8327

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-14 22:43:29 -05:00
Zack Cerza
c7d7abae2b Merge pull request #256 from ceph/wip-6542-wusui
Add missng docstrings to repair_test.py
2014-05-13 16:26:12 -05:00
Warren Usui
5dfc570004 Add missng docstrings to repair_test.py
Fixes: 6542
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-13 14:02:13 -07:00
Zack Cerza
010f83f19b Fix unit tests under Jenkins
os.getlogin() was throwing:
  OSError: [Errno 25] Inappropriate ioctl for device

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-13 13:09:04 -05:00
Zack Cerza
de32179028 Use VersionNotFoundError packages are missing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-13 10:21:18 -05:00
Zack Cerza
971c0652f5 Use config.archive_base if one isn't passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:25:31 -05:00
Zack Cerza
d945e56405 Add retries to orchestra.connection.connect()
This is an attempt to fix: http://tracker.ceph.com/issues/8314

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:09:30 -05:00
Zack Cerza
dfb2352d07 Fix typo
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:03:54 -05:00
Zack Cerza
2b8232a3f4 Better logging
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 16:03:54 -05:00
Zack Cerza
47f5d83519 Use try_mark_run_dead()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
456a1148b7 Add try_mark_run_dead()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
ad012469d1 Move list of exceptions to catch
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
756a6bfc93 Move "no results server" warning
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:38 -05:00
Zack Cerza
e0e012659f Fix name parsing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-12 12:57:21 -05:00
Zack Cerza
b1859c7993 Merge pull request #255 from ceph/wip-6921-wusui
Allow .teuthology.yaml to set downburst path
2014-05-12 12:50:56 -05:00
Zack Cerza
0465bdbb13 Don't pass a custom logger anymore
We already use the hostname in command execution calls

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00
Zack Cerza
22b51be46c Use 'stderr' and 'stdout' as logger names
We were using just 'err' and 'out', which isn't very intuitive.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00
Zack Cerza
470f824c6b Catch any Unicode errors that manage to sneak in
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00
Zack Cerza
60bba80e41 Express hostnames as child logger names
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
a58174d752 Use Remote.user
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3e65d18261 Add Remote.user attribute
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3352b58d30 Use Remote.shortname in logs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
30d1d518d5 Make Remote.shortname actually short
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
36fe6a5830 Remote.hostname doesn't have to be a property
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
b2648b21af Fix PEP-8 issues
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
8567352360 Pass hostname to execute()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
429553053f Use 'true' instead of 'echo online'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
d0f7a47bf9 Add Remote.ensure_online()
If the connection is alive, do nothing. If not, reconnect. Allow any
exceptions to bubble up to the caller. This is intended to fix unhelpful
'Bad File Descriptor' errors we were seeing when VMs go down.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3adb7d4629 Use Remote.hostname in logs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
29d3299497 Consolidate log file setup into shared function
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Zack Cerza
5dbce8b68f Use Unicode format strings
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Zack Cerza
085c508fd4 Revert "Revert "Show hostname instead of IP in errors""
This reverts commit 10fee0e368.

Conflicts:
	teuthology/orchestra/run.py
2014-05-10 09:10:21 -05:00
Warren Usui
b7a7383d75 Allow .teuthology.yaml to set downburst path
If .teuthology.yaml defines downburst, _get_downburst_exec()
now returns that value as the path to the downburst executable.

Also cleaned up code in create_if_vm.  ctx.downburst_conf was
never defined, so the code that handled the AttributeError
was always being executed.

Fixes: 6921

Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-09 17:20:26 -07:00
Zack Cerza
e2adb1fce1 Merge pull request #254 from ceph/wip-7707-wusui
Use master as default for debian upgrade.
2014-05-09 13:17:31 -05:00
Zack Cerza
8460c7a8d9 Force log lines to be interpreted as UTF-8
Any invalid UTF-8 byte will be replaced with a Unicode replacement
character: U+FFFD or '�'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-09 10:45:01 -05:00
Zack Cerza
cd7f268d9d Use binary flag for paramiko ChannelFiles
This works around http://tracker.ceph.com/issues/8313

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-09 09:24:22 -05:00
Warren Usui
c0ba105453 Use master as default for debian upgrade.
Make sure that uri is defined for debian upgrades.
Use master as default.

Added _get_uri_() which consolidates checking and assignment of
sha1, tags, and branch values.

Fixes: 7707
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-08 19:12:16 -07:00
Zack Cerza
b4508a0848 Merge pull request #253 from ceph/wip-7510-wusui
Further clarify 'too many values to unpack' error.
2014-05-08 13:47:35 -05:00
Warren Usui
6fbf98bb0c Further clarify 'too many values to unpack' error.
Many errors in yaml configurations cause ValueError to get thrown
with the message 'too many values to unpack.'  A previously reverted
change tried to handle all these situations and print an appropriate
message.

The current behavior of throwing the ValueError exception and exiting
is probably what we still want in these cases.  So instead of handling
the error, the code now checks for the exception at the top-most call
and displays appropriate messages in log.error and in the ctx.summary
data itself.

Fixes: 7510
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-08 10:57:06 -07:00
Josh Durgin
bca32ef54b Merge pull request #252 from ceph/wip-fsx-krbd
rbd_fsx: expose krbd and related fsx options

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-07 18:14:54 -07:00
Zack Cerza
bb170c1bf7 Merge pull request #249 from ceph/wip-8284
rados.py: Add pool_snaps option for ceph_test_rados test command
2014-05-07 13:20:40 -05:00
Ilya Dryomov
b105a07ac6 rbd_fsx: expose krbd and related fsx options
Expose

-K (enable krbd mode) through 'krbd',
-Z (use direct IO) through 'direct_io',
-U (disable randomized striping) through 'randomized_striping',
-H (disable discard ops) through 'punch_holes',

-r readbdy (read alignment) through 'readbdy',
-w writebdy (write alignment) through 'writebdy',
-h holebdy (discard alignment) through 'holebdy'.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-05-07 17:55:09 +04:00
Zack Cerza
a1838b2a0f Rewrite most file-retrieval functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-06 14:59:52 -05:00
Zack Cerza
01cf3671b4 Fix linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-06 14:59:52 -05:00
Warren Usui
8bed6ab625 FIx mktemp dir and redundant Paramiko connecting.
Use previously initialized connection for sftp_get calls.
Use local directory for tarball temp file location.
2014-05-06 14:59:52 -05:00
Warren Usui
36b07b8aee Use SFTPClienti get for long reads/writes
Modified remote.py to use the paramiko SFTPClient get
method to extract long files (mostly tar files) from
the remote host.  The code formerly saved the data
in a long local string which was very inefficient.

Fixes: 8261
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-06 14:59:52 -05:00
Zack Cerza
091d1fe48d Revert "Revert "Clean up remote.py and misc.py changes.""
This reverts commit 02504c3fd2.
2014-05-06 14:59:52 -05:00
Zack Cerza
0268487057 Revert "Revert "Handle raw data I/O.""
This reverts commit 0c8a3e2334.
2014-05-06 14:59:51 -05:00