Commit Graph

2320 Commits

Author SHA1 Message Date
Zack Cerza
3e65d18261 Add Remote.user attribute
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3352b58d30 Use Remote.shortname in logs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
30d1d518d5 Make Remote.shortname actually short
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
36fe6a5830 Remote.hostname doesn't have to be a property
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
b2648b21af Fix PEP-8 issues
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
8567352360 Pass hostname to execute()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
429553053f Use 'true' instead of 'echo online'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
d0f7a47bf9 Add Remote.ensure_online()
If the connection is alive, do nothing. If not, reconnect. Allow any
exceptions to bubble up to the caller. This is intended to fix unhelpful
'Bad File Descriptor' errors we were seeing when VMs go down.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
3adb7d4629 Use Remote.hostname in logs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Zack Cerza
29d3299497 Consolidate log file setup into shared function
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Zack Cerza
5dbce8b68f Use Unicode format strings
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:21 -05:00
Zack Cerza
085c508fd4 Revert "Revert "Show hostname instead of IP in errors""
This reverts commit 10fee0e368.

Conflicts:
	teuthology/orchestra/run.py
2014-05-10 09:10:21 -05:00
Zack Cerza
e2adb1fce1 Merge pull request #254 from ceph/wip-7707-wusui
Use master as default for debian upgrade.
2014-05-09 13:17:31 -05:00
Zack Cerza
8460c7a8d9 Force log lines to be interpreted as UTF-8
Any invalid UTF-8 byte will be replaced with a Unicode replacement
character: U+FFFD or '�'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-09 10:45:01 -05:00
Zack Cerza
cd7f268d9d Use binary flag for paramiko ChannelFiles
This works around http://tracker.ceph.com/issues/8313

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-09 09:24:22 -05:00
Warren Usui
c0ba105453 Use master as default for debian upgrade.
Make sure that uri is defined for debian upgrades.
Use master as default.

Added _get_uri_() which consolidates checking and assignment of
sha1, tags, and branch values.

Fixes: 7707
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-08 19:12:16 -07:00
Zack Cerza
b4508a0848 Merge pull request #253 from ceph/wip-7510-wusui
Further clarify 'too many values to unpack' error.
2014-05-08 13:47:35 -05:00
Warren Usui
6fbf98bb0c Further clarify 'too many values to unpack' error.
Many errors in yaml configurations cause ValueError to get thrown
with the message 'too many values to unpack.'  A previously reverted
change tried to handle all these situations and print an appropriate
message.

The current behavior of throwing the ValueError exception and exiting
is probably what we still want in these cases.  So instead of handling
the error, the code now checks for the exception at the top-most call
and displays appropriate messages in log.error and in the ctx.summary
data itself.

Fixes: 7510
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-08 10:57:06 -07:00
Josh Durgin
bca32ef54b Merge pull request #252 from ceph/wip-fsx-krbd
rbd_fsx: expose krbd and related fsx options

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-07 18:14:54 -07:00
Zack Cerza
bb170c1bf7 Merge pull request #249 from ceph/wip-8284
rados.py: Add pool_snaps option for ceph_test_rados test command
2014-05-07 13:20:40 -05:00
Ilya Dryomov
b105a07ac6 rbd_fsx: expose krbd and related fsx options
Expose

-K (enable krbd mode) through 'krbd',
-Z (use direct IO) through 'direct_io',
-U (disable randomized striping) through 'randomized_striping',
-H (disable discard ops) through 'punch_holes',

-r readbdy (read alignment) through 'readbdy',
-w writebdy (write alignment) through 'writebdy',
-h holebdy (discard alignment) through 'holebdy'.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-05-07 17:55:09 +04:00
Zack Cerza
a1838b2a0f Rewrite most file-retrieval functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-06 14:59:52 -05:00
Zack Cerza
01cf3671b4 Fix linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-06 14:59:52 -05:00
Warren Usui
8bed6ab625 FIx mktemp dir and redundant Paramiko connecting.
Use previously initialized connection for sftp_get calls.
Use local directory for tarball temp file location.
2014-05-06 14:59:52 -05:00
Warren Usui
36b07b8aee Use SFTPClienti get for long reads/writes
Modified remote.py to use the paramiko SFTPClient get
method to extract long files (mostly tar files) from
the remote host.  The code formerly saved the data
in a long local string which was very inefficient.

Fixes: 8261
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-06 14:59:52 -05:00
Zack Cerza
091d1fe48d Revert "Revert "Clean up remote.py and misc.py changes.""
This reverts commit 02504c3fd2.
2014-05-06 14:59:52 -05:00
Zack Cerza
0268487057 Revert "Revert "Handle raw data I/O.""
This reverts commit 0c8a3e2334.
2014-05-06 14:59:51 -05:00
Zack Cerza
38578b8034 Revert "Restrict paramiko to old versions for now"
This reverts commit c86df77aa6.
2014-05-06 14:59:51 -05:00
Sandon Van Ness
7b1eec94f1 Use longer varchar for locked_by in DB.
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-05-06 12:06:56 -07:00
David Zafman
ea3bef1e1d rados.py: Add pool_snaps option for ceph_test_rados test command
Fixes: #8284

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-05-06 10:30:36 -07:00
Zack Cerza
bdd1b5acf2 Merge pull request #251 from ceph/wip-8295
rgw: fix indentation for cache_pools
2014-05-06 11:34:04 -05:00
Sage Weil
4ad23dc5f8 rgw: fix indentation for cache_pools
Fixes: #8295
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-06 09:22:49 -07:00
Josh Durgin
d158c156ff Merge pull request #250 from ceph/wip-fix-thrasher
ceph_manager: reset osd weights to 1 when waiting for clean

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-05 17:20:19 -07:00
Sage Weil
33b4bfc764 ceph_manager: reset osd weights to 1 when waiting for clean
If we leave the weights adjusted, we can get PGs stuck in a remapped state
because we are probabilistically rejecting placement.  Avoid this by
setting on in osds to 1.0 before waiting for clean.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-05 17:05:10 -07:00
Zack Cerza
c86df77aa6 Restrict paramiko to old versions for now
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-05 13:10:42 -05:00
Zack Cerza
0c8a3e2334 Revert "Handle raw data I/O."
This reverts commit 257e1459fa.
2014-05-05 10:03:29 -05:00
Zack Cerza
02504c3fd2 Revert "Clean up remote.py and misc.py changes."
This reverts commit 74eff43ee1.
2014-05-05 10:03:18 -05:00
Sage Weil
794c9465da ceph_manager: fix float stringification
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-03 07:24:32 -07:00
Sage Weil
a723ddf5db ceph_manager: fix typo
From ce7fa1839f. Tested this time.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-02 21:18:38 -07:00
Josh Durgin
7a46469fc4 Merge pull request #248 from ceph/wip-thrash-osd-weights
ceph_manager: randomly reweight in osds

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-02 17:06:54 -07:00
Sage Weil
ce7fa1839f ceph_manager: randomly reweight in osds
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-02 16:32:53 -07:00
Zack Cerza
5844c23eb1 Bump paramiko to 1.12.0
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-02 11:48:08 -05:00
Sage Weil
c5da7b21f7 rgw: option to create a cache pool
64mb for now!

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-01 14:36:26 -07:00
Alfredo Deza
f74eea7b9e Merge pull request #247 from ceph/requests-sessions
Use a requests.Session object for retries instead of safe_while
2014-05-01 13:17:00 -04:00
Zack Cerza
d1b93530b3 Add branch name to job config
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-01 11:48:54 -05:00
Zack Cerza
ab9645f97b Add suite name to job config
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-01 11:25:36 -05:00
Zack Cerza
ba66c6ba8a Add /build and /*.yaml to gitignore
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-01 11:25:19 -05:00
Zack Cerza
3fa6271f1a Calculate a timeout to use based on queue size
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-30 14:30:43 -05:00
Zack Cerza
041666b07a Add --runs, to print only run names
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-30 14:30:43 -05:00
Zack Cerza
a9d7aa3514 Refactor teuthology.beanstalk
This architecture will make it easier to add new functionality.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-30 14:30:43 -05:00