Commit Graph

1255 Commits

Author SHA1 Message Date
Zack Cerza
0465bdbb13 Don't pass a custom logger anymore
We already use the hostname in command execution calls

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00
Zack Cerza
a58174d752 Use Remote.user
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:22 -05:00
Warren Usui
c0ba105453 Use master as default for debian upgrade.
Make sure that uri is defined for debian upgrades.
Use master as default.

Added _get_uri_() which consolidates checking and assignment of
sha1, tags, and branch values.

Fixes: 7707
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-08 19:12:16 -07:00
Josh Durgin
bca32ef54b Merge pull request #252 from ceph/wip-fsx-krbd
rbd_fsx: expose krbd and related fsx options

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-07 18:14:54 -07:00
Zack Cerza
bb170c1bf7 Merge pull request #249 from ceph/wip-8284
rados.py: Add pool_snaps option for ceph_test_rados test command
2014-05-07 13:20:40 -05:00
Ilya Dryomov
b105a07ac6 rbd_fsx: expose krbd and related fsx options
Expose

-K (enable krbd mode) through 'krbd',
-Z (use direct IO) through 'direct_io',
-U (disable randomized striping) through 'randomized_striping',
-H (disable discard ops) through 'punch_holes',

-r readbdy (read alignment) through 'readbdy',
-w writebdy (write alignment) through 'writebdy',
-h holebdy (discard alignment) through 'holebdy'.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-05-07 17:55:09 +04:00
Zack Cerza
091d1fe48d Revert "Revert "Clean up remote.py and misc.py changes.""
This reverts commit 02504c3fd2.
2014-05-06 14:59:52 -05:00
Zack Cerza
0268487057 Revert "Revert "Handle raw data I/O.""
This reverts commit 0c8a3e2334.
2014-05-06 14:59:51 -05:00
David Zafman
ea3bef1e1d rados.py: Add pool_snaps option for ceph_test_rados test command
Fixes: #8284

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-05-06 10:30:36 -07:00
Sage Weil
4ad23dc5f8 rgw: fix indentation for cache_pools
Fixes: #8295
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-06 09:22:49 -07:00
Sage Weil
33b4bfc764 ceph_manager: reset osd weights to 1 when waiting for clean
If we leave the weights adjusted, we can get PGs stuck in a remapped state
because we are probabilistically rejecting placement.  Avoid this by
setting on in osds to 1.0 before waiting for clean.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-05 17:05:10 -07:00
Zack Cerza
0c8a3e2334 Revert "Handle raw data I/O."
This reverts commit 257e1459fa.
2014-05-05 10:03:29 -05:00
Zack Cerza
02504c3fd2 Revert "Clean up remote.py and misc.py changes."
This reverts commit 74eff43ee1.
2014-05-05 10:03:18 -05:00
Sage Weil
794c9465da ceph_manager: fix float stringification
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-03 07:24:32 -07:00
Sage Weil
a723ddf5db ceph_manager: fix typo
From ce7fa1839f. Tested this time.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-02 21:18:38 -07:00
Sage Weil
ce7fa1839f ceph_manager: randomly reweight in osds
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-02 16:32:53 -07:00
Sage Weil
c5da7b21f7 rgw: option to create a cache pool
64mb for now!

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-01 14:36:26 -07:00
Warren Usui
74eff43ee1 Clean up remote.py and misc.py changes.
Fixed method names to be non-redundant (remote_mktemp in remote is
now just mktemp, for example), and made some parameters be more
self descriptive.  Added some docstrings.  Fixed sudo setting in
get_file method.

Made chmod independent of the actual sftp file getting.
Do not do extra file copy if non-sudo read is needed.
Fixed some parameter names. Made sure temp files are removed.
2014-04-29 16:14:11 -05:00
Warren Usui
257e1459fa Handle raw data I/O.
Paramiko 1.13.0 checks data in the Channel and fails if
invalid UTF-8 characters are sent.  The teuthology/misc.py
functions that piped cat output (get_file) and piped tar
output (pull_directory and pull_directory_tarball) formerly
did not work for Paramiko 1.13.0.

Code was changed to use SFTPClient to copy raw data.  The
remote_mktemp and function was changed to be a method of the
remote object.  Remote object methods to copy files and write
tar files were also added.

In misc.py, get_file() was changed to be a wrapper around the
remote object call.  Pull_directory() and pull_directory_tarball
were changed to use the remote object methods as well.

The remote methods used to send the data makes use of the
SFTPClient interface in Paramiko.

The remote_mktemp function was also modified slightly to insure
that new-lines do not appear in temp file names.

Fixes: 8116
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-29 16:14:11 -05:00
Gregory Meno
5339c1f2ee Changes so these are not installed and still removed 2014-04-29 15:18:42 -05:00
Gregory Meno
ce778848a5 Changes invocation of serialize_remote_roles to internal task to avoid being run during nuke 2014-04-29 05:09:07 -07:00
Gregory Meno
1532af440e Moves node: remote mapping to the internal task. 2014-04-29 05:09:07 -07:00
Gregory Meno
d71a87452f These will likely go somewhere better before merge 2014-04-29 05:09:07 -07:00
Gregory Meno
063b6a27f2 Fixes #8050 Adds a cluster.yaml that is written by interactive task 2014-04-29 05:09:07 -07:00
Sage Weil
f261687f29 valgrind: fix tcmalloc suppression for trusty
Fixes: #8225
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-28 15:57:36 -07:00
Sage Weil
bab84d45ab Revert "valgrind.supp: be less picky about library versions"
This reverts commit f895d16c9e.
2014-04-28 15:57:36 -07:00
Warren Usui
694827bc0c Allow scrubbing while thrashing
Added ability to implement scrubbing while thrashing
(scrub_interval in config can be set to an interval
similar to how clean_interval is set).  Defaults to 0,
which indicates that no scrubbing will take place.
Add scrub_interval description to thrashosds docstring.

Fixes: 7199
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-28 11:00:38 -07:00
Samuel Just
e64d8314ac task/: add tests for ec and rep mark_unfound_lost delete
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-04-22 17:39:29 -07:00
Zack Cerza
e9a1c778f1 Update requests version
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-17 15:33:26 -05:00
Zack Cerza
5dbc64264e s/wait-for-package/wait_for_package/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-17 15:03:37 -05:00
Zack Cerza
8b93c03fc9 Generate subtasks instead of copy/pasting them
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-16 09:45:07 -05:00
Zack Cerza
761d76937d Don't run apache functions if not using apache
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-16 09:45:07 -05:00
Zack Cerza
089dda1599 Optionally use civetweb instead of apache
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-16 09:45:07 -05:00
Zack Cerza
823219bb27 Don't pass apache's config to radosgw
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-15 14:28:04 -05:00
Zack Cerza
12af2abb4c Rename some functions and variables
This is to make the refactoring a little smoother and easier to read.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-15 13:12:00 -05:00
Zack Cerza
f82f663782 Fix all but one of the PEP-8 issues
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-15 10:58:36 -05:00
Warren Usui
eef2bf672b Fix kvm issues for Trusty
Change kvm reference to qemu-system-x86_64 and use raw format
in kvm/qemu command.  Tested on both Trusty and Precise.

Fixes: 7825
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-14 16:07:27 -07:00
Alfredo Deza
15a3acb713 fix redefinition of region
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-04-09 16:26:47 -04:00
Zack Cerza
addfed2da8 When ignoring a raised exception, at least log it
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-03-31 17:46:27 -05:00
Sage Weil
f895d16c9e valgrind.supp: be less picky about library versions
...so that this works on trusty

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-29 09:39:46 -07:00
Josh Durgin
dfdeb5c3c0 radosgw-agent: coerce max-entries config to a string
This is necessary to pass it as a command line argument.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-27 17:22:00 -07:00
Yehuda Sadeh
b6ad5c6ce2 rgw: idle timeout config moves to the external server line
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-03-27 10:24:00 -07:00
Zack Cerza
158f9ba1ff Revert "Lines formerly of the form '(remote,) = ctx.cluster.only(role).remotes.keys()'"
This reverts commit d693b3f895.
2014-03-27 11:35:28 -05:00
Warren Usui
d693b3f895 Lines formerly of the form '(remote,) = ctx.cluster.only(role).remotes.keys()'
and '(remote,) = ctx.cluster.only(role).remotes.iterkeys()' would fail with
ValueError and no message if there were less than 0 or more than 1 key.
Now a new function, get_single_remote_value() is called which prints out
more understandable messages.

Fixes: 7510
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-03-26 18:43:48 -07:00
Josh Durgin
b2cf052a08 rgw: allow overriding options
This is mainly useful for toggling ec/replicated pools right now.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-25 18:04:35 -07:00
Josh Durgin
812e48a148 radosgw-admin: skip data sync tests when only metadata is configured
Fixes http://tracker.ceph.com/issues/7818

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-25 14:57:50 -07:00
Josh Durgin
f89c0d59fb rgw: fix ec-data-pool config
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-25 14:57:50 -07:00
Josh Durgin
47ba1711d7 rgw: add option to use erasure coding instead of replication
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-24 18:19:41 -07:00
Josh Durgin
0cb00b1fb9 radosgw-agent: default to 1000 max entries
Using a small number of max entries is only needed for one test, so
make it configurable. Setting it too low makes s3tests fail.

Fixes http://tracker.ceph.com/issues/7742

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-24 14:54:36 -07:00
Josh Durgin
3e1683064c internal: cleaner fix for binary gibberish in logs
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-24 14:26:36 -07:00