Commit Graph

2387 Commits

Author SHA1 Message Date
Sage Weil
33b4bfc764 ceph_manager: reset osd weights to 1 when waiting for clean
If we leave the weights adjusted, we can get PGs stuck in a remapped state
because we are probabilistically rejecting placement.  Avoid this by
setting on in osds to 1.0 before waiting for clean.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-05 17:05:10 -07:00
Zack Cerza
c86df77aa6 Restrict paramiko to old versions for now
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-05 13:10:42 -05:00
Zack Cerza
0c8a3e2334 Revert "Handle raw data I/O."
This reverts commit 257e1459fa.
2014-05-05 10:03:29 -05:00
Zack Cerza
02504c3fd2 Revert "Clean up remote.py and misc.py changes."
This reverts commit 74eff43ee1.
2014-05-05 10:03:18 -05:00
Sage Weil
794c9465da ceph_manager: fix float stringification
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-03 07:24:32 -07:00
Sage Weil
a723ddf5db ceph_manager: fix typo
From ce7fa1839f. Tested this time.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-02 21:18:38 -07:00
Josh Durgin
7a46469fc4 Merge pull request #248 from ceph/wip-thrash-osd-weights
ceph_manager: randomly reweight in osds

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-02 17:06:54 -07:00
Sage Weil
ce7fa1839f ceph_manager: randomly reweight in osds
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-02 16:32:53 -07:00
Zack Cerza
5844c23eb1 Bump paramiko to 1.12.0
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-02 11:48:08 -05:00
Sage Weil
c5da7b21f7 rgw: option to create a cache pool
64mb for now!

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-05-01 14:36:26 -07:00
Alfredo Deza
f74eea7b9e Merge pull request #247 from ceph/requests-sessions
Use a requests.Session object for retries instead of safe_while
2014-05-01 13:17:00 -04:00
Zack Cerza
d1b93530b3 Add branch name to job config
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-01 11:48:54 -05:00
Zack Cerza
ab9645f97b Add suite name to job config
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-01 11:25:36 -05:00
Zack Cerza
ba66c6ba8a Add /build and /*.yaml to gitignore
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-01 11:25:19 -05:00
Zack Cerza
3fa6271f1a Calculate a timeout to use based on queue size
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-30 14:30:43 -05:00
Zack Cerza
041666b07a Add --runs, to print only run names
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-30 14:30:43 -05:00
Zack Cerza
a9d7aa3514 Refactor teuthology.beanstalk
This architecture will make it easier to add new functionality.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-30 14:30:43 -05:00
Zack Cerza
adc51e1c69 Drop usage of safe_while
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-29 16:41:45 -05:00
Zack Cerza
ea9c034f3c Use the new ResultsReporter.session object
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-29 16:17:08 -05:00
Zack Cerza
ec72137e1b Add a requests.Session object to ResultsReporter
By default it is set up to retry requests 10 times

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-29 16:17:08 -05:00
Zack Cerza
61e469b632 Remove unused timeout arg to ResultsReporter init
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-29 16:17:07 -05:00
Zack Cerza
3f93d16897 Merge pull request #243 from ceph/wip-8116-wusui
Wip 8116 wusui
2014-04-29 16:16:27 -05:00
Warren Usui
74eff43ee1 Clean up remote.py and misc.py changes.
Fixed method names to be non-redundant (remote_mktemp in remote is
now just mktemp, for example), and made some parameters be more
self descriptive.  Added some docstrings.  Fixed sudo setting in
get_file method.

Made chmod independent of the actual sftp file getting.
Do not do extra file copy if non-sudo read is needed.
Fixed some parameter names. Made sure temp files are removed.
2014-04-29 16:14:11 -05:00
Warren Usui
257e1459fa Handle raw data I/O.
Paramiko 1.13.0 checks data in the Channel and fails if
invalid UTF-8 characters are sent.  The teuthology/misc.py
functions that piped cat output (get_file) and piped tar
output (pull_directory and pull_directory_tarball) formerly
did not work for Paramiko 1.13.0.

Code was changed to use SFTPClient to copy raw data.  The
remote_mktemp and function was changed to be a method of the
remote object.  Remote object methods to copy files and write
tar files were also added.

In misc.py, get_file() was changed to be a wrapper around the
remote object call.  Pull_directory() and pull_directory_tarball
were changed to use the remote object methods as well.

The remote methods used to send the data makes use of the
SFTPClient interface in Paramiko.

The remote_mktemp function was also modified slightly to insure
that new-lines do not appear in temp file names.

Fixes: 8116
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-29 16:14:11 -05:00
Zack Cerza
3faeb08db2 When deleting all of a run's jobs, delete the run
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-29 15:18:42 -05:00
Gregory Meno
5339c1f2ee Changes so these are not installed and still removed 2014-04-29 15:18:42 -05:00
Gregory Meno
ce778848a5 Changes invocation of serialize_remote_roles to internal task to avoid being run during nuke 2014-04-29 05:09:07 -07:00
Gregory Meno
1532af440e Moves node: remote mapping to the internal task. 2014-04-29 05:09:07 -07:00
Gregory Meno
d71a87452f These will likely go somewhere better before merge 2014-04-29 05:09:07 -07:00
Gregory Meno
063b6a27f2 Fixes #8050 Adds a cluster.yaml that is written by interactive task 2014-04-29 05:09:07 -07:00
Sage Weil
f261687f29 valgrind: fix tcmalloc suppression for trusty
Fixes: #8225
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-28 15:57:36 -07:00
Sage Weil
bab84d45ab Revert "valgrind.supp: be less picky about library versions"
This reverts commit f895d16c9e.
2014-04-28 15:57:36 -07:00
wusui
2ac27d8f13 Merge pull request #244 from ceph/wip-7199-wusui
Wip 7199 wusui
2014-04-28 11:02:07 -07:00
Warren Usui
694827bc0c Allow scrubbing while thrashing
Added ability to implement scrubbing while thrashing
(scrub_interval in config can be set to an interval
similar to how clean_interval is set).  Defaults to 0,
which indicates that no scrubbing will take place.
Add scrub_interval description to thrashosds docstring.

Fixes: 7199
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-28 11:00:38 -07:00
Zack Cerza
2cbe1dc0f8 Only attempt to use sudo if necessary 2014-04-28 11:12:29 -05:00
Zack Cerza
f102e4943d Post last_in_suite jobs, but delete when run
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-25 15:22:30 -05:00
Zack Cerza
5de353e73f Update unit test for Cluster.__repr__()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-25 15:01:41 -05:00
Zack Cerza
e6e287446a Fix Cluster.__repr__()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-25 11:36:43 -05:00
Zack Cerza
af209851e6 Don't push last_in_suite jobs to paddles
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-24 10:46:11 -05:00
Samuel Just
e64d8314ac task/: add tests for ec and rep mark_unfound_lost delete
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-04-22 17:39:29 -07:00
Zack Cerza
8350b6e490 Bump psutil version requirement
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-22 17:46:02 -05:00
Sandon Van Ness
9078513c0b Fix for #8115
Increase boot disk size per #8115 where monitors shut down due to
/ being full on vm machines.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-04-22 12:35:11 -07:00
Zack Cerza
1448cdf5fc Work around #8166
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-21 10:11:15 -05:00
Zack Cerza
007d975290 Require requests >= 1.0 2014-04-18 10:49:51 -05:00
Zack Cerza
0e90c69fd4 watch_tube() belongs to the beanstalk module
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-17 16:06:32 -05:00
Zack Cerza
e9a1c778f1 Update requests version
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-17 15:33:26 -05:00
Zack Cerza
5dbc64264e s/wait-for-package/wait_for_package/
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-17 15:03:37 -05:00
Alfredo Deza
5580ffb8ab Merge pull request #242 from ceph/wip-7773
Mirror beanstalkd queue in paddles
2014-04-17 15:40:59 -04:00
Zack Cerza
03b8cdac38 Refactor try_delete_jobs()
Also tweak its error message
2014-04-17 12:27:42 -05:00
Zack Cerza
d12e6f4e00 Be slightly less verbose about logging
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-04-17 12:27:41 -05:00