RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-15 15:32:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,296 Commits 216 Branches 394 Tags 1.6 GiB
8bed6ab625
Commit Graph

1989 Commits

Author SHA1 Message Date
Warren Usui
8bed6ab625 FIx mktemp dir and redundant Paramiko connecting. 
Use previously initialized connection for sftp_get calls.
Use local directory for tarball temp file location.
 2014-05-06 14:59:52 -05:00
Warren Usui
36b07b8aee Use SFTPClienti get for long reads/writes 
Modified remote.py to use the paramiko SFTPClient get
method to extract long files (mostly tar files) from
the remote host.  The code formerly saved the data
in a long local string which was very inefficient.

Fixes: 8261
Signed-off-by: Warren Usui <warren.usui@inktank.com>
 2014-05-06 14:59:52 -05:00
Zack Cerza
091d1fe48d Revert "Revert "Clean up remote.py and misc.py changes."" 
This reverts commit 02504c3fd2.
 2014-05-06 14:59:52 -05:00
Zack Cerza
0268487057 Revert "Revert "Handle raw data I/O."" 
This reverts commit 0c8a3e2334.
 2014-05-06 14:59:51 -05:00
Sandon Van Ness
7b1eec94f1 Use longer varchar for locked_by in DB. 
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
 2014-05-06 12:06:56 -07:00
Sage Weil
4ad23dc5f8 rgw: fix indentation for cache_pools 
Fixes: #8295
Signed-off-by: Sage Weil <sage@inktank.com>
 2014-05-06 09:22:49 -07:00
Sage Weil
33b4bfc764 ceph_manager: reset osd weights to 1 when waiting for clean 
If we leave the weights adjusted, we can get PGs stuck in a remapped state
because we are probabilistically rejecting placement.  Avoid this by
setting on in osds to 1.0 before waiting for clean.

Signed-off-by: Sage Weil <sage@inktank.com>
 2014-05-05 17:05:10 -07:00
Zack Cerza
0c8a3e2334 Revert "Handle raw data I/O." 
This reverts commit 257e1459fa.
 2014-05-05 10:03:29 -05:00
Zack Cerza
02504c3fd2 Revert "Clean up remote.py and misc.py changes." 
This reverts commit 74eff43ee1.
 2014-05-05 10:03:18 -05:00
Sage Weil
794c9465da ceph_manager: fix float stringification 
Signed-off-by: Sage Weil <sage@inktank.com>
 2014-05-03 07:24:32 -07:00
Sage Weil
a723ddf5db ceph_manager: fix typo 
From ce7fa1839f. Tested this time.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2014-05-02 21:18:38 -07:00
Sage Weil
ce7fa1839f ceph_manager: randomly reweight in osds 
Signed-off-by: Sage Weil <sage@inktank.com>
 2014-05-02 16:32:53 -07:00
Sage Weil
c5da7b21f7 rgw: option to create a cache pool 
64mb for now!

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
 2014-05-01 14:36:26 -07:00
Alfredo Deza
f74eea7b9e Merge pull request #247 from ceph/requests-sessions 
Use a requests.Session object for retries instead of safe_while
 2014-05-01 13:17:00 -04:00
Zack Cerza
3fa6271f1a Calculate a timeout to use based on queue size 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-30 14:30:43 -05:00
Zack Cerza
041666b07a Add --runs, to print only run names 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-30 14:30:43 -05:00
Zack Cerza
a9d7aa3514 Refactor teuthology.beanstalk 
This architecture will make it easier to add new functionality.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-30 14:30:43 -05:00
Zack Cerza
adc51e1c69 Drop usage of safe_while 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-29 16:41:45 -05:00
Zack Cerza
ea9c034f3c Use the new ResultsReporter.session object 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-29 16:17:08 -05:00
Zack Cerza
ec72137e1b Add a requests.Session object to ResultsReporter 
By default it is set up to retry requests 10 times

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-29 16:17:08 -05:00
Zack Cerza
61e469b632 Remove unused timeout arg to ResultsReporter init 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-29 16:17:07 -05:00
Warren Usui
74eff43ee1 Clean up remote.py and misc.py changes. 
Fixed method names to be non-redundant (remote_mktemp in remote is
now just mktemp, for example), and made some parameters be more
self descriptive.  Added some docstrings.  Fixed sudo setting in
get_file method.

Made chmod independent of the actual sftp file getting.
Do not do extra file copy if non-sudo read is needed.
Fixed some parameter names. Made sure temp files are removed.
 2014-04-29 16:14:11 -05:00
Warren Usui
257e1459fa Handle raw data I/O. 
Paramiko 1.13.0 checks data in the Channel and fails if
invalid UTF-8 characters are sent.  The teuthology/misc.py
functions that piped cat output (get_file) and piped tar
output (pull_directory and pull_directory_tarball) formerly
did not work for Paramiko 1.13.0.

Code was changed to use SFTPClient to copy raw data.  The
remote_mktemp and function was changed to be a method of the
remote object.  Remote object methods to copy files and write
tar files were also added.

In misc.py, get_file() was changed to be a wrapper around the
remote object call.  Pull_directory() and pull_directory_tarball
were changed to use the remote object methods as well.

The remote methods used to send the data makes use of the
SFTPClient interface in Paramiko.

The remote_mktemp function was also modified slightly to insure
that new-lines do not appear in temp file names.

Fixes: 8116
Signed-off-by: Warren Usui <warren.usui@inktank.com>
 2014-04-29 16:14:11 -05:00
Zack Cerza
3faeb08db2 When deleting all of a run's jobs, delete the run 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-29 15:18:42 -05:00
Gregory Meno
5339c1f2ee Changes so these are not installed and still removed 2014-04-29 15:18:42 -05:00
Gregory Meno
ce778848a5 Changes invocation of serialize_remote_roles to internal task to avoid being run during nuke 2014-04-29 05:09:07 -07:00
Gregory Meno
1532af440e Moves node: remote mapping to the internal task. 2014-04-29 05:09:07 -07:00
Gregory Meno
d71a87452f These will likely go somewhere better before merge 2014-04-29 05:09:07 -07:00
Gregory Meno
063b6a27f2 Fixes #8050 Adds a cluster.yaml that is written by interactive task 2014-04-29 05:09:07 -07:00
Sage Weil
f261687f29 valgrind: fix tcmalloc suppression for trusty 
Fixes: #8225
Signed-off-by: Sage Weil <sage@inktank.com>
 2014-04-28 15:57:36 -07:00
Sage Weil
bab84d45ab Revert "valgrind.supp: be less picky about library versions" 
This reverts commit f895d16c9e.
 2014-04-28 15:57:36 -07:00
Warren Usui
694827bc0c Allow scrubbing while thrashing 
Added ability to implement scrubbing while thrashing
(scrub_interval in config can be set to an interval
similar to how clean_interval is set).  Defaults to 0,
which indicates that no scrubbing will take place.
Add scrub_interval description to thrashosds docstring.

Fixes: 7199
Signed-off-by: Warren Usui <warren.usui@inktank.com>
 2014-04-28 11:00:38 -07:00
Zack Cerza
2cbe1dc0f8 Only attempt to use sudo if necessary 2014-04-28 11:12:29 -05:00
Zack Cerza
f102e4943d Post last_in_suite jobs, but delete when run 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-25 15:22:30 -05:00
Zack Cerza
5de353e73f Update unit test for Cluster.__repr__() 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-25 15:01:41 -05:00
Zack Cerza
e6e287446a Fix Cluster.__repr__() 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-25 11:36:43 -05:00
Zack Cerza
af209851e6 Don't push last_in_suite jobs to paddles 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-24 10:46:11 -05:00
Samuel Just
e64d8314ac task/: add tests for ec and rep mark_unfound_lost delete 
Signed-off-by: Samuel Just <sam.just@inktank.com>
 2014-04-22 17:39:29 -07:00
Sandon Van Ness
9078513c0b Fix for #8115 
Increase boot disk size per #8115 where monitors shut down due to
/ being full on vm machines.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
 2014-04-22 12:35:11 -07:00
Zack Cerza
1448cdf5fc Work around #8166 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-21 10:11:15 -05:00
Zack Cerza
0e90c69fd4 watch_tube() belongs to the beanstalk module 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 16:06:32 -05:00
Zack Cerza
e9a1c778f1 Update requests version 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 15:33:26 -05:00
Zack Cerza
5dbc64264e s/wait-for-package/wait_for_package/ 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 15:03:37 -05:00
Zack Cerza
03b8cdac38 Refactor try_delete_jobs() 
Also tweak its error message
 2014-04-17 12:27:42 -05:00
Zack Cerza
d12e6f4e00 Be slightly less verbose about logging 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 12:27:41 -05:00
Zack Cerza
741c773be6 Look for archive_base in config 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 12:27:41 -05:00
Zack Cerza
ee33192f70 When deleting jobs, also delete them from paddles 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 12:27:41 -05:00
Zack Cerza
8fdea4d132 Submit queued jobs to paddles 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 12:27:41 -05:00
Zack Cerza
8a4de411a6 Rename teuthology.queue to teuthology.worker 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 12:27:41 -05:00
Zack Cerza
1449e753ab Use shared methods to connect to beanstalkd 
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
 2014-04-17 12:27:41 -05:00