Commit Graph

125 Commits

Author SHA1 Message Date
Greg Farnum
6ac6f7ab38 teuthology: convert from bzip2 to gzip.
gzip is much, much faster on large log files. With a 7.7GB client log, gzip
took 2:45 to compress it to 624MB. bzip2 took 34:38 to compress it to
366MB. For our purposes the space savings are not worth the time loss.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-29 10:35:02 -07:00
Sage Weil
277c4ff7aa set max_mds based on non-standbys 2011-07-28 10:25:30 -07:00
Sage Weil
5b0924494a tolerate named (not numbered) mons 2011-07-26 22:07:02 -07:00
Sage Weil
7c0f7c23c7 specify and clean up admin socket 2011-07-26 22:00:39 -07:00
Josh Durgin
271e066d6c Connect without using any known_hosts files. 2011-07-19 17:13:13 -07:00
Josh Durgin
8d196b001c Make targets a dictionary mapping hosts to ssh host keys. 2011-07-19 17:13:13 -07:00
Josh Durgin
ac5c1c41dd Add an overrides section for the ceph task.
This lets you run a suite against a particular version of ceph, or
with special debug settings.
2011-07-15 17:15:12 -07:00
Josh Durgin
9721e33457 Better interface for running functions in parallel. 2011-07-14 14:39:50 -07:00
Josh Durgin
b99e33f00c Download ceph binaries in parallel. 2011-07-13 14:02:46 -07:00
Josh Durgin
3e2c6c6cac Run workunits on different clients in parallel. 2011-07-13 14:02:46 -07:00
Josh Durgin
a282991bed Download and run autotests on multiple clients in parallel.
These clients must still be on different machines,
or they'll clobber each other's results.
2011-07-13 14:02:43 -07:00
Tommi Virtanen
c88ef9e7f7 Merge branch 'localdir'
Conflicts:
	teuthology/task/ceph.py
2011-07-13 12:38:12 -07:00
Tommi Virtanen
127ef6861c Feed locally-created binary tarball to remotes in parallel.
This should be faster as long as we have the bandwidth for it.
2011-07-13 12:34:39 -07:00
Tommi Virtanen
aee944229e Use a nameless tempfile for local tarball, avoids cleanup. 2011-07-13 12:18:55 -07:00
Tommi Virtanen
f52df63bce More careful error checking, avoid need for shell quoting. 2011-07-13 12:07:36 -07:00
Tommi Virtanen
e7618a6750 Clean up tarball tmpdir in all cases.
Prefer shutil.rmtree over os.system('rm -rf ...').
2011-07-13 11:32:28 -07:00
Tommi Virtanen
c701fe500c Use tempfile instead of ad hoc temp dir creation. 2011-07-13 10:58:01 -07:00
Tommi Virtanen
3547eba712 Avoid identifier clash with builtin "dir". 2011-07-13 10:17:04 -07:00
Sage Weil
8f3d56ade5 include sha1 in summary
Redundant (there's also a ceph-sha1 file), but convenient.
2011-07-11 20:32:44 -07:00
Josh Durgin
1edd435e8c Clean up from pyflakes. 2011-07-11 18:07:40 -07:00
Josh Durgin
5fadb1c11c Whitespace and style cleanup. 2011-07-11 18:07:37 -07:00
Josh Durgin
e69cf0b1b7 Success of test may not have been set yet. 2011-07-11 18:00:12 -07:00
Greg Farnum
f92b3a1cca add locktest task
This will retrieve xfstests' locktest and run it on two clients.

I still need to tweak this so the logging output we get is more useful, and
so that we test extra features like wait locks, but it does execute.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-11 16:45:02 -07:00
Greg Farnum
38ad4d1bf1 task ceph: distribute monmap to all nodes, not just mons.
And clean up the monmap, too!
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-11 16:45:02 -07:00
Josh Durgin
28f19a4104 Add an option to keep machines locked if a test fails. 2011-07-11 16:23:05 -07:00
Sage Weil
2f35eddb27 clean up locked machine list 2011-07-11 15:28:15 -07:00
Sage Weil
91c6f351a1 tell user which machines you locked 2011-07-11 14:39:21 -07:00
Sage Weil
a8d4901fe6 make connect work if no roles are specified
This is useful for -nuke.
2011-07-11 14:23:31 -07:00
Josh Durgin
fd30ed76bf Add --block option to retry until machines are locked.
If there are not enough machines up, fail immediately.
2011-07-07 16:15:18 -07:00
Josh Durgin
a55d2eb53a Read lock server from ~/teuthology.yaml. 2011-07-07 12:35:11 -07:00
Josh Durgin
9bfca87980 Check that all machines are locked, and add an option to lock machines instead of providing targets. 2011-07-07 12:35:11 -07:00
Greg Farnum
4fcecf0184 task ceph: set_max_mds so multiple MDS nodes are used
The current check will be insufficient when we handle standby-replays,
standbys, etc, but it's a lot better than the current situation where
it starts up all the daemons but only one is active!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-06 16:45:57 -07:00
Greg Farnum
850f337fc9 workunits task: clean up properly if there's an error.
Previously it would fail out and leave the workunits directory, causing
final cleanup to fail.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-06 16:45:57 -07:00
Tommi Virtanen
9655042d4b Skip s3-tests marked fails_on_rgw, they will fail anyway. 2011-07-06 14:17:24 -07:00
Tommi Virtanen
3665f7530a The shell exits after the command, hence there is no need for pushd/popd. 2011-07-06 14:15:51 -07:00
Josh Durgin
7ea8ecdc6b Don't set unix env vars in fastcgi env. 2011-07-06 11:40:25 -07:00
Sage Weil
7e603ceb61 adjust ceph.conf from yaml input 2011-07-05 16:47:00 -07:00
Josh Durgin
f80a2f69c6 Remove quotes from apache conf. 2011-07-05 16:48:00 -07:00
Josh Durgin
a3b42e6556 Let apache kill rgw.
It seems to be getting killed correctly now.
2011-07-05 16:38:21 -07:00
Josh Durgin
ba6545f8b7 Set LD_LIBRARY_PATH for rgw. 2011-07-05 16:32:41 -07:00
Sage Weil
d04256aa96 set flavor to 'local' if pushing from local src dir
always record in summary
2011-07-05 15:14:42 -07:00
Josh Durgin
003492a2d5 Retry connecting based on more error codes. 2011-07-05 13:48:26 -07:00
Josh Durgin
ae87abf333 Add s3tests task. 2011-07-01 16:18:59 -07:00
Josh Durgin
03a08eb392 Add rgw task with hardcoded apache config. 2011-07-01 16:18:59 -07:00
Tommi Virtanen
e697e4b8ee pyflakes cleanup. 2011-07-01 09:28:56 -07:00
Tommi Virtanen
2137da2cf3 Add final slash to path to enforce it being a dir. 2011-07-01 09:22:25 -07:00
Sage Weil
53fc6920b1 use local source dir for teuthology run
- ceph:
    path: /home/sage/ceph
...

This will 'make install' to a temp dir, tar it up, and ship that to the
target nodes.  A usr/local -> . symlink will be added if /usr/local isn't
there, to accommodate trees that /usr based autotools paths.
2011-07-01 09:09:39 -07:00
Josh Durgin
effee7ffc6 Make kernel a separate entity outside of tasks.
It is run before anything other than checking for conflicts.
This way it can't step on the connections used by other tasks,
or clobber test files in /tmp when rebooting.
2011-06-30 16:05:53 -07:00
Josh Durgin
4b1d536ab9 Don't recreate ctx.cluster when reconnecting after installing kernels. 2011-06-30 15:51:09 -07:00
Josh Durgin
6f86de4423 Save kernel version in summary instead of a separate file. 2011-06-30 15:48:43 -07:00