Commit Graph

312 Commits

Author SHA1 Message Date
Josh Durgin
a3b42e6556 Let apache kill rgw.
It seems to be getting killed correctly now.
2011-07-05 16:38:21 -07:00
Josh Durgin
ba6545f8b7 Set LD_LIBRARY_PATH for rgw. 2011-07-05 16:32:41 -07:00
Sage Weil
d04256aa96 set flavor to 'local' if pushing from local src dir
always record in summary
2011-07-05 15:14:42 -07:00
Josh Durgin
003492a2d5 Retry connecting based on more error codes. 2011-07-05 13:48:26 -07:00
Sage Weil
2b168b033d nuke: do not escape fusermount .../mnt.* 2011-07-05 09:01:01 -07:00
Josh Durgin
ae87abf333 Add s3tests task. 2011-07-01 16:18:59 -07:00
Josh Durgin
03a08eb392 Add rgw task with hardcoded apache config. 2011-07-01 16:18:59 -07:00
Tommi Virtanen
6e73607147 More idiomatic Python. 2011-07-01 09:34:08 -07:00
Tommi Virtanen
ce041a525c summary is used outside the try: except:, move it outside it. 2011-07-01 09:33:06 -07:00
Tommi Virtanen
c1cd141b29 Only ignore ENOENT errors in teuthology-ls. 2011-07-01 09:32:30 -07:00
Tommi Virtanen
fdbf591cba Whitespace cleanup. 2011-07-01 09:29:19 -07:00
Tommi Virtanen
e697e4b8ee pyflakes cleanup. 2011-07-01 09:28:56 -07:00
Tommi Virtanen
2137da2cf3 Add final slash to path to enforce it being a dir. 2011-07-01 09:22:25 -07:00
Sage Weil
53fc6920b1 use local source dir for teuthology run
- ceph:
    path: /home/sage/ceph
...

This will 'make install' to a temp dir, tar it up, and ship that to the
target nodes.  A usr/local -> . symlink will be added if /usr/local isn't
there, to accommodate trees that /usr based autotools paths.
2011-07-01 09:09:39 -07:00
Josh Durgin
effee7ffc6 Make kernel a separate entity outside of tasks.
It is run before anything other than checking for conflicts.
This way it can't step on the connections used by other tasks,
or clobber test files in /tmp when rebooting.
2011-06-30 16:05:53 -07:00
Josh Durgin
4b1d536ab9 Don't recreate ctx.cluster when reconnecting after installing kernels. 2011-06-30 15:51:09 -07:00
Josh Durgin
6f86de4423 Save kernel version in summary instead of a separate file. 2011-06-30 15:48:43 -07:00
Josh Durgin
7b1b332264 Kernel task does not need to be a context manager. 2011-06-30 15:47:54 -07:00
Tommi Virtanen
e16556e377 Archive dir removal has to be unconditional.
Even when ctx.archive is False, ceph logging
need the destination directory exist, so
/tmp/cephtest/archive has to be created (and
thus removed) unconditionally.
2011-06-30 11:26:20 -07:00
Tommi Virtanen
cb4ffc3157 Use idiomatic python. 2011-06-30 11:25:15 -07:00
Sage Weil
7d57b355d8 teuthology-ls: summarize results from an archive-dir
ugly but basically works
2011-06-29 12:55:25 -07:00
Sage Weil
437631695d workunits: set LD_LIBRARY_PATH
Needed by rbd workunit to find librbd.so
2011-06-29 12:55:21 -07:00
Sage Weil
b95e61ae29 teuthology-nuke
Take in a full config (or just targets: portion) and do a destructive
cleanup.

Still need to clean up kernel mounts.
2011-06-29 12:23:44 -07:00
Sage Weil
2125e8dc1e include @hostname in owner 2011-06-29 12:09:38 -07:00
Sage Weil
770edc3a0b suite: set each run description to combination of facet names 2011-06-29 12:09:38 -07:00
Sage Weil
052f43c958 pass owner, optional description through to summary.yaml
Owner can be overridden explicitly, otherwise it's the running unix user.

The description is optional and passed straight through.
2011-06-29 12:09:38 -07:00
Sage Weil
bc91e1b580 workunits: set CEPH_ARGS so 'ceph' etc can find config 2011-06-29 10:57:35 -07:00
Sage Weil
a9a2733621 workunit: include ceph bin dir in path
Some workunits need these binaries (e.g. kclient/file_layout.sh needs
cephfs).

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-29 10:41:03 -07:00
Josh Durgin
79956538a4 Add kernel task for controlling kernel version for different roles. 2011-06-28 14:51:11 -07:00
Josh Durgin
0904ce550d Move get_clients method into misc to avoid duplication. 2011-06-28 14:51:11 -07:00
Sage Weil
256e6a2bbc tasks/clock: tolerate ntp daemon 2011-06-28 14:18:08 -07:00
Josh Durgin
e2e96b31ef Enable core dumps when running the rbd cli tool. 2011-06-22 17:40:58 -07:00
Josh Durgin
9eea6b9325 Handle rbd config with no properties. 2011-06-22 17:34:08 -07:00
Josh Durgin
122ed28638 Wait for rbd devices to be removed before removing the module. 2011-06-22 17:32:10 -07:00
Tommi Virtanen
efeac9f328 Add status logging into task rbd. 2011-06-22 16:36:25 -07:00
Tommi Virtanen
fb016548ad Wait for block device to show up in task rbd.dev_create. 2011-06-22 16:36:12 -07:00
Josh Durgin
c0482793cb Add combined rbd task that runs all the subparts. 2011-06-22 16:03:57 -07:00
Josh Durgin
789de09f8b Add rbd.mount method. 2011-06-22 16:03:57 -07:00
Josh Durgin
deb2fe5c81 Add rbd.mkfs method. 2011-06-22 16:03:57 -07:00
Josh Durgin
2d64461959 Add rbd -> /dev mapping method. 2011-06-22 16:03:57 -07:00
Josh Durgin
dfc3a85154 Add rbd modprobe method. 2011-06-22 16:03:57 -07:00
Josh Durgin
bd46d753e3 Add rbd task with create_image function. 2011-06-22 16:03:56 -07:00
Tommi Virtanen
1a68b6fbb4 Remove unused import. 2011-06-22 16:03:20 -07:00
Tommi Virtanen
b0c8b1d7b8 Ensure suite components are run in alphabetical order. 2011-06-22 16:03:20 -07:00
Josh Durgin
05e2ba9b15 Save the flavor of a run in the summary file. 2011-06-21 11:02:43 -07:00
Tommi Virtanen
330ec41ff7 Add teuthology-suite, to run multiple tests in a batch. 2011-06-21 10:00:16 -07:00
Tommi Virtanen
e481db1337 Archive syslog messages while the test was in progress. 2011-06-20 14:31:41 -07:00
Tommi Virtanen
bc8cc868f9 Fix bug that thought all >1 node clusters always had core dumps.
Accidentally shared the stdout between all the runs.
2011-06-20 14:31:41 -07:00
Tommi Virtanen
6a32f723a3 Autotests run no ceph software, so don't try to do code coverage there. 2011-06-17 16:01:26 -07:00
Tommi Virtanen
57c542b9e8 Archive cores dumped during test, record test as failed if any seen. 2011-06-17 16:00:39 -07:00
Tommi Virtanen
2738ce011e Better examples for kclient task. 2011-06-16 16:51:57 -07:00
Tommi Virtanen
4f46e4b7f6 Make cfuse and kclient default to all clients. 2011-06-16 16:09:50 -07:00
Tommi Virtanen
b49c7390cc Archive autotest result output. 2011-06-16 16:09:49 -07:00
Tommi Virtanen
5b237fc50e Support running multiple autotest tests.
Docs had this from the start, it was just buggy. Still
doesn't support using the "autotest" task more than once,
no easy way to differentiate the results in that case.
2011-06-16 16:09:49 -07:00
Sage Weil
cebf88d92a show role in log prefix when running workunits 2011-06-16 15:19:55 -07:00
Sage Weil
55cfd9298e fix typo in workunits example 2011-06-16 15:19:55 -07:00
Sage Weil
7fe89b795f add clock task to sync clocks 2011-06-16 15:19:55 -07:00
Tommi Virtanen
78a3c23418 Move non-ceph logic out of the ceph task: base dir, archive transfer. 2011-06-16 14:36:22 -07:00
Tommi Virtanen
301ab56748 Move non-ceph logic out of the ceph task: host in use check.
To avoid every config always listing basic tasks, we silently
add internal.* tasks in front of the task list.
2011-06-16 14:36:21 -07:00
Tommi Virtanen
629ad4477d Move /tmp/cephtest/data creation to where it belongs, in ceph.cluster. 2011-06-16 14:36:21 -07:00
Tommi Virtanen
594a3d3f04 Refactor ceph log handling into a separate subtask. 2011-06-16 14:36:21 -07:00
Tommi Virtanen
9353fcc931 Move summary inside context.
This will hopefully make run_tasks usable by tasks.
The ceph task can't use it yet, because it has its
yield inside the with nested statement.
2011-06-16 14:36:21 -07:00
Tommi Virtanen
445186b0a5 Refactor ceph healthy waiting into a separate subtask.
Note, not a context manager, just a task. There's no cleanup.
2011-06-16 14:36:21 -07:00
Tommi Virtanen
259eb35068 Refactor ceph mds daemon handling into a separate subtask. 2011-06-16 14:36:21 -07:00
Tommi Virtanen
2da2d258e9 Refactor ceph osd daemon handling into a separate subtask. 2011-06-16 11:34:42 -07:00
Tommi Virtanen
3fc00e3764 Refactor ceph mon daemon handling into a separate subtask. 2011-06-16 11:34:42 -07:00
Tommi Virtanen
574cfe98ab Remove the "ceph mds set_max_mds" call, apparently it's not needed.
We can always re-add it if and when it's useful.
2011-06-16 11:04:59 -07:00
Tommi Virtanen
eaba08fbf4 Add debug logging to contextutil.nested. 2011-06-16 10:39:26 -07:00
Tommi Virtanen
915a366a36 Refactor ceph cluster setup into a separate subtask. 2011-06-16 10:39:26 -07:00
Tommi Virtanen
14ddb419d6 Start splitting the ceph task into smaller units.
This lets them nicely have independent error handling;
an example case where that is desirable is that the
old code failed to archive the logs if one of the daemons
exited with an error.

This also means a config file might specify just some
of the smaller tasks, e.g. for a test that explicitly
wants to create operational error situations.

The diff looks big because of an indentation change,
use "git diff -b" for a smaller diff.
2011-06-16 10:39:26 -07:00
Josh Durgin
9746e77498 Allow running of any function in a task. 2011-06-16 10:39:26 -07:00
Josh Durgin
1dd25b4745 Add task for mounting with the kernel client. 2011-06-15 18:08:29 -07:00
Josh Durgin
9d70d04893 Add function to output a secret key to a file. 2011-06-15 18:06:57 -07:00
Josh Durgin
9d60344700 Output a summary file when archiving a run.
For now, just record whether the test succeeded.
2011-06-15 15:52:36 -07:00
Josh Durgin
98a8071935 Remove unused imports and variable. 2011-06-15 15:22:12 -07:00
Tommi Virtanen
1a20ba1121 Tee teuthology log into the archive directory, if archiving. 2011-06-15 12:32:22 -07:00
Tommi Virtanen
2bae22f0a3 Create the archive dir earlier, move out of ceph task. 2011-06-15 12:10:27 -07:00
Tommi Virtanen
faa855dd2e Add task for running ceph workunits, QA tests that expect cwd to be ceph mount. 2011-06-15 11:59:57 -07:00
Tommi Virtanen
e00b7fc6ad Clean up after an autotest run. 2011-06-15 11:51:16 -07:00
Tommi Virtanen
cd8f31db0f Write config.yaml directly to file. 2011-06-15 11:50:32 -07:00
Tommi Virtanen
d157e32393 Move imports to the top. 2011-06-15 11:49:04 -07:00
Josh Durgin
c49f9471f1 Archive teuthology config. 2011-06-14 17:53:19 -07:00
Samuel Just
883991a057 added thrashosds
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-06-13 17:01:02 -07:00
Samuel Just
398a333833 adding radosbench.py to tasks
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-06-13 17:00:43 -07:00
Samuel Just
5cbe10c3bb added testsnaps
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-06-10 14:42:52 -07:00
Josh Durgin
d09ae0b280 With coverage, use SIGTERM to make the daemons exit(0). 2011-06-10 11:24:26 -07:00
Josh Durgin
e52bb0cf07 Put all coverage data in the archive dir. 2011-06-10 11:17:11 -07:00
Josh Durgin
41e19f5ecb Initialize BASE before using it. 2011-06-10 11:12:49 -07:00
Tommi Virtanen
798f3cc68c Can now run specific ceph version based on sha1. 2011-06-09 17:17:47 -07:00
Tommi Virtanen
ae77af0847 Simplify ceph sha1 saving. No need to round-trip, store N copies. 2011-06-09 17:17:47 -07:00
Josh Durgin
2533edde83 Save ceph sha1 in coverage dir.
This is needed to postprocess the coverage data.
2011-06-09 17:17:47 -07:00
Tommi Virtanen
c45488c24c Show status message before gcov-style shutdown of daemons. 2011-06-09 17:17:47 -07:00
Tommi Virtanen
7c5eed2f90 Check daemon exit codes, even when using gcov. 2011-06-09 17:17:47 -07:00
Josh Durgin
43f37b8da2 Add coverage support. 2011-06-09 17:17:47 -07:00
Tommi Virtanen
f162f07edb Support ceph tarball "favors", that is different gitbuilders.
Use that for picking the gcov gitbuilder, when told to record code
coverage. Actual coverage support comes in the next commit.

Assuming all the world is a VA.. I mean amd64, for now.
2011-06-09 17:16:06 -07:00
Tommi Virtanen
f3757f76d8 Let ceph task config specify branch or tag to run. 2011-06-09 17:12:54 -07:00
Tommi Virtanen
4903d06a76 Archive everything written to the "archive" directory.
This avoids listing "log", "profiling-logger", etc individually.
Adding new types of archived files should just be a matter of
adding a subdirectory under "archive".
2011-06-09 17:10:11 -07:00
Tommi Virtanen
fcc73e0d1d Class loading no longer needs a temp dir. 2011-06-07 14:51:56 -07:00
Tommi Virtanen
e6ae6bddf3 Archive logs if given --archive=PATH. Clean up after a test run. 2011-06-07 14:47:30 -07:00
Tommi Virtanen
ce10d4f5e0 Add missing trailing commas.
Lists of strings where last item has no comma are just
traps waiting to hurt you when you add a new item at
the end.
2011-06-07 12:58:48 -07:00
Tommi Virtanen
c8ecd12949 Remove mountpoint after shutting down cfuse. 2011-06-06 15:38:20 -07:00
Tommi Virtanen
2b237882d6 First draft of documentation. 2011-06-06 14:22:49 -07:00
Tommi Virtanen
7f393379c1 Prettify exception handling.
Display exception type (e.g. "RuntimeError").

Don't re-display the traceback.
2011-06-03 14:49:05 -07:00
Tommi Virtanen
086076923d Remove dead code. 2011-06-03 14:48:09 -07:00
Tommi Virtanen
b6e22436f2 Prettify config debug printing. 2011-06-03 14:47:58 -07:00
Tommi Virtanen
57f979f177 Refactor for modularity.
New style: run "./virtualenv/bin/teuthology -v interactive.yaml".
2011-06-03 14:47:44 -07:00
Tommi Virtanen
3be4b482e5 Make autotest show debug messages.
Otherwise it's very quiet for a long time.
2011-06-03 09:40:55 -07:00
Tommi Virtanen
1634f3e4c2 Move autotest running into a task. 2011-06-03 09:40:18 -07:00
Tommi Virtanen
ce5f0e7121 Move interactive and cfuse into tasks. 2011-06-02 15:04:01 -07:00
Tommi Virtanen
95163e9470 Fetch ceph binary tarball independently on every node.
Avoids shuffling the bytes through the controlling node.
Use sha1 file to make sure everyone gets the same version.
2011-06-02 09:09:08 -07:00
Tommi Virtanen
de0f0c72fc Refactor to use Cluster and Remote, to evaluate the new APIs. 2011-06-01 16:04:52 -07:00
Tommi Virtanen
7d4bb1202b Initial import.
Currently hardcoded to run dbench, not modular, and the remote
execution API is clumsy.
2011-05-31 13:51:48 -07:00