Commit Graph

84 Commits

Author SHA1 Message Date
Sage Weil
6d39cc1146 ceph: keep ceph.conf at ctx.ceph.conf
Signed-off-by: Sage Weil <sage@newdream.net>
2011-11-08 22:17:00 -08:00
Josh Durgin
bcded7f163 ceph: add whitelist for cluster log errors
Some messages are expected when thrashing osds or creating unfound
objects.

Fixes: #1622
2011-10-17 14:42:08 -07:00
Josh Durgin
1cad309d65 Add failure_reason to summary for the first failure detected.
For now, this is the exception raised during a task, the error found
in the central log, or coredumps found. More specific errors
(i.e. s3-tests had 3 failures) can be added later as exceptions raised
by tasks.
2011-10-03 17:07:41 -07:00
Samuel Just
28d60172f6 ceph.py: add btrfs option
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-10-03 14:26:04 -07:00
Sage Weil
a92fef77dc rename c* -> ceph-*
Leave cfuse task name unchanged for now...
2011-09-23 08:57:18 -07:00
Samuel Just
4a0f8fee54 ceph.py: remove unused variables mds_daemons and mon_daemons
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-09-15 17:26:38 -07:00
Samuel Just
a3c886af19 ceph.py/cephmanager.py: add ctx.daemons for restarting daemons
ctx.daemons will now be an instance of CephState.

ctx.daemons.get_daemon(role, id).stop() to stop daemon, retart() to
restart the daemon, etc.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-09-15 17:08:34 -07:00
Tommi Virtanen
a2372fce12 Move orchestra to teuthology.orchestra so there's just one top-level package. 2011-09-13 14:53:02 -07:00
Sage Weil
e66dffc3d3 don't eat exceptions for breakfast
fixes 0c2bee1514
2011-09-02 11:07:10 -07:00
Sage Weil
c502418fca thrashosds: make it work when first mon isn't mon.0 2011-09-01 12:56:29 -07:00
Josh Durgin
ec768ba3ca Fix pyflakes warnings. 2011-08-31 14:36:01 -07:00
Greg Farnum
0c2bee1514 valgrind: don't run valgrind_post if there's no valgrind
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-29 16:47:22 -07:00
Greg Farnum
3a3c859f5b valgrind: scan logs for bad results
It's not sophisticated but it will warn you about a node
if at least one node has issues.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-29 14:03:02 -07:00
Greg Farnum
50a648bdfc valgrind: use xml output for tools that support it
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-29 14:03:02 -07:00
Greg Farnum
1130e5fe37 coverage: create dir conditionally
We don't need to create the dir if we aren't using coverage.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-24 16:48:14 -07:00
Sage Weil
42318c57cb check ceph cluster log for badness (ERR, WRN, SEC) 2011-08-23 21:00:26 -07:00
Sage Weil
21d04419b8 ceph: copy cluster log file to archive/ceph.log 2011-08-22 22:04:57 -07:00
Greg Farnum
e20bae2a7f valgrind: Document!
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-17 10:35:37 -07:00
Greg Farnum
4efc95fa57 include log in valgrind log file names
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-17 10:30:26 -07:00
Greg Farnum
d5eb2c2b77 ceph task: split up arguments a little more
This allows selective daemon kill signal changes. With valgrind
daemons we want term instead of kill, for instance.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-17 10:30:24 -07:00
Greg Farnum
5323e1796f valgrind: move valgrind logs to log dir
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-17 10:29:54 -07:00
Greg Farnum
aa74481728 ceph: split up daemon-running arguments and insert valgrind ones
This setup should let us insert other kinds of things too, if we
need them.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-15 15:35:42 -07:00
Greg Farnum
9ec19f13df ceph: Set up valgrind as a flavor, and create a dir for logging.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-15 15:32:23 -07:00
Greg Farnum
98ac89a54e ceph task: pass the full config to the daemon startup subs
So far as I can tell there is no reason to reduce them to
the coverage config, and I want the full config for my
soon-to-exist valgrind options.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-08-15 15:31:18 -07:00
Sage Weil
bf7b1dd4a7 ceph: fix max_mds calculation
Signed-off-by: Sage Weil <sage@newdream.net>
2011-08-10 12:47:20 -07:00
Sage Weil
b5ba155c17 Revert "fix get_clients"
This reverts commit 83b6678e79.  The bug I was
hitting was actually fxied by 06e3e69c29.
2011-08-09 13:23:58 -07:00
Sage Weil
83b6678e79 fix get_clients
Only return the clients that are listed (not _all_ clients).  There might
be a combination of cfuse and kclient (or other) clients here!
2011-08-05 14:35:44 -07:00
Sage Weil
ef2b80910a use coverage_dir 2011-08-05 14:35:43 -07:00
Greg Farnum
6ac6f7ab38 teuthology: convert from bzip2 to gzip.
gzip is much, much faster on large log files. With a 7.7GB client log, gzip
took 2:45 to compress it to 624MB. bzip2 took 34:38 to compress it to
366MB. For our purposes the space savings are not worth the time loss.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-29 10:35:02 -07:00
Sage Weil
277c4ff7aa set max_mds based on non-standbys 2011-07-28 10:25:30 -07:00
Sage Weil
5b0924494a tolerate named (not numbered) mons 2011-07-26 22:07:02 -07:00
Sage Weil
7c0f7c23c7 specify and clean up admin socket 2011-07-26 22:00:39 -07:00
Josh Durgin
ac5c1c41dd Add an overrides section for the ceph task.
This lets you run a suite against a particular version of ceph, or
with special debug settings.
2011-07-15 17:15:12 -07:00
Josh Durgin
9721e33457 Better interface for running functions in parallel. 2011-07-14 14:39:50 -07:00
Josh Durgin
b99e33f00c Download ceph binaries in parallel. 2011-07-13 14:02:46 -07:00
Tommi Virtanen
c88ef9e7f7 Merge branch 'localdir'
Conflicts:
	teuthology/task/ceph.py
2011-07-13 12:38:12 -07:00
Tommi Virtanen
127ef6861c Feed locally-created binary tarball to remotes in parallel.
This should be faster as long as we have the bandwidth for it.
2011-07-13 12:34:39 -07:00
Tommi Virtanen
aee944229e Use a nameless tempfile for local tarball, avoids cleanup. 2011-07-13 12:18:55 -07:00
Tommi Virtanen
f52df63bce More careful error checking, avoid need for shell quoting. 2011-07-13 12:07:36 -07:00
Tommi Virtanen
e7618a6750 Clean up tarball tmpdir in all cases.
Prefer shutil.rmtree over os.system('rm -rf ...').
2011-07-13 11:32:28 -07:00
Tommi Virtanen
c701fe500c Use tempfile instead of ad hoc temp dir creation. 2011-07-13 10:58:01 -07:00
Tommi Virtanen
3547eba712 Avoid identifier clash with builtin "dir". 2011-07-13 10:17:04 -07:00
Sage Weil
8f3d56ade5 include sha1 in summary
Redundant (there's also a ceph-sha1 file), but convenient.
2011-07-11 20:32:44 -07:00
Josh Durgin
1edd435e8c Clean up from pyflakes. 2011-07-11 18:07:40 -07:00
Josh Durgin
5fadb1c11c Whitespace and style cleanup. 2011-07-11 18:07:37 -07:00
Greg Farnum
38ad4d1bf1 task ceph: distribute monmap to all nodes, not just mons.
And clean up the monmap, too!
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-11 16:45:02 -07:00
Greg Farnum
4fcecf0184 task ceph: set_max_mds so multiple MDS nodes are used
The current check will be insufficient when we handle standby-replays,
standbys, etc, but it's a lot better than the current situation where
it starts up all the daemons but only one is active!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-07-06 16:45:57 -07:00
Sage Weil
7e603ceb61 adjust ceph.conf from yaml input 2011-07-05 16:47:00 -07:00
Sage Weil
d04256aa96 set flavor to 'local' if pushing from local src dir
always record in summary
2011-07-05 15:14:42 -07:00
Sage Weil
53fc6920b1 use local source dir for teuthology run
- ceph:
    path: /home/sage/ceph
...

This will 'make install' to a temp dir, tar it up, and ship that to the
target nodes.  A usr/local -> . symlink will be added if /usr/local isn't
there, to accommodate trees that /usr based autotools paths.
2011-07-01 09:09:39 -07:00