Commit Graph

10 Commits

Author SHA1 Message Date
Warren Usui
567961b727 Readjust the indentation of mon_clock_skew_check.py and mon_thrash.py.
Added docstrings.

Fixes: 6537
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-02-13 20:36:08 -08:00
Zack Cerza
3981a8f1af Never use 'except:' without specifying an Exception. 2013-08-30 11:10:05 -05:00
Sage Weil
51c2963e53 mon_thrash: tolerate scrub command failure
We can get EBUSY if there is an election going on.
2013-07-19 21:53:33 -07:00
Sage Weil
a0457492cc mon_thrasher: add pause/unpause of mons to thrashing
This adds an additional element of laggyness to the cluster which should
cause mons to call new elections.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-08 10:39:39 -07:00
Sage Weil
121b1b9f38 mon_thrash: optionally scrub after each iteration (default true)
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-08 10:39:24 -07:00
Sage Weil
9b22d38883 mon_thrash: fix more naming
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-05 14:30:55 -07:00
Sage Weil
389f65e7a6 mon_thrash: use _ instead of - consistently
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-05 14:30:55 -07:00
Joao Eduardo Luis
c1b75c6b0c task: mon_thrash: Thrash multiple monitors and 'maintain-quorum' option
We now add a new option 'thrash-many' that by being set to true will break
the default behaviour of killing only one monitor at a time.  Instead,
this option will select up to the maximum number of killable monitors to
kill in each round.

We also add a new 'maintain-quorum' option that will limit the amount of
monitors that can be killed in each thrashing round.  If set to true, this
option will limit the amount of killable monitors up to (n/2-1).  This
means that if we are running a configuration that only has up to two
configured monitors, if 'maintain-quorum' is set to true, this task won't
run as there are no killable monitors -- in such a scenario, this option
should be set to false.

Furthermore, if 'store-thrash' is set to true, then 'maintain-quorum' must
also be set to true, as we cannot let the task to thrash all the monitor
stores, or we wouldn't be able to sync from other monitors, nor can we
let quorum be dropped, or we won't be able to resync our way into quorum.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-02-22 00:44:49 +00:00
Joao Eduardo Luis
d28bb05a65 task: mon_thrash: Add 'seed' and 'store-thrash' options
This patch introduces an option to thrash a monitor store when we thrash
the monitors, as well as a 'store-thrash-probability' option (defaulting
to 50%).

We also took this opportunity to introduce a new 'seed' option, that ought
to allow a given run of this task to be reproducible.  This might come in
hand when attempting to reproduce a given behavior that would otherwise
be randomly triggered.

You should note that while the 'seed' option will indeed mimic past
behaviors, this only applies to a past behavior of this task: other tasks
are not affected by this value, nor are any workunits or even ceph daemons.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-02-22 00:44:25 +00:00
Joao Eduardo Luis
f525359208 task: mon_thrash: thrash monitors while running other tests
Signed-off-by: Joao Eduardo Luis <jecluis@gmail.com>
2012-11-29 00:12:34 +00:00