Commit Graph

1563 Commits

Author SHA1 Message Date
Josh Durgin
8ad065dc9c rgw: add multi-region and zone support
Take client<->zone/region and the associated pools from ceph.conf, so
we don't have to invent a new format to specify it.

General region info is added to a new configuration section in the rgw
task. Each client is assumed to be a different zone, and a system user
is created with the key specified in the yaml, so it can be passed to
later task configuration as well. This isn't strictly necessary, but
avoids having to lookup this info in later tasks through something
like radosgw-admin.

Ports are allocated automatically because there's no obvious mapping
from host to client in the task configuration. Later tests can get the
endpoints desired by reading the region map.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-07-24 09:59:50 -07:00
Josh Durgin
721280b7f3 task_util: move rados command here
Six copies are replaced with one, with an added option to check status
automatically. This should probably be used in a few places where the
return code is ignored.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-07-24 09:59:50 -07:00
Josh Durgin
6d2434b48f rgw: move common rgwadmin function to a new utility file
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-07-24 09:59:50 -07:00
Joe Buck
88cab4712f teuth: reworked rgw to support regions / zones
Signed-off-by: Joe Buck <jbbuck@gmail.com>
2013-07-24 09:59:50 -07:00
Joe Buck
afd0d87eda teuthology: updating RGW task to support regions
Extending the rgw.py task to allow for regions and zones
to be specified in the YAML file.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
2013-07-24 09:59:50 -07:00
Alfredo Deza
02609438a3 add test requirements to requirements file
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2013-07-24 08:50:22 -04:00
Alfredo Deza
545fc2747c remove test dependencies from setup.py
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2013-07-24 08:49:36 -04:00
Alfredo Deza
2d9cb1ffb6 fix RST formatting issues in README file
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2013-07-24 08:43:04 -04:00
Alfredo Deza
b3bd39cb73 removing todo org file from the root of the project
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2013-07-24 08:31:27 -04:00
Alfredo Deza
1e4a4d7382 remove Makefile that attempted to do linting
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2013-07-24 08:30:40 -04:00
Sandon Van Ness
e6a30d73a7 Re-create guest if it already exists
In some cases tests fail or nuke fails and the guest is
not properly destroyed. This will look to see if it gets
an error due to the guest already existing or its disks
existing and will re-create the guest.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-07-23 16:10:24 -07:00
Sandon Van Ness
71b66ebd99 Add distro type to schedule_suite.sh
Also added machinetype to the name.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-07-23 16:09:07 -07:00
Sandon Van Ness
55cc15fb24 Wait a little longer before recreating VMs
Just to allow for the create to still work incase the os
volume is fairly large (takes a while to resize) and in
case the host machine is bogged down due to disk I/O.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-07-23 15:52:32 -07:00
Sandon Van Ness
52a886c596 Use os_type instead of vm_type. Add os_version
Use os_type instead of vm_type for more generic naming
for when we start re-imaging bare metal. Also added a
os_version dictionary for default versions of distros
that we want over-riding what downburst defaults are.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2013-07-23 15:50:50 -07:00
Sage Weil
c1e0812b6a ceph: add wait_for_mon_quorum command
tasks:
...
- ceph.wait_for_mon_quorum: [a, b]
...

will block until the mon quorum consists of exactly [a, b].  This is
compared directly to the relevant field from 'ceph quorum_status'
which has the alphanumeric names only.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-23 15:38:29 -07:00
Sage Weil
68888862a1 sequential, parallel: allow entries to be references to top-level config
Often we want to build a test collection that substitutes different
sequences of tasks into a parallel/sequential construction.  However, the
yaml combination that happens when generating jobs is not smart enough to
substitute some fragment into a deeply-nested piece of yaml.

Instead, make these sequences top-level entries in the config dict, and
reference them.  For example:

tasks:
- install:
- ceph:
- parallel:
  - workload
  - upgrade-sequence
workload:
  workunit:
    - something
upgrade-sequence:
  install.restart: [osd.0, osd.1]

Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-23 15:38:29 -07:00
Samuel Just
77cae4bf35 thrashosds: add delay option after recovery
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-07-22 16:30:57 -07:00
Joao Eduardo Luis
e84c54addd task: mon_clock_skew_check: grab max-skew value from ceph-mon's config
Instead of relying on hardcoded values, obtain the max-skew default from
'ceph-mon --show-config-value mon_clock_drift_allowed' to match the mon's
expectation.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-07-22 10:02:22 -07:00
Sage Weil
222b296019 admin_socket: loop until the socket command succeeds
Sometimes the thing we're talking to is slow to start, or to register the
command we are running.  Loop in that case, at least for a while.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-22 10:02:14 -07:00
Yehuda Sadeh
37a662442d apache.conf: load modules conditionally
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-07-20 11:30:24 -07:00
Sage Weil
494accb8e2 ceph-deploy: do not test mon destroy by default 2013-07-19 22:19:09 -07:00
Joao Eduardo Luis
06ad2d2cc9 task: mon_clock_skew_check: by default, use max skew from global config
If not defined, defaults to 0.05;  if 'max-skew' however is defined, it
must override whatever is on the config.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-07-19 21:54:34 -07:00
Joao Eduardo Luis
7ca59dfae1 task: mon_clock_skew_check: missing 'str'.format() key crashed the test
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-07-19 21:54:28 -07:00
Sage Weil
51c2963e53 mon_thrash: tolerate scrub command failure
We can get EBUSY if there is an election going on.
2013-07-19 21:53:33 -07:00
Warren Usui
4036547e04 Merge branch 'wip-teuthREAD-wusui' 2013-07-19 19:18:28 -07:00
Warren Usui
1964818399 Update to describe tasks and parameters to tasks, including the install
parameters requested in 4470.  Added more information to the vm section,
and included a section documenting the test suites.

Signed-off-by: Warren Usui <warren.usui@inktank.com>
Fixes: 4470
Reviewed By: Dan Mick and Alfredo Deza

Include Alfredo's suggestions
2013-07-19 19:16:21 -07:00
Josh Durgin
633a1881e4 Merge branch 'wip-centos-rgw' 2013-07-19 14:44:51 -07:00
Josh Durgin
f0123db7d9 rgw: turn off continue print on centos
Also note that a ceph.conf setting is needed for that too

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-07-19 14:42:38 -07:00
Josh Durgin
29e7db26eb install: remove ceph-release rpm file after it's used
No need for it anymore, it's just taking up space

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-07-19 14:36:18 -07:00
Sage Weil
0cc1cffd50 Merge remote-tracking branch 'gh/next' 2013-07-19 11:27:19 -07:00
Sage Weil
d874b57ef2 sleep: new task 2013-07-19 11:26:58 -07:00
Sage Weil
375c0d4e5c Merge pull request #18 from alfredodeza/master
Safer dict.get in queues.py
2013-07-19 10:10:15 -07:00
Alfredo Deza
5263a6f758 failed dict.get evaluates to None 2013-07-19 09:01:28 -04:00
Alfredo Deza
65f49beb35 safer get by falling back to a dictionary 2013-07-19 08:59:53 -04:00
Sandon Van Ness
203bc59b11 Merge branch 'wip-machine-based-workers' into next 2013-07-18 19:52:25 -07:00
Sandon Van Ness
a2efc17305 Merge branch 'wip-machine-based-workers' 2013-07-18 19:37:25 -07:00
Sage Weil
4db5b930af ceph: do not ignore osd leaks
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-18 18:05:25 -07:00
Sage Weil
0985f8c386 nuke: killall ceph-disk, too
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-18 12:31:11 -07:00
Sandon Van Ness
5f9a1d8a0f Worker processes by machine type instead of teuthology branch.
teuthology-suite and schedulewill now take --worker instead of
--branch. The branch is set by setting teuthology_branch in the
yaml used to schedule the job.

The teuthology branches are assumed to be in ~/teuthology-$branch
of whatever user is running the workers.
2013-07-18 12:04:08 -07:00
Sage Weil
320032f65b schedule_suite.sh: escape ceph-deploy overrides 2013-07-18 11:38:00 -07:00
Sage Weil
2173d33d89 ceph-deploy: support overrides
Something like

overrides:
  ceph-deploy:
    foo: bar

Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-18 11:21:20 -07:00
Sage Weil
a395d55e0a Merge remote-tracking branch 'gh/next' 2013-07-17 21:33:50 -07:00
Sage Weil
bfd6010747 Merge branch 'wip-machine-type'
Reviewed-by: Sandon Van Ness <sandon@inktank.com>
2013-07-17 20:59:54 -07:00
Sage Weil
99c40128e4 lock: filter machine type for --list, --list-targets
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-17 20:54:16 -07:00
Sage Weil
608d8a201a lock: make --summary list all machines by default
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-17 20:54:15 -07:00
Sage Weil
1d16a9ba7f lock: drop machine-type default, but require for lock-many
Signed-off-by: Sage Weil <sage@inktank.com>
2013-07-17 20:54:08 -07:00
Samuel Just
9e91395a2e ceph.conf.template: enable osd debug verify stray on activate
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-07-17 18:14:58 -07:00
Yehuda Sadeh
c395687fd9 radosgw-admin: adapt task to recent changes
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-07-17 14:05:26 -07:00
tamil
053ba3a242 Merge branch 'master' of github.com:ceph/teuthology 2013-07-16 17:41:57 -07:00
tamil
a24aaa41af added overrides for ceph-deploy
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-07-16 17:41:32 -07:00