Commit Graph

2566 Commits

Author SHA1 Message Date
Zack Cerza
7d0adcee2d Move DaemonState to teuthology.orchestra
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-23 19:59:16 -06:00
Zack Cerza
efce34186c Fail sooner if an invalid config_yaml is passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-22 15:47:53 -06:00
Zack Cerza
0e2149c86e Remove kcon_most
It was unused.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-22 13:57:40 -06:00
Zack Cerza
d6e5895fb2 Merge pull request #293 from ceph/wip-ship-utilities
move ship_utilities to install task (from ceph test)
2014-07-22 13:49:57 -06:00
Sage Weil
828bb2a6ea ceph_deploy: use new ship_utilities location
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-22 10:55:10 -07:00
Sage Weil
2dad906f4a move ship_utilities to install task (from ceph test)
No need to install ceph just to get daemon-helper, adjust-ulimits, etc..
These utilities are used by lots of tasks, not just ceph.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-19 09:22:27 -07:00
Zack Cerza
b8c443b44f Fix get_hash() arg ordering
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-16 12:07:55 -06:00
Zack Cerza
fccc6adb7f Merge pull request #287 from ceph/wip-mds-sessions
Wip mds sessions
2014-07-15 16:27:56 -06:00
Zack Cerza
443b782d39 Merge pull request #288 from ceph/wip-upgrade-fix
task/ceph: Make cephfs_setup cuttlefish-compatible
2014-07-15 16:22:29 -06:00
Sage Weil
d5a4998b3d Merge pull request #291 from ceph/wip-rgw-pools
rgw: set data extra pool correctly

Backport: next, firefly
Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-15 14:57:49 -07:00
Yehuda Sadeh
63fb271b7e rgw: set data extra pool correctly
When configuring multiregion zone, set the data extra pool

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-07-15 13:02:20 -07:00
Zack Cerza
29c06f00d9 Add and use new fetch() method
The old fetch_branch() wasn't behaving properly with the ceph.com git
mirror. This method works with github.com and ceph.com. Add a couple
unit tests, and leave the old fetch_branch() in place for now, even
though nothing uses it.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-15 12:02:32 -06:00
Sage Weil
7262effc12 Merge pull request #290 from ceph/wip-deep-scrub
task/ceph.py: deep-scrub instead of scrub
2014-07-15 12:02:32 -06:00
Zack Cerza
79da400dcf Fix a bug where results_email was being ignored
Referring to the setting in ~/.teuthology.yaml

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-15 12:02:32 -06:00
Samuel Just
26c49ec26e task/ceph.py: deep-scrub instead of scrub
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-07-15 10:28:11 -07:00
Sage Weil
36441a27d6 README: teuthology-suite
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-15 10:08:09 -07:00
John Spray
9c8dd98a38 task/kclient: remove redundant double loop
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
403ba2c892 task/cephfs: use dedent for embedded python
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
785a272bab task: fix admin_socket for non-int ids
This was working for OSDs and for my config
where MDS happened to have numeric ID, but
in general service IDs are strings, not ints.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
8bb77ed9e1 task: add mds_client_recovery
This task exercises the CephFS session recovery
behavior.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
91e56bb995 task/mds_journal_migration: only mount my client
Pass explicit client ID list to ceph_fuse context so
that it doesn't try to mount all clients in the config,
in case there are other clients.

Also allow configuration to specify which client
this task should use.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
d91f028e26 task: refactor kclient into KernelMount
Additionally make both kclient and ceph_fuse
tasks yield a collection of CephFSMount
objects so that subsequent tasks can
retrieve them.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:16 +01:00
John Spray
6cba4973c3 task: create FuseMount class from ceph_fuse
This is for use by other tasks that need filesystem
mounts under their own control.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 13:30:11 +01:00
Zack Cerza
657bd369d0 Fix the incomplete substitute_placeholders() fix
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 15:16:55 -06:00
Zack Cerza
f557ac5f8c Add a debug statement to reset_repo()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 14:48:31 -06:00
Zack Cerza
56ad957534 Be smarter about choosing branches
Part of this is also about failing sooner, and not allowing invalid
configurations to enter the queue. This commit also fixes an obscure bug
in substitute_placeholders(). Finally, it adds unit tests for all bugs
fixed.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 14:30:31 -06:00
John Spray
6c05747da7 task: move Filesystem class to shared location
...in preparation for tests other than mds_journal_migration
to use it.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 16:37:41 +01:00
Zack Cerza
47087ff7fb Fall back to master for suite_branch
The reason for this is that last-in-suite jobs don't have suite_branch
or branch set. We just want to use master for those.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-14 09:35:20 -06:00
Zack Cerza
c68b5fc9dd Add a flag to dump the entire job body.
... with a warning.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 14:55:09 -06:00
Zack Cerza
4f61db90ec Add missing placeholder
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 14:40:45 -06:00
Zack Cerza
dcd22a532f Add a --dry-run flag to teuthology-schedule
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 14:18:03 -06:00
Zack Cerza
0ccee81915 Don't drop the rest of os.environ
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 13:44:32 -06:00
Zack Cerza
f8658deb5b Use os.path.expanduser() instead of os.environ
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 13:20:29 -06:00
Zack Cerza
b6c7ba2977 Fix typo
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 13:15:47 -06:00
Zack Cerza
0ad105865a Fix lock paths
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 13:14:23 -06:00
Zack Cerza
7418de9315 Use the ceph_branch if suite_branch isn't found
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 13:06:21 -06:00
Alfredo Deza
b693c40291 Merge pull request #289 from ceph/split_prep
Split prep
2014-07-11 13:59:15 -04:00
Zack Cerza
9547a7f398 Discourage modifying defaults in instances
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 10:41:16 -06:00
Zack Cerza
4a6352e372 Don't use double underscores
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 10:33:43 -06:00
Zack Cerza
a924606d26 Run tests for base class in subclass tests
Also remove test_defaults() since it was a bad idea.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-11 09:55:34 -06:00
Zack Cerza
8b6e82437c Tweak fetch_teuthology_branch()
Specifically, make it match fetch_qa_suite()'s behavior.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:37 -06:00
Zack Cerza
24b44cbe28 Clone ceph-qa-suite and add it to PYTHONPATH
So that teuthology runs can find their tasks

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:37 -06:00
Zack Cerza
9257b8706f Use config.src_base_path
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:37 -06:00
Zack Cerza
49725e08e4 Add src_base_path to defaults.
Defaults to ~/src

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:37 -06:00
Zack Cerza
c105827d5e Store the suite_branch in the job config
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
fb97e85aec Use the new JobConfig object
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
c886a93688 Make teuthology.config *far* more robust
In addition to parsing its configuration from a yaml file, it can now be
created from a dict. It can also be dumped as a dict, or as a yaml
stream. It is also now split into multiple classes so that the same
implementation can be used for job configs, and not just as a proxy for
~/.teuthology.yaml.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
70d87bda25 Update existing unit test, and add another.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
0f69e3d4c6 Use a dict for a job template instead of a string.
This makes later modifications far easier.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00
Zack Cerza
9e5338f887 Add test for config substitution
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-10 16:35:36 -06:00