Commit Graph

3467 Commits

Author SHA1 Message Date
Zack Cerza
e431abd4aa Add a basic validation of the branch value
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 17:40:54 -06:00
Zack Cerza
bfd8226142 Run unit tests offline
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 17:23:20 -06:00
Sage Weil
b6a77d7fdd Merge pull request #44 from ceph/wip-7032
rados/singleton/all/thrash_cache_writeback_forward_none: thrash cache pool drain
2014-06-30 16:04:34 -07:00
Loic Dachary
b9f26eda9a documentation typo
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-30 23:29:48 +02:00
Loic Dachary
98e0617651 erasure-code: separate profile from pool creation
Instead of being hard coded, the erasure code profile is read from yaml
as:

    erasure_code_profile:
      name: teuthologyprofile
      k: 2
      m: 1
      ruleset-failure-domain: osd

Which translates into

    ceph osd erasure-code-profile set teuthologyprofile \
        k=2 m=1 ruleset-failure-domain=osd

The semantic of k/m etc. depends on the erasure code plugin, but it is
common to use k as the dividing factor for each object and m as the
number of coding chunks.

Using a different set of parameters or a different plugin can
be done without modifying the teuthology code:

    erasure_code_profile:
      name: LRCprofile
      plugin: LRC
      mapping: __DD__DD
      layers: [[ "_cDD_cDD", "" ], [ "cDDD____", "" ], [ "____cDDD", ""]]

For backward compatibility, the default erasure code profile is set to

      k: 2
      m: 1
      ruleset-failure-domain: osd

which matches the previously hardcoded default of the corresponding
functions.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-30 22:43:57 +02:00
Zack Cerza
84635d8b27 Merge pull request #233 from ceph/wip-background
run something in the background
2014-06-30 14:38:08 -06:00
Sage Weil
7e388c9f20 background_exec: run something in the background
This is a contextmanager task that will run some command in the background
for the duration of any subsequent tasks, and kill it in the cleanup
phase.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:35:53 -07:00
Sage Weil
1cd8076543 daemon-helper: optional kill an entire process group
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:35:53 -07:00
Sage Weil
f8282df84d rados/singleton/all/thrash_cache_writeback_forward_none: thrash cache pool drain
Enable/disable cache pool against a running workload.

Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:34:21 -07:00
Zack Cerza
5a61f449d1 Split up repo helper into separate functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 10:10:31 -06:00
John Spray
641a2943a7 task: update 'newfs' users to 'fs new'
Signed-off-by: John Spray <john.spray@redhat.com>
2014-06-30 10:40:18 +01:00
John Spray
8be756a065 task/ceph: Invoke newfs for CephFS as needed
New ceph versions will no longer create the
CephFS pools and will not enable the filesystem
by default.  This change adds an explicit step
to the cluster initialization to create the
filesystem if it doesn't already exist.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-06-30 10:40:18 +01:00
Zack Cerza
6b94807595 Use corrected tube_name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 14:42:18 -06:00
Zack Cerza
8583306769 Return corrected tube_name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 14:41:58 -06:00
Zack Cerza
491999beef Use teuthology.beanstalk
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 14:34:39 -06:00
Loic Dachary
3ec07cdc0e Merge pull request #43 from dachary/wip-firefly-x
add upgrade/firefly-x based on dumpling-x

Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-06-27 22:23:41 +02:00
Loic Dachary
d56b59de0d add upgrade/firefly-x based on dumpling-x
It is a s/dumpling/firefly/ mostly. With the exception of
rados/test-upgrade-firefly.sh which is dumpling specific.

The 'mon warn on legacy crush tunables: false' are dropped because they
no longer apply to firefly.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-27 22:20:19 +02:00
Sage Weil
5bb608c6a3 Merge pull request #42 from ceph/wip-smoke
upgrade: fix dumpling tests
2014-06-27 10:11:02 -07:00
Zack Cerza
55b65d62f0 Document checkout_repo()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:21:53 -06:00
Zack Cerza
25a40677cc Drop a "fix" for a bug that probably never existed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:18:05 -06:00
Zack Cerza
a4c3a02547 Add a note about teuthology scheduling
Specifically, that we always schedule using the master branch.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
f5bed55d47 Improve missing branch detection and logging
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
abd359086c Add unit tests for repo_utils
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
807d6fd715 Use 'ceph-qa-suite.git' for the repo name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
b16c48a8f8 Also handle teuthology repo checkouts
Our shell script did this also.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:07 -06:00
Zack Cerza
88d26e4ae4 Handle ceph-qa-suite checkouts
Previously we had an internally-maintained shell script that did this.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:06 -06:00
Zack Cerza
6e3e6693d1 Generalize error message
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:06 -06:00
Zack Cerza
484693c2e9 Fix linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:06 -06:00
Zack Cerza
93fd6b899f Move repo checkout code to new module repo_utils
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:06 -06:00
Zack Cerza
5e3c13de60 Use a more informative variable name for dest_path
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:14:06 -06:00
Zack Cerza
7d2388b42c Merge pull request #274 from dachary/wip-facet
document how to specify a facet in teuthology-suite
2014-06-27 10:07:04 -06:00
Loic Dachary
09baca9f33 document how to specify a facet in teuthology-suite
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-27 18:04:05 +02:00
Sage Weil
1c0dc1ce61 smoke: add rbd fsx + thrashing
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:52:02 -07:00
Sage Weil
3fa6dd21c3 smoke: add a mon thrash test
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:46:02 -07:00
Sage Weil
64ec775fe4 smoke: add some rados osd thrashing test
ec, caching, snaps

Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:44:07 -07:00
Sage Weil
e99eba9a3c smoke: specify fs on each run
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:43:39 -07:00
Zack Cerza
2e18fddb6f Only delete jobs that match the pattern
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
e7323da58b Swap order of job_id and run_name when deleting
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
f4321b0519 Skip the kernel stanza if the branch passed is '-'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
ba1eae988e Add more docstrings
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
e1597a036f No need to explicitly return None here
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
667a223f03 Update unit tests to reflect renamed function
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:24 -06:00
Zack Cerza
7082a3dff0 Add a few more docstrings and a debug statement
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
743edd6b70 Fix a couple linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
6df3b13452 Remove schedule_suite.sh
Its entire functionality is now provided by teuthology-schedule.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
173c7b84f6 Fix bug where the base yaml wasn't being merged
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
fd13a18c83 With dry_run, quote any individual args
So that individual commands can be copied and pasted
in order to execute them individually.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
b6cb3f8cb7 Add lots of unit tests for teuthology.suite
More to come...

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
91c7385988 Raise ScheduleFailError even if not sending email
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00
Zack Cerza
356ab7e06d Do everything that schedule_suite.sh does
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-25 12:54:23 -06:00