Commit Graph

2605 Commits

Author SHA1 Message Date
Josh Durgin
bc1550ad9b Merge pull request #286 from ceph/wip-results-timeout
suite: change default results_timeout to 9h (from 6h)

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-07 12:06:51 -07:00
Sage Weil
4d7c09ee46 suite: default to 9h results_timeout
6h isn't enough for xfstests.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-07 11:20:39 -07:00
John Spray
18e556b03e task/ceph: move set_max_mds into cephfs_setup
Move the calculation of active MDS count out
of the generic service setup and into the
filesystem setup.

Fixes: #8750

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-07 13:44:05 +01:00
Sage Weil
f3145e98e4 ceph.conf: drop min pg per osd warning
With only the rbd pool getting created this needs to be dropped

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-06 11:13:58 -07:00
Sage Weil
5860c3f978 Merge pull request #281 from dachary/wip-lost-unfound
fix create_pool_with_unique_name call to use profile name

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-06 11:02:31 -07:00
Zack Cerza
b7eecd446d Don't mess with ~/src/teuthology by default
Setting 'automated_scheduling: True' in ~/.teuthology.yaml enables it.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-03 10:18:01 -06:00
Zack Cerza
4881b2ed2b Relocate teuthology checkouts to ~/src/
Also use an underscore instead of a dash between 'teuthology' and the
branch name.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-03 10:12:41 -06:00
John Spray
6e19ba41ff task/ceph: add option to avoid doing scrub
When iterating on test in development, it's useful
to be able to skip this step.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-03 16:09:29 +01:00
John Spray
f6ec958986 nuke: fix unmounted multiple fuse mount points
It was trying to pass multiple paths to fusermount, but
it should instead invoke fusermount for each path.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-03 16:09:29 +01:00
John Spray
87383048d6 run_tasks: catch malformed task case
If you do something like this:

- foo:
- bar:
- baz

Then catching AttributeError is necessary for giving a somewhat
friendlier error on the 'baz' where we have a string instead
of a dict.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-03 16:09:29 +01:00
John Spray
6934bbe1f8 task/ceph_manager: generalize admin_socket calls
This is so that tasks can access the admin sockets
of other service types such as the MDS.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-03 16:09:29 +01:00
Zack Cerza
3428b090b4 Remove default results_server
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 18:42:11 -06:00
Zack Cerza
dbadcd0d56 Allow setting results_email in teuthology.yaml
(Instead of passing --email to teuthology-suite)

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 18:39:47 -06:00
Zack Cerza
34a7b31823 Don't remove the teuthology repo if errors occur
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 18:27:09 -06:00
Zack Cerza
97bf86c535 Optionally, don't remove a repo when errors occur
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 18:26:52 -06:00
Zack Cerza
63fd33e4c1 Add another unit test
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 18:17:37 -06:00
Loic Dachary
5f2aa569da fix create_pool_with_unique_name call to use profile name
The hardcoded arguments are deprecated for the profile name. Create a
profile that matches the previous default arguments. Read the config to
allow the caller to override the defaults from the yaml file.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-02 19:51:00 +02:00
Loic Dachary
7cdfb05e25 document create_pool erasure_code_profile_name argument
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-02 19:50:17 +02:00
Zack Cerza
71182fd86b Allow testing with online repos
It is not the default.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 10:19:25 -06:00
Zack Cerza
cb7fdfb73f Add a unit test simulating simultaneous checkouts
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 10:08:48 -06:00
Zack Cerza
43c4595ae2 Add a couple unit tests for teuthology.parallel
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-02 10:08:11 -06:00
Sage Weil
9211bb5dbd Merge pull request #280 from dachary/wip-erasure-code-profile
add rgw.create_ec_pool default profile
2014-07-01 16:18:40 -07:00
Loic Dachary
21681531b7 add rgw.create_ec_pool default profile
the former arguments had defaults, the caller do not set them

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-02 01:15:56 +02:00
Sage Weil
1d12dd771a ls: make --archive-dir default to .
This is how I use it 99% of the time.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-01 15:39:57 -07:00
Alfredo Deza
693aa0dd68 Merge pull request #275 from ceph/wip-replace-update-sh
Replace update.sh functionality
2014-07-01 17:01:04 -04:00
Zack Cerza
ec95ee25c3 Rename suite_base to suite_dir
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-01 12:21:45 -06:00
Zack Cerza
434348aa49 Add --suite-branch and --suite-base
The former lets you specify a specific ceph-qa-suite branch to use for
testing. The latter lets you specify an as-is directory to use, for
example if you want ro run tests that you don't want to commit yet.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-01 11:45:10 -06:00
Zack Cerza
42a73500c0 Use a test-specific name/email for the git calls
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-01 10:56:41 -06:00
Zack Cerza
d6f1752897 Add more unit tests
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-07-01 10:42:16 -06:00
Zack Cerza
b606456e4f Merge pull request #277 from dachary/wip-erasure-code-profile
erasure code profile: fix bugs found while testing manually
2014-07-01 09:20:44 -06:00
Gregory Farnum
d81c7d1910 Merge pull request #278 from ceph/wip-nullfs
Support the new fs syntax.

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-01 07:14:10 -07:00
Loic Dachary
bbb2524421 erasure-code: fix typo in create_pool argument name
missing _name at the end

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-01 12:26:13 +02:00
Loic Dachary
dd8f0980aa erasure-code: do not prepend 'ceph' to the erasure-code-profile command
When used in the radosgw context, the 'ceph' string must be present but
when used in ceph_manager, the 'ceph' string is already included.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-01 12:21:17 +02:00
Loic Dachary
2e5d1703b9 erasure-code: str() to avoid + conversion errors
if the value from the yaml file is an int, it must be converted into a
string bevore being concatenated with '='

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-01 12:19:54 +02:00
Zack Cerza
0164f91de0 Merge pull request #271 from dachary/wip-erasure-code-profile
erasure-code: separate profile from pool creation
2014-06-30 17:46:19 -06:00
Zack Cerza
32d094a402 Fix linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 17:43:54 -06:00
Zack Cerza
e431abd4aa Add a basic validation of the branch value
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 17:40:54 -06:00
Zack Cerza
bfd8226142 Run unit tests offline
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 17:23:20 -06:00
Loic Dachary
b9f26eda9a documentation typo
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-30 23:29:48 +02:00
Loic Dachary
98e0617651 erasure-code: separate profile from pool creation
Instead of being hard coded, the erasure code profile is read from yaml
as:

    erasure_code_profile:
      name: teuthologyprofile
      k: 2
      m: 1
      ruleset-failure-domain: osd

Which translates into

    ceph osd erasure-code-profile set teuthologyprofile \
        k=2 m=1 ruleset-failure-domain=osd

The semantic of k/m etc. depends on the erasure code plugin, but it is
common to use k as the dividing factor for each object and m as the
number of coding chunks.

Using a different set of parameters or a different plugin can
be done without modifying the teuthology code:

    erasure_code_profile:
      name: LRCprofile
      plugin: LRC
      mapping: __DD__DD
      layers: [[ "_cDD_cDD", "" ], [ "cDDD____", "" ], [ "____cDDD", ""]]

For backward compatibility, the default erasure code profile is set to

      k: 2
      m: 1
      ruleset-failure-domain: osd

which matches the previously hardcoded default of the corresponding
functions.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-30 22:43:57 +02:00
Zack Cerza
84635d8b27 Merge pull request #233 from ceph/wip-background
run something in the background
2014-06-30 14:38:08 -06:00
Sage Weil
7e388c9f20 background_exec: run something in the background
This is a contextmanager task that will run some command in the background
for the duration of any subsequent tasks, and kill it in the cleanup
phase.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:35:53 -07:00
Sage Weil
1cd8076543 daemon-helper: optional kill an entire process group
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:35:53 -07:00
Zack Cerza
5a61f449d1 Split up repo helper into separate functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 10:10:31 -06:00
John Spray
641a2943a7 task: update 'newfs' users to 'fs new'
Signed-off-by: John Spray <john.spray@redhat.com>
2014-06-30 10:40:18 +01:00
John Spray
8be756a065 task/ceph: Invoke newfs for CephFS as needed
New ceph versions will no longer create the
CephFS pools and will not enable the filesystem
by default.  This change adds an explicit step
to the cluster initialization to create the
filesystem if it doesn't already exist.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-06-30 10:40:18 +01:00
Zack Cerza
6b94807595 Use corrected tube_name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 14:42:18 -06:00
Zack Cerza
8583306769 Return corrected tube_name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 14:41:58 -06:00
Zack Cerza
491999beef Use teuthology.beanstalk
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 14:34:39 -06:00
Zack Cerza
55b65d62f0 Document checkout_repo()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-27 10:21:53 -06:00