Commit Graph

1304 Commits

Author SHA1 Message Date
Zack Cerza
443b782d39 Merge pull request #288 from ceph/wip-upgrade-fix
task/ceph: Make cephfs_setup cuttlefish-compatible
2014-07-15 16:22:29 -06:00
Yehuda Sadeh
63fb271b7e rgw: set data extra pool correctly
When configuring multiregion zone, set the data extra pool

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-07-15 13:02:20 -07:00
Samuel Just
26c49ec26e task/ceph.py: deep-scrub instead of scrub
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-07-15 10:28:11 -07:00
John Spray
cbc73f710f task/ceph: Make cephfs_setup cuttlefish-compatible
Signed-off-by: John Spray <john.spray@redhat.com>

Fixes: #8711
2014-07-10 16:50:52 +01:00
Zack Cerza
62f82c3db0 Merge pull request #282 from ceph/wip-jcsp-misc
Wip jcsp misc
2014-07-07 15:35:21 -06:00
John Spray
18e556b03e task/ceph: move set_max_mds into cephfs_setup
Move the calculation of active MDS count out
of the generic service setup and into the
filesystem setup.

Fixes: #8750

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-07 13:44:05 +01:00
John Spray
6e19ba41ff task/ceph: add option to avoid doing scrub
When iterating on test in development, it's useful
to be able to skip this step.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-03 16:09:29 +01:00
John Spray
6934bbe1f8 task/ceph_manager: generalize admin_socket calls
This is so that tasks can access the admin sockets
of other service types such as the MDS.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-03 16:09:29 +01:00
Loic Dachary
5f2aa569da fix create_pool_with_unique_name call to use profile name
The hardcoded arguments are deprecated for the profile name. Create a
profile that matches the previous default arguments. Read the config to
allow the caller to override the defaults from the yaml file.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-02 19:51:00 +02:00
Loic Dachary
7cdfb05e25 document create_pool erasure_code_profile_name argument
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-02 19:50:17 +02:00
Zack Cerza
b606456e4f Merge pull request #277 from dachary/wip-erasure-code-profile
erasure code profile: fix bugs found while testing manually
2014-07-01 09:20:44 -06:00
Gregory Farnum
d81c7d1910 Merge pull request #278 from ceph/wip-nullfs
Support the new fs syntax.

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-01 07:14:10 -07:00
Loic Dachary
bbb2524421 erasure-code: fix typo in create_pool argument name
missing _name at the end

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-01 12:26:13 +02:00
Zack Cerza
0164f91de0 Merge pull request #271 from dachary/wip-erasure-code-profile
erasure-code: separate profile from pool creation
2014-06-30 17:46:19 -06:00
Zack Cerza
32d094a402 Fix linter errors
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-30 17:43:54 -06:00
Loic Dachary
98e0617651 erasure-code: separate profile from pool creation
Instead of being hard coded, the erasure code profile is read from yaml
as:

    erasure_code_profile:
      name: teuthologyprofile
      k: 2
      m: 1
      ruleset-failure-domain: osd

Which translates into

    ceph osd erasure-code-profile set teuthologyprofile \
        k=2 m=1 ruleset-failure-domain=osd

The semantic of k/m etc. depends on the erasure code plugin, but it is
common to use k as the dividing factor for each object and m as the
number of coding chunks.

Using a different set of parameters or a different plugin can
be done without modifying the teuthology code:

    erasure_code_profile:
      name: LRCprofile
      plugin: LRC
      mapping: __DD__DD
      layers: [[ "_cDD_cDD", "" ], [ "cDDD____", "" ], [ "____cDDD", ""]]

For backward compatibility, the default erasure code profile is set to

      k: 2
      m: 1
      ruleset-failure-domain: osd

which matches the previously hardcoded default of the corresponding
functions.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-30 22:43:57 +02:00
Sage Weil
7e388c9f20 background_exec: run something in the background
This is a contextmanager task that will run some command in the background
for the duration of any subsequent tasks, and kill it in the cleanup
phase.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:35:53 -07:00
Sage Weil
1cd8076543 daemon-helper: optional kill an entire process group
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:35:53 -07:00
John Spray
641a2943a7 task: update 'newfs' users to 'fs new'
Signed-off-by: John Spray <john.spray@redhat.com>
2014-06-30 10:40:18 +01:00
John Spray
8be756a065 task/ceph: Invoke newfs for CephFS as needed
New ceph versions will no longer create the
CephFS pools and will not enable the filesystem
by default.  This change adds an explicit step
to the cluster initialization to create the
filesystem if it doesn't already exist.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-06-30 10:40:18 +01:00
Zack Cerza
a405c228fc Merge pull request #268 from ceph/wip-5400
Support installing ceph kernels from gitbuilder on rpm machines.
2014-06-09 16:41:10 -05:00
Sandon Van Ness
3d1df3aa63 Better variable names.
As suggested by review.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-06-09 13:43:45 -07:00
David Zafman
875e2d240d rados: Add hit_set_list missing from possible op weights
For the future help keep in sync with test/osd/TestRados.cc by listing
in order of op_types in that code.

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-06-06 15:30:05 -07:00
Sandon Van Ness
825db5057f Added requested comment.
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-06-05 12:07:47 -07:00
Sandon Van Ness
242d9de4e2 Remove unused variables and functions.
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-06-05 12:04:49 -07:00
Sandon Van Ness
ed3ec397ba Support installing ceph kernels from gitbuilder on rpm machines.
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-06-03 18:36:40 -07:00
Josh Durgin
3ae54ead8a Merge pull request #267 from ceph/wip-runxfstests
wip-runxfstests

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-06-03 15:56:44 -07:00
Zack Cerza
0f04af0799 Add a timeout for unmounting
Ten minutes seems like it might be longer than necessary, but I doubt
it's too short.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-06-03 12:39:38 -05:00
Alfredo Deza
60e6788ddf Merge pull request #265 from ceph/wip-orchestra
Refactor teuthology.orchestra.run
2014-06-03 09:12:21 -04:00
Yehuda Sadeh
3968f6f744 radosgw-admin: adjust bucket link interface
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-02 09:23:27 -05:00
Ilya Dryomov
86c60f7de0 rbd: change test_script to run_xfstests_krbd.sh
Invoke run_xfstests.sh through a wrapper, which supplies an exclusion
list, in order to skip tests we don't want to run.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-05-31 15:16:52 +04:00
Ilya Dryomov
2551c528a2 rbd: recognize 'randomize' parameter
randomize (default: false) randomizes xfstests test order.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-05-31 15:11:38 +04:00
Zack Cerza
205c455fc1 Give daemons a five-minute timeout for stopping
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-30 16:39:16 -05:00
Zack Cerza
eac2c2abbb Update users of the teuthology.orchestra.run APIs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-30 16:05:23 -05:00
Zack Cerza
abc722c8be More verbose logging for daemon restarts
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-29 00:37:27 -05:00
John Spray
6f8015135c tasks/mds_journal_migration: create.
This is for testing the changes to CephFS
journal format, especially the migration
of journals from old to new format.

This is a teuthology task rather than being
a workunit script, because it involves
manipulating services and config during the
procedure.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-05-28 14:39:41 +01:00
John Spray
554f8c81e0 task/ceph: separate ceph.conf into function
This is so that other tasks can modify ceph.conf
as needed.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-05-28 14:39:41 +01:00
John Spray
79dfe2cbef tasks: Use '_' instead of '-' in names
Python modules are not allowed to contain hyphens
in the name.  Using hyphens only works here because
we're using low level __import__.

Change run_tasks to replace '-' with '_' when reading
configs, and rename the task modules to have valid
python module names.

Aside from general hygiene, the motivation to do this
is to allow one task to build on code in another
task by importing it.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-05-28 14:39:41 +01:00
Zack Cerza
d58d2c152e Merge pull request #258 from ceph/wip-fix-format-samba
Fixed formatting and added a better variable for time out
2014-05-19 18:33:22 -05:00
Yuri Weinstein
c8881bb7fa Fixed broken quotations
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-19 16:18:48 -07:00
Yuri Weinstein
6e893ad219 Fixed formatting and added a better variable for time out
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-19 16:03:30 -07:00
Samuel Just
216e5c9a80 task/: add populate_rbd_pool for quickly spinning up a pool with rbd stuff
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-05-19 15:04:54 -07:00
Samuel Just
8d9d724b7f ceph_manager: reset timeout if we are making progress in wait_for_recovery
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-05-19 14:10:20 -07:00
Yuri Weinstein
a24218463d increased sleep to 100 as 90 seemed insufficient
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-19 08:11:20 -07:00
Yuri Weinstein
6eac0baf88 Added more logging
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-17 10:15:57 -07:00
Yuri Weinstein
686c01b58b Added sleep log info line
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-17 10:07:52 -07:00
Yuri Weinstein
1a503afff4 increased time wait to 90 sec so tests does not fail 2014-05-15 09:33:44 -07:00
Warren Usui
5dfc570004 Add missng docstrings to repair_test.py
Fixes: 6542
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-13 14:02:13 -07:00
Zack Cerza
de32179028 Use VersionNotFoundError packages are missing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-13 10:21:18 -05:00
Zack Cerza
0465bdbb13 Don't pass a custom logger anymore
We already use the hostname in command execution calls

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-05-10 09:10:23 -05:00