Commit Graph

114 Commits

Author SHA1 Message Date
Yan, Zheng
09b82e2bd9 tasks: add test case for readonly MDS
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2014-12-10 09:48:02 +08:00
Zack Cerza
a45663c543 Merge pull request #212 from ceph/wip-9117-wusui
Move output in task/s3readwrite
2014-12-03 14:17:26 -07:00
Yan, Zheng
d761831133 tasks: add mds_auto_repair
New CephFS tests for MDS's auto repair functions. (So far the only
test case is verify/repair backtrace on fetch dirfrag)

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2014-12-02 16:26:51 +08:00
Warren Usui
26a33c3a5a Move output in task/s3readwrite
The s3readwrite.py task formerly wrote too much output while excuting.
It now saves the data on the local machine in either the archive
directory or in /tmp if no archive directory is specified.
The new file contains a client name and timestamp in its name.
Once all processing has completed, that file is saved locally.

Fixes: 9117
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-12-01 11:01:26 -08:00
David Zafman
c59af44460 Merge pull request #244 from dachary/wip-objectstore-tool
add erasure coded pool tests to objectstore tool

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 15:40:54 -08:00
David Zafman
6923e68dac ceph_objectstore_tool: minor fixes
Remove development comment
nullfd isn't used anymore
s/log.errors/log.error/

Signed-off-by: David Zafman <dzafman@redhat.com>
2014-11-20 22:38:26 +01:00
David Zafman
a09d3a389d ceph_objectstore_tool: fix flake8 issues
Signed-off-by: David Zafman <dzafman@redhat.com>
2014-11-20 22:38:26 +01:00
David Zafman
f10edda4bc ceph_objectstore_tool: add assert so that teuthology knows when this test fails
Signed-off-by: David Zafman <dzafman@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
9a089ef369 ceph_objectstore_tool: skip unused osds
When the number of objects is low, some OSDs may not be used at all.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
be39bd5d84 ceph_objectstore_tool: run tests on erasure coded pools
Create an erasure coded pool and run tests on it. The list of PGs is
adapted to contain the shard id.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
fbb33f3577 ceph_objectstore_tool: only run get/set bytes for replicated pools
It needs to be adapted to run with erasure coded pools.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
2b57f4c59c ceph_objectstore_tool: use CephManager::get_pool_dump
Instead of custom made get_pool_id function.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
d0caf5cdff ceph_objectstore_tool: add pgnum option
Instead of hardcoding 12 use a configuration option that defaults to
12. It is handy during development to lower the number to 4 and speed up
the test cycle.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
c9e6edebd9 ceph_objectstore_tool: encapsulate into a function
Move code out of the task into function. Also remove the "REP" specifics
from helper functions that could also be used for erasure coded pools.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
d591226373 ceph_objectstore_tool: add hinfo_key tests for erasure coded objects
When an hinfo_key attribute is found, assume an erasure coded object and
verify set-attr/get-attr works as expected by removing its content and
restoring it.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
9ef8887a3b ceph_objectstore_tool: keep all json object representation
For erasure coded pools to be tested, the json object representation
must be preserved for all PG because they are all different. The
internal representation is changed from

   db[name]["pgid"] = pg
   db[name]["json"] = objjson

to a per pg map:

   db[name].setdefault("pg2json", {})[pg] = objjson

and the rest of the code is modified to adapt accordingly.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
b925be13bc ceph_manager: add pool type constants
The osd dump command displays pool types using numerics instead of
symbolic names. Create constants in the CephManager class to use instead
of numbers.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
fd1ec39d38 ceph_manager: fix typo in get_pgid docstring
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
2abb9f9087 ceph_manager: factorize with get_pool_dump
Replace code that duplicates get_osd_dump_json with a call to the
function.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
6dac43fa46 ceph_manager: factorize with get_osd_dump_json
Replace code that duplicates get_osd_dump_json with a call to the
function.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:17 +01:00
Loic Dachary
5fc42b98ab ceph_manager: add get_pool_dump to return the json pool dump
Get the part of ceph osd dump specific to the pool given in argument.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-19 23:19:13 +01:00
Loic Dachary
f353c150a8 ceph_manager: add get_osd_dump_json to get the full output
Converts ceph osd dump_json into a python object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-19 23:19:13 +01:00
Warren Usui
852fe69af4 Further changes for calamari_setup.py
Made suggestions from code reviews.
Added no_epel option.
Merged Dan Mick's changes that add the ability to get
iceballs from http URL.
Remove duplicate assignment and added some log.debugs

Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-11-18 19:06:24 -08:00
Warren Usui
357fd22f04 Add calamari_setup
Calamari_setup can be used to set up a calamari gui for manual testing,
or be run in a suite to test the calamari setup and calamari ceph
installation code.

Fixes: 9759
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-11-18 19:06:24 -08:00
Loic Dachary
e2d6ce7e9d Merge pull request #234 from ceph/wip-dzaddscrub
Add scrub_test and repair_test to rados basic suite

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-11-11 03:42:33 +01:00
Sage Weil
36055e143c Merge remote-tracking branch 'gh/next' 2014-11-09 20:48:45 -08:00
Sage Weil
5f19ef7116 tasks/radosbench: no log to stderr
Signed-off-by: Sage Weil <sage@redhat.com>
2014-11-09 20:48:35 -08:00
Gregory Farnum
e8cd3f10d6 Merge pull request #221 from ceph/wip-forward-scrub
Wip forward scrub

Reviewed-by: John Spray <john.spray@redhat.com>
2014-11-07 16:16:38 -08:00
Greg Farnum
6c26c073de mds_scrub_checks: Run scrub and flush commands against the MDS.
We mostly do a variety of successful ones, but we also corrupt the store
using the rados tool and make sure we get the expected error codes. Includes
a yaml fragment so the task gets run as part of the fs/basic suite.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-11-07 13:06:13 -08:00
David Zafman
74e776139b repair_test: Wait for OSDs to come up before proceeding with test
Signed-off-by: David Zafman <dzafman@redhat.com>
2014-11-06 22:23:34 -08:00
Yan, Zheng
edb780a3c5 tasks/cephfs/mount: use seperate for testing flock and posix lock
Old version libfuse treats both flock and posix lock requests as posix
lock request. This is a workaround for the bug.

Fixes: #9995
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2014-11-07 09:07:27 +08:00
Sage Weil
8a18d8baaf Merge remote-tracking branch 'gh/giant' into m
Conflicts:
	tasks/ceph_manager.py
2014-10-29 14:31:26 -07:00
Yehuda Sadeh
dd6194f637 Merge branch 'wip-apache-worker' 2014-10-23 16:05:44 -07:00
Yehuda Sadeh
c3b53c3265 apache: switch to use the apache worker mpm
Fixes: #9169

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2014-10-23 16:05:03 -07:00
Yehuda Sadeh
35c9cae84c apache: change template to load mpm worker module
in apache 2.4

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2014-10-23 16:04:58 -07:00
David Zafman
4ddadf0698 Thrasher: Disable ceph_objectstore_tool tests if old release missing command
Leaving disabled until merge of import/export fixes

Fixes: #9805

Signed-off-by: David Zafman <dzafman@redhat.com>
2014-10-22 23:30:29 -07:00
David Zafman
523cb63b5f ceph_manager: ceph_objectstore_tool testing off by default
Signed-off-by: David Zafman <dzafman@redhat.com>
2014-10-22 10:32:46 -07:00
Zack Cerza
1b8d31986a Smarter s3tests branch selection
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-10-22 09:12:43 -06:00
Sage Weil
ecfcb2e04c Merge pull request #189 from ceph/wip-apache-max-requests
apache: set MaxRequestsPerChild to 0
2014-10-21 10:57:29 -07:00
Yehuda Sadeh
1fd89f4e43 apache: switch to use the apache worker mpm
Fixes: #9169

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit c3b53c3265)
2014-10-23 16:08:22 -07:00
Yehuda Sadeh
14b5a9afdd apache: change template to load mpm worker module
in apache 2.4

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 35c9cae84c)
2014-10-23 16:08:14 -07:00
David Zafman
a295c18a80 Thrasher: Disable ceph_objectstore_tool tests if old release missing command
Don't need to explicitly turn off the test during some upgrades
Leaving disabled until merge of import/export fixes

Fixes: #9805

Signed-off-by: David Zafman <dzafman@redhat.com>
2014-10-22 19:21:04 -07:00
Sage Weil
7e41c93ed8 tasks/thrashosds: support overrides
e.g.,

overrides:
  thrashosds:
    thrash_primary_affinity: false
...
tasks:
- install:
- ceph:
- thrashosds:
- workunit:
...

Needed for #9865

Signed-off-by: Sage Weil <sage@redhat.com>
2014-10-22 11:19:01 -07:00
David Zafman
bdbcf760d9 ceph_manager: ceph_objectstore_tool testing off by default
Signed-off-by: David Zafman <dzafman@redhat.com>
2014-10-22 10:34:26 -07:00
Zack Cerza
01b556afc1 Smarter s3tests branch selection
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
(cherry picked from commit 1b8d31986a)
2014-10-22 09:13:11 -06:00
Loic Dachary
e48a0a3924 erasure-code: unfound test needs a non empty file
Other rados put will fail as follows

$ touch /tmp/bar
$ ./rados -p rbd put existing_3 /tmp/bar
$ ./rados -p rbd put existing_3 /tmp/bar
WARNING: could not create object: existing_3
error putting rbd/existing_3: (17) File exists

it should be considered a bug in the rados command line but needs to be
addressed separately.

http://tracker.ceph.com/issues/9387 Fixes: #9387

Signed-off-by: Loic Dachary loic-201408@dachary.org
2014-10-20 14:41:10 -07:00
Gregory Farnum
28761d8bfd Merge pull request #181 from ceph/wip-client-flock
tasks/mds_client_recovery: file lock test

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-10-16 06:57:54 -07:00
Yehuda Sadeh
f4432e6386 apache: set MaxRequestsPerChild to 0
Otherwise the default is 10k.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2014-10-14 14:17:41 -07:00
Yehuda Sadeh
8a87a08477 tasks/s3tests: add slow backend configurable
Adding this so that we can modify the clients' conf file as needed with slow backend.
This can be achieved by:

overrides:
  s3tests:
    slow_backend: true

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 61409179df)
2014-10-14 11:36:24 -07:00
Yehuda Sadeh
61409179df tasks/s3tests: add slow backend configurable
Adding this so that we can modify the clients' conf file as needed with slow backend.
This can be achieved by:

overrides:
  s3tests:
    slow_backend: true

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2014-10-13 15:07:06 -07:00