Commit Graph

3860 Commits

Author SHA1 Message Date
Sage Weil
be37339899 Merge remote-tracking branch 'gh/next'
Conflicts:
	machine_types/vps.yaml
2014-12-09 12:38:54 -08:00
Loic Dachary
ab822cb385 Merge pull request #261 from ceph/wip-10223
Fixes #10269 http://tracker.ceph.com/issues/10269

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-12-08 21:27:37 +01:00
Yuri Weinstein
1156a74705 Fixes #10269 http://tracker.ceph.com/issues/10269
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-12-08 11:12:04 -08:00
Josh Durgin
f3b3d75542 radosgw_admin: test full sync using existing tests
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2014-12-05 21:04:08 -08:00
Yuri Weinstein
50abebb5b9 Merge pull request #259 from ceph/wip-10223
Changed workloads in 2-workload to run in parallel
2014-12-04 14:50:48 -08:00
Yuri Weinstein
4487c3b092 Changed workloads in 2-workload to run in parallel
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-12-04 14:48:23 -08:00
Zack Cerza
a45663c543 Merge pull request #212 from ceph/wip-9117-wusui
Move output in task/s3readwrite
2014-12-03 14:17:26 -07:00
Yuri Weinstein
108dab6a33 Update vps.yaml
See http://tracker.ceph.com/issues/10178
2014-12-02 09:25:00 -08:00
Yuri Weinstein
2bb1e52414 Update vps.yaml 2014-12-02 09:24:11 -08:00
John Spray
8fc3550002 tasks/ceph: move FS creation inside Filesystem
Leave the legacy handling out in cephfs_setup, move
the filesystem creation stuff into Filesystem.  I
anticipate this being the right place for it if/when
we have tests that want to do 'fs rm' 'fs new' type
cycles within themselves.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-02 13:31:57 +00:00
John Spray
89beed1b0a tasks/ceph: conservative PG count in FS pools
This was tripping over the recent commit 42c85e80
in Ceph master, which tightens the limits on
acceptable PG counts per OSD, and was making
teuthology runs fail due to never going clean.

Rather than put in a new hardcoded count, infer
it from config.  Move some code around so that
the ceph task can get at a Filesystem object
to use in FS setup (this already has conf-getting
methods).

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-02 13:30:06 +00:00
John Spray
fd3aaec8c3 Merge pull request #249 from ceph/wip-9557
tasks: add mds_auto_repair

Reviewed-by: John Spray <john.spray@redhat.com>
2014-12-02 10:50:31 +00:00
Yan, Zheng
d761831133 tasks: add mds_auto_repair
New CephFS tests for MDS's auto repair functions. (So far the only
test case is verify/repair backtrace on fetch dirfrag)

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2014-12-02 16:26:51 +08:00
Warren Usui
26a33c3a5a Move output in task/s3readwrite
The s3readwrite.py task formerly wrote too much output while excuting.
It now saves the data on the local machine in either the archive
directory or in /tmp if no archive directory is specified.
The new file contains a client name and timestamp in its name.
Once all processing has completed, that file is saved locally.

Fixes: 9117
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-12-01 11:01:26 -08:00
Yuri Weinstein
7fd26c4dbb Update vps.yaml
Fixed syntax
2014-11-26 09:17:49 -08:00
Yuri Weinstein
7e0fd5026c Update vps.yaml
Fixed syntax
2014-11-26 09:17:09 -08:00
Yuri Weinstein
6086ad53c0 Fix fro #10178
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-11-25 08:35:58 -08:00
Yuri Weinstein
3d47b7305f Fix for #10178
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-11-25 08:30:44 -08:00
David Zafman
c59af44460 Merge pull request #244 from dachary/wip-objectstore-tool
add erasure coded pool tests to objectstore tool

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 15:40:54 -08:00
David Zafman
6923e68dac ceph_objectstore_tool: minor fixes
Remove development comment
nullfd isn't used anymore
s/log.errors/log.error/

Signed-off-by: David Zafman <dzafman@redhat.com>
2014-11-20 22:38:26 +01:00
David Zafman
a09d3a389d ceph_objectstore_tool: fix flake8 issues
Signed-off-by: David Zafman <dzafman@redhat.com>
2014-11-20 22:38:26 +01:00
David Zafman
f10edda4bc ceph_objectstore_tool: add assert so that teuthology knows when this test fails
Signed-off-by: David Zafman <dzafman@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
9a089ef369 ceph_objectstore_tool: skip unused osds
When the number of objects is low, some OSDs may not be used at all.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
be39bd5d84 ceph_objectstore_tool: run tests on erasure coded pools
Create an erasure coded pool and run tests on it. The list of PGs is
adapted to contain the shard id.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
fbb33f3577 ceph_objectstore_tool: only run get/set bytes for replicated pools
It needs to be adapted to run with erasure coded pools.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
2b57f4c59c ceph_objectstore_tool: use CephManager::get_pool_dump
Instead of custom made get_pool_id function.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
d0caf5cdff ceph_objectstore_tool: add pgnum option
Instead of hardcoding 12 use a configuration option that defaults to
12. It is handy during development to lower the number to 4 and speed up
the test cycle.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
c9e6edebd9 ceph_objectstore_tool: encapsulate into a function
Move code out of the task into function. Also remove the "REP" specifics
from helper functions that could also be used for erasure coded pools.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
d591226373 ceph_objectstore_tool: add hinfo_key tests for erasure coded objects
When an hinfo_key attribute is found, assume an erasure coded object and
verify set-attr/get-attr works as expected by removing its content and
restoring it.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
9ef8887a3b ceph_objectstore_tool: keep all json object representation
For erasure coded pools to be tested, the json object representation
must be preserved for all PG because they are all different. The
internal representation is changed from

   db[name]["pgid"] = pg
   db[name]["json"] = objjson

to a per pg map:

   db[name].setdefault("pg2json", {})[pg] = objjson

and the rest of the code is modified to adapt accordingly.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
f9367ae3c7 ceph_objectstore_tool: tests only needs 1 machine
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
b925be13bc ceph_manager: add pool type constants
The osd dump command displays pool types using numerics instead of
symbolic names. Create constants in the CephManager class to use instead
of numbers.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
fd1ec39d38 ceph_manager: fix typo in get_pgid docstring
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
2abb9f9087 ceph_manager: factorize with get_pool_dump
Replace code that duplicates get_osd_dump_json with a call to the
function.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:25 +01:00
Loic Dachary
6dac43fa46 ceph_manager: factorize with get_osd_dump_json
Replace code that duplicates get_osd_dump_json with a call to the
function.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-20 22:38:17 +01:00
Sage Weil
9066337ed7 Merge pull request #243 from ceph/wip-10057-next
ms die on skipped message = false for all krbd, kclient tasks
2014-11-20 10:18:27 -08:00
Sage Weil
761ae23899 Merge pull request #240 from ceph/wip-10057
ms die on skipped message = false for all krbd, kclient tasks
2014-11-20 10:18:12 -08:00
Loic Dachary
5fc42b98ab ceph_manager: add get_pool_dump to return the json pool dump
Get the part of ceph osd dump specific to the pool given in argument.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-19 23:19:13 +01:00
Loic Dachary
f353c150a8 ceph_manager: add get_osd_dump_json to get the full output
Converts ceph osd dump_json into a python object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-19 23:19:13 +01:00
Zack Cerza
2ef737ecfd Merge pull request #197 from ceph/wip-calateuth-wusui
Wip calateuth wusui
2014-11-19 13:59:01 -07:00
Warren Usui
852fe69af4 Further changes for calamari_setup.py
Made suggestions from code reviews.
Added no_epel option.
Merged Dan Mick's changes that add the ability to get
iceballs from http URL.
Remove duplicate assignment and added some log.debugs

Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-11-18 19:06:24 -08:00
Warren Usui
357fd22f04 Add calamari_setup
Calamari_setup can be used to set up a calamari gui for manual testing,
or be run in a suite to test the calamari setup and calamari ceph
installation code.

Fixes: 9759
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-11-18 19:06:24 -08:00
Yuri Weinstein
53cbf914cb Merge pull request #247 from ceph/wip-next-yuriw
Copied giant-x suite to next branch
2014-11-17 08:53:52 -08:00
Yuri Weinstein
6c53c4d905 Merge pull request #246 from ceph/revert-245-wip-next-yuriw
Revert "Copied giant-x suite to next branch"
2014-11-17 08:52:21 -08:00
Yuri Weinstein
a10e7d3427 Revert "Copied giant-x suite to next branch" 2014-11-17 08:51:39 -08:00
Yuri Weinstein
039d89dc16 Merge pull request #245 from ceph/wip-next-yuriw
Copied giant-x suite to next branch
2014-11-17 08:45:24 -08:00
Yuri Weinstein
2c442c93ec Copied giant-x suite to next branch
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-11-17 08:42:31 -08:00
Sage Weil
b4f14129e6 ms die on skipped message = false for all krbd, kclient tasks
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 219b72b6fd)
2014-11-13 21:16:15 -08:00
Sage Weil
219b72b6fd ms die on skipped message = false for all krbd, kclient tasks
Signed-off-by: Sage Weil <sage@redhat.com>
2014-11-13 21:12:48 -08:00
Sage Weil
c58af9f26b fs/basic/tasks/cfuse_workunit_misc: timeout at 6h
The multiple_rsync can take a while.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-11-13 06:58:22 -08:00