Commit Graph

3971 Commits

Author SHA1 Message Date
David Zafman
b239dadc02 ceph_manager: Fix Thrasher kill_osd() to ignore pool going away
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
4eda2967a4 ceph_manager: Thrasher fixes to run() calls to set check_status = False
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
e0b0d41e4c ceph_manager: Re-enable Thrasher ceph-objectstore-tool testing
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
4a195c78c1 ceph_manager: In Thrasher randomly remove past intervals
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
f9e088fcbc ceph_manager: In Thrasher disable ceph_objectstore_tool tests if old release missing command
Require ceph-objectstore-tool to be available on all OSD nodes
Log a message when tool is not available

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
Gregory Farnum
4761c2c094 Merge pull request #308 from ceph/wip-10579
suites/fs: isolate quota task

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-01-21 07:08:45 -08:00
John Spray
82159315b6 suites/fs: isolate quota task
Quota script is moved out of fs/misc so that kclient
doesn't try to run it.  Update cfuse suite to find
the new location, and only enable quota for this
one script rather than enabling across
all misc tests.

Fixes: #10579
Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-21 14:39:47 +00:00
Haomai Wang
e92d2e4ca0 rados: include msgr tests
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2015-01-21 01:05:39 +08:00
John Spray
a6b8e823f4 tasks/mds_flush: use new stray/purge perfcounters
Where previously we only tracked RADOS-level delete
ops during deletion, now also verify that they
correspond to the right number of MDS-level purge
operations.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-19 22:00:53 +00:00
John Spray
1b2ec97256 Merge pull request #285 from ceph/wip-9883
tasks/mds_journal_repair: create new test

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-01-19 21:20:11 +00:00
John Spray
2c1cef6b5d tasks/mds_journal_repair: add test_table_tool
Explicit test of the tool's various modes, to
complement the places it's used in other tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-19 19:36:34 +00:00
John Spray
bf13a4e062 tasks/mds_journal_repair: create new test
This tests the new #9883 repair functionality
where we selectively scrape dentries out of
the journal while the MDS is offline.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-19 19:36:34 +00:00
Alfredo Deza
a6bca74722 Merge pull request #298 from ceph/wip-bi-sharding-3
Wip bi sharding 3
2015-01-19 12:17:27 -05:00
Yuri Weinstein
11a8881cd1 Merge pull request #300 from ceph/restore_giant-x_on_master
Restored giant-x suite on master
2015-01-16 14:45:13 -08:00
Yuri Weinstein
19ca3538b4 Merge pull request #301 from ceph/restore_giant-x_on_next
Restore giant x on next
2015-01-16 14:45:00 -08:00
Yuri Weinstein
927a9905b8 Restored giant-x on next
Signed-off-by: Yuri Weinstein <yuriw@magna002.ceph.redhat.com>
2015-01-16 14:48:53 -05:00
Yuri Weinstein
21a4afc24b Restored giant-x suite on master
Signed-off-by: Yuri Weinstein <yuriw@magna002.ceph.redhat.com>
2015-01-16 14:46:16 -05:00
Andrew Schoen
b1d9f602c4 Merge pull request #288 from dmick/master
Tweaks to calamari-setup
2015-01-15 16:01:30 -06:00
Yehuda Sadeh
3d420ff1dd radosgw_admin: don't use boto for testing 301 responses
boto follows up on the redirects. Switched to using httplib2 for sending
this request.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2015-01-14 15:10:23 -08:00
Yehuda Sadeh
adc9bdae34 rgw: set default region and zone to all clients
Otherwise it's going to use zone 'default' for client.0, not as expected. Also
add region configuration to task.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2015-01-14 14:38:55 -08:00
Loic Dachary
74bef7f488 Merge pull request #291 from dachary/wip-10018-scrub
add erasure code repair / scrub tests (take 2)

Reviewed-by: David Zafman <dzafman@redhat.com>
2015-01-14 09:29:19 +01:00
Jianpeng Ma
2e5dcf2a66 test: add write_fadvise_dontneed.yaml to test write_fadvise_dontneed.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2015-01-14 13:34:25 +08:00
Jianpeng Ma
717dffe7c2 rados.py: Add write_fadvise_dontneed field
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2015-01-14 11:36:25 +08:00
Loic Dachary
e580eca3e3 repair_test: hinfo_key error injection
Add a function dedicated to erasure coded pools tests, similar to
repair_test_1. Add a corrupter that removes the hinfo_key from the object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 12:31:15 -08:00
Loic Dachary
ae68658339 ceph_manager: add ceph-objectstore-tool wrapper
Add the CephManager.objectstore_tool method to encapsulate a call to
ceph-objectstore-tool. The wrapper can convert an object name into the
PG id and figure out the primary OSD. The designated OSD is stopped
before running the command and restarted afterwards.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 12:31:15 -08:00
Loic Dachary
0465c0c53f ceph_manager: add object helpers
Add CephManager.methods to get information regarding the pools and PGs
used to store a given object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 12:31:15 -08:00
Loic Dachary
f3bd336dbe repair_test: rework indentation to make it pep8 clean
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 12:31:15 -08:00
Loic Dachary
f08d95a5ea repair_test: rework to remove levels of indirection
The commit is large but does not introduce any semantic change and
consists primarily in code moving around, re-indented and removed.

Replace functions generating functions by functions and sequentially
iterating over a list of functions with a sequential call to the
functions.

Replace the setup/teardown with an equivalent using a with
statement and the ceph_manager.pool method.

Replace inline code with a call to ceph_manager.wait_for_all_up

It makes it easier to modify the tests, for instance to create erasure
coded pools and tests specific to them.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 12:31:15 -08:00
Loic Dachary
bd4926c4ac ceph_manager: rework indentation to make it pep8 clean
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 20:22:33 +01:00
Loic Dachary
50e7e6df2b ceph_manager: fix docstring typo
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 20:18:25 +01:00
Loic Dachary
7234481bae ceph_manager: define pool context
To create a pool before running a code bloc and remove it after.

   with manager.pool("mypool"):
        mytest..

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 20:18:25 +01:00
David Zafman
940a990b99 Merge pull request #290 from ceph/revert-250-wip-10018-scrub
Revert "add erasure code repair / scrub tests"
2015-01-13 11:14:14 -08:00
David Zafman
7029dba08a Revert "add erasure code repair / scrub tests" 2015-01-13 11:12:25 -08:00
Warren Usui
f36b171816 Merge pull request #286 from ceph/wip-10261-wusui
Calamari_setup now allows > 1 mon.
2015-01-13 10:57:31 -08:00
Loic Dachary
4d52523c21 Merge pull request #250 from dachary/wip-10018-scrub
add erasure code repair / scrub tests

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 19:44:22 +01:00
Loic Dachary
01174518b8 repair_test: hinfo_key error injection
Add a function dedicated to erasure coded pools tests, similar to
repair_test_1. Add a corrupter that removes the hinfo_key from the object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 15:07:47 +01:00
Loic Dachary
236049b27d ceph_manager: add ceph-objectstore-tool wrapper
Add the CephManager.objectstore_tool method to encapsulate a call to
ceph-objectstore-tool. The wrapper can convert an object name into the
PG id and figure out the primary OSD. The designated OSD is stopped
before running the command and restarted afterwards.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 15:07:43 +01:00
Loic Dachary
372665d1ec ceph_manager: add object helpers
Add CephManager.methods to get information regarding the pools and PGs
used to store a given object.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 14:42:19 +01:00
Loic Dachary
f3a91d2ecd repair_test: rework indentation to make it pep8 clean
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 14:42:15 +01:00
Loic Dachary
9203259ec3 repair_test: rework to remove levels of indirection
The commit is large but does not introduce any semantic change and
consists primarily in code moving around, re-indented and removed.

Replace functions generating functions by functions and sequentially
iterating over a list of functions with a sequential call to the
functions.

Replace the setup/teardown with an equivalent using a with
statement and the ceph_manager.pool method.

Replace inline code with a call to ceph_manager.wait_for_all_up

It makes it easier to modify the tests, for instance to create erasure
coded pools and tests specific to them.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 14:37:35 +01:00
Loic Dachary
764f6159ba ceph_manager: rework indentation to make it pep8 clean
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 14:37:35 +01:00
Loic Dachary
1f14626b04 ceph_manager: fix docstring typo
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 14:37:35 +01:00
Loic Dachary
666aecc121 ceph_manager: define pool context
To create a pool before running a code bloc and remove it after.

   with manager.pool("mypool"):
        mytest..

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-01-13 14:37:35 +01:00
David Zafman
e2494c5050 Fix objectstore name changed to keyvaluestore
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-13 14:37:35 +01:00
David Zafman
7d4bb5529c ceph_manager: Fix Thrasher kill_osd() to ignore pool going away
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-13 14:37:35 +01:00
David Zafman
cf8bc063d5 ceph_manager: Thrasher fixes to run() calls to set check_status = False
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-13 14:37:35 +01:00
David Zafman
1903b7bee0 ceph_manager: Re-enable Thrasher ceph-objectstore-tool testing
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-13 14:37:35 +01:00
David Zafman
b6f7b17b5c ceph_manager: In Thrasher randomly remove past intervals
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-13 14:37:35 +01:00
David Zafman
0df5e84b69 ceph_manager: In Thrasher disable ceph_objectstore_tool tests if old release missing command
Require ceph-objectstore-tool to be available on all OSD nodes
Log a message when tool is not available

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-13 14:37:35 +01:00
Dan Mick
4c27048b12 tasks/calamari_setup: build ice-tools virtualenv if building iceball
ice-tools needs a virtualenv populated to properly run to build
an iceball; add the commands to do that.  Also remove the built
iceball when the task exits.

Fixes: #10523
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-01-12 19:56:58 -08:00