Commit Graph

706 Commits

Author SHA1 Message Date
Loic Dachary
c604149727 add erasure code workload to upgrade/firefly-x
copied from suites/rados/thrash/workloads/ec-readwrite.yaml

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-07-01 15:44:58 +02:00
Sage Weil
f8282df84d rados/singleton/all/thrash_cache_writeback_forward_none: thrash cache pool drain
Enable/disable cache pool against a running workload.

Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-30 13:34:21 -07:00
Loic Dachary
3ec07cdc0e Merge pull request #43 from dachary/wip-firefly-x
add upgrade/firefly-x based on dumpling-x

Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-06-27 22:23:41 +02:00
Loic Dachary
d56b59de0d add upgrade/firefly-x based on dumpling-x
It is a s/dumpling/firefly/ mostly. With the exception of
rados/test-upgrade-firefly.sh which is dumpling specific.

The 'mon warn on legacy crush tunables: false' are dropped because they
no longer apply to firefly.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-27 22:20:19 +02:00
Sage Weil
5bb608c6a3 Merge pull request #42 from ceph/wip-smoke
upgrade: fix dumpling tests
2014-06-27 10:11:02 -07:00
Sage Weil
1c0dc1ce61 smoke: add rbd fsx + thrashing
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:52:02 -07:00
Sage Weil
3fa6dd21c3 smoke: add a mon thrash test
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:46:02 -07:00
Sage Weil
64ec775fe4 smoke: add some rados osd thrashing test
ec, caching, snaps

Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:44:07 -07:00
Sage Weil
e99eba9a3c smoke: specify fs on each run
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-26 09:43:39 -07:00
Samuel Just
77670aeadf thrashers/mapgap.yaml: ignore osd_map_cache_size warning
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-06-24 10:19:48 -07:00
Sage Weil
82d3a3dc06 smoke-tests -> smoke
Signed-off-by: Sage Weil <sage@redhat.com>
2014-06-20 11:43:20 -07:00
Sage Weil
28a2253aaa smoke: remove old smoke suite
Signed-off-by: Sage Weil <sage@redhat.com>
2014-06-20 11:42:31 -07:00
Samuel Just
09d02abe45 Revert "rados: Fix cache_flush, cache_try_flush, cache_evict and add hit_set_list"
cache_evict is kinda broken at the moment due to snapdir nonsense.  I'm reverting this
test for now until it's fixed so it doesn't obscure the test results.

Bug: 8629
This reverts commit 3dae48c7cd.
2014-06-19 14:25:30 -07:00
Greg Farnum
c883e310f3 enable kernel debugging on kclient fsx runs
Signed-off-by: Greg Farnum <greg@inktank.com>
2014-06-11 13:44:42 -07:00
Zack Cerza
8bc25bf5d7 Merge pull request #41 from ceph/wip-rados-op-fixes
rados: Fix cache_flush, cache_try_flush, cache_evict and add hit_set_lis...
2014-06-11 14:39:25 -05:00
tamil
479a67e0ad creating smoke-tests suite to include basic tests from all modules
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-06-06 01:08:10 -07:00
David Zafman
3dae48c7cd rados: Fix cache_flush, cache_try_flush, cache_evict and add hit_set_list
Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-06-05 18:24:59 -07:00
Josh Durgin
55fb559542 Merge pull request #40 from ceph/wip-runxfstests
wip-runxfstests

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-06-03 16:00:03 -07:00
Josh Durgin
4c2bee7642 Merge pull request #38 from ceph/wip-krbd-fsx
krbd: add librbd_fsx -K job

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-06-03 15:58:26 -07:00
Ilya Dryomov
f6c4d00642 krbd: add librbd_fsx -K job
Our fsx fork has recently gained a support for the krbd mode - add it
to the test suite.  Disable discard ops and randomized striping, both
of which aren't ready yet.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-06-03 02:05:57 +04:00
Ilya Dryomov
670735f785 krbd: catch up with run_xfstests.sh changes
In the current xfstests, tests cannot be listed in ranges.  Because of
this, and because our distribution of tests between our three clients
was pretty uneven, I've changed this job to run the whole auto group
(with some tests excluded by run_xfstests_krbd.sh) in random order on
two clients in parallel.  It takes longer to run, but it also spares
a test box and can potentially create a better test workload.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-05-31 14:51:56 +04:00
Sage Weil
5ca3c7230e multimds: fix fuse_default_permissions syntax
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-30 09:00:55 -07:00
Sage Weil
c427af0701 osd_heartbeat_grace from 20 -> 40 when running valgrind
This will mask occasional 'wrongly marked me down' errors when valgrind
is running (it makes things generally slow).

Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-28 10:11:05 -07:00
Sage Weil
e02a773a6d Merge pull request #36 from ceph/wip-objectstore
fix objecstore test
2014-05-21 17:09:48 -07:00
Yuri Weinstein
50dc3eac9e Added dumpling v0.67.9 version, removed older versions v0.67.2, v0.67.4, v0.67.8
This will reduce number of tests to run, some  may failed on old versions, see http://tracker.ceph.com/issues/8409

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2014-05-21 14:06:23 -07:00
Sage Weil
a4f00abaa6 rados/singleton-nomsgr/all/objectstore: skip ceph cluster setup
Not necessary; we just need it installed.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-20 22:09:48 -07:00
Sage Weil
5be30f0d9b rados/singleton-nomsgr/all/objectstore: clean up
ceph_test_objectstore scribbles in $CWD.  Keep it inside $TESTDIR and
clean up when we are done.

Fixes: #8395
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-20 22:09:48 -07:00
Gregory Farnum
7418d062d0 Merge pull request #34 from ceph/wip-fuse
fuse_defautl_permissions = 0;

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-05-20 06:58:39 -07:00
Sage Weil
e207e9038b multimds: fuse_default_permissions = 0
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-20 06:50:17 -07:00
Sage Weil
bf99313d06 multimds: factor install+ceph tasks out of other collections
Signed-off-by: Sage Weil <sage@inktank.com>
2014-05-20 06:48:29 -07:00
Gregory Farnum
4391ce5394 Merge pull request #31 from ceph/wip-fuse-permission
marginal/multimds: fuse_default_permissions = 0 for ceph-fuse
2014-05-14 13:09:25 -07:00
David Zafman
5ae93dd276 Merge pull request #32 from ceph/wip-8284
Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-05-07 12:49:40 -07:00
Warren Usui
4a3728d1f7 2-workload testrgw needs to be sequential.
Fixes: 8297
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-05-06 16:50:16 -07:00
David Zafman
99e67abc94 rados/thrash: Add pool_snaps variants
Fixes: #8284

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-05-05 11:18:14 -07:00
Yan, Zheng
8e1e4ba34e marginal/multimds: fuse_default_permissions = 0 for ceph-fuse
This can reduce the test time becuase it avoids sending getattr
request whenever the kernel checks inode permission.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-05-05 14:28:07 +08:00
Samuel Just
d2d7b941dd cache-snaps.yaml: set target_max_objects to test snap flush/evict
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-05-02 17:04:09 -07:00
David Zafman
18334ea3d3 rados/thrash: Fix workload of cache-agent-big
Create a log of objects and operate on some of them
(Initial object creation counts against total operations specified)
Add limit to 20 minutes

Fixes: 8263

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-05-01 14:39:18 -07:00
David Zafman
b080355902 Fix syntax of erasure coded pool creation
Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-05-01 10:52:57 -07:00
Yuri Weinstein
013a3b6c8f added new correctd tag 67.8 2014-04-30 18:41:50 -07:00
Yuri Weinstein
4322ade66a added latest dumpling tag v0.68.8 2014-04-30 16:35:02 -07:00
Yehuda Sadeh
ee69c7a4f3 rgw: update idle_timeout for rgw_s3tests_multiregion.yaml
Fixes: #8194

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-04-24 14:29:55 -07:00
Samuel Just
3a2c8886c3 rados: add ec and rep lost_unfound_delete tests
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-04-22 17:42:17 -07:00
Sage Weil
387110b119 rados/singleton/all/cephtool: whitelist scrub vs split vs agent issue
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-22 12:44:48 -07:00
Sage Weil
b7394efed7 multimds: bump up timeout for misc.yaml
This keeps timing out after 3h.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-21 06:56:35 -07:00
Sage Weil
d7967b428b rbd/thrash: factor out install + ceph
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-18 09:53:59 -07:00
Sage Weil
e97b865037 rbd: do most tests with a (small) cache pool in front
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-18 09:51:17 -07:00
Sage Weil
03a8444253 rbd/basic: factor out install + ceph
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-18 09:51:16 -07:00
Sage Weil
c623b3dd97 rados/thrash: whitelist 'must scrub before tier agent can activate'
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-18 06:59:27 -07:00
Josh Durgin
7afc277736 rados: include objectstore tests
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-04-17 18:58:33 -07:00
Zack Cerza
ba74f9078e Merge pull request #25 from ceph/wip-fastdumpemp-wusui
Reduce runs in the dumpling-emperor upgrade suite.
2014-04-14 12:55:47 -05:00
Sage Weil
9fa5c5faaf big: test xfs + btrfs
Note that previously we were specifying neither, so the OSDs were running
off of /.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-10 18:30:16 -07:00
Warren Usui
d4f2a8cebc Reduce runs in the dumpling-emperor upgrade suite.
Add + to 2-workload, 4-workload and 6-final-workload
suites.  Reduce 5-upgrade-sequence to only run two
tests and make sure upgrades to emperor occur in each
sequence.  Fix swift.yaml to not include rgw: clause
(this is already done by s3tests.yaml).

Fixes: #8051
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-09 14:20:58 -07:00
Yuri Weinstein
96e1774462 changed idle_timeout to 300 2014-04-08 10:11:29 -07:00
Sage Weil
b97c3803c5 rados/thrash: rejection backfill reservations sometimes while thrashing 2014-04-03 18:11:01 -07:00
Sage Weil
946a9685f1 rados/singleton-nomsgr: add multi-backfill reservation rejection test
This triggers #7922.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-03 18:08:19 -07:00
Sage Weil
0f6c92f076 Merge pull request #23 from ceph/wip-7771-wusui
FIxed dumpling - emperor upgrade suites
2014-04-03 15:11:05 -07:00
Sage Weil
39166b2d34 upgrade/dumpling-x: run dumpling version of s3tests
Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-03 14:22:32 -07:00
Warren Usui
a60b50d61d FIxed dumpling - emperor upgrade suites
Reformatted many of the yaml files.
Fixed duplication of workunit definitions.
Do not do install.upgrade on clients.
Included branch: definition in final workload files.

Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-04-03 13:02:36 -07:00
Sage Weil
267307e601 upgrade/dumpling-emperor-x: do not warn about tunables
We do the same for dumpling-x.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-03 11:42:52 -07:00
Sage Weil
a5a5ba3c84 upgrade/dumpling-emperor-x: ignore 'scrub mismatch' from mon
The encoded full osdmaps can differ due to a series of issues that were
fixed well after emperor.  We also whitelist this for dumpling-x.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-03 11:42:36 -07:00
Sage Weil
552f9d8dee multimds: test ceph-fuse and kclient
Add client as a variable on the basic collection.  Move the other stuff
(libcephfs plus a weird restart test) to libcephfs collection.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-04-02 17:13:39 -07:00
Sage Weil
48c36dc399 Merge pull request #21 from ceph/wip-thrash-affinity
krbd, kcephfs: trash osd primary-affinity
2014-03-31 20:47:24 -07:00
Yan, Zheng
2e283ce6d7 multimds: fuse_default_permissions = 0 for kernel build test
This can reduce the test time becuase it avoids sending getattr
request whenever the kernel checks inode permission.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-04-01 09:30:27 +08:00
Ilya Dryomov
a536fd13d3 krbd, kcephfs: trash osd primary-affinity
libceph.ko support is in testing and should be in 3.15.  This commit
effectively reverts commit 66ffaa6565 ("kcephfs, krbd: do not thrash
primary-affinity").

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-03-31 20:34:18 +04:00
Sage Weil
cb699f6a1a rados/monthrash: shorten mon pings so that freezing triggers reconnects
This exercises (tho it doesn't necessarily verify) the mon ping reconnect
code when the thrasher freezes the mons.

See #7888.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-28 16:17:00 -07:00
Sage Weil
5651ee8131 upgrade/dumpling-x/parallel: restart after cuttlefish->dumpling upgrade
Fixes: #7824
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-27 17:58:09 -07:00
Samuel Just
68343ee193 rados/thrash/workloads: make cache-agent-big use an ec base pool
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-03-27 11:51:44 -07:00
Josh Durgin
b454bd6cb5 rgw: add erasure coded data pool variant
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-26 20:01:40 -07:00
Josh Durgin
bf90414a9e rgw: set max-entries to 10 for data sync test
This way it tests the agent generating more than max-intries writes to
a bucket.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-24 15:05:20 -07:00
Sage Weil
798daf5886 upgrade/dumpling-x/stress-split: set fastcgi idle timeout to 2 min
30 seconds isn't enough when combined with osd thrashing.

Fixes: #7702
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-20 16:51:03 -07:00
Sage Weil
6fd5ca9cff upgrade/dumpling-x/parallel: test cuttlefish->dumpling starting point
Maybe this will trigger #7519.  And anyway, it's good coverage.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-18 21:34:25 -07:00
wusui
cb194770e4 Merge pull request #20 from ceph/wip-distros
symlink all distros facets to a common set of 'supported' targets
2014-03-18 15:02:25 -07:00
Sage Weil
99f4e9dda3 symlink all distros facets to a common set of 'supported' targets
This makes it easier to maintain the supported/tested targets.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-18 13:39:13 -07:00
Sage Weil
d7f3eb34d9 knfs: make it a list
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-18 06:54:48 -07:00
Sage Weil
299766073e knfs: async export
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-17 18:26:56 -07:00
Sage Weil
a42e197f5d rados/monthrash: add pool create/delete tests
This is sufficient to trigger #7736 when combined with mon thrashing and
mon msg delay injection.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-17 16:16:50 -07:00
Sage Weil
eb6cd3a6f4 nkfs: 6h timeout of kernel build
Yes, NFS reexport is slow.  But at the moment appears to be reliable.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-17 06:56:36 -07:00
Sage Weil
2c875593c8 multimds: fix misc -> fs/misc paths
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-15 11:12:46 -07:00
Sage Weil
7597172695 upgrade/dumpling-x/stress-split: tolerate legacy crush tunables
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-15 09:18:33 -07:00
Yuri Weinstein
752380dc96 added print task 2014-03-14 15:46:04 -07:00
Sage Weil
22c461b501 upgrade/dumpling-x: more mon scrub whitelist
There are two log messages; whitelist them both

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-14 08:31:59 -07:00
Sage Weil
2e487d8afc knfs: test v3 and v4
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-14 08:21:47 -07:00
Yan, Zheng
4773a27789 knfs: add fsstress and kernel build
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-03-14 09:34:38 +08:00
Sage Weil
e1694b4c60 knfs: restructure a bit
Separate cluster buildup from tasks.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-13 17:42:51 -07:00
Sage Weil
7b0eda03ee nfs -> knfs
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-13 17:39:32 -07:00
Sage Weil
adca646413 workunits/misc -> fs/misc
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-13 17:36:05 -07:00
Sage Weil
8b4c8cbf1a upgrade/dumpling-x: whitelist mon scrub mismatch
A mixed dumpling/firefly cluster will have each mon independently encode
the full map.  Firefly now puts feature bits in the Incremental so that
we encode the "right" way, but dumpling doesn't have that capability
yet, and we don't plan to backport it.

Fixes: #7704
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-13 16:27:56 -07:00
Sage Weil
efdee0d31c upgrade/dumpling-x: upgrade final client node for final test
This means the final workloads are running firefly code.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-12 15:37:13 -07:00
Sage Weil
7fb5e14691 upgrade/dumpling-x: full librados tests after full upgrade
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-12 14:49:54 -07:00
Sage Weil
d5442a57b5 multimds: new (separate) suite for multi-mds tests
Eventually we can merge this into the fs suite, but for now it is useful
to segregate the test cases.

Start with a dup of basic and verify sections; add others later.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-11 21:11:42 -07:00
Sage Weil
88efa65e6c Revert "fs/basic: multimds"
This reverts commit aea501beb7.

Let's put this in a separate subdir for now.  It won't pass on firefly because
the libcephfs changes aren't there.
2014-03-11 21:07:44 -07:00
Sage Weil
a18cd6ddba Merge remote-tracking branch 'gh/firefly' 2014-03-11 19:16:52 -07:00
Sage Weil
cfbbcf7c08 upgrade/dumpling-x/stress-split: use dumpling workunits
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-11 19:16:39 -07:00
Sage Weil
c0b1c1070f Merge pull request #16 from ceph/wip-hint-tests
rados/singleton-nomsgr: add allocation hint test

Reviewed-by: Sage Weil <sage@inktank.com>
2014-03-11 18:11:05 -07:00
Yuri Weinstein
72094a8586 fixed final_load problem 2014-03-11 15:40:58 -07:00
Sage Weil
728bd3c551 upgrade/dumpling-x: upgrade mon before osd
The MDS needs to see the TMAP2OMAP feature bit in the osdmap.  THe mons
have to encode the feature bits passed by the new osds in order for that
to happen.  Ergo, upgrade mons first.

This is only important for the MDS and for users who want to use erasure
coded pools or tiering without restarting the osds *again* after the mons
get upgraded.

Fixes: #7679
Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-11 12:11:25 -07:00
Josh Durgin
f92d3a5667 rgw: add data sync test
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-09 23:35:11 -07:00
Josh Durgin
e5a43b75ac rgw: use different keys for different system users
Only one of these was being used before, due to a bug in
teuthology. This is fixed, and trying to create a second user with the
same access key fails.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-03-09 23:29:20 -07:00
Sage Weil
2cf0908946 upgrade/dumpling-x: fix order
Make it match the filename.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-09 14:27:09 -07:00
Sage Weil
9db665644e upgrade/dumpling-x: do not thrash primary-affinity
We can't do it on a mixed cluster

Signed-off-by: Sage Weil <sage@inktank.com>
2014-03-07 15:46:14 -08:00