Commit Graph

872 Commits

Author SHA1 Message Date
Loic Dachary
6334196a39 Merge pull request #950 from dachary/wip-buildpackages-xenial
buildpackages: xenial support
2016-04-09 19:37:53 +02:00
Robin H. Johnson
a33517a88f buildpackages: add build timeouts.
The build/upload process CAN get stuck sometimes. As we are paying
utility rates for the high-power build server, we should timeout when
it's likely the build is stuck.

Use a default timeout just short of 4 hours, as some providers round up
partial instance-hours for billing.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:44:04 +02:00
Robin H. Johnson
df5d147094 buildpackages: support ubuntu 12.04.
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:42:13 +02:00
Robin H. Johnson
cd4b7ad642 buildpackages: fix configure on Ubuntu 12.04.
Ubuntu 12.04/precise has a buggy lttng; it fails our lttng-is-sane
check, as it leaves out headers.

This should not stop building of Ceph, as the automatic build handling
from debian/rules will correctly omit LTTNG on Precise.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:42:13 +02:00
Robin H. Johnson
785801c2e9 buildpackages: catch VM instances in ERROR state.
It is possible for 'server create' to return success, but then NOT have
a good VM afterwards. The instance will be in state ERROR.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:42:09 +02:00
Orit Wasserman
6927f64866 rgw: add default zone name
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-08 23:29:55 +02:00
Orit Wasserman
4534e8ed61 rgw: policy acl format should be xml
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-08 22:46:31 +02:00
Loic Dachary
465ff97711 buildpackages: add ubuntu 16.04 xenial support
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-08 13:30:09 +02:00
Samuel Just
7e53203e80 rados/singleton-nomsgr: add lfn upgrade tests
Upgrade from hammer/infernalis to x and verify lfn objects are valid
across upgrade.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
4629585536 tasks: add create_verify_lfn_objects
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
93892eb82a ceph_manager: return exit status on do_get, do_put, do_rm
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
269d6002f1 ceph_manager: add do_rm
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
670ca43dfc ceph_manager: extend do_put and do_get to allow a namespace
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
c8f7694d52 ceph_manager: fix do_get to actually do a get
Currently unused.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Loic Dachary
c655de7ef3 buildpackages: discard google-perftools on trusty aarch64
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-07 15:36:22 +02:00
Greg Farnum
5e7e017d7d cephfs: update tests to enable multimds when needed
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-06 16:32:44 -07:00
Loic Dachary
5ab482e82c arch: teuthology must use aarch64, not arm64
teuthology / gitbuilder / ansible_architecture arch is

   dpkg-architecture --query DEB_HOST_GNU_CPU (x86_64 and aarch64)

deb package Architectures: (conf/distributions) is

   dpkg-architecture --query DEB_HOST_GNU_ARCH (amd64 and arm64)

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
Loic Dachary
42836aaf2f buildpackages: runabove has 30GB root disk max
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
Loic Dachary
3e7f311b76 buildpackages: install rsync
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
Loic Dachary
4f1029102a buildpackages: add missing arm64 to make-deb.sh
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
John Spray
ac383735ae tasks/cephfs: test health messages from readonly stat
Signed-off-by: John Spray <john.spray@redhat.com>
2016-04-06 17:17:32 +01:00
Loic Dachary
86619401ab buildpackages: add debian 8.0 support
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-31 14:49:25 +02:00
John Spray
9263bef283 tasks/cephfs: update vstart_runner for cmake build changes
All binaries now go into bin/

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-29 12:13:37 +01:00
John Spray
240c0dd2f0 tasks/cephfs: reproducer for #15303 client bug
Run through two-client scenario where the first client
thinks a dir is empty even though the second client
has written some files to it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-29 12:13:15 +01:00
John Spray
4f33f263eb tasks/cephfs: tidy Mount.ls to return [] on empty dir
Previously returned ['']

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-29 12:13:15 +01:00
Loic Dachary
c6bf2cd4a2 Merge pull request #908 from dachary/wip-archs
archs: add files for each known architecture
2016-03-29 01:01:32 +02:00
Loic Dachary
b976563af2 buildpackages: do not try tcmalloc on arm64
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 21:58:42 +02:00
Loic Dachary
b9b00a5ddb buildpackages: desambiguate nic on server create
When there are more than one network, it is required to select the one
to be attached to the nic of the instance.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 19:52:00 +02:00
Sage Weil
826aaad0bd Merge remote-tracking branch 'gh/jewel' 2016-03-28 12:39:11 -04:00
Loic Dachary
a8f4321f5c buildpackages: build will work on a range of flavors
When selecting a flavor to build, we prefer the largest we can find and
fallback to smaller ones, down to the minimum acceptable flavor, if
there is no other available.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Loic Dachary
c5182f257c buildpackages: do not hardcode x86_64 in build scripts
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Loic Dachary
f9c4858a26 buildpackages: use architecture suffixed images
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Loic Dachary
40277ca6a9 archs: add files for each known architecture
So that they can be prepend to teuthology-suite to run a job on a
designated architecture.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Gregory Farnum
11963dcd3e Merge pull request #905 from ceph/wip-15065
tasks/cephfs: extend TestMultiFilesystems
2016-03-24 18:01:41 -07:00
Yan, Zheng
b977e86f5d tasks/cephfs: test for request caps during lookup/open
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-24 17:47:53 -07:00
Gregory Farnum
f5a1cab663 Merge pull request #874 from ceph/jewel-15008
Jewel 15008

Reviewed-by: John Spray <john.spray@redhat.com>
2016-03-23 17:09:02 -07:00
John Spray
41b27979f1 tasks/cephfs: extend TestMultiFilesystems
...with cases for standby_for_rank and standby_for_fscid.

Fixes: #15065
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-22 12:03:13 +00:00
John Spray
bea9b5bb2e tasks: fix ceph_deploy call to Filesystem()
Fixes: #15204
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-21 10:13:25 +00:00
Loic Dachary
1cc657798a buildpackages: provision a small build machine for tests
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-19 11:15:22 +01:00
Sage Weil
7567c80885 Merge remote-tracking branch 'gh/jewel' 2016-03-17 09:27:07 -04:00
Dan Mick
228f71e176 tasks/ceph.py: Remove *.pid at end of run
http://tracker.ceph.com/issues/15162
Fixes: #15162
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2016-03-16 15:50:30 -07:00
Loic Dachary
c9a1f767c2 Merge pull request #882 from dachary/wip-buildpackages
buildpackages: allow for packages to be re-used for releases
2016-03-16 14:40:03 +01:00
Loic Dachary
63c1a6f9ed buildpackages: ensure clone to a ceph directory
In case the repository from which the clone is not named ceph.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
df3eba0f6b buildpackages: for source inclusion in debian
We do not build debian versions (i.e. -2 -3 etc). Even if the debian
detection logic infers that the previous debian version already had the
source package, it is incorrect.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
33b4397da8 buildpackages: allow for more parallel builds
Builds are in parallel if the OS type / version and the SHA1 are
different. Having just one build at a time for a given SHA1 slows thing
down when there are more than a few supported OS.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
c60ace31ea buildpackages: enable autoindex in the packages repository
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
b30655eeb6 buildpackages: do not requires the long tag version
So that v10.1.0 is used instead of 10.1.0-0-g35ac827 when possible.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
5e145c1a2f buildpackages: also pull tags from the user ceph fork
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
d1f456850c workunit: git checkout sha1/branch/tag
git clone --branch refspec only accepts branches and tags but not a sha1
git reset --hard refspec only accepts tags and sha1 but not branches

Use git checkout because it interprets branches, tags and sha1 as
expected.

$ git checkout jewel
Branch jewel set up to track remote branch jewel from origin.
Switched to a new branch 'jewel'
$ git checkout v0.94.6
HEAD is now at e832001... 0.94.6
$ git checkout b2503b0e15
HEAD is now at 95cefea... 0.94.3

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 09:25:56 +01:00
Gregory Farnum
7413c38bdf Merge pull request #875 from ceph/wip-15124
tasks/cephfs: support old mdsmap command during setup
2016-03-15 22:33:29 -07:00
Dan Mick
3f54da5eb2 Merge pull request #836 from ceph/wip-fix_cdtest
fix ceph-deploy test

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-03-15 12:58:18 -07:00
Gregory Farnum
6254215399 Merge pull request #861 from ceph/wip-vstart-fixes
tasks/cephfs: vstart & fuse improvements
2016-03-15 12:41:07 -07:00
Gregory Farnum
5116fb07f0 Merge pull request #867 from ceph/jewel-15050
tasks/cephfs: cover fancy layout in test_strays
2016-03-15 12:27:47 -07:00
John Spray
9e202b44c8 tasks/cephfs: support old mdsmap command during setup
While Filesystem at large requires the new commands, for
use from the `ceph` task we must support old style commands,
as the ceph task is used to instantiate old clusters during
upgrade testing.

Fixes: #15124, #15049, #15106

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-15 16:52:49 +00:00
Loic Dachary
96ef6ab699 workunit: git-reset --hard does not accept a branch
Uses git clone --branch refspec because it agrees to use either a tag or
a branch.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-15 16:34:26 +01:00
Yan, Zheng
4a65da5962 cephfs/test_client_limits.py: trim cache when mounting into subdir
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-15 19:48:01 +08:00
Vasu Kulkarni
4e145658a7 Fix review comments
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2016-03-12 02:15:39 -05:00
Jason Dillaman
77ca8030cd Merge pull request #868 from ceph/wip-fio-ver
Update fio version to 2.7

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-03-11 18:36:57 -05:00
Vasu Kulkarni
e805ebc459 Update fio version to 2.7
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2016-03-11 12:36:33 -05:00
Yan, Zheng
a54bf91de6 tasks/cephfs: cover fancy layout in test_strays
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-11 20:15:56 +08:00
John Spray
9915752acd tasks/cephfs: enable multi fs flag
Cluster won't let you create more than without
setting this flag explicitly.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:40:12 +00:00
John Spray
e1634ed2ed tasks/cephfs: debug in wait_for_daemons
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:40:11 +00:00
John Spray
e666fddf51 tasks/cephfs: switch off extra daemons in TestStrays
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:39:37 +00:00
John Spray
53f4430d03 tasks/cephfs: further thrasher fixes
Move the thrasher-specific methods out of CephManager
into MDSThrasher and plumb them into MDSCluster.

Signed-off-by: John Spray <john.spray@redhat.com
2016-03-11 10:39:37 +00:00
John Spray
9ca3721d72 tasks/cephfs: simplify recreate()
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:39:36 +00:00
John Spray
09f239f262 tasks/cephfs: update test_journal_repair for multi fs
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
c94d50258d tasks/cephfs: add TestStandbyReplay
In addition to the multi-fs tests, more localised
standby-replay cases.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
212a507e04 tasks/cephfs: fix datascan for multiple filesystems
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
e2176667a0 tasks/cephfs: move the journaltool smoke test into python land
This is one of those things that had a convoluted .yaml file
because it predated the ability to write explicit procedural
python tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
951102df37 tasks/cephfs: rename Filesystem.reset to recreate
Name was ambiguous wrt "fs reset"

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
b02afb2a2a tasks: fix mds_thrash for multi filesystems
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
3c3804ec16 tasks/cephfs: update test_runner for mds_cluster
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
22b350de86 tasks: generalise cephfs classes for multi-fs
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
8528cccf63 tasks: add cephfs TestMultiFilesystems
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:42 +00:00
John Spray
a693be2792 tasks/cephfs: vstart & fuse improvements
A couple of corner cases that would get tripped up sometimes
in a vstart_runner.py environment.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-10 12:27:44 +00:00
Greg Farnum
fafaaf4256 Merge remote-tracking branch 'origin/greg-fs-testing-3-7-damage' 2016-03-09 22:29:34 -08:00
Gregory Farnum
f69046cf87 Merge pull request #731 from ceph/wip-scrub-repair
Wip scrub repair
2016-03-09 22:31:21 -08:00
Vasu Kulkarni
1c24f58180 Fix recent failures due to HEALTH_WARN check issues
There were recent failures due to HEALTH_WARN check unrelated
to script, this fix basically bypasses this issue by using
osd pool default size: 1 in ceph.conf and now
checks for HEALTH_OK instead of HEALTH_WARN
It also adds the meta information to tasks which describes test

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2016-03-08 21:43:06 -05:00
Greg Farnum
d2edf7519f Merge remote-tracking branch 'origin/wip-damage-table' into greg-fs-testing
https://github.com/ceph/ceph-qa-suite/pull/782

Conflicts:
	tasks/cephfs/test_scrub_checks.py

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-03-07 16:31:35 -08:00
Greg Farnum
c0a2c10299 Merge remote-tracking branch 'origin/wip-scrub-repair' into greg-fs-testing
https://github.com/ceph/ceph-qa-suite/pull/731
2016-03-07 16:20:37 -08:00
Jason Dillaman
eb29adfb31 tasks/rbd_fio: create sane image name based on feature set
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-07 13:57:32 -05:00
Sage Weil
6deba7c649 tasks/ceph_manager: dump pgs if other peering timeouts expire
We were doing this for one of the recovery timeouts but not all of them.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-07 12:21:10 -05:00
John Spray
ec0db68b95 tasks: add TestDamage.test_damaged_dentry
A more detailed test for the case of damaged dentries,
because the handling involves the system passing through
a state where the containing dir has invalid stats,
and has the complete flag set even though the
dentry in question is missing.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-03 21:56:47 +00:00
John Spray
356579be97 tasks/cephfs: update TestDamage
...to account for the behavioural changes with
the addition of DamageTable.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-03 21:56:47 +00:00
John Spray
aa193b31be tasks: move wait_for_health up into CephFSTestCase
...so that TestDamage can use it too.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-03 21:56:47 +00:00
John Spray
67b711dee5 tasks/cephfs: optionally stat() in background
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-03 21:56:47 +00:00
John Spray
7a97fcbe42 tasks/cephfs: avoid sleep in test_client_cache_size
Instead of waiting 30s and then checking, use
wait_until_true to complete as soon as the
condition is met.  Test runs faster this way.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-03 21:56:47 +00:00
John Spray
41747d6f3f tasks/cephfs: remove extraneous ;s in test_client_limits
These are harmless but they stand out in some editors.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-03 21:56:47 +00:00
Yan, Zheng
21348aba27 tasks/cephfs: add test case for scrub repair
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-03 21:56:47 +00:00
Sage Weil
7a87625abb Merge remote-tracking branch 'gh/wip-file-layout' 2016-03-03 08:23:55 -05:00
Samuel Just
97d806907e Merge pull request #843 from ceph/wip-list-inconsistent-obj
tasks/scrub_test: match the NOSNAP with "head"

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-03-01 08:47:22 -08:00
Sage Weil
bb2f575598 tasks/cephfs/filesystem: ceph_file_layout -> file_layout_t
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-01 09:27:59 -05:00
Loic Dachary
70fb7493f1 cram: pin to version 0.6 because 0.7 handles \r differently
http://tracker.ceph.com/issues/14931 Fixes: #14931

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-01 14:17:16 +07:00
Kefu Chai
3a6bf7d258 tasks/scrub_test: match the NOSNAP with "head"
* rados cli prints "head" at seeing CEPH_NOSNAP, so update the test
  accordingly
* print inconsistent objs before testing them

Fixes: #14924
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-03-01 14:09:28 +08:00
Josh Durgin
03e6627de7 Merge pull request #821 from ceph/wip-fsx-journal
rbd: add fsx journal replay test case

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-02-29 18:18:22 -08:00
Samuel Just
e70a633b4f Merge pull request #832 from athanatos/wip-lost
Wip lost

Reviewed-by: Sage Weil <sage@redhat.com>
2016-02-29 15:53:12 -08:00
Vasu Kulkarni
130b12b6df Fix old and new pep8 issues
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2016-02-26 20:10:52 -08:00
Kefu Chai
2efd4c63fd Merge pull request #795 from ceph/wip-list-inconsistent-obj
task/scrub_test: tests for list inconsistent obj APIs

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-02-25 12:51:17 +08:00
Yan, Zheng
74b9216395 tasks/cephfs: add test case for scrub repair
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-02-22 22:06:38 +08:00
Kefu Chai
9a3252c17e tasks/scrub_test: add test for get-inconsistent-* commands
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-02-22 18:35:50 +08:00
Kefu Chai
bdf998c816 tasks/scrub_test: restore the changes to omap after the test
because the repair for digest mismatch will rewrite the omap digest
in the corresponding OI attribute with the one calculated from the
omap read from disk. this is fine. but the succeeding test can not
use the same way used before to mess up the victim object in hope
to get an inconsistent object, as we have accepted it as an authroized
copy and populate the change to its replicas. to address this
problem, the crime scene of the `test_repair_bad_omap()` is cleaned
up before calling `repair()`. it helps with isolating the different
tests, so new tests should not worry about what the current omap
should look like.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-02-22 15:57:40 +08:00
Samuel Just
af3af30418 divergent_priors: add sleep after reviving divergent
Basically same thing as
c0b0ec2831
client is getting ENXIO when trying to do osd tell because
the osd isn't quite up yet.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-02-19 12:28:36 -08:00
Samuel Just
b2a08efe87 tasks/*unfound*.py: run rados bench in parallel
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-02-19 12:28:36 -08:00
Samuel Just
8cf25611fb ceph_manager: use time before mon command for timeout
Slow mon commands can cause a false failure.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-02-19 12:28:36 -08:00
Gregory Farnum
73e02e8e87 Merge pull request #776 from ceph/wip-sharded-scan
tasks/cephfs: test sharded cephfs-data-scan
2016-02-18 06:46:13 -08:00
Gregory Farnum
64c469abf4 Merge pull request #789 from ceph/wip-14146
tasks/cephfs: check status asok output while in reconnect
2016-02-17 22:38:19 -08:00
Gregory Farnum
88eb2e73a8 Merge pull request #787 from ceph/wip-13903
Wip 13903 tests
2016-02-17 22:37:53 -08:00
Kefu Chai
362abf7e34 tasks/scrub_test: refactor this test
prepare for the scrub API tests

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-02-17 21:34:01 +08:00
Greg Farnum
3c76c57065 cephfs/test_full: add some gratuitous debugging
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-02-15 10:52:52 -08:00
Jason Dillaman
44c03072ab rbd: add fsx journal replay test case
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-11 11:53:44 -05:00
John Spray
17e310f57c tasks/cephfs: add TestConfigCommands
Get some coverage on the otherwise rarely touched
injectargs and `config set` interfaces.

Fixes: #14365
Signed-off-by: John Spray <john.spray@redhat.com>
2016-02-10 12:22:06 +00:00
John Spray
86b4231a64 tasks/cephfs: run ceph-fuse in foreground
Previously was running this in background, which prevented
checking for nonzero exit codes.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-02-10 12:22:05 +00:00
John Spray
08c28765ce tasks/cephfs: optionally check result of fuse proc on umount
For cases where the client process successfully unmounts,
but then crashes before finishing.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-02-10 12:22:05 +00:00
John Spray
9fd891f078 tasks/cephfs: make FuseMount.admin_socket public
For tests that specifically want to exercise an
asok operation (the test is responsible for
verifying that its mount object really is a
FuseMount and not a KernelMount)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-02-10 12:22:05 +00:00
John Spray
9cf37080fc tasks/cephfs: test sharded cephfs-data-scan
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-29 10:26:32 +00:00
Greg Farnum
afbc90b9a6 Merge remote-tracking branch 'origin/wip-full-msg' into greg-fs-testing
https://github.com/ceph/ceph-qa-suite/pull/786

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-01-18 16:06:45 -08:00
Greg Farnum
4169ca9434 Merge remote-tracking branch 'origin/wip-global-config' into greg-fs-testing
https://github.com/ceph/ceph-qa-suite/pull/784

Conflicts:
	tasks/cephfs/vstart_runner.py
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-01-18 16:06:02 -08:00
Greg Farnum
0e9b07f046 Merge remote-tracking branch 'origin/wip-14048' into greg-fs-testing
https://github.com/ceph/ceph-qa-suite/pull/767

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-01-18 15:53:47 -08:00
Greg Farnum
10d9fe1de6 Merge remote-tracking branch 'origin/wip-manila' into greg-fs-testing
https://github.com/ceph/ceph-qa-suite/pull/680

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-01-18 14:42:14 -08:00
Greg Farnum
617d8cce74 Merge remote-tracking branch 'origin/jewel-14254' into greg-fs-testing
https://github.com/ceph/ceph-qa-suite/pull/798

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-01-18 14:33:38 -08:00
Yan, Zheng
9b0e2a3ace tasks/cephfs: test for race between cap flush and clientreplay
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-01-15 13:49:19 +08:00
John Spray
500aac599d tasks/cephfs: override max_pgs_per_osd in TestVolumeClient
Because volume client cues its PG counts from the
mon pg warn max per osd setting, the teuthology template's
ultra-high 10000 setting causes problems.  Force it down
to the usual sensible default for this test.

Also update vstart_runner to populate ctx.daemons so that the test
can restart daemons the same way on vstart as in full blown teuthology.

For branch wip-manila

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
d1c3ef1fee tasks/cephfs: pg_num check in volume_client test
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
fb2e38f2df tasks/cephfs: fix raising from RemoteProcess.wait()
...in the case where we call wait() on an already-finished
process.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
55a04930e3 tasks/cephfs: fix vstart's LocalDaemon.proc
This class is meant to quack like a DaemonState,
so it needs to expose a .proc attribute.  This
was breaking TestDamageTable.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
5c525219c4 tasks/cephfs: fix wait in test_volume_client
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
627c33054c tasks/cephfs: add test_volume_client
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
523d84b5f0 tasks/cephfs: fix fuse killing in vstart
The "ps au" output was truncating lines which could cause
processes to get missed in some cases, like where there
is a long --client-mountpoint argument.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
cb699cccfe tasks/cephfs: write_n_mb optionally background
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
b94b35b68f tasks/cephfs: reset IDs of mounts between tests
because volumeclient test twiddles the IDs to
match the auth identities it creates.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
7a19b6dc0d tasks/cephfs: clear extra auth ids on test start
Because new volumeclient tests will be creating IDs
instead of modifying the default ones.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
John Spray
addf313c24 tasks/cephfs: add test case auth_list helper
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-14 22:55:29 +00:00
Gregory Farnum
3b37c245b3 Merge pull request #743 from ceph/wip-root-metadata
tasks/cephfs: add TestSessionMap.test_session_reject

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-01-14 10:37:04 -08:00
John Spray
b010b6fe35 tasks: add TestSessionMap.test_[mount|tell]_conn_close
To check that teardown is happening correctly when
sending commands to an MDS.

Fixes: #14048
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-13 09:29:08 +00:00
Jason Dillaman
608fb1f0e0 suites/rbd: avoid redundant helgrind tests
Allow rbd_fsx to accept an override for which valgrind tool to use.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-01-12 21:08:00 -05:00
John Spray
f566cf7713 tasks/cephfs: check status asok output while in reconnect
Mostly checking the output from the status asok is awkward
because you need to get the system stuck in a particular
state to do so.  However, we already have a test here
that sticks the system in reconnect, so here's some
very light test coverage for that asok.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-11 23:15:37 +00:00
John Spray
5c06511697 tasks/cephfs: add TestStrays.test_dir_deletion
test_ops_throttle was catching misbehaviour when
deleting lots of files in a directory, but
we should have a non-throttle test for that case
so that it's clearer what's gone wrong.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-11 20:10:07 +00:00
John Spray
028a140acf tasks/cephfs: better message from test_full_fsync
When it gives an error from the unexpected place,
say so.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-11 15:15:10 +00:00
John Spray
aafa06eb9d tasks/cephfs: generate mount paths on the fly
...because new tests that modify the client ID will
get confused about whether they're mounted or not, otherwise.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-11 14:04:05 +00:00
John Spray
acff449c04 tasks/cephfs: support mount_path in Mount subclasses
For e.g. volumeclient guests that want to mount
a subpath.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-11 13:26:58 +00:00
Samuel Just
7831ca1e44 Revert "pg: add test cases for pg list_missing on EC pool"
This reverts commit 6fb44db9cb.
2016-01-07 11:02:40 -08:00
Yan, Zheng
6082cb2b71 Merge pull request #785 from ceph/wip-14257
tasks/cephfs: fix wait_for_state timing
2016-01-07 22:22:32 +08:00
John Spray
58c13c1a28 tasks/cephfs: fix wait_for_state timing
Return actual elapsed wallclock time instead of
the number of times we polled.

Fixes: #14257
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-07 11:24:57 +00:00
John Spray
00f1523170 tasks/cephfs: update vstart_runner for teuthology change
Previously teuthology read test path from ctx.teuthology_config,
now it reads it from the global teuthology.config.config object.

This was breaking test_journal_migration because it uses tasks/workunit,
when run with vstart_runner.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-06 23:57:54 +00:00
Greg Farnum
eb1d4f607c Merge remote-tracking branch 'origin/jewel-14196' 2016-01-05 23:11:32 -08:00
Greg Farnum
8488a991a9 Merge remote-tracking branch 'origin/wip-13583' 2016-01-05 22:57:51 -08:00
John Spray
26423e9574 tasks/cephfs: fix wait in assert_cluster_log
I had the monc tick interval wrong.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-05 18:58:01 +00:00
John Spray
a6970271be tasks/cephfs: fixes to FuseMount
This was getting stressed in new ways by
TestSessionMap.test_session_reject, which
has a mount that fails initially.

Two changes here:
 * Raise CommandFailedError instead of RuntimeError when
   a mount fails (i.e. catch process termination instead
   of timing out on /sys/ population)
 * Generalise error handling on umount, so that we only
   raise the exception on an umount failure if the mount
   appears to really not be unmounted.  There is some
   EINVAL corner case that was getting triggered by the test.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-05 18:58:01 +00:00
John Spray
141de6e1b4 tasks/cephfs: add TestSessionMap.test_session_reject
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-05 18:58:01 +00:00
John Spray
3b9b68b176 tasks/cephfs: add assert_cluster_log
For capturing the cluster log and asserting
that we see a particular expected message.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-05 18:58:00 +00:00