Commit Graph

600 Commits

Author SHA1 Message Date
Gregory Farnum
5e714c69d5 Merge pull request #703 from ceph/wip-layout-restrict
tasks/cephfs: test for auth caps pool-setting restriction

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-12-06 21:05:55 -08:00
John Spray
1280caf7c2 tasks/cephfs: avoid using bare remote.run in scrub_checks
Use the Mount.* wrappers for filesystem operations,
so that changes like making run_shell use sudo just work.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:30:55 +00:00
John Spray
0cd6cb10ac tasks/cephfs: update for run_shell vs. sudo
(TestStrays.test_snapshot_remove blocked on the sudo change)

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:30:55 +00:00
John Spray
80397a5db2 tasks/cephfs: always sudo in run_shell
This was causing permissions issues when
running inside teuthology, as run_python
was using sudo and run_shell wasn't.

Would be nice to get rid of all the rootishness,
but for the moment just make it more uniform.
2015-12-02 23:30:55 +00:00
John Spray
bb924d2095 tasks/cephfs: cover snaps in test_strays
Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:30:55 +00:00
John Spray
14e2cf1ef2 tasks/cephfs: add TestForwardScrub
This tests the forward scrub's ability to traverse
some metadata and tag it, and the corresponding
functionality in cephfs-data-scan to filter based
on tag and inject orphaned items.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:28:28 +00:00
Loic Dachary
ea6360ac26 teuthology-integration: run teuthology integration tests
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-02 13:14:35 +01:00
Loic Dachary
ab9a3d5a88 buildpackages: create the image if it does not exist
Since buildpackages runs before target provisioning, it is possible that
the desired image does not yet exist on a newly provisionned tenant (or
region).

http://tracker.ceph.com/issues/13910 Fixes: #13910

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-30 16:55:38 +01:00
Loic Dachary
ca64229481 Merge pull request #679 from ceph/wip-ceph-whitespace
tasks/ceph: fix up whitespace

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-11-27 18:58:10 +01:00
Loic Dachary
9ea3b26b91 Merge pull request #740 from dachary/wip-13899-rbd-fio
task/rbd_fio: allow for unsigned packages

Reviewed-by: Abhishek Varshney <abhishek.varshney@flipkart.com>
2015-11-27 17:21:13 +01:00
Loic Dachary
d14f2da437 task/rbd_fio: allow for unsigned packages
Similar to what the teuthology install.py task does, add --force-yes to
the apt-get install so that unsigned packages are successfully
installed. It is needed when the buildpackages task is used to create
packages on the fly.

There is no need to do the same for rpm packages because the
verification is controlled from the ceph-release package instead of from
the command line.

http://tracker.ceph.com/issues/13899 Fixes: #13899

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-27 14:20:07 +01:00
Loic Dachary
8088d60524 buildpackages: wait for the build machine deletion
When the quotas are low, it matters to block until the build machine is
actually deleted. Otherwise target provisionning may fail because the
they exceed the quota. For instance the default on OVH is to have 32
cores and the build machine uses 16. The packages-repository machine
uses two, the teuthology cluster uses one and that leaves only 13 cores
for the targets which may be too low when running jobs that require
large instances.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-26 13:13:36 +01:00
Gregory Farnum
bb5aaac923 Merge pull request #729 from ceph/wip-scrub-tidy
tasks/cephfs: tidy test_scrub_checks

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:13:52 -05:00
Gregory Farnum
3ba38a4c29 Merge pull request #674 from ceph/wip-13698
tasks/cephfs: fix race in test_sessionmap

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:12:36 -05:00
Gregory Farnum
e774886a3c Merge pull request #663 from ceph/wip-client-mark-down
tasks/cephfs: quick test for `tell`...

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:08:58 -05:00
Gregory Farnum
079ba9ef52 Merge pull request #647 from ceph/wip-repair-dir
tasks/cephfs: include an empty dir in journal repair

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:04:59 -05:00
Gregory Farnum
d5934fc96d Merge pull request #633 from ceph/wip-test-failover
tasks/cephfs/test_failover

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:00:29 -05:00
Loic Dachary
5c8f349919 Merge pull request #718 from ceph/wip-fast-read
rados: add test for ec fast_read

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-11-24 00:38:22 +01:00
Loic Dachary
af95065c9b Merge pull request #730 from ceph/wip-repair
ceph_manager: do_pg_scrub: keep scrubbing until it's done

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-11-24 00:37:31 +01:00
John Spray
69560a8d65 tasks/cephfs: tidy test_scrub_checks
Use named error codes instead of numbers, and
use the helper fn for getting inode number
instead of doing it by hand.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-23 17:47:02 +00:00
Loic Dachary
f398b71e33 buildpackages: do not -jX on dumpling
http://tracker.ceph.com/issues/13845 Refs: #13845

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-20 13:46:28 +01:00
Samuel Just
89dcc0daf3 ceph_manager: do_pg_scrub: keep scrubbing until it's done
The ceph pg scrub ... command isn't really guarranteed to
start a scrub, keep reissuing it until the scrub actually
happens.

Related: #12746
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-11-19 15:07:38 -08:00
Samuel Just
5f90c35f70 rados: add test for ec fast_read
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-11-19 14:44:45 -08:00
Loic Dachary
87e50d394a buildpackages: avoid duplicate packages-repository
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-19 09:08:35 +01:00
Loic Dachary
13fb23ed69 buildpackages: implement get_pkg_type
It can be deprectated when it is implemented in teuthology.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-19 00:36:18 +01:00
Loic Dachary
69e9b22e4b buildpackages: refactor to not require remote
Most of the flavor, sha1, tag etc. selection logic as implemented in the
packaging module of teuthology relies on remote hosts. This is complex
to tests and inconvenient because hosts must be provisionned even before
trying to figure out which packages need to be installed.

Using remote hosts is necessary when bare metal targets are used because
teuthology must adapt to the operating system already installed. The
selection logic in the context of dynamically provisionned targets is
simpler because it is defined by the job being run.

The buildpackages is refactored to use only the job configuration to
figure out which packages must be built. It makes it specific to targets
that are dynamically provisionned. It would have to be modified to query
the remote host in the case of bare metal targets.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-18 22:49:59 +01:00
Loic Dachary
1877b818f6 Merge pull request #704 from dachary/wip-buildpackages-packaging
buildpackages: protect packages-repository
2015-11-14 10:27:03 +01:00
Loic Dachary
4825f64a7c buildpackages: protect packages-repository
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-14 09:31:41 +01:00
John Spray
95538f2c06 tasks/cephfs: test for auth caps pool-setting restriction
Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-13 14:16:38 +00:00
Loic Dachary
8d798c4eec buildpackages: do not fails for unpackaged files
Older versions of Ceph have that problem failing would break all upgrade suites.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-12 20:17:53 +01:00
Loic Dachary
9287493851 buildpackages: giant has some unpackaged files
And there really is nothing we can do about it expect ignore them.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-12 16:11:39 +01:00
Loic Dachary
118e919d35 Merge pull request #695 from dachary/wip-buildpackages-flavor
buildpackages: 10GB is too small most of the time
2015-11-12 15:11:10 +01:00
Loic Dachary
129c5db6c9 buildpackages: 10GB is too small most of the time
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-12 15:09:26 +01:00
Vasu Kulkarni
5ba70c8e30 Update fio version from 2.2.9 to 2.2.11
Also removes fio-version option from yaml since its redundant and if required can be specified in
overrides

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2015-11-10 14:48:59 -05:00
Jason Dillaman
accb287302 rbd_fio: removed deprecated command-line option to rbd CLI
Fixes: #13745
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-11-10 08:50:54 -05:00
John Spray
f05d977628 tasks/ceph: fix up whitespace
...because otherwise it lights up like a christmas
tree in pycharm.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-09 13:20:49 +00:00
John Spray
c713423bd1 tasks/cephfs: fix race in test_sessionmap
Fixes: #13698
Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-05 01:15:57 +00:00
Loic Dachary
7b8f205952 buildpackages: silently ignore IPv6 addresses
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-11-04 11:52:24 +01:00
Josh Durgin
fec80cd519 Merge pull request #652 from ceph/wip-13559
suites/rbd/qemu: excercise CoW support during QEMU testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-11-03 14:12:05 -08:00
John Spray
54e53a0006 tasks/cephfs: simplify test_backtrace_repair
This was previously using a bunch of files and a small
MDCache limit to force things out of cache.  It is much
simpler to just drop the journal.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-03 11:56:06 +00:00
Greg Farnum
2e47e03745 filesystem: fix get_daemon_names
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-10-29 15:35:43 -07:00
John Spray
b51a929c6f tasks/cephfs: quick test for tell...
...specifically that we don't have lingering
MDS sessions after running it.  This is testing
that Client::shutdown is doing the right thing
and closing sessions.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-28 14:28:42 +09:00
Loic Dachary
970a37226f buildpackages: fetch tags from the official Ceph repository
A clone of Ceph is not automagically updated with the tags from the
official Ceph repository. For a pull request based on master, git
describe will use whatever tags existed at the time the clone was made,
unless the author pull them from the official Ceph repository and later
git push --tags them.

The output of git describe is used to name the packages and if the
official tags are not present, the packages will be incorrectly
named. For instance instead of 9.0.3-34 the packages could be named
0.87-8433 because the v0.87 tag is the most recent tag in the
repository. That confuses the install task that will fail with:

   'ceph version 0.87 was not installed, found 9.0.3.'

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-10-28 00:06:46 +09:00
Jason Dillaman
59e768bb29 suites/rbd/qemu: excercise CoW support during QEMU testing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-10-22 08:28:32 -04:00
Loic Dachary
8f9de175e0 ceph: log which ceph.conf file is written
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-10-21 15:49:48 +02:00
John Spray
4a83c56604 tasks/cephfs: include an empty dir in journal repair
Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-19 17:57:53 +01:00
Zack Cerza
da22f74ad1 Merge pull request #632 from ceph/wip-rbd-dir-fix
use cephtest as base dir during testing
2015-10-14 17:28:14 -06:00
Vasu Kulkarni
bdf79881df Use cephtest as base dir for testing and let nuke cleanup in case of abrupt failures
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2015-10-14 17:27:00 -04:00
John Spray
176e9ef267 tasks/cephfs: add test_failover
A quick check that clients refuse to mount
when daemons are laggy, and while we're at it,
that the basics of failover work.  It's a trivial
test, but it's nice to have this kind of thing
so that we don't have to wait for weird thrasher
failures if something breaks.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-14 02:20:00 +01:00
John Spray
043049f6c3 tasks/cephfs: add a wait_for_daemons
...to avoid trying to mount a client
before the daemons are ready

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-14 02:16:13 +01:00