Commit Graph

4827 Commits

Author SHA1 Message Date
David Zafman
a204f6f932 repair_test: Add whitelist item for new stat error message
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-12-15 17:43:48 -08:00
Loic Dachary
ac45601950 Merge pull request #764 from dachary/wip-buildpackages-log
buildpackages: log the output of make
2015-12-12 14:43:47 +01:00
Loic Dachary
64d8a586f7 buildpackages: no need to sudo in bootcmd
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-12 14:27:55 +01:00
Loic Dachary
0c1e7f1f6b buildpackages: log the output of make
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-12 14:03:57 +01:00
Loic Dachary
f19a519b8e Merge pull request #756 from dachary/wip-13624-workunit-git
workunits: fetch from --ceph-git-url
2015-12-11 12:27:18 +01:00
Loic Dachary
a5ce9c2926 Merge pull request #758 from dreamhost/wip-openstack-dhc
Fix runs on OpenStack clusters like DreamHost Compute

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-12-11 08:04:52 +01:00
Robin H. Johnson
ebf8508c08 buildpackages: pkgrepo host also needs user-data setup.
The packages repo host fails in environments where networking setup is
needed in VMs. Use the same user-data as the buildhosts to ensure this
is the case.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2015-12-10 22:58:09 -08:00
Robin H. Johnson
89bde0b8fe buildpackages: copy teuthology user-data.txt changes
7b27e1db7: openstack: support /etc/network/intefaces injection
2358562cf: ensure VMs always have /etc/hosts set up
4378a505d: always allow unsigned deb packages
50b2db521: openstack: encode instance name with the full IP
6e828a33b: openstack: add 8.8.8.8 as a last resort resolver

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2015-12-10 22:58:04 -08:00
Robin H. Johnson
3c6954642a
buildpackages: catch instance creation failure.
Split the sleep from the server creation, so we catch 'server create'
failures (eg due to quota):
> Quota exceeded for cores: Requested 16, but already used 10 of 20 cores
> (HTTP 403) (Request-ID: req-6467934e-db50-4479-995c-4d44dedf553a)

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2015-12-10 11:55:53 -08:00
Robin H. Johnson
0240f57643
buildpackages: Be robust about addresses
OpenStack could tell us the VM has multiple networks, and offers no
guarantee about the order of addresses either (the old code failed if
the v4 IP was first).

For now, take the first listed network, and the first listed IPv4
address therein. Comments contain more detailed examples of possible
output from openstack tool.

Also remove the need for using jq to parse the output.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2015-12-10 11:55:49 -08:00
Loic Dachary
78bb60341e Merge pull request #757 from dachary/wip-dummy
Revert "dummy: only use the user playbook"
2015-12-08 01:48:26 +01:00
Loic Dachary
d0280d7910 Revert "dummy: only use the user playbook"
This reverts commit a016f29e21.
2015-12-08 01:47:09 +01:00
Gregory Farnum
da8a891b74 Merge pull request #744 from ceph/wip-inode-claim
tasks/cephfs: add TestJournalRepair.test_table_tool_take_inos

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-12-06 21:10:10 -08:00
Gregory Farnum
5e714c69d5 Merge pull request #703 from ceph/wip-layout-restrict
tasks/cephfs: test for auth caps pool-setting restriction

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-12-06 21:05:55 -08:00
Gregory Farnum
c619c161af Merge pull request #728 from ceph/wip-snap-strays
tasks/cephfs: cover snaps in test_strays
2015-12-06 21:04:30 -08:00
Gregory Farnum
543d48db5c Merge pull request #709 from ceph/wip-scrub-basic
tasks/cephfs: add TestForwardScrub
2015-12-06 21:01:53 -08:00
Loic Dachary
b0a770a3e7 workunit: fetch from --ceph-git-url
The commit from which workunits are fetched must be retrieved
from --ceph-git-url via teuth_config.get_ceph_git_url() instead of
assuming it is available via git://git.ceph.com/ceph.git.

Using git://git.ceph.com/ceph.git is convenient because it supports git
archive. In the general case, some git servers such as github do not
support git archive and a full git clone must be done instead.

Although it would be possible to

    git clone --branch=master --depth=1 --single-branch

to reduce the amount of data being retrieved, it would require a

    git fetch origin SHA1

but git version >= 1.7 do not support fetching a commit.

http://tracker.ceph.com/issues/13624 Fixes: #13624

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-06 13:23:14 +01:00
Loic Dachary
28dc5c0c33 workunit: keep the path to the list of tests in a variable
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-06 13:07:13 +01:00
Loic Dachary
7de33f082e workunit: allow tag to override sha1
The sha1 for the workunit task is always set by the suite.py task. The
tag must be checked before the sha1 othewise it cannot be used to
override the sha1.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-06 12:34:59 +01:00
John Spray
1280caf7c2 tasks/cephfs: avoid using bare remote.run in scrub_checks
Use the Mount.* wrappers for filesystem operations,
so that changes like making run_shell use sudo just work.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:30:55 +00:00
John Spray
0cd6cb10ac tasks/cephfs: update for run_shell vs. sudo
(TestStrays.test_snapshot_remove blocked on the sudo change)

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:30:55 +00:00
John Spray
80397a5db2 tasks/cephfs: always sudo in run_shell
This was causing permissions issues when
running inside teuthology, as run_python
was using sudo and run_shell wasn't.

Would be nice to get rid of all the rootishness,
but for the moment just make it more uniform.
2015-12-02 23:30:55 +00:00
John Spray
bb924d2095 tasks/cephfs: cover snaps in test_strays
Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:30:55 +00:00
John Spray
521a93a63a suites: add yaml for TestForwardScrub
Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:28:28 +00:00
John Spray
14e2cf1ef2 tasks/cephfs: add TestForwardScrub
This tests the forward scrub's ability to traverse
some metadata and tag it, and the corresponding
functionality in cephfs-data-scan to filter based
on tag and inject orphaned items.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-02 23:28:28 +00:00
Gregory Farnum
2bd05c7378 Merge pull request #737 from ceph/wip-enable-data-scan
suites: yaml for TestDataScan
2015-12-02 14:22:10 -08:00
Loic Dachary
55f3d4a341 Merge pull request #751 from dachary/wip-teuthology-integration
teuthology-integration: run teuthology integration tests
2015-12-02 13:16:08 +01:00
Loic Dachary
ea6360ac26 teuthology-integration: run teuthology integration tests
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-12-02 13:14:35 +01:00
Loic Dachary
c551091504 Merge pull request #664 from dachary/wip-nop
nop: suite that does not even lock targets
2015-12-01 21:14:57 +01:00
Loic Dachary
98c2f9c95a Merge pull request #748 from dachary/wip-13910-buildpackages-images
buildpackages: create the image if it does not exist

Reviewed-by: Abhishek Varshney <abhishek.varshney@flipkart.com>
2015-11-30 17:43:25 +01:00
Loic Dachary
ab9a3d5a88 buildpackages: create the image if it does not exist
Since buildpackages runs before target provisioning, it is possible that
the desired image does not yet exist on a newly provisionned tenant (or
region).

http://tracker.ceph.com/issues/13910 Fixes: #13910

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-30 16:55:38 +01:00
John Spray
4f29d92f7a suites: yaml for TestDataScan
This was an oversight.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-30 14:20:23 +00:00
Loic Dachary
ca64229481 Merge pull request #679 from ceph/wip-ceph-whitespace
tasks/ceph: fix up whitespace

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-11-27 18:58:10 +01:00
John Spray
b3da9d7e7c tasks/cephfs: add TestJournalRepair.test_table_tool_take_inos
Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-27 17:43:28 +00:00
Loic Dachary
9ea3b26b91 Merge pull request #740 from dachary/wip-13899-rbd-fio
task/rbd_fio: allow for unsigned packages

Reviewed-by: Abhishek Varshney <abhishek.varshney@flipkart.com>
2015-11-27 17:21:13 +01:00
Loic Dachary
77e75c0377 Merge pull request #742 from dachary/wip-openstack-morepggrow
openstack: rados/.../morepggrow.yaml may need more disk

Reviewed-by: Abhishek Varshney <abhishek.varshney@flipkart.com>
2015-11-27 15:12:12 +01:00
Loic Dachary
a6de4a0181 openstack: rados/.../morepggrow.yaml may need more disk
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-27 15:11:05 +01:00
Loic Dachary
d14f2da437 task/rbd_fio: allow for unsigned packages
Similar to what the teuthology install.py task does, add --force-yes to
the apt-get install so that unsigned packages are successfully
installed. It is needed when the buildpackages task is used to create
packages on the fly.

There is no need to do the same for rpm packages because the
verification is controlled from the ceph-release package instead of from
the command line.

http://tracker.ceph.com/issues/13899 Fixes: #13899

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-27 14:20:07 +01:00
Loic Dachary
50e83e32cb Merge pull request #736 from dachary/wip-buildpackage-delete-wait
buildpackages: wait for the build machine deletion
2015-11-27 12:58:08 +01:00
Loic Dachary
63d3569d93 Merge pull request #738 from dachary/wip-openstack-debug
openstack: add 15GB for debugging purposes

Reviewed-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>
2015-11-26 22:19:52 +01:00
Loic Dachary
a25638c585 openstack: add 15GB for debugging purposes
So that it can be used as follows:

   teuthology-openstack ... --suite mysuite ... debug/openstack-15G.yaml

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-26 22:10:24 +01:00
Loic Dachary
8088d60524 buildpackages: wait for the build machine deletion
When the quotas are low, it matters to block until the build machine is
actually deleted. Otherwise target provisionning may fail because the
they exceed the quota. For instance the default on OVH is to have 32
cores and the build machine uses 16. The packages-repository machine
uses two, the teuthology cluster uses one and that leaves only 13 cores
for the targets which may be too low when running jobs that require
large instances.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-26 13:13:36 +01:00
Sage Weil
30b64fd739 rados/thrash/workloads/admin-socket: 60s -> 180s
Provide more time for the asok workload to run.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-11-25 20:08:02 -05:00
Sage Weil
5c232b4ed5 Merge remote-tracking branch 'gh/jewel' 2015-11-25 20:07:38 -05:00
Gregory Farnum
bb5aaac923 Merge pull request #729 from ceph/wip-scrub-tidy
tasks/cephfs: tidy test_scrub_checks

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:13:52 -05:00
Gregory Farnum
3ba38a4c29 Merge pull request #674 from ceph/wip-13698
tasks/cephfs: fix race in test_sessionmap

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:12:36 -05:00
Gregory Farnum
e774886a3c Merge pull request #663 from ceph/wip-client-mark-down
tasks/cephfs: quick test for `tell`...

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:08:58 -05:00
Gregory Farnum
079ba9ef52 Merge pull request #647 from ceph/wip-repair-dir
tasks/cephfs: include an empty dir in journal repair

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:04:59 -05:00
Gregory Farnum
d5934fc96d Merge pull request #633 from ceph/wip-test-failover
tasks/cephfs/test_failover

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-11-25 17:00:29 -05:00
Loic Dachary
6e184ad0e8 Merge pull request #732 from dachary/wip-openstack-debug
openstack: add 30GB for debugging purposes
2015-11-25 19:25:19 +01:00