Commit Graph

570 Commits

Author SHA1 Message Date
Loic Dachary
f398b71e33 buildpackages: do not -jX on dumpling
http://tracker.ceph.com/issues/13845 Refs: #13845

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-20 13:46:28 +01:00
Loic Dachary
87e50d394a buildpackages: avoid duplicate packages-repository
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-19 09:08:35 +01:00
Loic Dachary
13fb23ed69 buildpackages: implement get_pkg_type
It can be deprectated when it is implemented in teuthology.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-19 00:36:18 +01:00
Loic Dachary
69e9b22e4b buildpackages: refactor to not require remote
Most of the flavor, sha1, tag etc. selection logic as implemented in the
packaging module of teuthology relies on remote hosts. This is complex
to tests and inconvenient because hosts must be provisionned even before
trying to figure out which packages need to be installed.

Using remote hosts is necessary when bare metal targets are used because
teuthology must adapt to the operating system already installed. The
selection logic in the context of dynamically provisionned targets is
simpler because it is defined by the job being run.

The buildpackages is refactored to use only the job configuration to
figure out which packages must be built. It makes it specific to targets
that are dynamically provisionned. It would have to be modified to query
the remote host in the case of bare metal targets.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-18 22:49:59 +01:00
Loic Dachary
1877b818f6 Merge pull request #704 from dachary/wip-buildpackages-packaging
buildpackages: protect packages-repository
2015-11-14 10:27:03 +01:00
Loic Dachary
4825f64a7c buildpackages: protect packages-repository
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-14 09:31:41 +01:00
Loic Dachary
8d798c4eec buildpackages: do not fails for unpackaged files
Older versions of Ceph have that problem failing would break all upgrade suites.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-12 20:17:53 +01:00
Loic Dachary
9287493851 buildpackages: giant has some unpackaged files
And there really is nothing we can do about it expect ignore them.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-12 16:11:39 +01:00
Loic Dachary
118e919d35 Merge pull request #695 from dachary/wip-buildpackages-flavor
buildpackages: 10GB is too small most of the time
2015-11-12 15:11:10 +01:00
Loic Dachary
129c5db6c9 buildpackages: 10GB is too small most of the time
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-12 15:09:26 +01:00
Vasu Kulkarni
5ba70c8e30 Update fio version from 2.2.9 to 2.2.11
Also removes fio-version option from yaml since its redundant and if required can be specified in
overrides

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2015-11-10 14:48:59 -05:00
Jason Dillaman
accb287302 rbd_fio: removed deprecated command-line option to rbd CLI
Fixes: #13745
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-11-10 08:50:54 -05:00
Loic Dachary
7b8f205952 buildpackages: silently ignore IPv6 addresses
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-11-04 11:52:24 +01:00
Josh Durgin
fec80cd519 Merge pull request #652 from ceph/wip-13559
suites/rbd/qemu: excercise CoW support during QEMU testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-11-03 14:12:05 -08:00
John Spray
54e53a0006 tasks/cephfs: simplify test_backtrace_repair
This was previously using a bunch of files and a small
MDCache limit to force things out of cache.  It is much
simpler to just drop the journal.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-03 11:56:06 +00:00
Loic Dachary
970a37226f buildpackages: fetch tags from the official Ceph repository
A clone of Ceph is not automagically updated with the tags from the
official Ceph repository. For a pull request based on master, git
describe will use whatever tags existed at the time the clone was made,
unless the author pull them from the official Ceph repository and later
git push --tags them.

The output of git describe is used to name the packages and if the
official tags are not present, the packages will be incorrectly
named. For instance instead of 9.0.3-34 the packages could be named
0.87-8433 because the v0.87 tag is the most recent tag in the
repository. That confuses the install task that will fail with:

   'ceph version 0.87 was not installed, found 9.0.3.'

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-10-28 00:06:46 +09:00
Jason Dillaman
59e768bb29 suites/rbd/qemu: excercise CoW support during QEMU testing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-10-22 08:28:32 -04:00
Loic Dachary
8f9de175e0 ceph: log which ceph.conf file is written
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-10-21 15:49:48 +02:00
Zack Cerza
da22f74ad1 Merge pull request #632 from ceph/wip-rbd-dir-fix
use cephtest as base dir during testing
2015-10-14 17:28:14 -06:00
Vasu Kulkarni
bdf79881df Use cephtest as base dir for testing and let nuke cleanup in case of abrupt failures
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2015-10-14 17:27:00 -04:00
John Spray
267ef8bad7 Merge pull request #624 from ceph/wip-13437
Wip 13437 (tasks/cephfs: fix TestClientLimits.test_client_oldest_tid …)

Reviewed-by: John Spray <john.spray@redhat.com>
2015-10-13 22:50:52 +01:00
Loic Dachary
baa8ea327e buildpackages: implement notcmalloc flavor
http://tracker.ceph.com/issues/13454 Fixes: #13454

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-13 14:56:10 +02:00
Kefu Chai
8d1c15e9a5 Merge pull request #621 from dachary/wip-13449-admin-socket
tasks/admin_socket.py: wait 120 seconds instead of 60

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-10-13 17:04:55 +08:00
Loic Dachary
ccd1bc2c03 Merge pull request #619 from dachary/wip-buildpackages-submodules
buildpackages: get ceph submodules
2015-10-13 10:55:55 +02:00
Yan, Zheng
b03ac07980 tasks/cephfs: fix TestClientLimits.test_client_oldest_tid
To get the health warning, first we need to make sure requests are
added to session's completed request list. Then we need to send an
extra request to MDS to trigger the code that generates the warning.

Fixes: #13437
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-10-13 16:53:39 +08:00
Loic Dachary
c0828cae19 tasks/admin_socket.py: wait 120 seconds instead of 60
When running on virtual machines, it may take more than one minute for a
daemon to create the admin socket.

http://tracker.ceph.com/issues/13449 Fixes: #13449

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-13 10:25:18 +02:00
Sage Weil
2545265f17 Merge remote-tracking branch 'gh/infernalis' 2015-10-12 13:04:19 -04:00
Loic Dachary
81f5c3ad03 buildpackages: get ceph submodules
Prior to v0.80.9, autogen.sh did not get submodules. Copy/paste the
submodule initialization from newer autogen.sh in common.sh so that
v0.80.8 and below can be rebuilt from sources. It does not hurt to
update the submodules twice.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-12 18:46:38 +02:00
Yehuda Sadeh
d1ada2e8dd radosgw_admin: skip log objects that start with obj_delete_at_hint
when testing radosgw-admin log show --object, don't use these objects

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2015-10-12 09:13:25 -07:00
Loic Dachary
56a6e0c356 buildpackages: use _get_version instead of os_version
os_version is from the remote and will be 7.1.23 for CentOS 7
instead of the expected 7.0 for all 7.* CentOS.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-10 12:51:15 +02:00
Samuel Just
174a74105f radosbench: use pool config even if create_pool is false
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-10-09 14:06:04 -07:00
Samuel Just
c0b0ec2831 divergent_priors2: give divergent time to come up
Fixes: #13322
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-10-09 14:05:42 -07:00
Loic Dachary
0446645de8 Merge pull request #609 from dachary/wip-13376-buildpackages-upgrade
buildpackages: honour install priorities tags, branch, sha1
2015-10-09 16:37:40 +02:00
Loic Dachary
0045dfc8a5 buildpackages: enforce ceph-object-corpus canonical URL
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-09 11:57:40 +02:00
Loic Dachary
4d89c9e4de buildpackages: walk the whole config tree to find sha1 to build
It is not enough to look for the first install task. In upgrade tests,
the install.upgrade task requires more packages to be built. In more
complicated tests using sequential and parallel tasks, the actual
install or install.upgrade task may be deeper in the config tree.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-09 10:05:58 +02:00
Loic Dachary
c103579a55 buildpackages: honour install priorities tags, branch, sha1
The install config may have contradicting tag/branch and sha1.  When
suite.py prepares the jobs, it always overrides the sha1 with whatever
default is provided on the command line with --distro and what is found
in the gitbuilder. If it turns out that the tag or the branch in the
install config task is about another sha1, it will override anyway.

Instead of obtaining the tag, branch and sha1 directly from the
packaging.GitbuilderProject object, compute them from the returned
uri_reference data member. The uri_reference is used by the install task
to fetch packages in the gitbuilders and this is what buildpackages
needs to build.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-09 10:03:35 +02:00
Loic Dachary
810caaf55f buildpackages: branches are found in refs/remotes/origin
Note in refs/heads which is populated for local branches only and not
after a fresh clone.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-09 10:01:34 +02:00
Loic Dachary
e54c916891 buildpackages: do not override the sha1
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-09 10:01:05 +02:00
Loic Dachary
a630da7220 buildpackages: allow for concurrent build if != sha1
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-08 12:16:30 +02:00
Loic Dachary
9db757b811 buildpackages: prefer GitbuilderProject.os_{type,version} over config.
The config['os_type'] and config['os_version'] are not always set for a given
job (for instance, in the rbd suite). When a suite runs, it relies on
default values, depending on the target Operating System and internal,
hard coded values associating ubuntu to 14.04 etc.

Instead of using config['os_{type,version}'] use the GitbuilderProject
equivalent which is set with the appropriate defaults.

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-10-08 12:16:30 +02:00
Greg Farnum
94d54f7510 Merge remote-tracking branch 'origin/wip-vstart-runner' into infernalis
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-10-07 10:55:36 -07:00
Loic Dachary
a5f260ee92 Merge pull request #596 from ceph/wip-radosbench
tasks/radosbench: wait just a bit longer

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-10-05 01:57:04 +02:00
vasukulkarni
5f201625b1 Merge pull request #549 from ceph/wip-krbd-fio
Add rbd fio test to exercise block IO on all format/features
2015-10-02 11:54:26 -07:00
Vasu Kulkarni
971c5fc29c rbd io tests using fio, various fio options can be specified in yaml
test rbd or krbd using fio, can also run io on rbd clones if option is specified in yaml
various options like image-size, rbd format/features, fio io size, readwrite options can be provided in yaml.
check the docstring for exact usage.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2015-10-02 13:41:42 -04:00
John Spray
62247f2009 tasks/cephfs: fix FuseMount bin path in vstart
FuseMount only uses the prefix for finding the 'ceph'
executable, which is in ./ for either cmake or
authtools, not ./src for cmake like other binaries.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:18 +01:00
John Spray
0584b9c8dc tasks/cephfs: fix test_journal_migration
It was trying to get the output file from
a different remote than the one used to
run the journal tool.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:18 +01:00
John Spray
9eb65dd1be tasks/cephfs: move mds_scrub_checks
...into a CephFSTestCase.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:18 +01:00
John Spray
03ea0971cc tasks/cephfs: move journal migration test
...into a CephFSTestCase.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:17 +01:00
John Spray
176123caea tasks/cephfs: extend vstart_runner's ctx&run
Sufficiently to enable using workunits.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:17 +01:00
John Spray
99e3a400e1 tasks/cephfs: add --interactive for vstart runner
Just like interactive-on-error in teuthology.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:17 +01:00