Commit Graph

74 Commits

Author SHA1 Message Date
Sage Weil
9db328f2ab Merge PR #24204 into master
* refs/pull/24204/head:
	qa/suites/rgw/tempest: valgrind on centos only

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-10-12 16:29:44 -05:00
Casey Bodley
8622d8a241
Merge pull request #24011 from cbodley/wip-qa-rgw-multisite-speedup
qa/rgw: reduce number of multisite log shards

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 16:39:51 -04:00
Sage Weil
04e608e1a2 qa/suites/rgw/tempest: valgrind on centos only
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-20 13:00:47 -05:00
Sage Weil
44de03d5e6 qa/suites: test pg merging
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:05 -05:00
Casey Bodley
2629231ca1 qa/rgw: reduce number of multisite log shards
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-09-05 14:45:04 -04:00
Casey Bodley
7ad313768a qa/rgw: raise default curl timeout for multisite suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Sage Weil
b500359409 qa/rgw: vary omap osd-side limit
Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Casey Bodley
8d36655fcb
Merge pull request #23372 from cbodley/wip-25214
qa/rgw: override valgrind --max-threads for radosgw

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2018-08-01 16:12:21 -04:00
Casey Bodley
e617990efe qa/rgw: override valgrind --max-threads for radosgw
radosgw now uses 512 frontend threads by default, and valgrind won't
start with its default --max-threads=500

Fixes: http://tracker.ceph.com/issues/25214

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-01 14:45:24 -04:00
Casey Bodley
bfc892ab84 qa/rgw: add radosgw-admin-rest task to singleton suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Sage Weil
a3c2b28edb qa/suites/rgw/verify/tasks/cls_rgw: test cls_rgw
Test this as part of the rgw suite (currently we only cover it in the
rados suite).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-06 16:49:10 -05:00
Patrick Donnelly
b39f9d06dc
qa: fix symlinks indirectly pointing at qa to .qa
Building on the previous commit.

Command used:

$ find suites/ -type l -and -not -name .qa -execdir ~/fix.sh {} \;

fix.sh:
    #!/bin/bash

    link="$(readlink "$1")"

    echo $link
    dirlink="$(dirname "$link")"
    baselink="$(basename "$link")"

    while true; do
        echo $dirlink
        if [ "$dirlink" -ef ~/ceph/qa ]; then
            ln -nsf ".qa/$baselink" "$1"
            exit
        else
            baselink="$(basename "$dirlink")/$baselink"
            dirlink="$(dirname "$dirlink")"
            if [ "$dirlink" -ef . ]; then
                break
            fi
        fi
    done

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:48:38 -07:00
Patrick Donnelly
716db6e2fd
qa: add .qa helper link
This utilizes the recent feature in teuthology [1] to skip hidden files in
suites when building the job matrix.

Idea of this change is to enable referring to the top-level qa directory in a
position-independent way such that copies of a suite to another location do not
break any symlinks.

[1] https://github.com/ceph/teuthology/pull/1185

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:33:48 -07:00
Casey Bodley
64e20c3a6a qa/rgw: reorganize verify tasks
split the verify suite tasks back into separate yaml files, using + to
combine them into a single job

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-05-25 10:44:14 -04:00
Yuri Weinstein
7ce9163948 tests/qa: Adding $ distro mix - rgw
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-05-10 12:29:20 -07:00
Casey Bodley
c4f6031fc6 qa/rgw: remove rgw/upgrade suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-05-03 15:19:49 -04:00
Yuri Weinstein
b28ab5616d
Merge pull request #20678 from ceph/wip-s3a-fix
fix s3atests that are failing for sometime

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-01 09:28:24 -07:00
Casey Bodley
35fd4050b7 qa/rgw: verify suite tests beast with ssl
instead of adding special frontend configs like civetweb_ssl.yaml and
beast_ssl.yaml, added a new proto/ subdirectory for http.yaml and
https.yaml

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-05 15:30:22 -04:00
Vasu Kulkarni
0a794cf980 qa/tests: use dnsmasq task which does better job of setting up cname and cleanup
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2018-03-30 11:11:41 -07:00
Vasu Kulkarni
ab9a78b903 qa/tests: Remove distro version and use 20gb disk size for ovh,
use 8 as default pg_num and pgp_num

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2018-03-30 09:08:56 -07:00
Ricardo Dias
98e4b331aa
qa/rgw: renamed ssl task to openssl_keys
The ssl task located in a python file called `ssl.py` will generate
python module loading conflicts with the `ssl` system module, when
running QA tests using vstart_runner.py.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-13 14:41:25 +00:00
Casey Bodley
ce8a22afbe qa/rgw: verify suite tests civetweb with ssl
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-03-09 16:33:10 -05:00
Casey Bodley
b497d9fdd3 qa/rgw: combine swift, s3tests, ragweed into single verify task
these tests don't need to be split across the job matrix the same way
that we split features like frontend, ssl, objectstore, etc. by
combining them, we can still test the whole matrix of features, but with
only 1/3 of the total jobs

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-03-07 09:21:55 -05:00
Yuri Weinstein
00e0cd0b72
Merge pull request #20440 from cbodley/wip-qa-rgw-beast
qa/rgw: remove some civetweb overrides for beast testing

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-02-27 09:47:05 -08:00
Yehuda Sadeh
2d23084092 qa/rgw: ragweed: change base branch for upgrade testing
Change directory structure to reflect base version of upgrade test.
Also set base version to kraken.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-19 14:45:51 -08:00
Yehuda Sadeh
0882d306f6 qa/tasks/rgw/upgrade: don't restart the entire cluster at once
and also whitelist 'wrongly marked me down'

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-19 14:45:51 -08:00
Yehuda Sadeh
52d8f0d82f qa/tasks: add ragweed tasks
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-19 14:45:51 -08:00
Yehuda Sadeh
3bf80dd171 ceph/qa/suites: add rgw/upgrade/ragweed
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-19 14:45:51 -08:00
Casey Bodley
12218eeea9 qa/rgw: remove some civetweb overrides for beast testing
these overrides were preventing frontend/beast.yaml from selecting the
beast frontend

Fixes: http://tracker.ceph.com/issues/23002

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-02-14 12:22:09 -05:00
Casey Bodley
f8909bb6a6 qa/rgw: disable log trim in multisite suite
the multisite tests run manual trim operations with radosgw-admin, which
can race with internal log trimming to produce tests failures

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-12-11 16:48:02 -05:00
Casey Bodley
607b72f553 qa/rgw: add beast frontend to some rgw suites
added a qa/rgw_frontend directory for civetweb.yaml and the new
beast.yaml. the rgw suites for multifs and singleton now symlink
rgw_frontend/civetweb.yaml. the multisite, tempest and verify suites
symlink rgw_frontend to test both. this doubles the number of jobs in
those suites

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-10-27 11:20:52 -04:00
Vasu Kulkarni
56d1511bdf use ovh instead of vps
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2017-09-21 16:43:24 -07:00
Vasu Kulkarni
184d5e6bad qa/tests: update required ceph-ansbile vars
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2017-09-19 17:12:09 -07:00
Casey Bodley
a97d5bea42 qa/rgw: hadoop suite targets centos_latest
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:29:40 -04:00
Casey Bodley
4a953a16d7 qa/rgw: use overrides for hadoop version
instead of having two separate tasks, add v27.yaml and v28.yaml with
overrides for hadoop_version

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-18 13:28:24 -04:00
Matt Benjamin
1e1731e663 Merge pull request #16612 from cbodley/wip-20668
rgw: fixes for multisite replication of encrypted objects
2017-08-23 15:57:02 -04:00
Casey Bodley
f27ebabe55 test/rgw: add kms encryption key for teuthology
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-16 12:22:31 -04:00
Radoslaw Zarzynski
ed8a6b89e4 qa/suites/rgw/tempest: use fixed-1 cluster instead of fixed-2.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-14 01:11:22 +00:00
Radoslaw Zarzynski
43a7399720 qa/tasks/rgw: make the frontend_prefix per-client configurable.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-14 01:11:18 +00:00
Radoslaw Zarzynski
09db786581 qa/suites/rgw: move the Tempest testing to its dedicated sub-suite.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
99e1d443a0 qa/suites/rgw: freeze the Tempest version for RGW testing.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
afe1ad3010 qa, rgw: Keystone's instances can be now accessed via non-local network interfaces.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Radoslaw Zarzynski
849f46f8cf qa/suites/rgw: integrate Tempest to verify Swift API compliance.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-08-13 23:14:40 +00:00
Sage Weil
960f00071f qa/suites: disable mon crush smoke test with valgrind
Valgrind runs itself on forked children, and does its cleanup when they
complete, and this is slow... slow enough that it frequently makes the
test time out.

Valgrind let's you ignore child *processes* that you exec, but I can't
find a way to skip forked children in the same address space.

Work around this by skip this validation when running under valgrind.

Fixes: http://tracker.ceph.com/issues/20602
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-14 11:51:47 -04:00
Sage Weil
8d711a5659 qa/suites/rgw/thrash: whitelist
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-12 12:52:03 -04:00
Sage Weil
aa986f58ef Merge pull request #16046 from liewegas/wip-valgrind-on-centos
do all valgrind runs on centos

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-06-30 21:17:21 -05:00
Sage Weil
c7893283cd do all valgrind runs on centos
We are fighting two issues with valgrind on ubuntu (xenial, yakkety,
and z):

	http://tracker.ceph.com/issues/18126
	http://tracker.ceph.com/issues/20360

Revert this when it is fixed.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-30 09:33:18 -04:00
Nathan Cutler
2fa6a3ec32 tests: rgw/singleton: drop duplicate filestore-xfs.yaml
This yaml is now included in the objectstore/ directory. It makes no sense to
duplicate it here.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-06-27 23:14:43 +02:00
Greg Farnum
7d33e98bd3 qa: do not restrict valgrind runs to centos
This reverts 693bd23851, which was
added in response to http://tracker.ceph.com/issues/18126. But
we updated the Ubuntu packages in sepia so it should be good to go.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-06-23 16:25:16 -04:00
Casey Bodley
6b42352b70 Merge pull request #14624 from ceph/wip-s3a-hadoop
qa/tasks: S3A hadoop task to test s3a with Ceph

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-06-23 13:46:05 -04:00