Commit Graph

107 Commits

Author SHA1 Message Date
Casey Bodley
97f1be5d3a qa/rgw: rgw/website suite uses subdomain calling format
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:52 -04:00
Casey Bodley
bb56ac01c2 qa/rgw: add new rgw/website suite for static website tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:51 -04:00
Casey Bodley
8c801f073d
Merge pull request #30218 from cbodley/wip-qa-rgw-barbican
qa/rgw: add integration test for sse-kms with barbican

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2019-09-17 08:17:30 -04:00
Casey Bodley
71a87afb5d qa/barbican: pin barbican to 5.0.1 release
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
53cd9b8dc6 qa/rgw: crypt suite uses clusters/fixed-1.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
1c5a12fd9e qa/rgw: abstract out barbican under 2-kms/
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Adam Kupczyk
a5ec971402 tasks/barbican: Added task to deploy and configure barbican
Fixed keystone, rgw and s3tests tasks to work with it.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-09-13 15:04:43 -04:00
Shilpa Jagannath
280986f8e6 Added radosgw_admin_rest task to multisite yaml.
svc_zone related modifications

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2019-08-22 13:44:48 +05:30
Soumya Koduri
eb6eddbe8d Validate bucket names as per revised s3 spec
As per amazon s3 spec -
https://docs.aws.amazon.com/AmazonS3/latest/dev/BucketRestrictions.html

* The s3 bucket names should not contain upper case letters or underscore.
* Name cannot end with dash or have consecutive periods, or dashes adjacent
  to periods.
* Each label in the bucket name must start and end with a lowercase
  letter or a number.
* Name cannot exceed 63 characters.

This change is to enforce these rules if rgw_relaxed_s3_bucket_names is set to
'false' which is by default.

Fixes: https://tracker.ceph.com/issues/36293

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2019-08-08 16:54:12 +05:30
Ali Maredia
d7e2acb86b
Merge pull request #22788 from adamyanova/wip-s3java
A task to run S3 Java tests against RGW
2019-07-18 14:37:50 -04:00
Casey Bodley
8c8a706b6f qa/rgw: add dnsmasq back to s3a-hadoop
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
0fc2c8ecee qa/rgw: remove ceph-ansible from s3a-hadoop suite
Fixes: http://tracker.ceph.com/issues/39706

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
3ff5f0c240 qa/rgw: use default ports (80 or 443) unless overridden
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Radoslaw Zarzynski
b2007e275f Revert "qa: remove mon valgrind check in rgw verfiy suite"
This reverts commit d25d6ee0af.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-29 23:39:16 +02:00
Ali Maredia
d25d6ee0af qa: remove mon valgrind check in rgw verfiy suite
memory leaks in the monitor are causing a significant
percentage of jobs run in the rgw verify suite to
fail even though the jobs succeeded before hand.

See: http://tracker.ceph.com/issues/38827 for
root cause

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-05-17 15:59:30 -04:00
Antoaneta Damyanova
d43302ef42 Explicitly show force-branch and force-repo in s3tests-java.yaml
Signed-off-by: Antoaneta Damyanova <adamyanova@gmail.com>
2019-05-08 21:28:43 +02:00
Antoaneta Damyanova
09683dbac8 Updated task functionality
- run tests in groups: AWS4Test, BucketTest,ObjectTest
- do garbage collection via radosgw-admin before and after
each group to remove shadow objects and leftovers from multipart upoload
- add output forwarding of gradle to log and cat log file on completion
- switcehd from teardown to end method
- check for endpoint certificat and add it to the java keystore
- add s3tests-java.yaml task file to qa/suites/rgw/verify/tasks
- remove optional branch and repo and use default at ceph/java_s3tests

Signed-off-by: Antoaneta Damyanova <adamyanova@gmail.com>
2019-05-08 21:25:24 +02:00
Yuval Lifshitz
d8d817a600 rgw/pubsub: add another zone for pubsub
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-04-30 11:51:16 +03:00
Yuval Lifshitz
677dbfce61 Merge branch 'wip-yuval-pubsub_teuthology' of https://github.com/ceph/ceph-ci into wip-yuval-pubsub_teuthology
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-04-29 09:42:32 +03:00
Casey Bodley
d0142a189a DNM qa/rgw: disable debuginfo packages
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-03-29 14:18:55 -04:00
Casey Bodley
9fdcaae19a
Merge pull request #26100 from ceph/wip-s3a-hadoop-ver
qa/tests: update s3a hadoop versions used for test

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-25 13:22:39 -04:00
Sage Weil
e79dc454db qa/suites: disable valgrind leak checks on ceph-mgr
We've disabled the "clean" shutdown in ceph-mgr due to
https://tracker.ceph.com/issues/38621

Until then, no valgrind leak checks!

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 13:03:28 -06:00
Sage Weil
b8b398e1ab qa/suites/rgw/tempest/tasks/rgw_tempest: no need for notcmalloc
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 09:11:07 -06:00
Vasu Kulkarni
22222e2721 qa/tests: test only with centos as its known to work with ceph-ansible better
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2019-01-23 15:27:13 -08:00
Vasu Kulkarni
badd61f10f qa/tests: update hadooop versions used for test
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2019-01-23 11:59:18 -08:00
Matt Benjamin
d4c4082cca
Merge pull request #25774 from yehudasa/wip-rgw-tiering-3
rgw: rados tiering
2019-01-22 12:42:21 -05:00
Casey Bodley
92ea0a6873
Merge pull request #25996 from yehudasa/wip-37885
qa/rgw/tempest: either force os_type or select random distro

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-01-18 11:45:29 -05:00
Yehuda Sadeh
0c238c2704 qa/rgw/tempest: either force os_type or select random distro
Fixes: https://tracker.ceph.com/issues/37885

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-16 11:39:29 -08:00
Yehuda Sadeh
dab1424588 qa/rgw/tempest: either force os_type or select random distro
Fixes: https://tracker.ceph.com/issues/37885

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-14 17:05:25 -08:00
Yehuda Sadeh
2d6b645d23 qa/rgw: support for storage classes
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-11 08:43:41 -08:00
Yehuda Sadeh
83f7af473b qa/ragweed: change the way we determine which ragweed branch to use
- if force-branch, use that
 - otherwise:
    - read default-branch from client config
    - use suite branch or ceph branch if suite branch is not defined
    - if this branch is one of official releases (or master), prefix
      it with 'ceph-'

try to clone branch specified above, if failed (branch doesn't exist probably)
and not force-branch, use default-branch.
Also add an option to override ragweed repo.

Switched all force-branch from ragweed qa suite to default-branch.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-01-09 11:02:57 -08:00
Casey Bodley
8bf1c60f6a qa/rgw: add cls_lock/log/refcount tests to verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-10 13:56:34 -05:00
Sage Weil
03908113b4 qa/suites: valgrind ceph-mgr too
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-09 08:52:07 -06:00
Sage Weil
9db328f2ab Merge PR #24204 into master
* refs/pull/24204/head:
	qa/suites/rgw/tempest: valgrind on centos only

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-10-12 16:29:44 -05:00
Casey Bodley
8622d8a241
Merge pull request #24011 from cbodley/wip-qa-rgw-multisite-speedup
qa/rgw: reduce number of multisite log shards

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-09-25 16:39:51 -04:00
Sage Weil
04e608e1a2 qa/suites/rgw/tempest: valgrind on centos only
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-20 13:00:47 -05:00
Sage Weil
44de03d5e6 qa/suites: test pg merging
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:05 -05:00
Casey Bodley
2629231ca1 qa/rgw: reduce number of multisite log shards
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-09-05 14:45:04 -04:00
Casey Bodley
7ad313768a qa/rgw: raise default curl timeout for multisite suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Sage Weil
b500359409 qa/rgw: vary omap osd-side limit
Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Casey Bodley
8d36655fcb
Merge pull request #23372 from cbodley/wip-25214
qa/rgw: override valgrind --max-threads for radosgw

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2018-08-01 16:12:21 -04:00
Casey Bodley
e617990efe qa/rgw: override valgrind --max-threads for radosgw
radosgw now uses 512 frontend threads by default, and valgrind won't
start with its default --max-threads=500

Fixes: http://tracker.ceph.com/issues/25214

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-01 14:45:24 -04:00
Casey Bodley
bfc892ab84 qa/rgw: add radosgw-admin-rest task to singleton suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Sage Weil
a3c2b28edb qa/suites/rgw/verify/tasks/cls_rgw: test cls_rgw
Test this as part of the rgw suite (currently we only cover it in the
rados suite).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-06 16:49:10 -05:00
Patrick Donnelly
b39f9d06dc
qa: fix symlinks indirectly pointing at qa to .qa
Building on the previous commit.

Command used:

$ find suites/ -type l -and -not -name .qa -execdir ~/fix.sh {} \;

fix.sh:
    #!/bin/bash

    link="$(readlink "$1")"

    echo $link
    dirlink="$(dirname "$link")"
    baselink="$(basename "$link")"

    while true; do
        echo $dirlink
        if [ "$dirlink" -ef ~/ceph/qa ]; then
            ln -nsf ".qa/$baselink" "$1"
            exit
        else
            baselink="$(basename "$dirlink")/$baselink"
            dirlink="$(dirname "$dirlink")"
            if [ "$dirlink" -ef . ]; then
                break
            fi
        fi
    done

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:48:38 -07:00
Patrick Donnelly
716db6e2fd
qa: add .qa helper link
This utilizes the recent feature in teuthology [1] to skip hidden files in
suites when building the job matrix.

Idea of this change is to enable referring to the top-level qa directory in a
position-independent way such that copies of a suite to another location do not
break any symlinks.

[1] https://github.com/ceph/teuthology/pull/1185

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:33:48 -07:00
Casey Bodley
64e20c3a6a qa/rgw: reorganize verify tasks
split the verify suite tasks back into separate yaml files, using + to
combine them into a single job

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-05-25 10:44:14 -04:00
Yuri Weinstein
7ce9163948 tests/qa: Adding $ distro mix - rgw
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-05-10 12:29:20 -07:00
Casey Bodley
c4f6031fc6 qa/rgw: remove rgw/upgrade suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-05-03 15:19:49 -04:00
Yuri Weinstein
b28ab5616d
Merge pull request #20678 from ceph/wip-s3a-fix
fix s3atests that are failing for sometime

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-01 09:28:24 -07:00