Commit Graph

229 Commits

Author SHA1 Message Date
Marcus Watts
20cb9805c9 qa/rgw - run sse-s3 test cases by default
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2022-04-19 17:35:40 -04:00
Casey Bodley
065b9aad86 qa/rgw: run sse-s3 test cases conditionally
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4e644832b0)
2022-04-19 17:35:39 -04:00
Casey Bodley
e346a75399 qa/rgw: configure sse-s3 in vault_transit.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1b679e0828)
2022-04-19 17:35:39 -04:00
Ali Maredia
8de2884e06
Merge pull request #44856 from cbodley/wip-54103
qa/rgw: install s3cmd with extra_system_packages

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2022-02-07 16:02:40 -05:00
Casey Bodley
a2d2ed2d8e
Merge pull request #44348 from soumyakoduri/wip-skoduri-lc-teuthology
rgw/qa: Add test suite for lifecycle cases

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-02-04 11:04:13 -05:00
Patrick Donnelly
1f714da814
qa: fix or add missing .qa links
Using this command:

    find qa/suites/ -type d -execdir ln -sfT ../.qa/ {}/.qa \;

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-03 10:08:30 -05:00
Soumya Koduri
9dfe5ac714 rgw/qa: Add test suite for lifecycle cases
Execute lifecycle s3-tests in the teuthology test-suite by configuring
required storage classes and 'rgw lc debug interval' option.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2022-02-03 00:16:03 +05:30
Casey Bodley
12d23d3f63 qa/rgw: install s3cmd with extra_system_packages
this was preventing installation on ubuntu because of
https://tracker.ceph.com/issues/25026

Fixes: https://tracker.ceph.com/issues/54103

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-02-01 10:39:18 -05:00
Casey Bodley
0fad609d4d qa/rgw: rgw/verify no longer pins centos 8.0
the symlink rgw/verify/centos_latest.yaml already selects centos

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 17:23:27 -05:00
Ali Maredia
99f0e82a95 qa: move certificates for kmip task into /etc/ceph
On rhel/centos the ceph user does not have permission
to access these certs which leads to s3-test failures
in teuthology.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2022-01-20 17:43:55 -05:00
Casey Bodley
52bfa9a866 qa/rgw: run multisite tests with some async notifications disabled
disable the sending of async datalog notifications on one zone per
cluster. this helps to verify that tests don't rely on notifications to
succeed

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-17 13:54:39 -05:00
Casey Bodley
95544e802b qa/rgw: add PG_DEGRADED cluster warnings to log-ignorelist
and cover rgw/singleton suite

Fixes: https://tracker.ceph.com/issues/51727

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-12 15:56:38 -05:00
Casey Bodley
f70d24997e qa/rgw: run ceph_test_cls_rgw_gc in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-12-09 11:07:03 -05:00
Casey Bodley
2ed55af056 qa/rgw: run ceph_test_cls_rgw_stats in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
Casey Bodley
0bb60469d1 qa/rgw: bump tempest version to resolve dependency issue
Fixes: https://tracker.ceph.com/issues/53095

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-08 10:06:26 -05:00
Casey Bodley
a25d1a70aa qa/rgw: master branch targets ceph-master branch of java_s3tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-04 12:12:04 -04:00
Kalpesh Pandya
74b5ec876c qa/tasks: Addition of two new parameters for sts-tests
Addition of SUB and AZP parameter for some new sts-tests

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-09-01 17:09:54 +05:30
Casey Bodley
e3a6377099
Merge pull request #42196 from cbodley/wip-qa-rgw-rm-cephadm
qa/rgw: remove rgw_cephadm.yaml from rgw/singleton suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-07-21 13:14:35 -04:00
Casey Bodley
255293bd80
Merge pull request #42317 from cbodley/wip-39657
rgw multisite: metadata sync treats all errors as 'transient' for retry

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2021-07-21 13:13:54 -04:00
Casey Bodley
1acee2ab76
Merge pull request #42361 from cbodley/wip-49747
qa/rgw: add failing tempest test to blocklist

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2021-07-21 13:10:30 -04:00
galsalomon66
7d4bc5a72c revert force-branch to be ceph-master
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2021-07-20 12:48:00 +03:00
Casey Bodley
84909e7a50 qa/rgw: add failing tempest test to blocklist
Fixes: https://tracker.ceph.com/issues/49747

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:10:14 -04:00
Casey Bodley
cff6bf37e6 qa/rgw: run multisite tests with metadata sync error injection
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-13 14:17:00 -04:00
Casey Bodley
b7d4ea481c qa/rgw: remove rgw_cephadm.yaml from rgw/singleton suite
this cephadm task was merged without testing in
https://github.com/ceph/ceph/pull/39855/ and fails consistently with an
error in kernel.py. the teuthology issue
https://tracker.ceph.com/issues/50338 has gone unfixed for months, so
removing rgw_cephadm.yaml to clean up the rgw suite

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-06 11:01:20 -04:00
Ali Maredia
1a6255530f qa: add workunit for testing rgw datacache
Add a workunit for testing the rgw object cache
by using s3cmd to write objects and then
verify the objects in the cache.

Also move the 0-install.yaml file out of tasks and
into the main dir for the rgw/verify subsuite.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

qa: d3n: add debug logs

Signed-off-by: Ali Maredia <amaredia@redhat.com>

rgw: s3n: qa: fix netstat search for rgw process

Signed-off-by: Mark Kogan <mkogan@redhat.com>
2021-07-04 14:18:06 +03:00
Kalpesh Pandya
9bb68a55ca rgw: Modification in the usage of force-branch
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-07-01 13:54:51 +05:30
Kalpesh
2e0b8a2a1f qa/tasks: Adding RabbitMQ task for bucket notification tests
This commit majorly consists of the RabbitMQ task which is a required and supported endpoint in bucket notification tests.
And some related changes in the AMQP tests. Major changes are:
1. Addition of RabbitMQ task
2. Documentation update for the steps to execute AMQP tests
3. Addition of attributes to the tests
4. Tox dependency removal from kafka.py

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-06-01 23:34:31 +05:30
Matt Benjamin
5276c2a3d0
Merge pull request #40910 from galsalomon66/update_s3select_submodule_and_s3tests_head_10apr
rgw/s3select: update s3select submodule to last commit, (new features), update for test coverage(s3test)
2021-05-21 19:17:53 -04:00
gal salomon
7c9ac4ed3d update to s3select/master (new features)
Signed-off-by: gal salomon <gal.salomon@gmail.com>

force-branch to s3test/master

Signed-off-by: gal salomon <gal.salomon@gmail.com>

update of s3select (== -> =)

Signed-off-by: gal salomon <gal.salomon@gmail.com>

update of s3select (== -> =)

Signed-off-by: gal salomon <gal.salomon@gmail.com>

closing documentation gaps between previous and current functionalities(WIP)

Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

additional features

Update s3select.rst

Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

editorial
Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

editorial
Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

adding cast to bool
Signed-off-by: gal salomon <gal.salomon@gmail.com>

editorial; more description for substring and trim

Signed-off-by: gal salomon <gal.salomon@gmail.com>
2021-05-21 21:58:20 +03:00
Casey Bodley
46c0292870 rgw: remove the civetweb frontend from src and qa
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-05-17 15:00:31 -04:00
Casey Bodley
8cb94edcb1 qa/rgw: rgw/crypt uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-13 10:44:05 -04:00
Casey Bodley
6262cfa41f qa/rgw: reenable valgrind in rgw/website
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:31:26 -04:00
Casey Bodley
bbefbd3146 qa/rgw: rgw/tempest uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:30:01 -04:00
Casey Bodley
0a4437ba6f qa/rgw: rgw/multifs uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
09c93945a7 qa/rgw: rgw/thrash uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1a42bd37d2 qa/rgw: rgw/notifications no longer pins centos
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
c59f994a7e qa/rgw: use symlinks for rgw/sts suite, target supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1942095a32 qa/rgw: rgw/multisite uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:06:29 -04:00
Casey Bodley
8f27c845be qa/rgw: move rgw/multisite valgrind config into valgrind.yaml.disabled
the valgrind coverage wasn't enabled, and it will take a lot more work
before we can reenable

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:05:16 -04:00
Yuval Lifshitz
c43878d0bd
Merge pull request #40625 from TRYTOBE8TME/wip-rgw-notifications
rgw/test: Changing force-branch to master
2021-04-08 08:32:45 +03:00
Kalpesh
42d87989e9 rgw/test: Changing force-branch to master
This PR includes 2 things:
1. Changing force-branch to master and removing the git-remote. This change was forgetten for PR #39139.
2. Proper cleanup/removal after completion of commands more precisely removing the kafka logs directory.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-04-08 01:37:29 +05:30
Casey Bodley
b1830e43d2 qa/rgw: move ignore-pg-availability.yaml out of suites/rgw
this was added in https://github.com/ceph/ceph/pull/39820 to
avoid repeating the override in rgw subsuites, but teuthology
was picking up suites/rgw/ignore-pg-availability.yaml as a job
of its own, and led to 'list index out of range' failures

Fixes: https://tracker.ceph.com/issues/50147

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-05 13:09:52 -04:00
Yuval Lifshitz
b903b2e011
Merge pull request #39139 from TRYTOBE8TME/wip-rgw-bucket-tests-separation-new
Wip rgw bucket tests separation new
2021-03-18 20:33:00 +02:00
Casey Bodley
29f4bbb5ee qa/rgw: notifications suite runs single job
pin to the beast frontend, default bluestore, replicated pools, and run
against a random distro

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-03-18 11:06:40 +05:30
Casey Bodley
2bc016b52c
Merge pull request #39820 from cbodley/wip-qa-rgw-ignore-pg-avail
qa/rgw: put PG_AVAILABILITY ignorelist override in its own file

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-15 15:09:29 -04:00
Marcus Watts
e8ff0464d4 rgw/kms/vault - s3tests for both old and new test logic.
Test both "old" and "new" transit logic with s3tests.  Does not test
migration - that will need to be done separately.  I've added
a "flavor" parameter so the test logic can tell the difference
between the "old" engine and the "new" engine.  The vault
keys creation logic now has options to determine whether
the keys created are exportable (needed for the old transit
engine), or not (should be the case going forward with the
new transit engine.)

Fixes: http://tracker.ceph.com/issues/48746
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2021-03-05 23:05:13 -05:00
Matt Benjamin
d2c30d7130
Merge pull request #33996 from mdw-at-linuxbox/wip-master-kmip
rgw / kmip kms
2021-03-05 16:20:18 -05:00
Sage Weil
9002400301 qa/suites/rgw/singleton: add trivial cephadm case
Make sure we can deploy an rgw and not generate any warnings.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-05 09:47:19 -05:00
Marcus Watts
809677d991 rgw/kms/kmip - rgw / kmip test integration.
Actually add kmip to the kms crypt suite.

This also makes some ssl certs which is required for use of kmip.

Signed-off-by: Marcus Watts <mwatts@redhat.com>
2021-03-03 19:14:10 -05:00
root
948a00b1d8 qa: Kafka task files for bucket notification tests
This commit consists of 3 things:
1. Files required for setting up new directory (in order to run the task in teuthology)
2. Kafka task file
3. The new files conataining tests and it's infrastructure for separation of bucket notification tests from pubsub tests

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-03-03 22:04:04 +05:30