Commit Graph

213 Commits

Author SHA1 Message Date
Kalpesh Pandya
74b5ec876c qa/tasks: Addition of two new parameters for sts-tests
Addition of SUB and AZP parameter for some new sts-tests

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-09-01 17:09:54 +05:30
Casey Bodley
e3a6377099
Merge pull request #42196 from cbodley/wip-qa-rgw-rm-cephadm
qa/rgw: remove rgw_cephadm.yaml from rgw/singleton suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-07-21 13:14:35 -04:00
Casey Bodley
255293bd80
Merge pull request #42317 from cbodley/wip-39657
rgw multisite: metadata sync treats all errors as 'transient' for retry

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2021-07-21 13:13:54 -04:00
Casey Bodley
1acee2ab76
Merge pull request #42361 from cbodley/wip-49747
qa/rgw: add failing tempest test to blocklist

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2021-07-21 13:10:30 -04:00
galsalomon66
7d4bc5a72c revert force-branch to be ceph-master
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2021-07-20 12:48:00 +03:00
Casey Bodley
84909e7a50 qa/rgw: add failing tempest test to blocklist
Fixes: https://tracker.ceph.com/issues/49747

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:10:14 -04:00
Casey Bodley
cff6bf37e6 qa/rgw: run multisite tests with metadata sync error injection
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-13 14:17:00 -04:00
Casey Bodley
b7d4ea481c qa/rgw: remove rgw_cephadm.yaml from rgw/singleton suite
this cephadm task was merged without testing in
https://github.com/ceph/ceph/pull/39855/ and fails consistently with an
error in kernel.py. the teuthology issue
https://tracker.ceph.com/issues/50338 has gone unfixed for months, so
removing rgw_cephadm.yaml to clean up the rgw suite

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-06 11:01:20 -04:00
Ali Maredia
1a6255530f qa: add workunit for testing rgw datacache
Add a workunit for testing the rgw object cache
by using s3cmd to write objects and then
verify the objects in the cache.

Also move the 0-install.yaml file out of tasks and
into the main dir for the rgw/verify subsuite.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

qa: d3n: add debug logs

Signed-off-by: Ali Maredia <amaredia@redhat.com>

rgw: s3n: qa: fix netstat search for rgw process

Signed-off-by: Mark Kogan <mkogan@redhat.com>
2021-07-04 14:18:06 +03:00
Kalpesh Pandya
9bb68a55ca rgw: Modification in the usage of force-branch
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-07-01 13:54:51 +05:30
Kalpesh
2e0b8a2a1f qa/tasks: Adding RabbitMQ task for bucket notification tests
This commit majorly consists of the RabbitMQ task which is a required and supported endpoint in bucket notification tests.
And some related changes in the AMQP tests. Major changes are:
1. Addition of RabbitMQ task
2. Documentation update for the steps to execute AMQP tests
3. Addition of attributes to the tests
4. Tox dependency removal from kafka.py

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-06-01 23:34:31 +05:30
Matt Benjamin
5276c2a3d0
Merge pull request #40910 from galsalomon66/update_s3select_submodule_and_s3tests_head_10apr
rgw/s3select: update s3select submodule to last commit, (new features), update for test coverage(s3test)
2021-05-21 19:17:53 -04:00
gal salomon
7c9ac4ed3d update to s3select/master (new features)
Signed-off-by: gal salomon <gal.salomon@gmail.com>

force-branch to s3test/master

Signed-off-by: gal salomon <gal.salomon@gmail.com>

update of s3select (== -> =)

Signed-off-by: gal salomon <gal.salomon@gmail.com>

update of s3select (== -> =)

Signed-off-by: gal salomon <gal.salomon@gmail.com>

closing documentation gaps between previous and current functionalities(WIP)

Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

additional features

Update s3select.rst

Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

editorial
Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

editorial
Signed-off-by: gal salomon <gal.salomon@gmail.com>

Update s3select.rst

adding cast to bool
Signed-off-by: gal salomon <gal.salomon@gmail.com>

editorial; more description for substring and trim

Signed-off-by: gal salomon <gal.salomon@gmail.com>
2021-05-21 21:58:20 +03:00
Casey Bodley
46c0292870 rgw: remove the civetweb frontend from src and qa
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-05-17 15:00:31 -04:00
Casey Bodley
8cb94edcb1 qa/rgw: rgw/crypt uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-13 10:44:05 -04:00
Casey Bodley
6262cfa41f qa/rgw: reenable valgrind in rgw/website
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:31:26 -04:00
Casey Bodley
bbefbd3146 qa/rgw: rgw/tempest uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:30:01 -04:00
Casey Bodley
0a4437ba6f qa/rgw: rgw/multifs uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
09c93945a7 qa/rgw: rgw/thrash uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1a42bd37d2 qa/rgw: rgw/notifications no longer pins centos
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
c59f994a7e qa/rgw: use symlinks for rgw/sts suite, target supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1942095a32 qa/rgw: rgw/multisite uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:06:29 -04:00
Casey Bodley
8f27c845be qa/rgw: move rgw/multisite valgrind config into valgrind.yaml.disabled
the valgrind coverage wasn't enabled, and it will take a lot more work
before we can reenable

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:05:16 -04:00
Yuval Lifshitz
c43878d0bd
Merge pull request #40625 from TRYTOBE8TME/wip-rgw-notifications
rgw/test: Changing force-branch to master
2021-04-08 08:32:45 +03:00
Kalpesh
42d87989e9 rgw/test: Changing force-branch to master
This PR includes 2 things:
1. Changing force-branch to master and removing the git-remote. This change was forgetten for PR #39139.
2. Proper cleanup/removal after completion of commands more precisely removing the kafka logs directory.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-04-08 01:37:29 +05:30
Casey Bodley
b1830e43d2 qa/rgw: move ignore-pg-availability.yaml out of suites/rgw
this was added in https://github.com/ceph/ceph/pull/39820 to
avoid repeating the override in rgw subsuites, but teuthology
was picking up suites/rgw/ignore-pg-availability.yaml as a job
of its own, and led to 'list index out of range' failures

Fixes: https://tracker.ceph.com/issues/50147

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-05 13:09:52 -04:00
Yuval Lifshitz
b903b2e011
Merge pull request #39139 from TRYTOBE8TME/wip-rgw-bucket-tests-separation-new
Wip rgw bucket tests separation new
2021-03-18 20:33:00 +02:00
Casey Bodley
29f4bbb5ee qa/rgw: notifications suite runs single job
pin to the beast frontend, default bluestore, replicated pools, and run
against a random distro

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-03-18 11:06:40 +05:30
Casey Bodley
2bc016b52c
Merge pull request #39820 from cbodley/wip-qa-rgw-ignore-pg-avail
qa/rgw: put PG_AVAILABILITY ignorelist override in its own file

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-15 15:09:29 -04:00
Marcus Watts
e8ff0464d4 rgw/kms/vault - s3tests for both old and new test logic.
Test both "old" and "new" transit logic with s3tests.  Does not test
migration - that will need to be done separately.  I've added
a "flavor" parameter so the test logic can tell the difference
between the "old" engine and the "new" engine.  The vault
keys creation logic now has options to determine whether
the keys created are exportable (needed for the old transit
engine), or not (should be the case going forward with the
new transit engine.)

Fixes: http://tracker.ceph.com/issues/48746
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2021-03-05 23:05:13 -05:00
Matt Benjamin
d2c30d7130
Merge pull request #33996 from mdw-at-linuxbox/wip-master-kmip
rgw / kmip kms
2021-03-05 16:20:18 -05:00
Sage Weil
9002400301 qa/suites/rgw/singleton: add trivial cephadm case
Make sure we can deploy an rgw and not generate any warnings.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-05 09:47:19 -05:00
Marcus Watts
809677d991 rgw/kms/kmip - rgw / kmip test integration.
Actually add kmip to the kms crypt suite.

This also makes some ssl certs which is required for use of kmip.

Signed-off-by: Marcus Watts <mwatts@redhat.com>
2021-03-03 19:14:10 -05:00
root
948a00b1d8 qa: Kafka task files for bucket notification tests
This commit consists of 3 things:
1. Files required for setting up new directory (in order to run the task in teuthology)
2. Kafka task file
3. The new files conataining tests and it's infrastructure for separation of bucket notification tests from pubsub tests

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-03-03 22:04:04 +05:30
Casey Bodley
4fe1b138ff qa/rgw: put PG_AVAILABILITY ignorelist override in its own file
now covers the sts and multifs subsuites

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-03-03 11:29:18 -05:00
Sage Weil
568eb9e3f3 Merge PR #39561 into master
* refs/pull/39561/head:
	qa/valgrind.supp: suppress free[] warnings
	qa/suites: do not use notcmalloc flavor

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-19 13:56:33 -05:00
Sage Weil
dc64ccf063 qa/suites: do not use notcmalloc flavor
teuthology now knows how to run valgrind against a tcmalloc binary

Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-18 10:26:28 -06:00
Casey Bodley
6f2af91518 qa/rgw: add 'branch' option to rgw-multisite-tests task
Fixes: https://tracker.ceph.com/issues/49330

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-17 09:01:05 -05:00
Casey Bodley
c706740dbe test/rgw: re-enable valgrind in rgw verify suite
this only enables it for radosgw itself, not the other daemons

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-09 14:26:19 -05:00
Casey Bodley
58e0da8fc9 qa/rgw: move valgrind config into valgrind.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-09 14:26:19 -05:00
Casey Bodley
85641ac3e6 qa/rgw: add librgw_file unit tests to rgw/verify task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-01-25 16:46:04 -05:00
Casey Bodley
e2f8f23d21 qa/rgw: don't add a certificate for nonexistent rgw.client.1
this override to the rgw task is causing the rgw/verify suite to start
an extra radosgw

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-01-13 10:58:42 -05:00
Kalpesh Pandya
64db3a9aca qa: STS Web Identity task files
This commit comprises of 3 things:
1) Keycloak task (to bring up keycloak in teuthology inorder to execute Assume_Role_With_Web_Identity tests).
2) The required changes for this in s3tests.py which consists of writing some parameters to configuration file.
3) The yaml files which executes these tasks.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2020-11-29 04:52:19 +05:30
Kalpesh Pandya
60904c907e qa : STS Testing Files (AssumeRole and GetSessionToken)
Added required files for testing of AssumeRole and GetSessionToken API's and modified s3tests.py to handle the same.

(cherry picked from commit c2c90eaf52)

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2020-09-15 11:58:59 +05:30
Sage Weil
2ee9365d0b qa: log-whitelist -> log-ignorelist
Signed-off-by: Sage Weil <sage@newdream.net>
2020-08-24 19:53:08 +00:00
Sage Weil
dfd01d7653 blacklist -> blocklist
Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-08-24 19:53:08 +00:00
Daniel Gryniewicz
00ccbc74bb RGW - Turn on debug logging for tempest tests
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2020-08-17 12:30:58 -04:00
J. Eric Ivancich
94f53f513c
Merge pull request #33492 from prasakri/multisite-sync-check
RGW:Multisite: Verify if the synced object is identical to source

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-06-08 19:49:46 -04:00
Neha Ojha
7cd88b31e8 qa/suites/rgw/multisite, qa/suites/rgw/crypt: whitelist PG_AVAILABILITY
This follows b162541ac2.
The balancer was turned on by default in
d4fbaf7, as a result of which we might see
PG_AVAILABILITY health warnings when pg-upmap-items are applied.

Fixes: https://tracker.ceph.com/issues/45802
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-06-02 17:15:22 +00:00
Kefu Chai
8f5c832915 qa/tasks/tempest: use user/pass to authenticate
instead of using admin token use "admin" user to authenticate,
as admin token is not suggested anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-06-02 09:48:32 +08:00