Commit Graph

2422 Commits

Author SHA1 Message Date
Adam King
4d0cc762d7
Merge pull request #48428 from zmc/cephadm-smoke-small
qa/suites: Add orch/cephadm/smoke-small suite

Reviewed-by: Adam King <adking@redhat.com>
2023-01-24 09:08:44 -05:00
Ilya Dryomov
562a2ad03a
Merge pull request #48848 from stefan-chivu/rbd-wnbd-live-resize
rbd: live resize support for rbd-wnbd

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-01-19 17:29:36 +01:00
Lucian Petrut
2b014e159f qa: add windows run-tests.ps1
We have a few Python rbd-wnbd tests that are invoked explicitly
by the ceph-build scripts [1].

There are a few issues with that:

* it's a separate repo that has to be updated whenever we add new
  tests
* new tests that reside in the ceph repo will not be executed by
  the PR check
* some tests may be missing in case of older branches

For this reason, we're adding a new script as part of the Ceph
repo that will take care of invoking the Windows rbd-wnbd tests.

The ceph-build script has already been updated accordingly [2].

[1] https://github.com/ceph/ceph-build/blob/main/scripts/ceph-windows/run_tests#L73-L80
[2] https://github.com/ceph/ceph-build/pull/2094

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
Co-Authored-By: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
2023-01-18 15:32:50 +02:00
Laura Flores
c190aa9c82
Merge pull request #49181 from ljflores/wip-envlibrados-rocksdb-fix
qa/workunits/rados: skip running envlibrados rocksdb tests on ubuntu
2023-01-17 16:32:20 -06:00
Laura Flores
acc8c7e2ef qa/workunits/rados: skip running envlibrados rocksdb tests on ubuntu
This test passes on centos and rhel, but fails on ubuntu from an
invalid pointer. Since the envlibrados rocksdb tests are experimental
and don't have any actual users, we can just run them on rhel and
centos.

At the moment, the actual bug is not fully understood, but it was
decided that fixing it is low priority, and removing the test from
problematic distros is okay for the time being. This commit
is considered a workaround to the actual issue.

Related tracker: https://tracker.ceph.com/issues/57632
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-01-17 11:38:19 -06:00
Matan Breizman
314ffcb338 qa/suites/crimson-rados: rados_python - enable rollback test
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-01-03 13:47:04 +00:00
Venky Shankar
c20b57220c Merge PR #49423 into main
* refs/pull/49423/head:
	qa: remove qa/suites/marginal and restart task

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-12-22 19:35:27 +05:30
Casey Bodley
95aea3f4e2
Merge pull request #49390 from cbodley/wip-qa-rgw-inline
qa/rgw: rgw/verify suite randomizes --placement-inline-data

Reviewed-by: Cory Snyder <csnyder@iland.com>
2022-12-20 14:32:16 -05:00
Venky Shankar
e2ed89f05f qa: remove qa/suites/marginal and restart task
marginal suite was probably used sometime back and seems obsolete
now. Remove it and its corresponding restart task.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-12-15 16:56:03 +05:30
Neha Ojha
a968c6d024
Merge pull request #48226 from sseshasa/wip-fix-recovery-backfill-limits-for-mclock
osd: Reduce backfill/recovery default limits for mClock and other optimizations

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-12-14 10:59:15 -08:00
Casey Bodley
99262dc408 qa/rgw: rgw/verify suite randomizes --placement-inline-data
test coverage for https://github.com/ceph/ceph/pull/48711

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-12-12 12:32:24 -05:00
Sridhar Seshasayee
5b2fee21e8 qa: Allow tests to override recovery configs with mClock scheduler enabled
Set osd_mclock_override_recovery_settings option to true for tests that
modify recovery/backfill configuration options. This prevents logging of
the cluster warning when modifying recovery/backfill limits.

Fixes: https://tracker.ceph.com/issues/57529
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-12-12 18:12:46 +05:30
Adam King
af71b62986
Merge pull request #48389 from adk3798/staggered-start-update
qa/cephadm: update staggered upgrade test to use --image when redeploying mgr

Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-12-07 10:25:51 -05:00
Venky Shankar
e5558ce1a2
Merge pull request #48628 from lxbsz/kclient_fscrypt
qa: cephfs add fscrypt test suite support for kclient

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2022-12-06 11:06:58 +05:30
Xiubo Li
22f01ee61e qa: cephfs add fscrypt test suite for kclient
For both io path and common test cases in xfstests. Currently only
support the centos and ubuntu distros. But for rhel we couldn't
install the 'userspace-rcu-devel', 'device-mapper-devel' and
'libedit-devel' dependency packages.

Fixes: https://tracker.ceph.com/issues/58133
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-12-01 16:33:10 +08:00
Xiubo Li
df3a12c315 qa: test_acl ignore PG_AVAILABILITY and PG_DEGRADED healh WRNs
Which is irrelevant to this test.

Fixes: https://tracker.ceph.com/issues/58133
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-12-01 16:33:10 +08:00
Matan Breizman
d45bbaf6bf qa/suites/crimson-rados/thrash: do not wait for scrub
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-11-29 16:03:08 +00:00
Laura Flores
5573558a17
Merge pull request #48291 from ljflores/wip-upgrade-telemetry 2022-11-04 20:00:30 -05:00
Ilya Dryomov
0f93f745c6
Merge pull request #40363 from orozery/rbd-clone-encryption
librbd: add encryption format support for clones (part 1/2)

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-25 18:16:33 +02:00
Casey Bodley
5dc16bef2e
Merge pull request #46188 from Zhiwei-Dai/wip-rgw-crypto-stack-on-compress
rgw: support full object encryption stack on compression

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-10-24 11:52:26 -04:00
Samuel Just
5a6199b7d7
Merge pull request #48515 from athanatos/sjust/wip-crimson-suites
qa/suites/crimson-rados: move seastore to crimson-rados-experimental, remove cache/dedup workloads

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-10-18 15:45:28 -07:00
Samuel Just
224891fe47 qa/suites/crimson-rados: remove cache and dedup related tests
It's an accident that some of these pass -- the tests provide some
coverage for inconsistencies that can arise, but don't really validate
that the objects actually get moved between tiers.

It's going to be some time before we implement cache or dedup in
crimson, and we'll probably want to disable the related commands for
pools that can map to crimson osds to prevent accidents.

Signed-off-by: Samuel Just <sjust@redhat.com>
2022-10-18 07:59:50 -07:00
Samuel Just
f9c58c0416 qa/suites: move seastore to crimson-rados-experimental suite
Let's use crimson-rados-experimental for tests that don't yet
pass reliably.  We can move these to crimson-rados as they
become reliable.

Signed-off-by: Samuel Just <sjust@redhat.com>
2022-10-18 07:59:47 -07:00
Venky Shankar
bfa5da4b2f qa: fs:upgrade featureful_client test upgrades to quincy
Reef cycle will not allow upgrades from octopus. However, the featureful
client tests still needs to be testes, therefore, upgrade to quincy (from
octopus) rather to the current cycle (reef).

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-10-14 11:24:34 +05:30
Samuel Just
2013ea32d0
Merge pull request #48406 from athanatos/sjust/wip-57798
qa/suites/crimson-rados: add CRIMSON_COMPAT to workunit env

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2022-10-11 11:36:03 -07:00
Marcus Watts
5deb213ae5
Merge pull request #45395 from tobias-urdin/rgw-keystone-service-token
rgw/auth: Add service token support for Keystone auth
2022-10-11 05:49:30 -04:00
Samuel Just
436fc5d7e6 qa/suites/crimson-rados: add CRIMSON_COMPAT to workunit env
Fixes: https://tracker.ceph.com/issues/57798
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-10-10 16:45:33 -07:00
Zack Cerza
26dd31f7c9 qa/suites/orch/cephadm: Add smoke-small suite
This was created to be used with ceph-devstack, but may be useful in
other contexts

Signed-off-by: Zack Cerza <zack@redhat.com>
2022-10-10 16:04:46 -06:00
Rishabh Dave
ee321e8570
Merge pull request #47754 from batrick/i57248
qa: cleanup volumes on unwind

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2022-10-11 00:12:24 +05:30
Adam King
2dda2599c4 qa/cephadm: fix iscsi deployment in upgrade tests
Signed-off-by: Adam King <adking@redhat.com>
2022-10-10 14:06:51 -04:00
Adam King
10e89a53e9 qa/cephadm: update staggered upgrade test to use --image when redeploying mgr
since we now start from pacific rather than octopus, this flag is supported

Signed-off-by: Adam King <adking@redhat.com>
2022-10-10 14:06:51 -04:00
Laura Flores
f9e77f0286 qa/suites/upgrade: add telemetry coverage to existing upgrade tests
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-10-08 04:48:49 +00:00
Laura Flores
359435efb8 qa/suites/upgrade/telemetry-upgrade: add new telemetry upgrade tests
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-10-08 04:48:40 +00:00
Samuel Just
9056dbcdea
Merge pull request #48275 from liu-chunmei/rados-api-test
crimson/qa: add rados_api_tests.yaml for seastore

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-10-06 16:39:53 -07:00
Samuel Just
f567e63fd9
Merge pull request #48162 from Matan-B/wip-matanb-c-rados-test
qa/suites/crimson-rados/thrash: Adding workloads / Simplifying thrashers

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-10-06 16:35:10 -07:00
Adam King
100a7bbdff
Merge pull request #48285 from adk3798/upgrade-start-version
qa/cephadm: do not start upgrades from Octopus

Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-10-06 07:48:43 -04:00
Adam King
80025d06d1 qa/cephadm: do not start upgrades from Octopus
now that we officially have v18 in main the upgrade
will fail if upgrading from Octopus (v15) to main
because they are now considered 3 major releases apart

Additionally adding more debugging to the end
of the upgrade tests as something like `ceph health detail`
can be very useful to see at the end of failed
upgrade tests

Fixes: https://tracker.ceph.com/issues/57695

Signed-off-by: Adam King <adking@redhat.com>
2022-10-05 07:13:15 -04:00
Radoslaw Zarzynski
bf46d3736d
Merge pull request #47458 from rzarzynski/wip-all-kickoff-r
kickoff v18 reef

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-10-04 22:39:19 +02:00
Venky Shankar
8981012ad9
Merge pull request #46821 from batrick/i55470
qa: postgresql test suite workunit

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-10-03 10:08:05 +05:30
chunmei-liu
6b47f01dea crimson/qa: add rados_api_tests.yaml for seastore
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-09-29 13:03:25 -07:00
Venky Shankar
187d73bf4c
Merge pull request #48174 from batrick/i57597
qa: output debugging for cephfs-journal-tool/cephfs-data-scan

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-09-29 18:14:23 +05:30
Venky Shankar
09fa1b2604
Merge pull request #48257 from batrick/i57657
qa: ignore expected scrub error

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-09-29 17:25:10 +05:30
Venky Shankar
e1d457b3ce
Merge pull request #48264 from batrick/i57677
qa: ignore MDS_TRIM warnings when osd thrashing

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-09-29 17:22:33 +05:30
Patrick Donnelly
efe41d2a9d
qa: ignore MDS_TRIM warnings when osd thrashing
Fixes: https://tracker.ceph.com/issues/57677
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-26 22:20:57 -04:00
Patrick Donnelly
fe60ad4436
qa: add testing for postgresql databases on CephFS
Fixes: https://tracker.ceph.com/issues/55470
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-26 22:19:44 -04:00
Patrick Donnelly
d02e41dd0a
qa: fs:workload add journal flush task
Idea here is to force the MDS to flush metadata mutations out of the
journal. This may help expose any type of corruption seen with postgres.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-26 22:19:44 -04:00
Patrick Donnelly
b5ba931f30
qa: add snap-schedule task
To exercise snapshot creation and deletion during workloads.

Fixes: https://tracker.ceph.com/issues/23724
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-26 22:19:43 -04:00
Patrick Donnelly
e9477ae421
qa: reorganize scrub/workunit tasks
So we can enforce an ordering of tasks and ensure that the fs/subvolume
is available before the task runs.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-26 22:19:43 -04:00
Patrick Donnelly
298ef39420
qa: add missing or correct .qa links
find qa/suites/ -type d -execdir ln -sfT ../.qa/ {}/.qa \;

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-26 22:19:21 -04:00
Patrick Donnelly
e930a8b221
qa: ignore expected scrub error
The test_orphan_scan test deliberately removes a dentry which will cause
rstat damage. Ignore it.

Fixes: https://tracker.ceph.com/issues/57657
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-26 13:27:57 -04:00