Commit Graph

8869 Commits

Author SHA1 Message Date
Ronen Friedman
20dd022715 qa/standalone: osd-scrub-repair.sh: fix expected "not scrubbed since" warnings count
Following PR#43244, the 'ceph tell pg deep_scrub' now sets both
deep-scrub and "regular" scrub time-stamps. This necessitated a modification
to TEST_scrub_warning, as more PGs in this test are late for their regular scrubbing.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-11-23 16:43:21 +00:00
Casey Bodley
1f8bdd2ddf
Merge pull request #43843 from cbodley/wip-test-cls-rgw-stats
test/cls/rgw: add index transaction simulator to model bucket stats

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-22 10:59:39 -05:00
Neha Ojha
0f9ed11e67
Merge pull request #43999 from kamoltat/wip-autoscale-profile-scale-up-default
pybind/mgr/pg_autoscale: revert to default profile scale-up

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-19 16:55:43 -08:00
Patrick Donnelly
860518bcb6
Merge PR #43974 into master
* refs/pull/43974/head:
	qa: disable metrics on kernel client during upgrade

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-11-19 18:43:48 -05:00
Ernesto Puerta
515af762bb
Merge pull request #43987 from rhcs-dashboard/53123-dashboard-nfs-cleanup
mgr/dashboard: NFS non-existent files cleanup

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-19 20:40:41 +01:00
J. Eric Ivancich
08adeae354
Merge pull request #43824 from cbodley/wip-qa-rgw-upgrade-octopus-multisite-cv
qa/upgrade: rgw multisite upgrade test excludes ceph-volume

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-19 14:11:39 -05:00
Kamoltat
a9f9f7b3fd pybind/mgr/pg_autoscale: revert to default profile scale-up
pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-11-19 18:55:36 +00:00
Patrick Donnelly
dcda5cb9ce
qa: disable metrics on kernel client during upgrade
v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-19 13:32:04 -05:00
Casey Bodley
2ed55af056 qa/rgw: run ceph_test_cls_rgw_stats in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
Casey Bodley
e3f0fc7f7f
Merge pull request #43409 from linuxbox2/wip-rgwadmin-logtest
qa/rgw: use local runner with cmdline radosgw_admin.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-18 10:06:56 -05:00
Sage Weil
b1fba14ef5 Merge PR #43929 into master
* refs/pull/43929/head:
	qa/suites/orch/cephadm: verify /var/log/ceph/$fsid ownership
	cephadm: only make_log_dir for ceph daemons

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-17 17:05:23 -05:00
Sage Weil
91157246d6 Merge PR #43934 into master
* refs/pull/43934/head:
	qa/suites/rados/dashboard: use single-container-host.yaml
	qa/distros: add single-container-host.yaml
	qa/suites: use distros/container-hosts/
	qa/distros/container-hosts: add 8.stream + crun
	qa/distros/container-hosts: add collection of container targets

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-17 17:04:57 -05:00
Casey Bodley
06b266b83c qa/upgrade: rgw multisite upgrade test excludes ceph-volume
E: Unable to locate package ceph-volume

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-17 14:37:49 -05:00
Matt Benjamin
0046803534 qa/rgw: use local runner with cmdline radosgw_admin.py
Restore ability to run radosgw_admin.py unit standalone--improved
to use vstart_runner hooks.

Local rgwadmin(...) wrapper suggested as a cleanup in review by Casey.

Fixes: https://tracker.ceph.com/issues/52837

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-11-17 11:22:32 -05:00
Sage Weil
411b2d39c2 qa/suites/rados/dashboard: use single-container-host.yaml
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-17 09:02:42 -06:00
Sage Weil
362207ba45 qa/distros: add single-container-host.yaml
This is a single, possibly preferred, os + container runtime
combination.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-17 09:02:42 -06:00
Sage Weil
88da4c38d4 qa/suites: use distros/container-hosts/
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-17 09:02:39 -06:00
Alfonso Martínez
045d2d0f76 mgr/dashboard: NFS non-existent files cleanup
After https://github.com/ceph/ceph/pull/42526 and https://github.com/ceph/ceph/pull/43725 merges,
the following files do not exist but there were still references to them:
- src/pybind/mgr/dashboard/services/ganesha.py
- qa/tasks/mgr/dashboard/test_ganesha.py

The following files were renamed but there were still references to old names:
- src/pybind/mgr/dashboard/controllers/nfsganesha.py:  nfsganesha.py --> nfs.py
- src/pybind/mgr/dashboard/tests/test_ganesha.py:  test_ganesha.py --> test_nfs.py

Other changes in qa/suites/rados/dashboard/tasks/dashboard.yaml:
- Add missing task: tasks.mgr.dashboard.test_api
- Sort dashboard tasks alphabetically.

Fixes: https://tracker.ceph.com/issues/53123
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-11-17 13:25:17 +01:00
Sage Weil
f28f32dbc0 qa/distros/container-hosts: add 8.stream + crun
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-16 09:58:32 -06:00
Sage Weil
ec6a502cdb qa/distros/container-hosts: add collection of container targets
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-16 09:58:23 -06:00
Ronen Friedman
2766946460
Merge pull request #43912 from ronen-fr/wip-rf-test-dump
qa/standalone: fix osd-scrub-dump following changes to 'pg dump pgs' output

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-11-16 17:58:07 +02:00
Neha Ojha
d31130d451
Merge pull request #43938 from neha-ojha/wip-quick-fix
qa/suites/upgrade/octopus-x: set bluestore fsck quick fix on mount to true

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2021-11-15 16:09:30 -08:00
Neha Ojha
94e3a240ad qa/suites/upgrade/octopus-x: set bluestore fsck quick fix on mount to true
First step towards catching bugs like https://tracker.ceph.com/issues/53062.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-11-15 21:39:15 +00:00
Sage Weil
22871aa2e0 Merge PR #43894 into master
* refs/pull/43894/head:
	qa/suites/orch/cephadm: verify that 'orch ls' reports OSDs properly
	mgr/cephadm: show unmanaged OSDs under 'osd' service

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-15 11:13:11 -05:00
Sage Weil
4f71cbba1a qa/suites/orch/cephadm: verify /var/log/ceph/$fsid ownership
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-15 10:48:42 -05:00
Deepika Upadhyay
44cd7c7650
Merge pull request #42046 from CongMinYin/align-entry-bit
librbd/cache/pwl/ssd: make log entry 64 bit and add ssd version control

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-11-13 17:27:27 +05:30
Ronen Friedman
9dda986bd5 qa/standalone: fix scrub/osd-scrub-dump following changes to 'pg dump pgs' output
Make osd-scrub-dump test ignore the 'scrubbing' that might be late to disappear
from the modified (PR #43403) 'pg dump' output.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-11-12 18:43:41 +00:00
Yin Congmin
3da4a9401c qa/suites/rbd/persistent-writeback-cache: add test case
Add the test case which size is 8GB, So that some problems that occur
only in test scenarios above 4GB may be found in this test. For example,
the variables of 32-bit may be unexpected value when it operates with
a 64 bit value.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2021-11-12 17:31:00 +08:00
Sage Weil
e1cd91098f qa/suites/orch/cephadm: verify that 'orch ls' reports OSDs properly
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-11 13:53:33 -05:00
Sebastian Wagner
0eb651ca7f
Merge pull request #43874 from liewegas/qa-podman-add-stream
qa/suites/orch/cephadm: add 8.stream + container_tools

Reviewed-by: Adam King <adking@redhat.com>
2021-11-11 16:43:34 +01:00
Sage Weil
25c65fddd1 Merge PR #43046 into master
* refs/pull/43046/head:
	mgr/rook: get running pods, auth rm, better error checking for orch nfs
	qa/tasks/rook: add apply nfs to rook qa task
	mgr/rook: prevent creation of NFS clusters not in .nfs rados pool
	mgr/rook, mgr/nfs: update rook orchestrator to create and use .nfs pool

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-11-11 10:31:22 -05:00
Laura Flores
92fcfbb464
Merge pull request #43411 from ljflores/wip-mgr-command-cleanup
mon: simplify 'mgr module ls' output
2021-11-10 14:09:51 -06:00
Patrick Donnelly
b4980dd1ed
Merge PR #43767 into master
* refs/pull/43767/head:
	qa: increase the timeout value to wait a litte longer

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-11-10 14:00:19 -05:00
Patrick Donnelly
de9fe60f84
Merge PR #42520 into master
* refs/pull/42520/head:
	test: add cephfs-mirror HA active/active workunit and test yamls
	test: add cephfs_mirror thrasher
	tasks/cephfs_mirror: optionally run in foreground
	mgr/mirroring: throttle directory reassigment to mirror daemons

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-10 13:58:48 -05:00
Joseph Sawaya
2c803ec117 qa/tasks/rook: add apply nfs to rook qa task
This commit adds apply nfs to the rook qa task to see if the
command runs with no errors, this doesn't actually check if
an NFS daemon was created.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-11-10 12:08:02 -05:00
Sage Weil
eb43f2be9c qa/suites/orch/cephadm: add 8.stream + container_tools
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-10 10:42:33 -06:00
Casey Bodley
411f0eb20d
Merge pull request #43847 from cbodley/wip-53095
qa/rgw: bump tempest version to resolve dependency issue

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-11-10 09:23:31 -05:00
Yuri Weinstein
f6484d7290
Merge pull request #43403 from ronen-fr/wip-rf-scrub-deep-v2
osd/scrub: expose PGs scrubbing schedule to the operator 

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2021-11-09 12:24:03 -08:00
Venky Shankar
e7bdf7fb35 test: add cephfs-mirror HA active/active workunit and test yamls
Fixes: http://tracker.ceph.com/issues/50372
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 02:03:32 -05:00
Venky Shankar
3a4dd30a1e test: add cephfs_mirror thrasher
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 00:08:05 -05:00
Venky Shankar
087d7aa8ca tasks/cephfs_mirror: optionally run in foreground
cephfs mirror damon thrasher needs to send SIGTERM to mirror
daemons. The mirror daemon needs to run in foreground for
it to receive signal via `daemon.signal`.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 00:08:05 -05:00
Sage Weil
df9988d94a Merge PR #43827 into master
* refs/pull/43827/head:
	qa/suites/orch/cephadm: add repave-all test case
	mgr/cephadm/services/osd: less noisy
	mgr/cephadm/services/osd: do not log ok-to-stop/safe-to-destroy failures
	mgr/orchestrator: clean up 'orch osd rm status'

Reviewed-by: Adam King <adking@redhat.com>
2021-11-08 14:43:25 -05:00
Yuri Weinstein
4d137d6ca7
Merge pull request #43699 from sebastian-philipp/qa-rados-mgr-random-objectstore
qa/suites/rados/mgr: use only one objectstore instead of all

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-08 09:51:27 -08:00
Casey Bodley
0bb60469d1 qa/rgw: bump tempest version to resolve dependency issue
Fixes: https://tracker.ceph.com/issues/53095

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-08 10:06:26 -05:00
Sage Weil
4abe4c6a78 qa/suites/orch/cephadm: add repave-all test case
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-05 19:25:16 -04:00
Neha Ojha
63cead9248
Merge pull request #43814 from neha-ojha/wip-more-cv
qa/suites/upgrade/octopus-x/stress-split-no-cephadm: exclude ceph-volume

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2021-11-05 11:37:57 -07:00
Ali Maredia
c3b5ca0fe0
Merge pull request #43808 from cbodley/wip-qa-rgw-java-master
qa/rgw: master branch targets ceph-master branch of java_s3tests
2021-11-05 12:34:53 -04:00
Ronen Friedman
10909c3cba osd/scrub: update the stand-alone tests to check 'scrub scheduling' entries
Analyzing and verifying the relevant entries in 'pg query' and
'pg dump' output.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-11-05 17:07:57 +02:00
Neha Ojha
1be081da02 qa/suites/upgrade/octopus-x/stress-split-no-cephadm: exclude ceph-volume
To address failures like

```
Command failed on smithi096 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-11-g5f8f263c-1focal ceph-mds=15.2.15-11-g5f8f263c-1focal ceph-mgr=15.2.15-11-g5f8f263c-1focal ceph-common=15.2.15-11-g5f8f263c-1focal ceph-fuse=15.2.15-11-g5f8f263c-1focal ceph-test=15.2.15-11-g5f8f263c-1focal ceph-volume=15.2.15-11-g5f8f263c-1focal radosgw=15.2.15-11-g5f8f263c-1focal python3-rados=15.2.15-11-g5f8f263c-1focal python3-rgw=15.2.15-11-g5f8f263c-1focal python3-cephfs=15.2.15-11-g5f8f263c-1focal python3-rbd=15.2.15-11-g5f8f263c-1focal libcephfs2=15.2.15-11-g5f8f263c-1focal librados2=15.2.15-11-g5f8f263c-1focal librbd1=15.2.15-11-g5f8f263c-1focal rbd-fuse=15.2.15-11-g5f8f263c-1focal'
```

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-11-04 21:45:21 +00:00
Patrick Donnelly
93cdc800e2
Merge PR #43666 into master
* refs/pull/43666/head:
	qa/vstart_runner: add "managers" to LocalContext instances

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-04 16:54:14 -04:00