Commit Graph

8882 Commits

Author SHA1 Message Date
Samuel Just
81d7403a7a
Merge pull request #43481 from myoungwon/wip-dedup-tool-repair
tool: add repair command to ceph-dedup-tool

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-11-28 16:10:46 -08:00
Sage Weil
22c402b84e Merge PR #43936 into master
* refs/pull/43936/head:
	qa/tasks/cephadm: pull image to all hosts in parallel
	qa/tasks/cephadm: add hosts via mon remote
	qa/tasks/cephadm: use shortname for remote directory
	qa/tasks/cephadm: deploy no more than 5 mons in roleless mode
	qa/tasks/radosbench: default clients to all clients (not client.0)
	qa/tasks/ceph_manager: parallelize flush_pg_stats()
	qa/suites/big: remove thrasher
	qa/suites/big: update for cephadm

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-26 10:38:58 -05:00
Sage Weil
9d50154a93 qa/tasks/cephadm: pull image to all hosts in parallel
This doesn't affect bootstrap, but it does mean we avoid any delay
the first time we cephadm.shell on some non-boostrap host.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:56 -06:00
Sage Weil
3a110f6c00 qa/tasks/cephadm: add hosts via mon remote
If we use a new remote for each shell command, we end up waiting
for the image to pull on every host in sequence.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:56 -06:00
Sage Weil
0e40064d31 qa/tasks/cephadm: use shortname for remote directory
This aligns with what the ceph and syslog tasks do.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:56 -06:00
Sage Weil
689d7ceabd qa/tasks/cephadm: deploy no more than 5 mons in roleless mode
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:55 -06:00
Sage Weil
e7bf9242c4 qa/tasks/radosbench: default clients to all clients (not client.0)
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:55 -06:00
Sage Weil
99cdaaba70 qa/tasks/ceph_manager: parallelize flush_pg_stats()
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:55 -06:00
Sage Weil
9559fea8b2 qa/suites/big: remove thrasher
This doesn't work with roleless (yet)

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:55 -06:00
Sage Weil
0514b0a323 qa/suites/big: update for cephadm
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-25 07:52:55 -06:00
Neha Ojha
892c3de851
Merge pull request #43875 from liewegas/ceph-cli-better-help
ceph: make -h/--help show match when some args are supplied

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-24 09:17:11 -08:00
Casey Bodley
1f8bdd2ddf
Merge pull request #43843 from cbodley/wip-test-cls-rgw-stats
test/cls/rgw: add index transaction simulator to model bucket stats

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-22 10:59:39 -05:00
Neha Ojha
0f9ed11e67
Merge pull request #43999 from kamoltat/wip-autoscale-profile-scale-up-default
pybind/mgr/pg_autoscale: revert to default profile scale-up

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-19 16:55:43 -08:00
Patrick Donnelly
860518bcb6
Merge PR #43974 into master
* refs/pull/43974/head:
	qa: disable metrics on kernel client during upgrade

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-11-19 18:43:48 -05:00
Ernesto Puerta
515af762bb
Merge pull request #43987 from rhcs-dashboard/53123-dashboard-nfs-cleanup
mgr/dashboard: NFS non-existent files cleanup

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: ljflores <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-19 20:40:41 +01:00
J. Eric Ivancich
08adeae354
Merge pull request #43824 from cbodley/wip-qa-rgw-upgrade-octopus-multisite-cv
qa/upgrade: rgw multisite upgrade test excludes ceph-volume

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-19 14:11:39 -05:00
Kamoltat
a9f9f7b3fd pybind/mgr/pg_autoscale: revert to default profile scale-up
pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-11-19 18:55:36 +00:00
Patrick Donnelly
dcda5cb9ce
qa: disable metrics on kernel client during upgrade
v16.2.4 MDS triggers an assert from these messages.

Also: add latest pacific for extra coverage.

Fixes: https://tracker.ceph.com/issues/53293
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-19 13:32:04 -05:00
Casey Bodley
2ed55af056 qa/rgw: run ceph_test_cls_rgw_stats in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
Casey Bodley
e3f0fc7f7f
Merge pull request #43409 from linuxbox2/wip-rgwadmin-logtest
qa/rgw: use local runner with cmdline radosgw_admin.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-18 10:06:56 -05:00
Sage Weil
b1fba14ef5 Merge PR #43929 into master
* refs/pull/43929/head:
	qa/suites/orch/cephadm: verify /var/log/ceph/$fsid ownership
	cephadm: only make_log_dir for ceph daemons

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-17 17:05:23 -05:00
Sage Weil
91157246d6 Merge PR #43934 into master
* refs/pull/43934/head:
	qa/suites/rados/dashboard: use single-container-host.yaml
	qa/distros: add single-container-host.yaml
	qa/suites: use distros/container-hosts/
	qa/distros/container-hosts: add 8.stream + crun
	qa/distros/container-hosts: add collection of container targets

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-17 17:04:57 -05:00
Casey Bodley
06b266b83c qa/upgrade: rgw multisite upgrade test excludes ceph-volume
E: Unable to locate package ceph-volume

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-17 14:37:49 -05:00
Matt Benjamin
0046803534 qa/rgw: use local runner with cmdline radosgw_admin.py
Restore ability to run radosgw_admin.py unit standalone--improved
to use vstart_runner hooks.

Local rgwadmin(...) wrapper suggested as a cleanup in review by Casey.

Fixes: https://tracker.ceph.com/issues/52837

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-11-17 11:22:32 -05:00
Sage Weil
411b2d39c2 qa/suites/rados/dashboard: use single-container-host.yaml
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-17 09:02:42 -06:00
Sage Weil
362207ba45 qa/distros: add single-container-host.yaml
This is a single, possibly preferred, os + container runtime
combination.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-17 09:02:42 -06:00
Sage Weil
88da4c38d4 qa/suites: use distros/container-hosts/
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-17 09:02:39 -06:00
Alfonso Martínez
045d2d0f76 mgr/dashboard: NFS non-existent files cleanup
After https://github.com/ceph/ceph/pull/42526 and https://github.com/ceph/ceph/pull/43725 merges,
the following files do not exist but there were still references to them:
- src/pybind/mgr/dashboard/services/ganesha.py
- qa/tasks/mgr/dashboard/test_ganesha.py

The following files were renamed but there were still references to old names:
- src/pybind/mgr/dashboard/controllers/nfsganesha.py:  nfsganesha.py --> nfs.py
- src/pybind/mgr/dashboard/tests/test_ganesha.py:  test_ganesha.py --> test_nfs.py

Other changes in qa/suites/rados/dashboard/tasks/dashboard.yaml:
- Add missing task: tasks.mgr.dashboard.test_api
- Sort dashboard tasks alphabetically.

Fixes: https://tracker.ceph.com/issues/53123
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-11-17 13:25:17 +01:00
Sage Weil
f28f32dbc0 qa/distros/container-hosts: add 8.stream + crun
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-16 09:58:32 -06:00
Sage Weil
ec6a502cdb qa/distros/container-hosts: add collection of container targets
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-16 09:58:23 -06:00
Ronen Friedman
2766946460
Merge pull request #43912 from ronen-fr/wip-rf-test-dump
qa/standalone: fix osd-scrub-dump following changes to 'pg dump pgs' output

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-11-16 17:58:07 +02:00
Neha Ojha
d31130d451
Merge pull request #43938 from neha-ojha/wip-quick-fix
qa/suites/upgrade/octopus-x: set bluestore fsck quick fix on mount to true

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2021-11-15 16:09:30 -08:00
Neha Ojha
94e3a240ad qa/suites/upgrade/octopus-x: set bluestore fsck quick fix on mount to true
First step towards catching bugs like https://tracker.ceph.com/issues/53062.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-11-15 21:39:15 +00:00
Sage Weil
22871aa2e0 Merge PR #43894 into master
* refs/pull/43894/head:
	qa/suites/orch/cephadm: verify that 'orch ls' reports OSDs properly
	mgr/cephadm: show unmanaged OSDs under 'osd' service

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-15 11:13:11 -05:00
Sage Weil
4f71cbba1a qa/suites/orch/cephadm: verify /var/log/ceph/$fsid ownership
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-15 10:48:42 -05:00
Deepika Upadhyay
44cd7c7650
Merge pull request #42046 from CongMinYin/align-entry-bit
librbd/cache/pwl/ssd: make log entry 64 bit and add ssd version control

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-11-13 17:27:27 +05:30
Ronen Friedman
9dda986bd5 qa/standalone: fix scrub/osd-scrub-dump following changes to 'pg dump pgs' output
Make osd-scrub-dump test ignore the 'scrubbing' that might be late to disappear
from the modified (PR #43403) 'pg dump' output.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-11-12 18:43:41 +00:00
Yin Congmin
3da4a9401c qa/suites/rbd/persistent-writeback-cache: add test case
Add the test case which size is 8GB, So that some problems that occur
only in test scenarios above 4GB may be found in this test. For example,
the variables of 32-bit may be unexpected value when it operates with
a 64 bit value.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2021-11-12 17:31:00 +08:00
myoungwon oh
dd1d563ff2 qa/test_dedup_tool: fix test cases for ceph-dedup-tool
1. add a delay after pool creation
2. fix checking output due to changed output format
3. fix wrong variable to test chunk-repair

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-11-12 13:22:48 +09:00
Sage Weil
e1cd91098f qa/suites/orch/cephadm: verify that 'orch ls' reports OSDs properly
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-11 13:53:33 -05:00
Sebastian Wagner
0eb651ca7f
Merge pull request #43874 from liewegas/qa-podman-add-stream
qa/suites/orch/cephadm: add 8.stream + container_tools

Reviewed-by: Adam King <adking@redhat.com>
2021-11-11 16:43:34 +01:00
Sage Weil
25c65fddd1 Merge PR #43046 into master
* refs/pull/43046/head:
	mgr/rook: get running pods, auth rm, better error checking for orch nfs
	qa/tasks/rook: add apply nfs to rook qa task
	mgr/rook: prevent creation of NFS clusters not in .nfs rados pool
	mgr/rook, mgr/nfs: update rook orchestrator to create and use .nfs pool

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-11-11 10:31:22 -05:00
Sage Weil
f988b2a833 ceph: make -h/--help show match when some args are supplied
Currently,

 # ceph orch ls -h
 ...
 orch ls [<service_type>] [<service_name>] [--export] [--  List services known to orchestrator
  format {plain|json|json-pretty|yaml}] [--refresh]
 # ceph orch ls osd -h
 ... nothing ...

because the CLI is provided more arguments than the command prefix.  Make
-h drop right-hand args until we get at least one prefix match.  This
means we can have a partial command written with some args and add -h to
get a usage for that command.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-10 16:30:47 -05:00
Laura Flores
92fcfbb464
Merge pull request #43411 from ljflores/wip-mgr-command-cleanup
mon: simplify 'mgr module ls' output
2021-11-10 14:09:51 -06:00
Patrick Donnelly
b4980dd1ed
Merge PR #43767 into master
* refs/pull/43767/head:
	qa: increase the timeout value to wait a litte longer

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-11-10 14:00:19 -05:00
Patrick Donnelly
de9fe60f84
Merge PR #42520 into master
* refs/pull/42520/head:
	test: add cephfs-mirror HA active/active workunit and test yamls
	test: add cephfs_mirror thrasher
	tasks/cephfs_mirror: optionally run in foreground
	mgr/mirroring: throttle directory reassigment to mirror daemons

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-10 13:58:48 -05:00
Joseph Sawaya
2c803ec117 qa/tasks/rook: add apply nfs to rook qa task
This commit adds apply nfs to the rook qa task to see if the
command runs with no errors, this doesn't actually check if
an NFS daemon was created.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-11-10 12:08:02 -05:00
Sage Weil
eb43f2be9c qa/suites/orch/cephadm: add 8.stream + container_tools
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-10 10:42:33 -06:00
Casey Bodley
411f0eb20d
Merge pull request #43847 from cbodley/wip-53095
qa/rgw: bump tempest version to resolve dependency issue

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-11-10 09:23:31 -05:00
Yuri Weinstein
f6484d7290
Merge pull request #43403 from ronen-fr/wip-rf-scrub-deep-v2
osd/scrub: expose PGs scrubbing schedule to the operator 

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2021-11-09 12:24:03 -08:00