Commit Graph

8179 Commits

Author SHA1 Message Date
Alfonso Martínez
7bdb1587fc
Merge pull request #40519 from rhcs-dashboard/50077-vstart-runner-max-required-mgrs
qa/tasks/vstart_runner.py: start max required mgrs

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: rishabh-d-dave <NOT@FOUND>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-01 08:30:50 +02:00
Patrick Donnelly
7ab0794c95
Merge PR #40509 into master
* refs/pull/40509/head:
	qa/tasks/cephfs: create enough subvolumes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-31 08:26:32 -07:00
Alfonso Martínez
45e1134e3b qa/tasks/vstart_runner.py: start max required mgrs
Pass environment copy with max required mgrs when shell kwarg is True.

Fixes: https://tracker.ceph.com/issues/50077
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-03-31 10:11:50 +02:00
Sage Weil
5f32756744 Merge PR #40471 into master
* refs/pull/40471/head:
	qa/suites/rados/cephadm: stop testing on broken focal kubic podman

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-30 18:25:14 -04:00
Ramana Raja
433b70a483 qa/tasks/cephfs: create enough subvolumes
... in a subvolume group so that the desired number of ephmerally pinned
subtrees are created for the subvolume group, which has the distributed
ephemeral pin policy set on it.

Fixes: https://tracker.ceph.com/issues/48411
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-03-30 16:36:21 -04:00
Sage Weil
de295bacf0 Merge PR #40409 into master
* refs/pull/40409/head:
	qa/workunits/cephadm/test_cephadm: specify image separately

Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-03-29 10:05:10 -04:00
Sage Weil
64668275b5 qa/suites/rados/cephadm: stop testing on broken focal kubic podman
See https://tracker.ceph.com/issues/49633

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-29 07:51:08 -05:00
Kefu Chai
73925c488a
Merge pull request #39969 from batrick/i49684
qa: wait for daemons to come up via cephadm

Reviewed-by: Sage Weil <sage@redhat.com>
2021-03-28 20:01:32 +08:00
Sridhar Seshasayee
b5570238b6 qa/tasks: Add wait_for_clean() check prior to initiating scrubbing.
Fixes: https://tracker.ceph.com/issues/49983
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2021-03-25 22:01:19 +05:30
Sage Weil
4d5c6044b0 qa/workunits/cephadm/test_cephadm: specify image separately
On master, this will be IMAGE_MASTER.  On pacific branch, we'll make it
IMAGE_PACIFIC so that we don't hit the release mismatch error.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-25 07:33:26 -05:00
Sage Weil
fe9454722a Merge PR #40314 into master
* refs/pull/40314/head:
	qa/tasks/cephadm: use 'orch apply mon' to deploy mons

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-03-23 22:58:14 -04:00
Ernesto Puerta
f1557e8f62
Merge pull request #36402 from rhcs-dashboard/wip-45965-users-quota-usage
mgr/dashboard: Display users current quota usage

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-03-23 20:07:45 +01:00
Patrick Donnelly
7d412b86d0
Merge PR #40174 into master
* refs/pull/40174/head:
	qa/vstart_runner: fix the admin_socket args parsing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-22 20:05:29 -07:00
Patrick Donnelly
49241859b5
Merge PR #40146 into master
* refs/pull/40146/head:
	test: pass peer uuid when adding cephfs mirror peers
	mon: check cephfs mirror peer based on remote cluster spec and file system name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-22 20:03:41 -07:00
Patrick Donnelly
5000b33180
Merge PR #40145 into master
* refs/pull/40145/head:
	doc: add note about disabling standby-replay during upgrades
	qa: add test for standby-replay disable
	mon: fail standby-replay daemons when flag is turned off

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2021-03-22 20:03:02 -07:00
Patrick Donnelly
42270a5338
Merge PR #38443 into master
* refs/pull/38443/head:
	qa: set "shell" to False for run_ceph_w()
	vstart_runner: make "shell" a default argument

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-03-22 20:00:46 -07:00
Sage Weil
a17593a177 qa/tasks/cephadm: use 'orch apply mon' to deploy mons
The 'orch daemon add ...' command is not idempotent and can cause
duplicate (and failing) attempts to add the same mon.

Maintain the ability to add mons the old way for the benefit of testing
upgrades from early octopus versions of cephadm.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-22 16:28:40 -05:00
Sage Weil
ccbf40317f Merge PR #40290 into master
* refs/pull/40290/head:
	qa/suites/rados/cephadm/upgrade: wait for rgw servicemap entries to refresh

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-22 13:26:06 -04:00
Patrick Donnelly
6ad5901422
Merge PR #39191 into master
* refs/pull/39191/head:
	pybind/mgr/snap_schedule: use ceph VFS
	pybind/mgr/snap_schedule: idempotentize table creation
	mgr: add ceph sqlite VFS
	doc: add libcephsqlite
	ceph.spec,debian: package libcephsqlite
	test/libcephsqlite,qa: add tests for libcephsqlite
	libcephsqlite: rework architecture and backend
	SimpleRADOSStriper: wait for finished aios after write
	SimpleRADOSStriper: add new minimal async striper
	mon: define simple-rados-client-with-blocklist profile
	librados: define must renew lock flag
	common: add timeval conversion for durations
	Revert "libradosstriper: add function to read into char*"
	test_libcephsqlite: test random inserts
	cephsqlite: fix compiler errors
	cmake: improve build inst for cephsqlite
	libcephsqlite: sqlite interface to RADOS
	libradosstriper: add function to read into char*

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-22 10:06:11 -07:00
Sage Weil
1ea01fc13a Merge PR #40301 into master
* refs/pull/40301/head:
	qa/distros/podman: install containernetworking-plugins along with podman

Reviewed-by: Sage Weil <sage@redhat.com>
2021-03-22 10:08:05 -04:00
Kefu Chai
abee0b31e3
Merge pull request #40143 from neha-ojha/wip-objectstore-debug
qa/suites/rados/objectstore/backends: use default level for filestore

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-22 15:21:20 +08:00
Kefu Chai
325c8fce46 qa/distros/podman: install containernetworking-plugins along with podman
/etc/cni/net.d/87-podman-bridge.conflist tries to load "bridge",
"firewall", "tuning" and "portmap" plugins, which are provided by
containernetworking-plugins package.

Fixes: https://tracker.ceph.com/issues/49909
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-22 15:05:00 +08:00
Patrick Donnelly
d06689e16e
qa: wait for daemons to come up via cephadm
Rather than waiting for a set amount of time.

Fixes: https://tracker.ceph.com/issues/49684
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:07 -07:00
Patrick Donnelly
5292e88201
qa: reduce dependence on teuthology role list for mds
It's not yet possible to completely remove the dependency on
mds_ids/mds_daemons in the CephFS tests but this commit reduces it
enough for most code paths to work with cephadm.

The main change here is use of CephManager.do_rados, with some
improvements.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:07 -07:00
Patrick Donnelly
24bb1aa31b
qa: improve usability of do_rados helper
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:07 -07:00
Patrick Donnelly
8e45af05c9
qa: remove get_lone_mds_id
This helps remove a dependence on the list of mds_daemons from
teuthology/cephadm.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:07 -07:00
Patrick Donnelly
0825d6aa9e
qa: simplify tests which stop MDS ranks
Instead of stopping MDS daemons and individually failing MDS daemons,
just fail the ranks or the entire file system, where possible.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
6ca48f6330
qa: use mds_tell for getting mds status
mds_asok is broken with cephadm currently due to [1].

[1] https://tracker.ceph.com/issues/48019#note-5

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
fe85001de2
qa: remove shutdown lockdep not relevant to unit test
This is part of a fleet of commits trying to remove unnecessary mds_stop
calls in testing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
4c3c69b230
qa: remove fallback for non-multifs ceph version
This code was for jewel (IIRC) or older.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
eccf961697
qa: add Filesystem.reset helper
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Sage Weil
3f3d955b19 qa/suites/rados/cephadm/upgrade: wait for rgw servicemap entries to refresh
rgw changed the way it registered in the service map.  Wait a bit for
the old entries to be flushed out.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-21 11:22:07 -05:00
Sage Weil
664b08b954 Merge PR #40244 into master
* refs/pull/40244/head:
	qa/suites/rados/cephadm/smoke-roleless: deploy additional daemon types

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-20 19:56:58 -04:00
Sage Weil
fdfd4f8b14 Merge PR #40224 into master
* refs/pull/40224/head:
	qa/suites/rados/cephadm/dashboard: test on centos

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-20 09:14:21 -04:00
Sage Weil
e48d80671a qa/suites/rados/cephadm/smoke-roleless: deploy additional daemon types
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-19 11:07:25 -05:00
Patrick Donnelly
54b3c8f7a7
test/libcephsqlite,qa: add tests for libcephsqlite
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-19 08:52:55 -07:00
Sage Weil
04e89d57e7 qa/suites/rados/cephadm/dashboard: test on centos
Fixes: https://tracker.ceph.com/issues/49638
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-19 08:56:19 -05:00
Kotresh HR
92dc982318 mgr/volumes: Retain suid/guid bits in subvolume clone
Fixes: https://tracker.ceph.com/issues/49882
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2021-03-19 09:30:04 +05:30
Neha Ojha
da7a6fae9e
Merge pull request #40227 from neha-ojha/wip-message-cap-val
qa/suites/rados/perf: set osd client message cap to 5000

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-18 17:28:01 -07:00
Neha Ojha
fb8b4e9727 qa/suites/rados/perf: set osd client message cap to 5000
Related to https://tracker.ceph.com/issues/49894
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-03-18 21:28:52 +00:00
Yuval Lifshitz
b903b2e011
Merge pull request #39139 from TRYTOBE8TME/wip-rgw-bucket-tests-separation-new
Wip rgw bucket tests separation new
2021-03-18 20:33:00 +02:00
Neha Ojha
2f1cb79620
Merge pull request #40161 from sseshasa/wip-fix-wait-for-clean
qa/tasks: Add additional wait_for_clean() check in lost_unfound tasks.

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-18 09:24:31 -07:00
Avan Thakkar
9456884c29 mgr/dashboard: Display users current quota usage
Fixes: https://tracker.ceph.com/issues/45965

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-03-18 18:48:37 +05:30
Sridhar Seshasayee
88df47230b qa/tasks: Add additional wait_for_clean() check in lost_unfound tasks.
At the end of the lost_unfound tests add an additional wait_for_clean()
check to ensure that recoveries get enough time to complete before
proceeding and avoid failures down the line. For e.g. failure like
"Scrubbing terminated -- not all pgs were active and clean." is because
recoveries on the PGs did not get sufficient time to complete even though
they were bound to eventually complete.

Fixes: https://tracker.ceph.com/issues/49844
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2021-03-18 13:03:41 +05:30
Casey Bodley
29f4bbb5ee qa/rgw: notifications suite runs single job
pin to the beast frontend, default bluestore, replicated pools, and run
against a random distro

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-03-18 11:06:40 +05:30
Sage Weil
f45f6ee4f6 Merge PR #40160 into master
* refs/pull/40160/head:
	qa/suites/rados/cephadm/orchestrator_cli: random-distro$ -> 0-random-distro$
	qa/suites/rados/cephadm/smoke-roleless: distro -> 0-distro
	qa/distros/podman: install kubic once per host, in parallel
	qa/suites/fs/multiclient: use clients: not all: for pexec

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-17 15:50:50 -04:00
Ilya Dryomov
8d5b3b0dc2
Merge pull request #40175 from idryomov/wip-krbd-blkroset-5.12
qa: krbd_blkroset.t: update for separate hw and user read-only flags

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-03-17 19:44:14 +01:00
Kefu Chai
181dc1a43f
Merge pull request #39757 from aclamk/wip-qa-test-bluestore-reshard
qa: Add bluestore resharding test

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-17 22:41:34 +08:00
Sage Weil
476422a6e3 qa/suites/rados/cephadm/orchestrator_cli: random-distro$ -> 0-random-distro$
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-17 10:40:32 -04:00
Xiubo Li
e0e5eb4c93 qa/vstart_runner: fix the admin_socket args parsing
Fixes: https://tracker.ceph.com/issues/49621
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-03-17 21:54:50 +08:00