Commit Graph

2103 Commits

Author SHA1 Message Date
Patrick Donnelly
a5675535ba
qa: only set frag confs for workloads
Otherwise these local conf overrides prevent functional testing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-10-07 15:08:34 -04:00
Kefu Chai
958b22e3ab
Merge pull request #43335 from liewegas/debug-51815
mon,auth: fix proposal (and mon db rebuild) of rotating secrets

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-10-07 06:45:45 +08:00
Neha Ojha
363b223844
Merge pull request #42964 from trociny/wip-52448
osd: re-cache peer_bytes on every peering state activate

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-10-06 09:26:16 -07:00
Sage Weil
eddfbbc421 qa/suites/rados/singleton/rebuild-mon-db: debug auth 30
Hunting https://tracker.ceph.com/issues/51815

Signed-off-by: Sage Weil <sage@newdream.net>
2021-10-01 14:42:23 -04:00
Joseph Sawaya
f4980c39db mgr/rook: use default replication size in orch apply rgw
This commit changes `orch apply rgw` to use the osd_pool_default_size
when setting the replication size for the data pool and metadata pool
of the rgw daemon. This commit also adds `orch apply rgw` to the Rook
QA.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-09-27 14:51:13 -04:00
Ilya Dryomov
75824a113b
Merge pull request #43228 from idryomov/wip-rbd-mirror-snapshot-rx-only
rbd-mirror: unbreak one-way snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-09-25 10:58:17 +02:00
Ilya Dryomov
366e9c51a8 qa/suites/rbd: test case for one-way snapshot-based mirroring
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-09-24 12:30:14 +02:00
Sage Weil
6bf32314f7 Merge PR #43156 into master
* refs/pull/43156/head:
	qa/suites/orch/rook/smoke: add flannel back in

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-21 11:37:50 -04:00
Patrick Donnelly
c8a900c6c6 Merge PR #42763 into master
* refs/pull/42763/head:
	mon/FSCommands: add 'recover' flag in `fs new` command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-20 20:46:25 -04:00
Sage Weil
34c483965f Merge PR #43211 into master
* refs/pull/43211/head:
	qa/suites/upgrade/pacific-x: skip c-v install on pacific start
	qa/packages: install ceph-volume

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-20 10:59:56 -04:00
Sage Weil
4e525127fb qa/suites/upgrade/pacific-x: skip c-v install on pacific start
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-20 08:47:45 -04:00
Sage Weil
0b361fc8b9 qa/packages: install ceph-volume
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-19 21:51:19 -04:00
Patrick Donnelly
0d9753fa3c Merge PR #43122 into master
* refs/pull/43122/head:
	qa: add test for standby-replay marking rank damaged
	MDSMonitor: handle damaged from standby-replay
	mds: add config to mark rank damaged in standby-replay
	include: unset std::hex after printing CompatSet
	mds: refactor iterator lookup
	mds: harden rank lookup

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-09-16 21:47:40 -04:00
Mykola Golub
76743e0058 qa/suites/rados: add backfill_toofull test
Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-09-15 17:21:11 +03:00
Sage Weil
688f963da7 qa/suites/orch/rook/smoke: add flannel back in
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-13 17:28:52 -05:00
Sage Weil
13238ade13 Merge PR #43136 into master
* refs/pull/43136/head:
	qa/tasks/kubeadm: change calico encap to IPIPCrossSubnet
	qa/suites/orch/rook/smoke: add host networking to matrix
	qa/tasks/rook: fix shadowing of config arg in rook_cluster()

Reviewed-by: Joseph Sawaya <jsawaya@redhat.com>
2021-09-13 18:28:43 -04:00
Ramana Raja
67bb13859a mon/FSCommands: add 'recover' flag in fs new command
Currently, to recover a file system after recovering monitor store, you
need to stop all the MDSs; create FSMap with defaults using `fs new`
command; execute `fs reset` command to get the file system's rank 0 into
existing but failed state; and then restart MDSs.

Add 'recover' flag to the `fs new` command that sets the file system's
rank 0 to existing but failed state, and sets the file system's
'joinable' setting to False. Using the `fs new` command with 'recover'
flag gets rid of the steps to stop all the MDSs and execute `fs reset`
command when recovering the file system after recoving monitor store.

Fixes: https://tracker.ceph.com/issues/51716
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-09-13 00:15:39 -04:00
Joseph Sawaya
7dfbf7c9f5 qa/tasks/rook: add testing for host label add/rm
This commit adds simple tests that check if the orchestrator
can add and remove labels from nodes.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-09-10 09:44:20 -05:00
Patrick Donnelly
f4a11a3290
qa: add test for standby-replay marking rank damaged
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-09 20:16:03 -04:00
Neha Ojha
e273418bbb
Merge pull request #42604 from sseshasa/wip-skip-osd-benchmark
osd: Add config option to skip running the osd benchmark during init and update documentation.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-09-08 11:03:09 -07:00
Sage Weil
9f050f094a qa/suites/orch/rook/smoke: add host networking to matrix
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-03 11:03:38 -05:00
Sebastian Wagner
b88bd99066
Merge pull request #43040 from sebastian-philipp/qa-deadsymlinks
qa/tox.ini: check for dead symlinks

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@newdream.net>
2021-09-03 17:17:03 +02:00
Sebastian Wagner
5313da14b9
Merge pull request #43021 from sebastian-philipp/rhel_8.3_container_tools_rhel8.yaml
qa/distros/podman: Add rhel_8.3_container_tools_rhel8.yaml

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-03 11:44:19 +02:00
Sebastian Wagner
c6779fdf13
qa/tox.ini: check for dead symlinks
IMO the amount of symlinks we have to manually maintain
is tedious and error prone. Any ideas on improving thing?

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-03 11:38:04 +02:00
Sebastian Wagner
0293580b50
qa/distros/podman: Add rhel_8.rhel_8.4_container_tools_3.0.yaml
mainly for the cephfs suite

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-03 10:04:45 +02:00
Sridhar Seshasayee
7dcede75df qa: Use osd_op_queue=wpq for tests using filestore backend.
Force a subset of tests that explicitly employ the filestore backend to
use WPQ scheduler. This is because mclock scheduler will not be
optimized for filestore.

Fixes: https://tracker.ceph.com/issues/52025
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2021-09-02 18:15:54 +05:30
Kalpesh Pandya
74b5ec876c qa/tasks: Addition of two new parameters for sts-tests
Addition of SUB and AZP parameter for some new sts-tests

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-09-01 17:09:54 +05:30
Neha Ojha
de8a68b768
Merge pull request #41912 from trociny/wip-crushdiff
tools/crushdiff: new tool to test crushmap change

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-08-31 14:18:37 -07:00
Patrick Donnelly
297fcdce24 Merge PR #42687 into master
* refs/pull/42687/head:
	qa: test the "ms_mode" options in kclient workflows

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-08-27 21:29:17 -04:00
Mykola Golub
7311f6656f qa/suites/rados: add crushdiff test
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2021-08-27 17:45:40 +03:00
Patrick Donnelly
1b1f108449 Merge PR #42530 into master
* refs/pull/42530/head:
	qa: ignore expected metadata cluster log error

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2021-08-26 22:36:28 -04:00
Casey Bodley
214f2f3b84 qa/rgw: move mixed-version multisite tests out of upgrade suite
not really fixing anything, but moves the failures out of the normal
upgrade suite

Fixes: https://tracker.ceph.com/issues/49955

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-08-20 10:30:42 -04:00
Sebastian Wagner
e436483c77
qa/distro: Add centos_8.2_container_tools_3.0.yaml
Let's avoid latest kubic stable

Fixes: https://tracker.ceph.com/issues/52279
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-20 10:53:11 +02:00
Yuri Weinstein
4e6fbccea4
Merge pull request #42852 from sebastian-philipp/centos_8.3_container_tools_3.0.yaml
qa/cephadm: centos_8.3_container_tools_3.0.yaml

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-08-19 12:45:01 -07:00
Sebastian Wagner
c6bd968eff
qa/cephadm: centos_8.3_container_tools_3.0.yaml
Let's avoid latest stable

Fixes: https://tracker.ceph.com/issues/52279

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-19 16:55:58 +02:00
Joseph Sawaya
ee90f5e5c0 qa/tasks/rook: add device ls command to rook task
This commit adds the device ls command to the rook qa task
since that command should be working from now on.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-08-18 11:11:15 -04:00
Jeff Layton
cd41b1c150 qa: test the "ms_mode" options in kclient workflows
Note that I didn't bother adding the prefer-* options, as I figure it's
better to be definite.

Fixes: https://tracker.ceph.com/issues/52068
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2021-08-18 09:24:13 -04:00
Sage Weil
4b9a3b2171 Merge PR #42613 into master
* refs/pull/42613/head:
	qa/suites/roch/rook/smoke: test rook 1.7.0, not 1.6.2
	qa/tasks/rook: set storage_class to scratch

Reviewed-by: merge 42318
2021-08-10 16:47:22 -04:00
Sage Weil
3331a0a7ea Merge PR #42691 into master
* refs/pull/42691/head:
	mgr/nfs: add --port to 'nfs cluster create' and port to 'nfs cluster info'
	qa/suites/orch/cephadm/smoke-roleless: test taking ganeshas offline
	qa/tasks/vip: exec with bash -ex
	qa/suites/orch/cephadm: separate test_nfs from test_orch_cli

Reviewed-by: Varsha Rao <varao@redhat.com>
2021-08-10 16:37:38 -04:00
Neha Ojha
97b23d85f1 qa/suites/perf-basic/ceph.yaml: remove rgw
This is no longer required because we removed cosbench workloads in
fd350fd015.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-08-09 17:31:50 +00:00
Sage Weil
8ebe341198 mgr/nfs: add --port to 'nfs cluster create' and port to 'nfs cluster info'
Fixes: https://tracker.ceph.com/issues/51787
Signed-off-by: Sage Weil <sage@newdream.net>
2021-08-09 11:41:08 -04:00
Neha Ojha
119544bb29 qa/suites/rados/perf/ceph.yaml: remove rgw
This is no longer required because we removed cosbench workloads in
fd350fd015. This is also required to prevent
failures like the following or any other changes that break the rgw task:

```
2021-08-06T20:13:25.812 INFO:teuthology.orchestra.run.smithi060.stderr:curl: (7) Failed to connect to smithi060.front.sepia.ceph.com port 80: Connection refused
2021-08-06T20:15:33.813 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/teuthology/contextutil.py", line 31, in nested
    vars.append(enter())
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_3c0f8c8164075af7aac4d1f2805d3f4580709461/qa/tasks/rgw.py", line 191, in start_rgw
    wait_for_radosgw(url, remote)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_3c0f8c8164075af7aac4d1f2805d3f4580709461/qa/tasks/util/rgw.py", line 94, in wait_for_radosgw
    assert exit_status == 0
AssertionError
```

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-08-09 15:08:11 +00:00
Sage Weil
a5e8227a83 qa/suites/orch/cephadm/smoke-roleless: test taking ganeshas offline
Signed-off-by: Sage Weil <sage@newdream.net>
2021-08-09 11:03:55 -04:00
Sage Weil
972f6468b9 qa/suites/roch/rook/smoke: test rook 1.7.0, not 1.6.2
The RBAC changes so that we can see the PVs etc are needed by mgr/rook.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-08-06 17:50:20 -04:00
Sage Weil
0ae020979d qa/suites/orch/cephadm: separate test_nfs from test_orch_cli
Signed-off-by: Sage Weil <sage@newdream.net>
2021-08-05 14:28:17 -04:00
Patrick Donnelly
c99a5e56a6 Merge PR #42201 into master
* refs/pull/42201/head:
	qa: fold frag confs into conf/mds.yaml

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-07-30 14:00:19 -07:00
Patrick Donnelly
665b36de4e Merge PR #42349 into master
* refs/pull/42349/head:
	mon/MDSMonitor: propose if FSMap struct_v is too old
	mon/MDSMonitor: give a proper error message if FSMap struct_v is too old
	mds/FSMap: use DECODE_OLDEST to gate FSMap version
	qa: add tests for fs dump of epoch and trimming
	qa: add file system support for dumping epoch
	mon/MDSMonitor: return mon_mds_force_trim_to even if equal to current epoch
	mon: add debugging for trimming methods
	mon: fix debug spacing
	qa: add nofs upgrade suite

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-07-28 10:45:08 -07:00
Patrick Donnelly
4f0f51e4cb Merge PR #41025 into master
* refs/pull/41025/head:
	qa: wait pgs to be clean before using the pools
	qa: ignore PG_RECOVERY_FULL and PG_DEGRADED for mds-full
	qa: wait more time since there have many more pgs than before
	qa: do not multiple the full ratio twice
	qa: do not raise for kclient for _fsync test
	qa: use the pg autoscale mode to calcuate the pg_num
	qa: set the object_size to 1M
	qa: move the is_full() to parent class

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-28 10:34:12 -07:00
Patrick Donnelly
8116b95a34 qa: ignore expected metadata cluster log error
Fixes: https://tracker.ceph.com/issues/51905
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-28 09:17:19 -07:00
Patrick Donnelly
9941188116 qa: add nofs upgrade suite
This adds an upgrade suite to ensure that a Ceph cluster without a
CephFS file system does not blow up on upgrade (in particular, that the
MDSMonitor does not trip). This was developed to potentially reproduce
tracker 51673 but the actual cause for that issue was an old encoding
for the MDSMap which was obsoleted in Pacific. You must create a cluster
older than the FSMap (~Hammer or Infernalis) to reproduce. In any case,
this upgrade suite may be useful in the future so let's keep it!

Related-to: https://tracker.ceph.com/issues/51673
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-28 07:07:05 -07:00