Commit Graph

6903 Commits

Author SHA1 Message Date
Kefu Chai
65c159497f
Merge pull request #35125 from tchaikov/wip-cephadm-test
qa/tasks/cephadm: ignore tarfile.ReadError

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-20 14:37:43 +08:00
Neha Ojha
8bcfaf2941
Merge pull request #35110 from neha-ojha/wip-revert-34894
Revert "qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Yuri Weinstein <yuriw@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-19 14:06:20 -07:00
Sebastian Wagner
5200b6478a
Merge pull request #34980 from sebastian-philipp/cephadm-workunits-rm-ubuntu_2020
qa/cephadm: rm ubuntu_latest for now

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-19 13:59:09 +02:00
Kefu Chai
d67b0f1e3a qa/tasks/cephadm: ignore tarfile.ReadError
there is chance that /var/log/ceph (and other directories) is not
created when cephadm fails, but we always try to collect /var/log/ceph
by tar the directory on the test node and transfer it back for archiving
it. when we fail to do so, an exception is thrown, and this exception is
in turn logged as the cause of the failure instead of the one which
fails the test.

in this change, `tarfile.TarError`s is caught and ignored if it is
thrown by `misc.pull_directory()`, as normally, we don't consider it a fatal
failure when `misc.pull_directory()` fails because of `tar`. the
failures for the test are.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-05-19 19:10:56 +08:00
Patrick Donnelly
076d04654f
Merge PR #35062 into master
* refs/pull/35062/head:
	qa/tasks/cephfs/fuse_mount.py: retry when the admin socket is not ready

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-05-18 15:14:08 -07:00
Patrick Donnelly
356c64a3ff
Merge PR #34596 into master
* refs/pull/34596/head:
	test: add a new program for testing ino_release_cb
	client: add a new inode release request callback
	client: expose ceph_ll_register_callbacks via libcephfs
	client: move callback typedefs and arg struct into ceph_ll_client.h
	client: rename ceph_statx.h to ceph_ll_client.h
	client: make client_dentry_callback_t more friendly for C
	client: only override umask_cb with non-NULL values

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-05-18 15:07:43 -07:00
Patrick Donnelly
5ea3a9a1f7
Merge PR #34951 into master
* refs/pull/34951/head:
	qa/cephfs: run() cleanup whether FS was mounted or not

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-05-18 14:57:20 -07:00
Neha Ojha
1f885b6c2f Revert "qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04"
This reverts commit 835f2f5f51.

Reverting this to narrow down recent failures seen in rados and upgrade suites.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-05-18 21:55:25 +00:00
Patrick Donnelly
0825b9b97d
Merge PR #35058 into master
* refs/pull/35058/head:
	qa/tasks: logger.warn() -> logger.warning()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-18 14:34:28 -07:00
Sebastian Wagner
71c7f959f7
Merge pull request #34900 from gekios/wip-cephadm-bootstrapped
qa/tasks/cephadm.py: Support already bootstrapped clusters

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-18 20:46:47 +02:00
Patrick Donnelly
f9c9bc9b74
Merge PR #35081 into master
* refs/pull/35081/head:
	qa: do not save/restore ip_forward sysctl

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-05-15 19:22:16 -07:00
Jason Dillaman
7f1df0d18a
Merge pull request #34789 from trociny/wip-rbd-nbd-quiesce
rbd-nbd: add quiesce/unquiesce hooks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-15 11:12:50 -04:00
Patrick Donnelly
6f14713aed
qa: do not save/restore ip_forward sysctl
We don't really care if this is left on during the course of the mount.
These settings don't persist across tests anyway.

Fixes: https://tracker.ceph.com/issues/45525
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-14 20:15:38 -07:00
Xiubo Li
422d736568 qa/tasks/cephfs/fuse_mount.py: retry when the admin socket is not ready
Fixes: https://tracker.ceph.com/issues/45552
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-05-14 22:00:35 -04:00
Yuri Weinstein
5d67ab8459 qa/tests: reduced powercycle jobs amount
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-14 13:49:01 -07:00
Lenz Grimmer
28ac243556 Merge pull request #32829 from Devp00l/wip-43765
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-14 13:45:16 -07:00
Yuri Weinstein
6c9d990697 qa/tests: run nautilus-x on pacific on ubuntu 18.04
...as we don't build `nauiltus` on `20.04`

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-14 12:35:20 -07:00
Georgios Kyratsas
35e158605e qa/tasks/cephadm: Add support for raw disks
Currently tests on raw disks are failing due to stripping '/dev/' from
device name. (ie https://tracker.ceph.com/issues/45383#change-165721)

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>
2020-05-14 16:54:57 +02:00
Georgios Kyratsas
a002b28bc1 qa/tasks/cephadm.py: Support bootstrapped clusters
Add the possibility of being able to run cephadm.py on clusters that
were already bootstrapped by some other task/way so you can deploy the
rest of the daemons/services.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>
2020-05-14 16:54:30 +02:00
Sebastian Wagner
0240e14b9d
Merge pull request #35030 from mgfritch/cephadm-shell-mount-special
cephadm: fix shell mount for special files

Reviewed-by: Matthew Oliver <moliver@suse.com>
2020-05-14 13:30:34 +02:00
Rishabh Dave
e57c86fab3 qa/cephfs: run() cleanup whether FS was mounted or not
In case the mount command in mount() fails, it would still have created
the mountpoint and network namespace for the FS's mount. Therefore, run
cleanup() and cleanup_netns() in umount() and umount_wait() even when
self.mounted is set to False.

Also, move the call to cleanup_netns() in cleanup().

Fixes: https://tracker.ceph.com/issues/45430
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-05-14 10:06:21 +05:30
Michael Fritch
44bcee8d1a
qa/tasks: logger.warn() -> logger.warning()
logger.warn() is the same as logger.warning(), but was removed in py3.3

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-13 17:18:13 -06:00
Yuri Weinstein
929a9e64bb
Merge pull request #35029 from yuriw/wip-yuriw-subsets-master
qa/tests: reduce number of jobs for rados to 309
2020-05-13 15:57:35 -07:00
Kefu Chai
b23de0c4b0
Merge pull request #34956 from tchaikov/wip-qa-tasks-cephfs-py3
qa/tasks/cephfs: remove sys.exc_clear() calls

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-13 15:21:41 +08:00
Kefu Chai
2941bbd7bc
Merge pull request #34857 from tchaikov/wip-qa-tasks-no-filter
qa/tasks: use list comprehension for checking the length

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-13 14:10:24 +08:00
Yuri Weinstein
116ac90ad2 qa/tests: reduce number of jobs for rados to 309
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-12 15:40:01 -07:00
Michael Fritch
629a9eeeb5
qa/workunits/cephadm/test_cephadm.sh: add shell mount test
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-12 16:13:49 -06:00
Patrick Donnelly
01aea7f7e1
Merge PR #34978 into master
* refs/pull/34978/head:
	qa/tasks/cephfs/mount.py: always setup the NAT rules
	qa/tasks/cephfs/mount.py: fall back to use ip command to setup the bridge

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2020-05-12 11:59:51 -07:00
Xiubo Li
2e6e3916a0 qa/tasks/cephfs/mount.py: always setup the NAT rules
If the last test failed just after the 'ceph-brx' bridge is created
but with setuping the NAT rules in iptables, so if we run the test
case again, it will just skip seting the 'ceph-brx' and the NAT rules.
Then deleting the NAT rules will get the errors like:

iptables: Bad rule (does a matching rule exist in that chain?).

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-05-11 23:20:42 -04:00
Xiubo Li
f7b49f5bab qa/tasks/cephfs/mount.py: fall back to use ip command to setup the bridge
CentOS/RHEL8 have abandoned the bridge-utils package so the brctl
cmd is none avalible, and on Ubuntu 18.04 and 20.04 the nmcli is
buggy to setup the bridge. So this will fall back to use ip cmd
to setup the bridge stuff.

Fixes: https://tracker.ceph.com/issues/45459
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-05-11 22:51:29 -04:00
Patrick Donnelly
8a0caa435e
Merge PR #34962 into master
* refs/pull/34962/head:
	vstart_runner.py: use tuple instead of set

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-11 19:35:18 -07:00
Rishabh Dave
cb0bfc8fab vstart_runner.py: use tuple instead of set
Using python3 leads to an error that says
"TypeError: unhashable type: 'Raw'".

Fixes: https://tracker.ceph.com/issues/45446
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-05-11 18:01:58 +05:30
Sebastian Wagner
3742a28415 qa/cephadm: rm ubuntu_latest for now
Fixes: https://tracker.ceph.com/issues/45462
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-11 11:53:11 +02:00
Mykola Golub
a834e7115e qa/suites/rbd: enable random distro for nbd tests
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-05-09 16:36:49 +01:00
Mykola Golub
b0ab564eae qa/workunits/rbd: add rbd-nbd quiesce tests
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-05-09 16:36:49 +01:00
Kefu Chai
bcbb8abb96
Merge pull request #34834 from sidharthanup/qa-test-exports-fix
qa/test_exports: fix TestExports failure under new py3 compability changes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-09 14:53:10 +08:00
Kefu Chai
0d06671898
Merge pull request #34871 from tchaikov/wip-qa-tasks-mgr-set-application
qa/tasks/mgr: always add "application" label to pool

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-05-09 14:50:00 +08:00
Kefu Chai
9f2ac621e9
Merge pull request #34875 from tchaikov/wip-qa-tasks-qemu
qa/tasks/qemu: open file in text mode

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-05-09 14:41:04 +08:00
Patrick Donnelly
9859cd0f25
Merge PR #34941 into master
* refs/pull/34941/head:
	qa/cephfs: use StringIO instead of BytesIO

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-05-08 21:28:04 -07:00
Sebastian Wagner
6a15a25d9a
Merge pull request #34903 from sebastian-philipp/cephadm-adopt-qa-grafana
qa/workunits/cephadm: test grafana adoption

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-05-08 18:58:50 +02:00
Kefu Chai
702de9590c qa/tasks/cephfs: remove sys.exc_clear() calls
sys.exc_clear() was removed in Python3, see
https://docs.python.org/3/whatsnew/3.0.html#index-22. so we should not
call it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-05-08 11:21:22 +08:00
Lenz Grimmer
3a0cfdcc4d
Merge pull request #34591 from votdev/issue_45109
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-05-07 11:59:22 +02:00
Rishabh Dave
71b823daee qa/cephfs: use StringIO instead of BytesIO
Fixes: https://tracker.ceph.com/issues/45425
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-05-07 12:13:53 +05:30
Casey Bodley
a96f9583f4
Merge pull request #34899 from smanjara/wip-dynamic-resharding
qa/rgw: add ssl option in reshard tests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-05-06 11:18:39 -04:00
Patrick Donnelly
ab9db61a08
Merge PR #34911 into master
* refs/pull/34911/head:
	qa: move fsx deps into common cephfs install yaml

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-05-05 10:58:32 -07:00
Patrick Donnelly
d791daa732
qa: move fsx deps into common cephfs install yaml
The double install task causes errors during unwind.

Fixes: fe3961fc36
Fixes: https://tracker.ceph.com/issues/45387
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-05 09:35:44 -07:00
Yuri Weinstein
c94dc41144
Merge pull request #34894 from yuriw/wip-yuriw-distro-master
qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04
2020-05-05 08:31:32 -07:00
Sebastian Wagner
b62dd11e3d qa/workunits/cephadm: test grafana adoption
now includes af85d49307

Fixes: https://github.com/ceph/cephadm-adoption-corpus/pull/3
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 14:50:14 +02:00
Shilpa Jagannath
06e6013ec1 qa/rgw: add ssl option in reshard tests
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-05-05 15:07:59 +05:30
Volker Theile
2fa69eb688 qa: mgr/dashboard: Replace Telemetry module in REST API test
Fixes: https://tracker.ceph.com/issues/45109

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-05-05 09:35:24 +02:00