Commit Graph

6923 Commits

Author SHA1 Message Date
Patrick Donnelly
481b575491
Merge PR #35090 into master
* refs/pull/35090/head:
	mgr/volumes: Fix subvolume create idempotency

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2020-05-22 14:23:57 -07:00
Patrick Donnelly
dbef451083
Merge PR #35063 into master
* refs/pull/35063/head:
	cephfs: allow pool names with '-' and '.'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-22 14:21:30 -07:00
Patrick Donnelly
22517f8fd1
Merge PR #35109 into master
* refs/pull/35109/head:
	qa: use py3 compat list from range

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-22 10:34:19 -07:00
Kotresh HR
db8706aa68 mgr/volumes: Fix subvolume create idempotency
After subvolume is created, it can be resized
using subvolume create command. But it was
broken and the same is fixed.

Fixes: https://tracker.ceph.com/issues/45398
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-05-22 16:28:35 +05:30
Kefu Chai
fdb2d1e62c
Merge pull request #35104 from varshar16/wip-fix-roleless-mon-issue
qa/cephadm: Add roleless mon names to ctx.cluster.remotes role dict

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Georgios Kyratsas <gkyratsas@suse.com>
2020-05-22 12:44:09 +08:00
Kefu Chai
c927371894
Merge pull request #35082 from badone/wip-xenial-cmake-install-test_envlibrados_for_rocksdb
qa/workunits: Remove redundant Xenial cmake3 requirements

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-22 12:35:30 +08:00
Kefu Chai
a9b6103281
Merge pull request #34593 from hfutljx/master
qa/workunits:fix the error of getting encoding technique in ec test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-22 12:33:52 +08:00
Kefu Chai
636d6a681c
Merge pull request #35140 from batrick/i45612
qa: run install task only once

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-22 12:28:02 +08:00
Neha Ojha
617298c201
Merge pull request #35139 from smithfarm/wip-proxy-is-removed
qa/cephtool: remove/deprecate proxy cache-tier mode

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-05-21 10:07:56 -07:00
Nathan Cutler
4f0cecbadd qa/cephtool: clean up after removal of cache-tier modes
The "proxy" and "forward" cache-tier modes have been completely removed,
so it's sufficient to test once that they cannot be set.

Fixes: a0a3ed324a
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-21 13:42:09 +02:00
Rishabh Dave
1abfdd161c cephfs-shell: support cephfs-shell.conf
cephfs-shell options should reside in cephfs-shell.conf and not in
ceph.conf. Please note, unlike before, -c option of cephfs-shell must
take path to cephfs-shell.conf instead of path to ceph.conf.

This commit also updates the docs and the tests for cephfs-shell accordingly
and renames the variable config_path in cephfs-shell to shell_conf_path so
that it's easy to distinguish.

Fixes: https://tracker.ceph.com/issues/44127
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-05-20 21:32:45 +05:30
Patrick Donnelly
3a26099d05
Merge PR #33264 into master
* refs/pull/33264/head:
	test_cephfs_shell: refactor test_put_and_get_without_target_directory

Reviewed-by: Varsha Rao <varao@redhat.com>
2020-05-20 08:27:34 -07:00
Kefu Chai
65c159497f
Merge pull request #35125 from tchaikov/wip-cephadm-test
qa/tasks/cephadm: ignore tarfile.ReadError

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-20 14:37:43 +08:00
Patrick Donnelly
41b6120399
qa: run install task only once
Fixes: https://tracker.ceph.com/issues/45612
Fixes: 8d77d134c7
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-19 15:28:49 -07:00
Neha Ojha
8bcfaf2941
Merge pull request #35110 from neha-ojha/wip-revert-34894
Revert "qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Yuri Weinstein <yuriw@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-19 14:06:20 -07:00
Sebastian Wagner
5200b6478a
Merge pull request #34980 from sebastian-philipp/cephadm-workunits-rm-ubuntu_2020
qa/cephadm: rm ubuntu_latest for now

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-19 13:59:09 +02:00
Kefu Chai
d67b0f1e3a qa/tasks/cephadm: ignore tarfile.ReadError
there is chance that /var/log/ceph (and other directories) is not
created when cephadm fails, but we always try to collect /var/log/ceph
by tar the directory on the test node and transfer it back for archiving
it. when we fail to do so, an exception is thrown, and this exception is
in turn logged as the cause of the failure instead of the one which
fails the test.

in this change, `tarfile.TarError`s is caught and ignored if it is
thrown by `misc.pull_directory()`, as normally, we don't consider it a fatal
failure when `misc.pull_directory()` fails because of `tar`. the
failures for the test are.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-05-19 19:10:56 +08:00
Varsha Rao
58eaeb53e4 qa/cephadm: Add roleless mon names to ctx.cluster.remotes role dict
Fixes: https://tracker.ceph.com/issues/45584
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-05-19 09:57:27 +00:00
Ramana Raja
d9f8f8e3d0 cephfs: allow pool names with '-' and '.'
... to be set as pool layouts for files and directories.

Fixes: https://tracker.ceph.com/issues/45521
Signed-off-by: Ramana Raja <rraja@redhat.com>
2020-05-19 13:34:49 +05:30
Patrick Donnelly
076d04654f
Merge PR #35062 into master
* refs/pull/35062/head:
	qa/tasks/cephfs/fuse_mount.py: retry when the admin socket is not ready

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-05-18 15:14:08 -07:00
Patrick Donnelly
356c64a3ff
Merge PR #34596 into master
* refs/pull/34596/head:
	test: add a new program for testing ino_release_cb
	client: add a new inode release request callback
	client: expose ceph_ll_register_callbacks via libcephfs
	client: move callback typedefs and arg struct into ceph_ll_client.h
	client: rename ceph_statx.h to ceph_ll_client.h
	client: make client_dentry_callback_t more friendly for C
	client: only override umask_cb with non-NULL values

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-05-18 15:07:43 -07:00
Patrick Donnelly
5ea3a9a1f7
Merge PR #34951 into master
* refs/pull/34951/head:
	qa/cephfs: run() cleanup whether FS was mounted or not

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-05-18 14:57:20 -07:00
Neha Ojha
1f885b6c2f Revert "qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04"
This reverts commit 835f2f5f51.

Reverting this to narrow down recent failures seen in rados and upgrade suites.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-05-18 21:55:25 +00:00
Patrick Donnelly
0825b9b97d
Merge PR #35058 into master
* refs/pull/35058/head:
	qa/tasks: logger.warn() -> logger.warning()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-18 14:34:28 -07:00
Patrick Donnelly
8d51b33e5d
qa: use py3 compat list from range
Fixes: https://tracker.ceph.com/issues/45590
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-18 12:57:43 -07:00
Sebastian Wagner
71c7f959f7
Merge pull request #34900 from gekios/wip-cephadm-bootstrapped
qa/tasks/cephadm.py: Support already bootstrapped clusters

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-18 20:46:47 +02:00
Patrick Donnelly
f9c9bc9b74
Merge PR #35081 into master
* refs/pull/35081/head:
	qa: do not save/restore ip_forward sysctl

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-05-15 19:22:16 -07:00
Jason Dillaman
7f1df0d18a
Merge pull request #34789 from trociny/wip-rbd-nbd-quiesce
rbd-nbd: add quiesce/unquiesce hooks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-15 11:12:50 -04:00
Brad Hubbard
88094c264f qa/workunits/ceph-helpers-root: Remove unused function
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-05-15 16:50:25 +10:00
Brad Hubbard
9d2632a953 qa/workunits/rados/test_envlibrados_rocksdb: Remove Xenial cmake3 requirements
It's no longer necessary to handle Xenial as a special case.

Fixes: https://tracker.ceph.com/issues/45561

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-05-15 16:50:00 +10:00
Patrick Donnelly
6f14713aed
qa: do not save/restore ip_forward sysctl
We don't really care if this is left on during the course of the mount.
These settings don't persist across tests anyway.

Fixes: https://tracker.ceph.com/issues/45525
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-14 20:15:38 -07:00
Xiubo Li
422d736568 qa/tasks/cephfs/fuse_mount.py: retry when the admin socket is not ready
Fixes: https://tracker.ceph.com/issues/45552
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-05-14 22:00:35 -04:00
Yuri Weinstein
5d67ab8459 qa/tests: reduced powercycle jobs amount
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-14 13:49:01 -07:00
Lenz Grimmer
28ac243556 Merge pull request #32829 from Devp00l/wip-43765
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-14 13:45:16 -07:00
Yuri Weinstein
6c9d990697 qa/tests: run nautilus-x on pacific on ubuntu 18.04
...as we don't build `nauiltus` on `20.04`

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-14 12:35:20 -07:00
Georgios Kyratsas
35e158605e qa/tasks/cephadm: Add support for raw disks
Currently tests on raw disks are failing due to stripping '/dev/' from
device name. (ie https://tracker.ceph.com/issues/45383#change-165721)

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>
2020-05-14 16:54:57 +02:00
Georgios Kyratsas
a002b28bc1 qa/tasks/cephadm.py: Support bootstrapped clusters
Add the possibility of being able to run cephadm.py on clusters that
were already bootstrapped by some other task/way so you can deploy the
rest of the daemons/services.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>
2020-05-14 16:54:30 +02:00
Sebastian Wagner
0240e14b9d
Merge pull request #35030 from mgfritch/cephadm-shell-mount-special
cephadm: fix shell mount for special files

Reviewed-by: Matthew Oliver <moliver@suse.com>
2020-05-14 13:30:34 +02:00
Rishabh Dave
e57c86fab3 qa/cephfs: run() cleanup whether FS was mounted or not
In case the mount command in mount() fails, it would still have created
the mountpoint and network namespace for the FS's mount. Therefore, run
cleanup() and cleanup_netns() in umount() and umount_wait() even when
self.mounted is set to False.

Also, move the call to cleanup_netns() in cleanup().

Fixes: https://tracker.ceph.com/issues/45430
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-05-14 10:06:21 +05:30
Michael Fritch
44bcee8d1a
qa/tasks: logger.warn() -> logger.warning()
logger.warn() is the same as logger.warning(), but was removed in py3.3

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-13 17:18:13 -06:00
Yuri Weinstein
929a9e64bb
Merge pull request #35029 from yuriw/wip-yuriw-subsets-master
qa/tests: reduce number of jobs for rados to 309
2020-05-13 15:57:35 -07:00
Kefu Chai
b23de0c4b0
Merge pull request #34956 from tchaikov/wip-qa-tasks-cephfs-py3
qa/tasks/cephfs: remove sys.exc_clear() calls

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-13 15:21:41 +08:00
Kefu Chai
2941bbd7bc
Merge pull request #34857 from tchaikov/wip-qa-tasks-no-filter
qa/tasks: use list comprehension for checking the length

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-13 14:10:24 +08:00
Yuri Weinstein
116ac90ad2 qa/tests: reduce number of jobs for rados to 309
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-05-12 15:40:01 -07:00
Michael Fritch
629a9eeeb5
qa/workunits/cephadm/test_cephadm.sh: add shell mount test
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-12 16:13:49 -06:00
Patrick Donnelly
01aea7f7e1
Merge PR #34978 into master
* refs/pull/34978/head:
	qa/tasks/cephfs/mount.py: always setup the NAT rules
	qa/tasks/cephfs/mount.py: fall back to use ip command to setup the bridge

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2020-05-12 11:59:51 -07:00
Xiubo Li
2e6e3916a0 qa/tasks/cephfs/mount.py: always setup the NAT rules
If the last test failed just after the 'ceph-brx' bridge is created
but with setuping the NAT rules in iptables, so if we run the test
case again, it will just skip seting the 'ceph-brx' and the NAT rules.
Then deleting the NAT rules will get the errors like:

iptables: Bad rule (does a matching rule exist in that chain?).

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-05-11 23:20:42 -04:00
Xiubo Li
f7b49f5bab qa/tasks/cephfs/mount.py: fall back to use ip command to setup the bridge
CentOS/RHEL8 have abandoned the bridge-utils package so the brctl
cmd is none avalible, and on Ubuntu 18.04 and 20.04 the nmcli is
buggy to setup the bridge. So this will fall back to use ip cmd
to setup the bridge stuff.

Fixes: https://tracker.ceph.com/issues/45459
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-05-11 22:51:29 -04:00
Patrick Donnelly
8a0caa435e
Merge PR #34962 into master
* refs/pull/34962/head:
	vstart_runner.py: use tuple instead of set

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-05-11 19:35:18 -07:00
Rishabh Dave
cb0bfc8fab vstart_runner.py: use tuple instead of set
Using python3 leads to an error that says
"TypeError: unhashable type: 'Raw'".

Fixes: https://tracker.ceph.com/issues/45446
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-05-11 18:01:58 +05:30