Commit Graph

2402 Commits

Author SHA1 Message Date
Kefu Chai
2225deb989
Merge pull request #36376 from tchaikov/wip-crimson-log
qa/tasks/ceph: redirect stderr to log file

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-07-31 17:45:35 +08:00
Kefu Chai
87e61e1d6e qa/tasks/ragweed: always set ragweed_repo
* extract get_ragweed_branch() out of download() task, for better
  readablity.
* use a loop for retry when the first clone fails
* drop the `raise ValueError()` clause as it never happens. we could use
  an assert() here, but i don't think it is necessary anyway.
* use sh() instead of run() for better readablity.
* always set ragweed_repo. before this change this variable is
  unbounded if `force-branch` is set.

Fixes: https://tracker.ceph.com/issues/46771
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-31 13:08:56 +08:00
Kefu Chai
da76f46461 qa/tasks/ceph: redirect stderr to log file
crimson write log to stderr, let's redirect it to log file for a more
peaceful teuthology.log.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-31 00:51:30 +08:00
Patrick Donnelly
cd8571ea4a
Merge PR #36064 into master
* refs/pull/36064/head:
	mgr/volumes: Fix traceback of ops when volume doesn't exist

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-29 19:58:16 -07:00
Kefu Chai
45c3bed0ea
Merge pull request #36232 from mgfritch/cephadm-ok-to-stop
mgr/cephadm: add `orch ok-to-stop` commands

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2020-07-29 20:29:01 +08:00
Michael Fritch
60b99dcdc7
mgr/orch: add errno to OrchestratorError
add errno to OrchestratorError and ServiceSpecValidationError exceptions

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-07-28 15:54:46 -06:00
Tatjana Dehler
739b365a3f mgr/dashboard: wait longer for health status to be cleared
Because of reasons the cluster needs more time to recover from
HEALTH_WARN while changes are made by `test_pool_update_metadata`.
Lets wait several times for the cluster status to be HEALTH_OK
again.

Fixes: https://tracker.ceph.com/issues/46573
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-07-28 14:47:27 +02:00
Varsha Rao
801047f6cb qa/tasks/nfs:Add test for relative and just '/' pseudo path
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-07-23 13:03:38 +05:30
Laura Paduano
63a56b4b52
Merge pull request #35694 from rhcs-dashboard/wip-45901-master
mgr/dashboard: increase API test coverage in API controllers

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-07-22 16:58:44 +02:00
Kefu Chai
eb4e5de14e
Merge pull request #35866 from tchaikov/wip-qa-tempest-pin-openstackclients
qa/keystone: pin python-openstackclient

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-07-22 20:38:54 +08:00
Kefu Chai
75570ce6a4 qa/keystone: pin python-openstackclient and osc-lib
keystone's dependencies are installed using its tox.ini,
which in turn uses a constraints file of
https://releases.openstack.org/constraints/upper/ussuri,
and it pins cliff to 3.1.0, which is not able to fulfill the requirement
of osc-lib 2.2.0. as it needs needs cliff>=3.2.0. per
https://releases.openstack.org/ussuri/, the latest osc-lib for
ussuri is 2.0.0. and osc-lib>=2.0.0 is required by
python-openstackclient 2.5.1, so let's use it instead of using the latest
one.

if we install cliff==3.1.0 along with python-openstackclient==5.2.1,
we will have following error, as `CommandManager.add_command_group()`
method was added to cliff in 3.2.0. see
8477c4dbd0,
so cliff failed to work with the latest openstackclient, like:

2020-06-29T17:26:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:'CommandManager' object has no attribute 'add_command_group'
2020-06-29T17:26:23.402 INFO:teuthology.orchestra.run.smithi039.stderr:Traceback (most recent call last):
2020-06-29T17:26:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/cliff/app.py", line 264, in run
2020-06-29T17:26:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:    self.initialize_app(remainder)
2020-06-29T17:26:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/openstackclient/shell.py", line 133, in
initialize_app
2020-06-29T17:26:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:    super(OpenStackShell, self).initialize_app(argv)
2020-06-29T17:26:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/osc_lib/shell.py", line 442, in initialize_app
2020-06-29T17:26:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:    self._load_plugins()
2020-06-29T17:26:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/openstackclient/shell.py", line 104, in
_load_plugins
2020-06-29T17:26:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:    self.command_manager.add_command_group(cmd_group)
2020-06-29T17:26:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:AttributeError: 'CommandManager' object has no attribute 'add_command_group'
2020-06-29T17:26:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:Traceback (most recent call last):
2020-06-29T17:26:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/osc_lib/shell.py", line 134, in run
2020-06-29T17:26:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:    ret_val = super(OpenStackShell, self).run(argv)
2020-06-29T17:26:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/cliff/app.py", line 264, in run
2020-06-29T17:26:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:    self.initialize_app(remainder)
2020-06-29T17:26:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/openstackclient/shell.py", line 133, in
initialize_app
2020-06-29T17:26:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:    super(OpenStackShell, self).initialize_app(argv)
2020-06-29T17:26:23.406 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/osc_lib/shell.py", line 442, in initialize_app
2020-06-29T17:26:23.406 INFO:teuthology.orchestra.run.smithi039.stderr:    self._load_plugins()
2020-06-29T17:26:23.406 INFO:teuthology.orchestra.run.smithi039.stderr:  File "/home/ubuntu/cephtest/keystone/.tox/venv/lib/python3.6/site-packages/openstackclient/shell.py", line 104, in
_load_plugins
2020-06-29T17:26:23.406 INFO:teuthology.orchestra.run.smithi039.stderr:    self.command_manager.add_command_group(cmd_group)
2020-06-29T17:26:23.406 INFO:teuthology.orchestra.run.smithi039.stderr:AttributeError: 'CommandManager' object has no attribute 'add_command_group'

in this change the openstackclients version is pin'ed to the
latest stable of 5.2.1. will have a separated PR to bump up
the cliff version on teuthology side.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-22 19:20:00 +08:00
Kefu Chai
6048c0320f
Merge pull request #36198 from tchaikov/wip-test-drop-py2
rpm,deb,qa,python-common,test: drop python2 support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-07-22 17:38:01 +08:00
Kefu Chai
24e7acc261 qa/tasks: drop python2 support from rgw related tests
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-22 11:55:49 +08:00
Kefu Chai
b36f98d388 qa/tasks/samba: drop python2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-22 11:55:49 +08:00
Kefu Chai
4aa86f7a76 qa/tasks/rbd: drop python2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-22 11:55:49 +08:00
Kefu Chai
877a0cd871 qa/tasks/mgr/dashboard: drop python2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-22 11:55:49 +08:00
Kefu Chai
56d2ae8ccf qa/tasks/fs: drop python2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-21 19:52:11 +08:00
Kefu Chai
4aa537b739 qa/tasks: drop python2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-21 19:52:11 +08:00
Kefu Chai
76c4e68be4 qa/tasks/cephfs: drop python2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-21 19:52:11 +08:00
Kefu Chai
2a377b01fd qa/tasks/cephadm: drop python2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-21 19:52:11 +08:00
Sebastian Wagner
120acb4c37
Merge pull request #35850 from sebastian-philipp/cephadm-set-paused-health
mgr/cephadm: Add CEPHADM_PAUSED to test_cli

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-07-21 10:43:41 +02:00
Laura Paduano
4bf04db39f
Merge pull request #36157 from rhcs-dashboard/fix-46601-master
mgr/dashboard/api: increase API health timeout

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-07-20 15:48:21 +02:00
Patrick Donnelly
c049d31540
Merge PR #35953 into master
* refs/pull/35953/head:
	qa: Fix name collisions

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2020-07-17 20:20:47 -07:00
Ernesto Puerta
cd9f680b11
mgr/dashboard/api: increase API health timeout
Fixes: https://tracker.ceph.com/issues/46601
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2020-07-17 15:21:55 +02:00
Aashish Sharma
2538d52fda
Merge branch 'master' into wip-45901-master 2020-07-17 15:35:20 +05:30
Sebastian Wagner
aee1aed641 mgr/cephadm: Add CEPHADM_PAUSED to test_cli
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-07-17 10:29:20 +02:00
Kefu Chai
451937d711
Merge pull request #35768 from rhcs-dashboard/fix-45185-master
mgr/dashboard: fix pool usage calculation

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2020-07-16 17:21:59 +08:00
Aashish Sharma
ffb76a88dd mgr/dashboard: increase API test coverage in API controllers
Added test cases for the missing endpoints

Fixes: https://tracker.ceph.com/issues/45901
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2020-07-15 20:03:50 +05:30
Kotresh HR
e4ebdb1a5d mgr/volumes: Fix traceback of ops when volume doesn't exist
Subvolume operations throw a traceback if the volume
doesn't exist. This patch fixes the same.

Fixes: https://tracker.ceph.com/issues/46496
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-07-14 18:38:14 +05:30
Kotresh HR
3b6f6f1abf qa: Fix name collisions
Addresses the name collisions of volumes, subvolumes,
clones, subvolume groups and snapshots within the tests.

Fixes: https://tracker.ceph.com/issues/43517
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-07-14 15:39:34 +05:30
Patrick Donnelly
7f8bd09e88
Merge PR #35755 into master
* refs/pull/35755/head:
	mgr/volumes: Deprecate protect/unprotect CLI calls for subvolume snapshots

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Victoria Martinez de la Cruz <vkmc@redhat.com>
Reviewed-by: Goutham Pacha Ravi <gouthamr@redhat.com>
2020-07-13 19:58:13 -07:00
Patrick Donnelly
41d76856fa
Merge PR #35951 into master
* refs/pull/35951/head:
	qa/cephfs: set omit_sudo to False for wait_until_mounted() in...

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-13 11:10:00 -07:00
Shyamsundar Ranganathan
c52a7383d3 mgr/volumes: Deprecate protect/unprotect CLI calls for subvolume snapshots
Subvolume snapshots required to be protected, prior to cloning the same.

Also, protected snapshots were not allowed to be unprotected or removed,
if there were in-flight clones, whose source was the snapshot being
removed.

The protection of snapshots explicitly is not required, as these can be
prevented from being removed based only on the in-flight clones checks.

This commit hence deprecates the additional protect/unprotect requirements
prior to cloning a snapshot.

In addition to deprecating the above, support to query a subvolume for
supported features, via the info command, is added. The feature list
is set to "clone" and "auto-protect", where the latter is useful to
decide if protect/unprotect commands are required or not.

Fixes: https://tracker.ceph.com/issues/45371

Signed-off-by: Shyamsundar Ranganathan <srangana@redhat.com>
2020-07-10 11:08:44 -04:00
Patrick Donnelly
957bcb4edf
Merge PR #34861 into master
* refs/pull/34861/head:
	test: adjust scrub control tests for optional scrub status
	mgr: set `task_dirty_status` on reconnect
	mds: send scrub status to ceph-mgr only when scrub is running

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-09 06:28:13 -07:00
Georgios Kyratsas
7e50ee3496
Merge pull request #35927 from gekios/wip-cephadm-image-fix
qa/tasks: fix cephadm config image check
2020-07-09 14:47:37 +02:00
Ernesto Puerta
b4a9dc17a3
mgr/dashboard: fix pool usage calculation
Currently Dashboard Pool usage calculation does not match the output of
'ceph df' command.

Fixes: https://tracker.ceph.com/issues/45185
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2020-07-09 14:11:59 +02:00
Georgios Kyratsas
390ca4d92f qa/tasks: fix cephadm config image check
Check container_image_name only if ceph cluster image is not pre-defined in config.
We shouldn't care about container_image_name if there cephadm or ceph already have image defined.

Signed-off-by: Georgios Kyratsas <gkyratsas@suse.com>
2020-07-09 10:28:49 +02:00
Venky Shankar
ff63624a17 test: adjust scrub control tests for optional scrub status
Fixes: http://tracker.ceph.com/issues/45349
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-07-08 23:50:34 -04:00
Patrick Donnelly
4ec68680bd
Merge PR #33827 into master
* refs/pull/33827/head:
	mon: add 'ceph fs required_client_feature <fs_name> add/rm' command

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-08 17:06:16 -07:00
Patrick Donnelly
fb436e9fbe
Merge PR #35361 into master
* refs/pull/35361/head:
	mgr/volumes: Validate mon_allow_pool_delete before volume deletion

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-08 15:30:20 -07:00
Casey Bodley
f0cc5a8c50
Merge pull request #35910 from galsalomon66/add_s3select_filter
adding filter for s3select

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-07-08 08:52:22 -04:00
Patrick Donnelly
1dbad702b6
Merge PR #35743 into master
* refs/pull/35743/head:
	qa/tasks/test_nfs: Add test for cluster info
	mgr/volumes/nfs: Add cluster show info command

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-07 06:59:41 -07:00
Varsha Rao
93aa5e4012 qa/tasks/test_nfs: Add test for cluster info
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-07-07 10:50:22 +05:30
Rishabh Dave
aad0cfcb49 qa/cephfs: set omit_sudo to False for wait_until_mounted() in...
fuse_mount.py. This isn't critical at all to vstart_runner.py runs but
this patch must dramatically reduce the time it takes in case the
command fails with "permission denied" due to lack of superuser
privileges since in this case the command is re-run 9 more times, each
separated by a sleep for 5 seconds.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-07-07 09:45:28 +05:30
Yan, Zheng
c4a335d7c6 mon: add 'ceph fs required_client_feature <fs_name> add/rm' command
Fixes: https://tracker.ceph.com/issues/43817
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-07-07 09:05:56 +08:00
Kefu Chai
a5441010ed
Merge pull request #35913 from ideepika/wip-container-tag-change
docker/podman: tag crimson flavor container as 'sha-1-flavor'

Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-07-06 21:01:06 +08:00
Deepika Upadhyay
b0a14d6e1e docker/podman: tag crimson flavor container as 'sha-1-flavor'
see also: ceph/ceph-container#1704

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-07-06 16:19:28 +05:30
Aashish Sharma
a30de22468 mgr/dashboard: increase API test coverage in API controllers
Added test cases for the missing endpoints

Fixes: https://tracker.ceph.com/issues/45901
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2020-07-06 10:39:44 +05:30
Kefu Chai
a045778d5b qa/tasks/cephfs: drop six dependency
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-05 10:58:28 +08:00
Kefu Chai
3ee164b92c qa/tasks/ceph_objectstore_tool: drop six dependency
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-05 10:58:28 +08:00