Commit Graph

6002 Commits

Author SHA1 Message Date
Laura Paduano
f22247fd28
Merge pull request #32032 from votdev/issue_43088_passwd_async_validator
mgr/dashboard: Process password complexity checks immediately

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-01-14 11:15:10 +01:00
Casey Bodley
abe5277269
Merge pull request #32188 from cbodley/wip-qa-rgw-obj-manifest
qa/rgw: add rgw_obj and throttle tests to rgw verify suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-01-13 14:45:19 -05:00
Casey Bodley
9d4d273af7
Merge pull request #32550 from cbodley/wip-qa-rgw-multisite-admin-rest
qa/rgw: remove failing radosgw_admin_rest from multisite suite

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2020-01-13 14:43:37 -05:00
Kefu Chai
62a79c08bd
Merge pull request #32588 from tchaikov/wip-qa-mgr-setup-with-force
qa/tasks/mgr: set mgr module option with --force

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-01-10 22:58:42 +08:00
Kefu Chai
14a138e676
Merge pull request #32519 from tchaikov/wip-qa-skip-if-no-pool
qa/tasks/ceph_manager: do not pick a pool is there is no pools

Reviewed-By: Neha Ojha <nojha@redhat.com>
2020-01-10 21:33:32 +08:00
Kefu Chai
ba98e06c61
Merge pull request #32549 from tchaikov/wip-qa-rados-whitelist-health-warning
qa: whitelist FS_DEGRADED

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-10 21:28:33 +08:00
Kefu Chai
492b41bb2a
Merge pull request #32512 from tchaikov/wip-cbt-py3
Revert "qa/tasks/cbt: include py2 deps on ubuntu for now"

Reviewed-By: Neha Ojha <nojha@redhat.com>
2020-01-10 21:26:49 +08:00
Kefu Chai
7210d7f951 qa/tasks/mgr: set mgr module option with --force
if mgr is not active, monitor will refuse to set any option consumed by
mgr modules.

the reason the tests pass somtimes is that, we have a racing here:

1. stop all mgr daemons
2. MgrMonitor gets updated and updates its mgr_module_options
accordingly.
3. in TestDashboard.setUp(), we reset the port number for dashboard
using "ceph config set mgr mgr/dashboard/y/ssl_server_port 7789"
4. restart all mgr daemons

but the 2nd step and 3rd step could race with each other, if the 2nd
step happens after 3rd step, the test passes. otherwise it fails.

in this change, "--force" is passed to the "ceph config set" command,
so ConfigMonitor can bypass the sanity test for the option, and just
set this option.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-10 13:28:34 +08:00
Kefu Chai
1bd1328ad7
Merge pull request #32571 from tchaikov/wip-qa-test-runner-run-testcase
qa/tasks/cephfs_test_runner: setattr to class not instance

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-01-10 11:28:52 +08:00
Casey Bodley
cfa5922fd8 qa/rgw: add rgw_obj and throttle tests to rgw verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-01-09 16:51:37 -05:00
Patrick Donnelly
cf2d411251
Merge PR #32532 into master
* refs/pull/32532/head:
	qa: only restart MDS between tests

Reviewed-by: Jos Collin <jcollin@redhat.com>
2020-01-09 12:24:28 -08:00
Casey Bodley
c0a1b533f9
Merge pull request #32462 from alimaredia/wip-s3-tests-branch-override-remove
qa: remove force-branch from overrides of s3-tests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-09 14:48:44 -05:00
Patrick Donnelly
bae0c67395
Merge PR #32533 into master
* refs/pull/32533/head:
	qa: fix various py3 cephfs qa bugs x2

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
2020-01-09 11:13:53 -08:00
Patrick Donnelly
148e99be09
Merge PR #32507 into master
* refs/pull/32507/head:
	qa: detect RHEL8 for yum package installation

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-09 11:12:32 -08:00
Kefu Chai
2fe9771842
Merge pull request #32575 from tchaikov/wip-43227
qa/tasks/mgr/dashboard: set pg_num to 16

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-01-09 23:23:15 +08:00
Kefu Chai
15a5ebdce2 qa/tasks/mgr/dashboard: set pg_num to 16
as the default pg_num is now 16 since 78bf9244, and the minimum pg_num
is also 16 in autoscaler since 78bf9244.

Fixes: https://tracker.ceph.com/issues/43227
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-09 20:54:56 +08:00
Kefu Chai
204263b829 qa/tasks/cephfs_test_runner: setattr to class not instance
before this change, `setattr()` sets the instance specialized with a certain method
of test case, so in `MgrTestCase.setUpClass()`

assert cls.mgr_cluster is not None

fails,

after this change, instead of test case, the class of test suite is updated with the
specified params, even if we pass a certain test to test runner.
so we can

./run-backend-api-tests.sh tasks.mgr.test_dashboard.TestDashboard.test_standby

now. before this change, we can only:

./run-backend-api-tests.sh tasks.mgr.test_dashboard.TestDashboard

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-09 20:48:23 +08:00
Tatjana Dehler
1c18ca31fd
Merge pull request #32234 from votdev/better_orch_exception
mgr/dashboard: Throw a more meaningful exception

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-01-09 13:41:43 +01:00
Kefu Chai
e67034b95a qa/tasks/ceph_manager: do not pick a pool is there is no pools
random.choice(seq) raises IndexError if seq is empty. we cannot ensure
there is always one or more pools in the cluster while using pool
related thrasher. so skip the thrasher action if there is no pools at
that moment.

Fixes: https://tracker.ceph.com/issues/43412
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-09 10:26:32 +08:00
Casey Bodley
f51a7cae7d qa/rgw: remove failing radosgw_admin_rest from multisite suite
this was added to test that admin apis forward relevent requests to the
master zone, but radosgw_admin_rest.py tries to create an admin user
with 'radosgw-admin user create'. this fails with:

Please run the command on master zone. Performing this operation on
non-master zone leads to inconsistent metadata between zones
Are you sure you want to go ahead? (requires --yes-i-really-mean-it)

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-01-08 10:27:33 -05:00
Patrick Donnelly
1d727267e5
Merge PR #32535 into master
* refs/pull/32535/head:
	qa: define centos version for fs:verify

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-08 07:27:06 -08:00
Kefu Chai
44fb077978 qa: whitelist FS_DEGRADED
`admin_socket_output --all` sends "respawn" to mds, so when the mds
restarts, FS_DEGRADED.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-08 22:20:35 +08:00
Kefu Chai
93fd11dd47
Merge pull request #32461 from s0nea/wip-dashboard-fix-user-test
mgr/dashboard: fix failing user test

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-08 11:40:42 +08:00
Patrick Donnelly
423dcb4c54
qa: only restart MDS between tests
"fs fail" will only fail the MDS that are part of the file system which
will generally allow us to avoid spurious MDS_INSUFFICIENT_STANDBY
warnings. Further, only restart the MDS, there's no reason to leave them
offline.

Fixes: https://tracker.ceph.com/issues/43514
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 18:47:23 -08:00
Patrick Donnelly
6adcace694
Merge PR #30802 into master
* refs/pull/30802/head:
	cephfs-shell: Modify Quota Test
	cephfs-shell: Fix permission errors on quota tests
	cephfs-shell: Add tests for quota
	cephfs-shell: Print max_bytes and max_files as string on get Quota
	cephfs-shell: Remove extra length argument passed to setxattr()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-07 14:11:16 -08:00
Patrick Donnelly
e83aa733b9
Merge PR #32459 into master
* refs/pull/32459/head:
	qa/tasks: Nothing to clean up if the volume was not created
	mgr/volumes: drop obsolete comment in _cmd_fs_volume_create
	mgr/volumes: cleanup on fs create error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 14:08:41 -08:00
Patrick Donnelly
593d3b1779
qa: detect RHEL8 for yum package installation
Fixes: https://tracker.ceph.com/issues/43487
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 13:54:17 -08:00
Patrick Donnelly
8f8d03dd3c
Merge PR #32510 into master
* refs/pull/32510/head:
	mon: use non-obsolete mon scrub cmd

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 13:52:36 -08:00
Patrick Donnelly
2cdb2972cd
qa: define centos version for fs:verify
Otherwise it uses the teuthology default of 7.6.

Fixes: https://tracker.ceph.com/issues/43516
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 13:20:00 -08:00
Patrick Donnelly
ae28ed11d7
qa: fix various py3 cephfs qa bugs x2
Fixes: https://tracker.ceph.com/issues/43515
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 13:06:11 -08:00
David Zafman
3869ee3d7c
Merge pull request #32247 from dzafman/wip-43307
Remove use of rules batching for upmap balancer and default for upmap_max_deviation to 5

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-07 10:41:37 -08:00
Tatjana Dehler
b9094f1e17 mgr/dashboard: fix failing user tests
Choose another future_date_1 date (9 days instead of 10) to
make sure the expiration date will be between future_date_1
and future_date_2. Otherwise the expiration date might be
equal to future_date_1.
Also wait for 10 seconds before the password refresh in
test_pwd_expiration_date_update to prevent date equality.

Fixes: https://tracker.ceph.com/issues/43431
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-01-07 11:56:52 +01:00
Ilya Dryomov
39fdbe1b81
Merge pull request #32376 from idryomov/wip-krbd-fsx-object-map
qa/suites/krbd: fsx with object-map and fast-diff

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-07 11:32:26 +01:00
Kefu Chai
0150ac9daa
Merge pull request #32518 from tchaikov/wip-orchestrator-service-action-tests
qa/tasks/mgr/test_orchestrator_cli: fix service action tests

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-07 17:44:10 +08:00
Kefu Chai
ccfaf40491
Merge pull request #32428 from tchaikov/wip-qa-mgr-mon-update
qa/tasks/mgr/test_orchestrator_cli: fix "mon update" test

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-07 16:29:34 +08:00
Kefu Chai
4c98b3224e qa/tasks/mgr/test_orchestrator_cli: fix service action tests
in b77f0c74a5, "reload"
service[-instance] action was dropped. so replace "reload" with
"restart" in the related tests.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:00:04 +08:00
David Zafman
c65d5c8d14 test: Sort pool list because the order isn't guaranteed from "balancer pool ls"
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
b0a1b758d0 mgr: Change default upmap_max_deviation to 5
Fixes: https://tracker.ceph.com/issues/43312

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
8e46bbbf36 test: Fix test case for pool based balancing instead of rule batched
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
Kefu Chai
8f9e8cce03 Revert "qa/tasks/cbt: include py2 deps on ubuntu for now"
This reverts commit 3f2270a1c4.

since https://github.com/ceph/cbt/pull/208 got merged, there is no need
to install python2 for cbt anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-07 09:35:20 +08:00
Ilya Dryomov
53066d09ab
Merge pull request #32358 from idryomov/wip-krbd-py3-fixup
qa: krbd_exclusive_option.sh: fixup for json.tool ordering change

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-06 21:54:43 +01:00
Patrick Donnelly
e389d9016c
Merge PR #32480 into master
* refs/pull/32480/head:
	qa: use -D_GNU_SOURCE when compiling fsync-tester.c
	qa: add comment about fsync-tester distribution

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:34:37 -08:00
Patrick Donnelly
87755902ad
Merge PR #31494 into master
* refs/pull/31494/head:
	qa: force creation of fs with EC default data pool
	qa: add tests for adding EC data pools
	mon/MDSMonitor: warn when creating fs with default EC data pool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:30:59 -08:00
Patrick Donnelly
c755740376
Merge PR #32467 into master
* refs/pull/32467/head:
	qa: fix various py3 cephfs qa bugs

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:25:34 -08:00
Patrick Donnelly
02b3883dd0
Merge PR #32363 into master
* refs/pull/32363/head:
	qa: add .qa link

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:18:12 -08:00
Patrick Donnelly
1710acdc6b
mon: use non-obsolete mon scrub cmd
Fixes: e9a5ce0897
Fixes: https://tracker.ceph.com/issues/43488
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:06:10 -08:00
Kefu Chai
f05696ebeb qa: enable CRB repo for RHEL8
instead of enabling PowerTools repo, we need to enable CodeReady Builder
repo for RHEL8

also, since we are moving to RHEL8, there is no need to install cmake3
specifically for CentOS. CentOS 8 comes with cmake3.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-06 23:41:23 +08:00
Ilya Dryomov
b2b7610d1a qa: krbd_exclusive_option.sh: fixup for json.tool ordering change
In Python 3.5 json.tool was changed to produce unsorted output and
--sort-keys option was added to compensate.  This wasn't caught by
4fe245cc2f ("qa: update krbd tests for python3") because it raced
with 50933b863a ("qa: krbd_exclusive_option.sh: update for recent
kernel changes").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-06 15:12:25 +01:00
Ilya Dryomov
cff2e49ff0 qa/suites/krbd: fsx with object-map and fast-diff
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-06 14:52:52 +01:00
Patrick Donnelly
6ea2730ea6
qa: fix various py3 cephfs qa bugs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 16:42:13 -08:00