Commit Graph

1738 Commits

Author SHA1 Message Date
Jason Dillaman
82a01d3d3b qa/tasks: use correct NFS service name for EL8 distros
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-01-17 08:44:43 -05:00
Sage Weil
4b7f5de235 Merge PR #32411 into master
* refs/pull/32411/head:
	qa/tasks/ceph_manager: enable ceph-objectstore-tool via cephadm
	qa/tasks/cephadm: support crush_tunables config option

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-15 08:39:48 -06:00
Sage Weil
2739ac4a60 qa/tasks/ceph_manager: enable ceph-objectstore-tool via cephadm
- drop support for keyvaluestore
- leave a few paths non-cephadm specific (filestore, upgrade workaround)

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-15 07:53:01 -06:00
Patrick Donnelly
dc018d8b79
Merge PR #31763 into master
* refs/pull/31763/head:
	test: auto-upgrade subvolume test
	mgr/volumes: tie everything together to implement versioned subvolumes
	mgr/volumes: provide subvolume create/remove/open APIs
	mgr/volumes: implement subvolume based on subvolume template
	mgr/volumes: implement subvolume group based on group template
	mgr/volumes: implement trash as a subvolume group
	mgr/volumes: snapshot util module
	mgr/volumes: template for implementing groups and subvolumes
	mgr/volumes: implement filesystem volume module
	mgr/volumes: lock module to serialize volume operations
	mgr/volumes: introduce volume specification module
	mgr/volumes: add fs_util helper module

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-14 20:32:44 -08:00
Casey Bodley
6a6d4a4ffa
Merge pull request #32620 from cbodley/wip-qa-rgw-hadoop-versions
qa/rgw: s3a-hadoop task defaults to maven-version 3.6.3

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2020-01-14 13:36:29 -05:00
Laura Paduano
f22247fd28
Merge pull request #32032 from votdev/issue_43088_passwd_async_validator
mgr/dashboard: Process password complexity checks immediately

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-01-14 11:15:10 +01:00
Sage Weil
eba385b715 qa/tasks/cephadm: support crush_tunables config option
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 19:49:57 -06:00
Casey Bodley
82351b9874 qa/rgw: s3a-hadoop task defaults to maven-version 3.6.3
binaries for v3.6.2 are no longer available under
http://www-us.apache.org/dist/maven/maven-3/

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-01-13 14:15:03 -05:00
Kefu Chai
62a79c08bd
Merge pull request #32588 from tchaikov/wip-qa-mgr-setup-with-force
qa/tasks/mgr: set mgr module option with --force

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-01-10 22:58:42 +08:00
Kefu Chai
14a138e676
Merge pull request #32519 from tchaikov/wip-qa-skip-if-no-pool
qa/tasks/ceph_manager: do not pick a pool is there is no pools

Reviewed-By: Neha Ojha <nojha@redhat.com>
2020-01-10 21:33:32 +08:00
Kefu Chai
492b41bb2a
Merge pull request #32512 from tchaikov/wip-cbt-py3
Revert "qa/tasks/cbt: include py2 deps on ubuntu for now"

Reviewed-By: Neha Ojha <nojha@redhat.com>
2020-01-10 21:26:49 +08:00
Kefu Chai
7210d7f951 qa/tasks/mgr: set mgr module option with --force
if mgr is not active, monitor will refuse to set any option consumed by
mgr modules.

the reason the tests pass somtimes is that, we have a racing here:

1. stop all mgr daemons
2. MgrMonitor gets updated and updates its mgr_module_options
accordingly.
3. in TestDashboard.setUp(), we reset the port number for dashboard
using "ceph config set mgr mgr/dashboard/y/ssl_server_port 7789"
4. restart all mgr daemons

but the 2nd step and 3rd step could race with each other, if the 2nd
step happens after 3rd step, the test passes. otherwise it fails.

in this change, "--force" is passed to the "ceph config set" command,
so ConfigMonitor can bypass the sanity test for the option, and just
set this option.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-10 13:28:34 +08:00
Kefu Chai
1bd1328ad7
Merge pull request #32571 from tchaikov/wip-qa-test-runner-run-testcase
qa/tasks/cephfs_test_runner: setattr to class not instance

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-01-10 11:28:52 +08:00
Patrick Donnelly
cf2d411251
Merge PR #32532 into master
* refs/pull/32532/head:
	qa: only restart MDS between tests

Reviewed-by: Jos Collin <jcollin@redhat.com>
2020-01-09 12:24:28 -08:00
Patrick Donnelly
bae0c67395
Merge PR #32533 into master
* refs/pull/32533/head:
	qa: fix various py3 cephfs qa bugs x2

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
2020-01-09 11:13:53 -08:00
Patrick Donnelly
148e99be09
Merge PR #32507 into master
* refs/pull/32507/head:
	qa: detect RHEL8 for yum package installation

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-09 11:12:32 -08:00
Kefu Chai
2fe9771842
Merge pull request #32575 from tchaikov/wip-43227
qa/tasks/mgr/dashboard: set pg_num to 16

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-01-09 23:23:15 +08:00
Kefu Chai
15a5ebdce2 qa/tasks/mgr/dashboard: set pg_num to 16
as the default pg_num is now 16 since 78bf9244, and the minimum pg_num
is also 16 in autoscaler since 78bf9244.

Fixes: https://tracker.ceph.com/issues/43227
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-09 20:54:56 +08:00
Kefu Chai
204263b829 qa/tasks/cephfs_test_runner: setattr to class not instance
before this change, `setattr()` sets the instance specialized with a certain method
of test case, so in `MgrTestCase.setUpClass()`

assert cls.mgr_cluster is not None

fails,

after this change, instead of test case, the class of test suite is updated with the
specified params, even if we pass a certain test to test runner.
so we can

./run-backend-api-tests.sh tasks.mgr.test_dashboard.TestDashboard.test_standby

now. before this change, we can only:

./run-backend-api-tests.sh tasks.mgr.test_dashboard.TestDashboard

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-09 20:48:23 +08:00
Tatjana Dehler
1c18ca31fd
Merge pull request #32234 from votdev/better_orch_exception
mgr/dashboard: Throw a more meaningful exception

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-01-09 13:41:43 +01:00
Venky Shankar
03ee966b6c test: auto-upgrade subvolume test
Fixes: https://tracker.ceph.com/issues/43349
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-09 06:33:31 -05:00
Kefu Chai
e67034b95a qa/tasks/ceph_manager: do not pick a pool is there is no pools
random.choice(seq) raises IndexError if seq is empty. we cannot ensure
there is always one or more pools in the cluster while using pool
related thrasher. so skip the thrasher action if there is no pools at
that moment.

Fixes: https://tracker.ceph.com/issues/43412
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-09 10:26:32 +08:00
Kefu Chai
93fd11dd47
Merge pull request #32461 from s0nea/wip-dashboard-fix-user-test
mgr/dashboard: fix failing user test

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-08 11:40:42 +08:00
Patrick Donnelly
423dcb4c54
qa: only restart MDS between tests
"fs fail" will only fail the MDS that are part of the file system which
will generally allow us to avoid spurious MDS_INSUFFICIENT_STANDBY
warnings. Further, only restart the MDS, there's no reason to leave them
offline.

Fixes: https://tracker.ceph.com/issues/43514
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 18:47:23 -08:00
Patrick Donnelly
6adcace694
Merge PR #30802 into master
* refs/pull/30802/head:
	cephfs-shell: Modify Quota Test
	cephfs-shell: Fix permission errors on quota tests
	cephfs-shell: Add tests for quota
	cephfs-shell: Print max_bytes and max_files as string on get Quota
	cephfs-shell: Remove extra length argument passed to setxattr()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-01-07 14:11:16 -08:00
Patrick Donnelly
e83aa733b9
Merge PR #32459 into master
* refs/pull/32459/head:
	qa/tasks: Nothing to clean up if the volume was not created
	mgr/volumes: drop obsolete comment in _cmd_fs_volume_create
	mgr/volumes: cleanup on fs create error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 14:08:41 -08:00
Patrick Donnelly
593d3b1779
qa: detect RHEL8 for yum package installation
Fixes: https://tracker.ceph.com/issues/43487
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 13:54:17 -08:00
Patrick Donnelly
8f8d03dd3c
Merge PR #32510 into master
* refs/pull/32510/head:
	mon: use non-obsolete mon scrub cmd

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 13:52:36 -08:00
Patrick Donnelly
ae28ed11d7
qa: fix various py3 cephfs qa bugs x2
Fixes: https://tracker.ceph.com/issues/43515
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-07 13:06:11 -08:00
Tatjana Dehler
b9094f1e17 mgr/dashboard: fix failing user tests
Choose another future_date_1 date (9 days instead of 10) to
make sure the expiration date will be between future_date_1
and future_date_2. Otherwise the expiration date might be
equal to future_date_1.
Also wait for 10 seconds before the password refresh in
test_pwd_expiration_date_update to prevent date equality.

Fixes: https://tracker.ceph.com/issues/43431
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-01-07 11:56:52 +01:00
Kefu Chai
0150ac9daa
Merge pull request #32518 from tchaikov/wip-orchestrator-service-action-tests
qa/tasks/mgr/test_orchestrator_cli: fix service action tests

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-07 17:44:10 +08:00
Kefu Chai
ccfaf40491
Merge pull request #32428 from tchaikov/wip-qa-mgr-mon-update
qa/tasks/mgr/test_orchestrator_cli: fix "mon update" test

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-07 16:29:34 +08:00
Kefu Chai
4c98b3224e qa/tasks/mgr/test_orchestrator_cli: fix service action tests
in b77f0c74a5, "reload"
service[-instance] action was dropped. so replace "reload" with
"restart" in the related tests.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:00:04 +08:00
Kefu Chai
8f9e8cce03 Revert "qa/tasks/cbt: include py2 deps on ubuntu for now"
This reverts commit 3f2270a1c4.

since https://github.com/ceph/cbt/pull/208 got merged, there is no need
to install python2 for cbt anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-07 09:35:20 +08:00
Patrick Donnelly
87755902ad
Merge PR #31494 into master
* refs/pull/31494/head:
	qa: force creation of fs with EC default data pool
	qa: add tests for adding EC data pools
	mon/MDSMonitor: warn when creating fs with default EC data pool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:30:59 -08:00
Patrick Donnelly
1710acdc6b
mon: use non-obsolete mon scrub cmd
Fixes: e9a5ce0897
Fixes: https://tracker.ceph.com/issues/43488
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:06:10 -08:00
Patrick Donnelly
6ea2730ea6
qa: fix various py3 cephfs qa bugs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 16:42:13 -08:00
Jos Collin
67e43f4668
qa/tasks: Nothing to clean up if the volume was not created
There are only 2 cases which needs cleanup:
1. The volume is successfully created
2. The volume is successfully created but create_mds fails

In either case, we could do a 'volume rm'.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2020-01-03 15:55:56 +05:30
Volker Theile
bf567f4308 mgr/dashboard: Various fixes
* Remove scope and permission check from UserPasswordPolicy controller again, otherwise the Angular UI validator can't be executed for users without that privilege.
* Remobe obsolete QA test.

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-02 11:06:58 +01:00
Tatjana Dehler
7015c2a82b mgr/dashboard: fix REST API test cases
1. Fix the test cases by using the 'assertJsonBody'
   method. The '_post' method doesn't return anything.
   That's why we need to use the 'assertJsonBody'
   method here instead of checking the fields directly.

2. Add the missing scope and permission definition of the
   'validate_password' resource. Otherwise the resource
   is not restricted and 'test_validate_password_invalid_permissions'
   will fail.

3. Re-word error messages. Change 'cannot' to 'must not'.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-01-02 10:49:37 +01:00
Volker Theile
01c4bcadf6 mgr/dashboard: Process password complexity checks immediately
- Add 'api/user/validate_password' endpoint to check if a
  password meets the password policy. A new controller has
  to be added for 'api/user' which has NO security scope,
  otherwise it wouldn't be possible for users without USER
  privileges to call the endpoint.
- Add Angular async validator to check if the entered password
  meets the policy.

Fixes: https://tracker.ceph.com/issues/43088

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-02 10:49:37 +01:00
Varsha Rao
cd15fc8a77 cephfs-shell: Modify Quota Test
This patch makes following modifications quota test:
- Add additional condtion to confirm Command Failure Error due to exceeding set
  quota values.
- Rename function valid to set_and_get_quota_vals.
- Use run_cephfs_shell_cmd instead of get_cephfs_shell_cmd_output.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-12-28 17:55:40 +05:30
Varsha Rao
228a290c2d cephfs-shell: Fix permission errors on quota tests
Use of mount_a.run_shell() to create directory, requires Sudo access and
cephfs-shell should be run without sudo access. Instead use cephfs-shell mkdir
command to create directory.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-12-28 17:55:40 +05:30
Varsha Rao
d4b5c760cd cephfs-shell: Add tests for quota
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-12-28 17:55:40 +05:30
Kefu Chai
f12dbaeaa3
Merge pull request #32427 from tchaikov/qa-devices-schema-with-path
qa: add "path" to "device" output schema

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-28 12:18:15 +08:00
Kefu Chai
5fe27c2267 qa/tasks/vstart_runner: write string to StringIO
we use `six.StringIO` for stdout when writing output messages from
`self.subproc.communicate()`, and `six.StringIO` accepts strings, so we
need to decode the output before sending them to `six.StringIO`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-28 01:11:54 +08:00
Kefu Chai
570f18f4c8 qa: add "path" to "device" output schema
"path" was added by 2c0fd7d868, so update
the test accordingly

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-27 00:25:51 +08:00
Kefu Chai
37fd93d67e qa/tasks/mgr/test_orchestrator_cli: fix "mon update" test
we need at least one of "hosts" and "label" since
1498170aaa

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-26 16:31:47 +08:00
Kefu Chai
4c6a5798c2
Merge pull request #32222 from toabctl/qa-flake8-py3
qa: Run flake8 on python2 and python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-24 10:47:07 +08:00
Sage Weil
5d8635d0d3 Merge PR #32377 into master
* refs/pull/32377/head:
	qa/suites/rados/thrash-old-clients: configure mons in terms of addrvecs
	qa/suites/rados/thrash-old-clients: hammer: fix package list
	qa/tasks/cephadm: set .conf to cluster config object
	qa/tasks/cephadm: archive /var/log/ceph logs too (not just cluster dir)
	qa/tasks/cephadm: client keyring
	qa/tasks/cephadm: setup thrashers ctx item
	qa/tasks/ceph_manager: asok commands via cephadm shell
	qa/suites/rados/thrash-old-clients: stick to el7
	qa/tasks/cephadm: check cluster log; support log-whitelist
	qa/suites/rados/thrash-old-clienets: python-foo to python3-foo
	qa/suites/rados/thrash-old-clients: add new exclude_packages
	qa/suites/rados/thrash-old-clients: use cephadm
	mon/ConfigMonitor: make legacy mon addr/port parseable by legacy code

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-23 17:54:30 -06:00