Commit Graph

2603 Commits

Author SHA1 Message Date
Lenz Grimmer
10cb89241f
Merge pull request #37568 from s0nea/wip-dashboard-qa-linting
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-10-26 11:27:23 +01:00
Patrick Donnelly
c569036c5d
Merge PR #37629 into master
* refs/pull/37629/head:
	qa/cephfs: add session_timeout option support
	qa/cephfs: move the cephfs's opertions setting to create()
	qa/cephfs: add 'cephfs:' section support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-25 16:26:36 -07:00
Patrick Donnelly
e059e9666c
Merge PR #37652 into master
* refs/pull/37652/head:
	qa/tasks: tear down the background process before unmounting
	qa/tasks: switch to _kill_background() helper to terminate the daemons

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-10-25 16:25:24 -07:00
Neha Ojha
27871caa7f
Merge pull request #37678 from ideepika/wip-drop-hammer-from-qa
qa: drop hammer branch qa tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-10-23 08:35:02 -07:00
Lenz Grimmer
1e131d5a99
Merge pull request #36449 from s0nea/wip-dashboard-osd-flags-indiv
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-10-23 16:45:28 +02:00
Xiubo Li
0422673b61 qa/cephfs: add session_timeout option support
When the mds revoking the Fwbl caps, the clients need to flush
the dirty data back to the OSDs, but the flush may make the OSDs
to be overloaded and slow, which may take more than 60 seconds to
finish. Then the MDS daemons will report the WRN messages.

For the teuthology test cases, let's just increase the timeout
value to make it work.

Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-23 14:27:37 +08:00
Xiubo Li
cb8081ce7f qa/cephfs: move the cephfs's opertions setting to create()
Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-23 14:27:37 +08:00
Xiubo Li
3b5303482f qa/cephfs: add 'cephfs:' section support
Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-23 14:27:30 +08:00
Patrick Donnelly
24137e1ffa
Merge PR #36544 into master
* refs/pull/36544/head:
	vstart_runner: omit result line only when testcases are run one by one
	vstart_runner: don't quit running testsuite on a test failure

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-22 12:52:01 -07:00
Tatjana Dehler
1b67691492 mgr/dashboard/qa: add pylint check
Fixes: https://tracker.ceph.com/issues/47757
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-10-22 14:12:14 +02:00
Tatjana Dehler
1474259b65 mgr/dashboard/qa: add isort check
Add isort check to the QA test files and
fix issues.

Fixes: https://tracker.ceph.com/issues/47757
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-10-22 14:12:14 +02:00
Tatjana Dehler
bc3d1997bd mgr/dashboard/qa: add flake8 linting
Add flake8 linting to the QA test files and
fix issues.

Fixes: https://tracker.ceph.com/issues/47757
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-10-22 14:12:14 +02:00
Tatjana Dehler
3639332f34 mgr/dashboard: assign flags to single OSDs
Add the possibility to assign the flags ['noup',
'nodown', 'noin', 'noout'] to single OSDs.

Fixes: https://tracker.ceph.com/issues/40739
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-10-21 15:11:23 +02:00
Lenz Grimmer
7d9d3a60d5
Merge pull request #37416 from tspmelo/wip-rbd-clone
mgr/dashboard: Disable RBD clone action when conditions are not met

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-21 15:06:27 +02:00
Xiubo Li
7acd445fcc qa/tasks: tear down the background process before unmounting
If the background process keeps running by opening the mountpoint
directory, the unmount will fail with BUSY.

Fixes: https://tracker.ceph.com/issues/46883
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-21 04:02:38 -04:00
Xiubo Li
def177ff3b qa/tasks: switch to _kill_background() helper to terminate the daemons
Fixes: https://tracker.ceph.com/issues/46883
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-21 04:01:35 -04:00
Lenz Grimmer
2437ef8648
Merge pull request #36948 from bk201/wip-46492
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-10-20 12:58:51 +02:00
Patrick Donnelly
008eaca6c1
Merge PR #37529 into master
* refs/pull/37529/head:
	qa: set rados op timeouts for mds/ceph-fuse
	qa: print debug info on mount cleanup
	qa: remove redundant rmr
	qa: use null mode to prevent undesired changes to mountpoint
	qa: unmount all clients before deleting the file system
	osdc: add timeout configs for mons/osds
	common: accept timespan for SaferCond.wait_for

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-19 19:26:52 -07:00
Kiefer Chang
a9accaeccf mgr/dashboard: support Orchestrator and user-defined Ganesha clusters
This change make the Dashboard support two types of Ganesha clusters:

- Orchestrator clusters (Since Octopus)
  - Deployed by the Orchestrator.
  - The Dashboard gets the pool/namespace that stores Ganesha
    configuration objects from the Orchestrator.
  - The Dashboard gets the daemons in a cluster from the Orchestrator.

- User-defined clusters (Since Nautilus)
  - Clusters defined by using `ceph dashboard
    set-ganesha-clusters-rados-pool-namespace` command is treated as
    user-defined clusters.
  - Each daemon has its own RADOS configuration objects. The
    Dashboard uses these objects to deduce daemons.

Fixes: https://tracker.ceph.com/issues/46492
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-10-19 19:11:14 +08:00
Kefu Chai
3ec03efc70
Merge pull request #37175 from changchengx/log_start
common: remove log_early configuration option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-19 18:44:29 +08:00
Lenz Grimmer
86f6a89c1b
Merge pull request #37564 from s0nea/wip-dashboard-nfs-daemons-param
mgr/dashboard/qa: consider `daemons` parameter

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
2020-10-19 10:42:22 +02:00
Changcheng Liu
dbdcb2535d common: remove log_early configuration option
After deciding to always enable tracking log in early phase, there's no
need to keep "log_early" option here and remove it directly.

Suggested-by: Kefu Chai <kefu@redhat.com>
Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>
2020-10-19 14:30:28 +08:00
Deepika Upadhyay
7ef18559cb qa: drop hammer branch qa tests
fixes: https://tracker.ceph.com/issues/47731
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-10-15 17:32:06 +05:30
Kefu Chai
1d15e8c2d1
Merge pull request #37624 from lxbsz/cram
qa/tasks: add a 'parallel' option support for the cram task

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-15 18:53:38 +08:00
Kefu Chai
2724a73743
Merge pull request #37601 from tspmelo/wip-rm-wait-for-expected-get-result
qa/mgr: Remove _wait_for_expected_get_result

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-15 18:12:54 +08:00
Patrick Donnelly
f8f607dbd1
qa: print debug info on mount cleanup
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:16:40 -07:00
Patrick Donnelly
8e7a89009c
qa: remove redundant rmr
The mount.cleanup method will remove the mount point. This `rm -rf` will
always fail (with exit status 0).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:16:40 -07:00
Patrick Donnelly
2432871a1b
qa: use null mode to prevent undesired changes to mountpoint
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:16:40 -07:00
Patrick Donnelly
bc25bd70f2
qa: unmount all clients before deleting the file system
Otherwise we have unnecessary timeout waits.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:16:40 -07:00
Yan, Zheng
e76abf517b qa/cephfs: update ephemeral pin tests
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-10-13 20:52:40 +08:00
Rishabh Dave
f9f4c78101 vstart_runner: omit result line only when testcases are run one by one
vstart_runner omits the result line ("Ran X tests in Y") generated by
unittest unconditionally. Don't do so when vstart_runner triggers entire
test module at once.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-10-13 09:12:45 +05:30
Rishabh Dave
80ecc017e8 vstart_runner: don't quit running testsuite on a test failure
Add an option that makes it possible to not to quit running testsuite on
a test failure. This way user can get a better idea on the current state
of the testsuite and test its own code patches more effectively and
easily.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-10-13 09:12:45 +05:30
Patrick Donnelly
daa2f85156
Merge PR #29951 into master
* refs/pull/29951/head:
	test: add tests for validating MDS metrics via `perf stats` module
	test: Filesystem class helpers to grow and shrink MDS cluster
	mgr/stats: mds performance stats module
	mds: support sending empty perf metrics to ceph-manager

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-12 18:50:33 -07:00
Patrick Donnelly
473d8e9a60
Merge PR #37593 into master
* refs/pull/37593/head:
	qa/tasks/cephfs: Refactor test_volumes

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-12 07:42:13 -07:00
Xiubo Li
833eca15f2 qa/tasks: add a 'parallel' option support for the cram task
For the ceph-iscsi test case we need to run the tests sequentially,
because the client test will depend on the gateway ones.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-10-12 21:46:34 +08:00
Tatjana Dehler
1edaa17181
Merge pull request #37154 from bk201/wip-47397
mgr/dashboard: fix the error when exporting CephFS path "/" in NFS exports

Reviewed-by: Laura Paduano lpaduano@suse.com
Reviewed-by: Stephan Müller smueller@suse.com
Reviewed-by: Varsha Rao varao@redhat.com
2020-10-12 14:32:39 +02:00
Venky Shankar
a95b364e3e test: add tests for validating MDS metrics via perf stats module
Fixes: http://tracker.ceph.com/issues/24285
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Venky Shankar
5afdf26943 test: Filesystem class helpers to grow and shrink MDS cluster
These routines were test specific. Make them a part of Filesystem
class.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-10-12 07:34:51 -04:00
Ramana Raja
d1d5d61884 qa/tasks/cephfs: Refactor test_volumes
... into smaller test classes. This enables breaking up the volumes yaml
into smaller yaml fragments.

Fixes: https://tracker.ceph.com/issues/47160
Signed-off-by: Ramana Raja <rraja@redhat.com>
2020-10-12 13:54:40 +05:30
Patrick Donnelly
07ea8f5bca
Merge PR #37441 into master
* refs/pull/37441/head:
	qa: fix proc exit status check

Reviewed-by: Jos Collin <jcollin@redhat.com>
2020-10-09 18:41:24 -07:00
Lenz Grimmer
16e8df214c
Merge pull request #37064 from bk201/wip-47372
mgr/dashboard: fix error when typing existing paths in the Ganesha form

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-10-09 13:42:30 +02:00
Patrick Donnelly
2cb09bd4bd
Merge PR #36554 into master
* refs/pull/36554/head:
	mgr/volumes: Make number of cloner threads configurable

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Shyamsundar R <srangana@redhat.com>
2020-10-08 13:25:15 -07:00
Patrick Donnelly
5c9f77cb65
Merge PR #36457 into master
* refs/pull/36457/head:
	qa/tasks/cephfs: fix fs authorize cmd args
	mds: add root_squash mode in MDS auth caps
	vstart_runner: add write_file and sudo_write_file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-08 13:23:34 -07:00
Tiago Melo
ed237aa203 mgr/dashboard: Disable RBD clone action when conditions are not met
Disable clone action when RBD snapshot is not protected
and clone format version is 1.

Fixes: https://tracker.ceph.com/issues/37873

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-10-08 16:45:00 +00:00
Tiago Melo
a7ca0631d6 qa/mgr: Remove _wait_for_expected_get_result
Fixes: https://tracker.ceph.com/issues/47793

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-10-08 15:58:06 +00:00
Varsha Rao
97959d249a qa/tasks/cephfs/nfs: Check ganesha daemon status after restarting mgr
Fixes: https://tracker.ceph.com/issues/47591
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-10-06 22:56:05 +05:30
Tatjana Dehler
032a39e6f4 mgr/dashboard/qa: consider daemons parameter
Consider the values given by the `daemons` parameter
and do not use hard-coded values only.

Fixes: https://tracker.ceph.com/issues/47759
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-10-06 10:38:24 +02:00
Kiefer Chang
ee14ef7c60
mgr/dashboard: fix error when typing existing paths in the Ganesha form
- The `CephFS.ls_dir()` implementation in the backend had changed, the code in the
  UI endpoint `/ui-api/nfs-ganesha/lsdir` needs to adapt.
- Add fs_name as resource_id in `/ui-api/nfs-ganesha/lsdir/<fs_name>` to distinguish FS.
- Add more checks and unit tests.

Fixes: https://tracker.ceph.com/issues/47372
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-10-06 11:25:55 +08:00
Kefu Chai
fbb2cc49bf
Merge pull request #36732 from rishabh-d-dave/vr-rotate-logs
vstart_runner: rotate logs between testcases

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-04 13:28:39 +08:00
Rishabh Dave
864a15e7ca vstart_runner: rotate logs between testcases optionally
Fixes: https://tracker.ceph.com/issues/46059
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-09-29 14:52:47 +05:30