Commit Graph

1222 Commits

Author SHA1 Message Date
Sage Weil
0b4ce2ab4c qa/tasks/ceph_manager: make is_{clean,recovered,active_or_down} less racy
Currently these can be thrown off if the cluster is creating or removing
pools at the same time.  Fix by taking a single snapshot of the pg stats
and based our judgement on that.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-10 11:04:49 -05:00
Casey Bodley
9aa1eeb37a
Merge pull request #28910 from yuvalif/wip-yuval-pubsub-test-fixes
rgw/pubsub: tests enhancements and fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-09 16:24:56 -04:00
Yuri Weinstein
695f41952d
Merge pull request #28932 from yuriw/wip-yuriw-40452-master_2
qa/tests: added ragweed coverage to stress-split* upgrade suites
2019-07-09 12:53:52 -07:00
Yuri Weinstein
0f6b30d600 qa/tests: added ragweed coverage to stress-split* upgrade suites
added ceph config set global bluestore_warn_on_legacy_statfs fals
changed user "foo" to "ragweed" in ragweed.py

Fixes: http://tracker.ceph.com/issues/40452
Fices: http://tracker.ceph.com/issues/40467
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 12:51:51 -07:00
Casey Bodley
bf99e58799
Merge pull request #28823 from cbodley/wip-qa-rgw-swift-server
qa/rgw: more fixes for swift task

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 11:16:42 -04:00
Yuval Lifshitz
38c23833b3 rgw/pubsub: fix duplicates due to multiple zone synching
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-07-07 13:48:40 +03:00
Yuval Lifshitz
1df809144c rgw/pubsub: run pubsub tests even if multisite fails
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-07-07 13:48:05 +03:00
Lenz Grimmer
797690c8b4
mgr/dashboard: Pool list shows current r/w byte usage in graph (#28153)
mgr/dashboard: Pool list shows current r/w byte usage in graph

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-03 11:26:30 +02:00
Lenz Grimmer
8a6aec4617
mgr/dashboard: Allow viewing and setting pool quotas (#27945)
mgr/dashboard: Allow viewing and setting pool quotas

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-03 11:20:25 +02:00
Kefu Chai
009bd79be2
Merge pull request #28731 from tchaikov/wip-40533
qa/tasks/ceph_manager.py: ignore errors in test_pool_min_size

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-02 17:45:06 +08:00
Patrick Donnelly
0e25e4bb4e
Merge PR #27073 into master
* refs/pull/27073/head:
	qa/tasks: Check MDS failover during mon_thrash
	qa/tasks: Compare two FSStatuses
	qa/suites/fs: renamed default.yaml to mds.yaml
	qa/suites/fs: mon_thrash test for fs
	qa/tasks: Fix typo in the comment

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-01 15:31:55 -07:00
Patrick Donnelly
fcd0c82e30
Merge PR #28642 into master
* refs/pull/28642/head:
	mds: check last laggy before marking unresponsive client stale
	mds: remove the code that skip evicting the only client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-01 14:56:54 -07:00
Casey Bodley
89fa4e71de qa/rgw: clean up arguments for swift task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-07-01 12:09:14 -04:00
Casey Bodley
ba3c17c4fa qa/rgw: swift task filters out config for skipped clients
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-07-01 12:08:11 -04:00
Casey Bodley
5e667c4f73 qa/rgw: swift task looks for rgw_server endpoint
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-07-01 12:07:16 -04:00
Venky Shankar
c404a30f5b
Merge pull request #28706 from ajarr/wip-fs-subvolumes-enhancements
mgr/volumes: minor enhancements and fixes
2019-06-27 19:38:49 +05:30
Kefu Chai
fbd4836d24 qa/tasks/ceph_manager.py: ignore errors in test_pool_min_size
to be specific, ignore errors when querying erasure coded pool's
erasure-code-profile. the pool might be removed after
"test_pool_min_size" lists all pools and before queries the pools'
erasure-code-profile. in that case, we should just continue on with the
next pool.

normally, the pools are created by the "radosbench" tasks. and they
don't delete the ec profiles after removing the ec pools using them, but
i don't want to rely on this fact. so, in this change, the `try` block
guards both `ceph osd pool get <pool_name> erasure_code_profile`
and `ceph osd erasure-code-profile get <profile>` calls.

Fixes: http://tracker.ceph.com/issues/40533
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-27 19:00:23 +08:00
Kefu Chai
1a2700f404 qa/tasks: extract {ERASURE_CODED,REPLICATED}_POOL out
so they can be reused by `Thrasher`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-27 19:00:23 +08:00
Ramana Raja
5c00cc30a1 mgr/volumes: allow setting mode
... of fs subvolumes and subvolume groups during their creation.

Fixes: https://tracker.ceph.com/issues/40299
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-06-27 02:07:56 +05:30
Ramana Raja
22ed891528 mgr/volumes: allow setting data pool layout
... of fs subvolumes and subvolume groups during their creation.

Fixes: https://tracker.ceph.com/issues/40431
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-06-27 01:36:33 +05:30
Kefu Chai
90022b35ab
Merge pull request #17619 from liuchang0812/wip-ec-below-min-size
osd: allow EC PGs to do recovery below min_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-22 12:58:55 +08:00
Casey Bodley
9b8be0584d qa/rgw: fix swift warning message
File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/swift.py", line 245, in task
    log.warning('Swift tests cannot run on rhel 7.6+, skipping client {client}'.format(client))
KeyError: 'client'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-21 15:18:59 -04:00
Patrick Donnelly
475f2deaf3
Merge PR #28561 into master
* refs/pull/28561/head:
	vstart_runner: upgrade the check for commands to be run as another user
	vstart_runner: split unicode arguments into lists

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 11:09:01 -07:00
Rishabh Dave
21a1b30a3e vstart_runner: upgrade the check for commands to be run as another user
Rectify the condition that checks if command to be issued as another
user using sudo is issued as a single argument after "-c".

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 21:35:38 +05:30
Patrick Donnelly
f26493cc25
Merge PR #28194 into master
* refs/pull/28194/head:
	test_volume_client: declare only one default for python version
	test_volume_client: don't shadow class variable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 06:27:04 -07:00
Rishabh Dave
d78e035432 test_volume_client: declare only one default for python version
Fixes: http://tracker.ceph.com/issues/40460
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 12:18:49 +05:30
Rishabh Dave
da441cb381 vstart_runner: split unicode arguments into lists
Split not just string arguments but also unicode arguments into lists.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 11:04:59 +05:30
Patrick Donnelly
ff1f04f4d5
qa: elide python version config
This test doesn't actually use the config and cephfs-shell is py3 only.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-19 18:22:51 -07:00
Rishabh Dave
4870574473 test_volume_client: don't shadow class variable
Name class and instance variables differently so that the latter doesn't
shadow the former.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-19 17:50:55 +05:30
Casey Bodley
09e992ff01 qa/rgw: extra s3tests tasks use rgw endpoint configuration
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-19 07:50:35 -04:00
Yan, Zheng
cd29206974 mds: remove the code that skip evicting the only client
There is already logic that defer marking unresponsive client stale.
No reason to defer evicting the only stale client.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-06-19 14:28:31 +08:00
Kiefer Chang
f57a3aae01
mgr/dashboard: support pool quotas in backend
Fixes: https://tracker.ceph.com/issues/36559
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-06-18 15:44:03 +08:00
Yuri Weinstein
10dfa31e23
Merge pull request #28605 from cbodley/wip-40304
qa/rgw: fix import error in tasks/swift.py

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-06-17 13:22:49 -07:00
Casey Bodley
2dd5574cf9 qa/rgw: fix import error in tasks/swift.py
> ImportError: No module named packaging

replaces packaging.version.Version with distutils.version.LooseVersion

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-17 15:07:40 -04:00
Stephan Müller
2f18cf5770 mgr/dashboard: Pool list shows current r/w byte usage in graph
Now the pool list will show the current read and write byte usage in the
sparkline graph like it is already done in the OSD listing.

Fixes: https://tracker.ceph.com/issues/39650
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-06-17 17:04:22 +02:00
Lenz Grimmer
61c7632a3d
mgr/dashboard: Add QA tests for RBD configuration (#27774)
mgr/dashboard: Add QA tests for RBD configuration

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-06-17 13:29:00 +02:00
Patrick Donnelly
85470cd171
Merge PR #28198 into master
* refs/pull/28198/head:
	qa/tasks: upgrade command arguments checks in vstart_runner.py

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-14 11:44:17 -07:00
Neha Ojha
94246359f2
Merge pull request #28522 from neha-ojha/wip-add-client-endpoints
qa/tasks/cbt.py: add support for client_endpoints

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-06-14 09:34:57 -07:00
Yuri Weinstein
2b3719264c
Merge pull request #28532 from cbodley/wip-40304
qa/rgw: skip swift tests on rhel 7.6+
2019-06-14 08:16:32 -07:00
Laura Paduano
a6636bd941
Merge pull request #28260 from s0nea/wip-dashboard-pool-delete-flag
mgr/dashboard: consider 'mon_allow_pool_delete' flag

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-06-14 12:02:02 +02:00
Casey Bodley
c0c00180bd
Merge pull request #28521 from alimaredia/wip-qa-rgw-ssl
qa: use curl in wait_for_radosgw() in util/rgw.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-13 15:00:21 -04:00
Ali Maredia
9c6afa3fb5 qa: use curl in wait_for_radosgw() in util/rgw.py
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-06-13 12:05:56 -04:00
Casey Bodley
c62f89fd75 qa/rgw: skip swift tests on rhel 7.6+
swift bootstrap fails because libev-devel is not available

Fixes: http://tracker.ceph.com/issues/40304

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-13 11:10:31 -04:00
Neha Ojha
143c1da2d2 qa/tasks/cbt.py: add support for client_endpoints
Note that this will only work for librbdfio for now.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-06-12 22:36:12 +00:00
Patrick Donnelly
c28ae6970f
Merge PR #27856 into master
* refs/pull/27856/head:
	test: remove fs/test-volume.sh workunit
	test: port fs/volume related tests to python

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-12 14:27:07 -07:00
Patrick Donnelly
9e1771472b
Merge PR #28221 into master
* refs/pull/28221/head:
	qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2019-06-12 14:15:30 -07:00
Venky Shankar
d92840b59e test: port fs/volume related tests to python
... and add subvolume related tests.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-06-12 12:43:17 -04:00
Lianne
7c7c7870d3 qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs
Fixes: http://tracker.ceph.com/issues/40184

Signed-off-by: Lianne <liyan.wang@xtaotech.com>
2019-06-11 18:27:06 +08:00
Yan, Zheng
1c8be588e3 qa/cephfs: update tests for stale session handling
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-06-08 21:15:14 +08:00
Patrick Donnelly
38fc69d0fa
Merge PR #28171 into master
* refs/pull/28171/head:
	test_volume_client: simplify test_get_authorized_ids()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-07 21:20:18 -07:00