Commit Graph

1212 Commits

Author SHA1 Message Date
Lenz Grimmer
797690c8b4
mgr/dashboard: Pool list shows current r/w byte usage in graph (#28153)
mgr/dashboard: Pool list shows current r/w byte usage in graph

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-03 11:26:30 +02:00
Lenz Grimmer
8a6aec4617
mgr/dashboard: Allow viewing and setting pool quotas (#27945)
mgr/dashboard: Allow viewing and setting pool quotas

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-03 11:20:25 +02:00
Kefu Chai
009bd79be2
Merge pull request #28731 from tchaikov/wip-40533
qa/tasks/ceph_manager.py: ignore errors in test_pool_min_size

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-02 17:45:06 +08:00
Patrick Donnelly
0e25e4bb4e
Merge PR #27073 into master
* refs/pull/27073/head:
	qa/tasks: Check MDS failover during mon_thrash
	qa/tasks: Compare two FSStatuses
	qa/suites/fs: renamed default.yaml to mds.yaml
	qa/suites/fs: mon_thrash test for fs
	qa/tasks: Fix typo in the comment

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-01 15:31:55 -07:00
Patrick Donnelly
fcd0c82e30
Merge PR #28642 into master
* refs/pull/28642/head:
	mds: check last laggy before marking unresponsive client stale
	mds: remove the code that skip evicting the only client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-01 14:56:54 -07:00
Venky Shankar
c404a30f5b
Merge pull request #28706 from ajarr/wip-fs-subvolumes-enhancements
mgr/volumes: minor enhancements and fixes
2019-06-27 19:38:49 +05:30
Kefu Chai
fbd4836d24 qa/tasks/ceph_manager.py: ignore errors in test_pool_min_size
to be specific, ignore errors when querying erasure coded pool's
erasure-code-profile. the pool might be removed after
"test_pool_min_size" lists all pools and before queries the pools'
erasure-code-profile. in that case, we should just continue on with the
next pool.

normally, the pools are created by the "radosbench" tasks. and they
don't delete the ec profiles after removing the ec pools using them, but
i don't want to rely on this fact. so, in this change, the `try` block
guards both `ceph osd pool get <pool_name> erasure_code_profile`
and `ceph osd erasure-code-profile get <profile>` calls.

Fixes: http://tracker.ceph.com/issues/40533
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-27 19:00:23 +08:00
Kefu Chai
1a2700f404 qa/tasks: extract {ERASURE_CODED,REPLICATED}_POOL out
so they can be reused by `Thrasher`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-27 19:00:23 +08:00
Ramana Raja
5c00cc30a1 mgr/volumes: allow setting mode
... of fs subvolumes and subvolume groups during their creation.

Fixes: https://tracker.ceph.com/issues/40299
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-06-27 02:07:56 +05:30
Ramana Raja
22ed891528 mgr/volumes: allow setting data pool layout
... of fs subvolumes and subvolume groups during their creation.

Fixes: https://tracker.ceph.com/issues/40431
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-06-27 01:36:33 +05:30
Kefu Chai
90022b35ab
Merge pull request #17619 from liuchang0812/wip-ec-below-min-size
osd: allow EC PGs to do recovery below min_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-06-22 12:58:55 +08:00
Casey Bodley
9b8be0584d qa/rgw: fix swift warning message
File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/swift.py", line 245, in task
    log.warning('Swift tests cannot run on rhel 7.6+, skipping client {client}'.format(client))
KeyError: 'client'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-21 15:18:59 -04:00
Patrick Donnelly
475f2deaf3
Merge PR #28561 into master
* refs/pull/28561/head:
	vstart_runner: upgrade the check for commands to be run as another user
	vstart_runner: split unicode arguments into lists

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 11:09:01 -07:00
Rishabh Dave
21a1b30a3e vstart_runner: upgrade the check for commands to be run as another user
Rectify the condition that checks if command to be issued as another
user using sudo is issued as a single argument after "-c".

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 21:35:38 +05:30
Patrick Donnelly
f26493cc25
Merge PR #28194 into master
* refs/pull/28194/head:
	test_volume_client: declare only one default for python version
	test_volume_client: don't shadow class variable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-20 06:27:04 -07:00
Rishabh Dave
d78e035432 test_volume_client: declare only one default for python version
Fixes: http://tracker.ceph.com/issues/40460
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 12:18:49 +05:30
Rishabh Dave
da441cb381 vstart_runner: split unicode arguments into lists
Split not just string arguments but also unicode arguments into lists.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-20 11:04:59 +05:30
Patrick Donnelly
ff1f04f4d5
qa: elide python version config
This test doesn't actually use the config and cephfs-shell is py3 only.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-19 18:22:51 -07:00
Rishabh Dave
4870574473 test_volume_client: don't shadow class variable
Name class and instance variables differently so that the latter doesn't
shadow the former.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-19 17:50:55 +05:30
Casey Bodley
09e992ff01 qa/rgw: extra s3tests tasks use rgw endpoint configuration
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-19 07:50:35 -04:00
Yan, Zheng
cd29206974 mds: remove the code that skip evicting the only client
There is already logic that defer marking unresponsive client stale.
No reason to defer evicting the only stale client.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-06-19 14:28:31 +08:00
Kiefer Chang
f57a3aae01
mgr/dashboard: support pool quotas in backend
Fixes: https://tracker.ceph.com/issues/36559
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-06-18 15:44:03 +08:00
Yuri Weinstein
10dfa31e23
Merge pull request #28605 from cbodley/wip-40304
qa/rgw: fix import error in tasks/swift.py

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-06-17 13:22:49 -07:00
Casey Bodley
2dd5574cf9 qa/rgw: fix import error in tasks/swift.py
> ImportError: No module named packaging

replaces packaging.version.Version with distutils.version.LooseVersion

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-17 15:07:40 -04:00
Stephan Müller
2f18cf5770 mgr/dashboard: Pool list shows current r/w byte usage in graph
Now the pool list will show the current read and write byte usage in the
sparkline graph like it is already done in the OSD listing.

Fixes: https://tracker.ceph.com/issues/39650
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-06-17 17:04:22 +02:00
Lenz Grimmer
61c7632a3d
mgr/dashboard: Add QA tests for RBD configuration (#27774)
mgr/dashboard: Add QA tests for RBD configuration

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-06-17 13:29:00 +02:00
Patrick Donnelly
85470cd171
Merge PR #28198 into master
* refs/pull/28198/head:
	qa/tasks: upgrade command arguments checks in vstart_runner.py

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-14 11:44:17 -07:00
Neha Ojha
94246359f2
Merge pull request #28522 from neha-ojha/wip-add-client-endpoints
qa/tasks/cbt.py: add support for client_endpoints

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-06-14 09:34:57 -07:00
Yuri Weinstein
2b3719264c
Merge pull request #28532 from cbodley/wip-40304
qa/rgw: skip swift tests on rhel 7.6+
2019-06-14 08:16:32 -07:00
Laura Paduano
a6636bd941
Merge pull request #28260 from s0nea/wip-dashboard-pool-delete-flag
mgr/dashboard: consider 'mon_allow_pool_delete' flag

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-06-14 12:02:02 +02:00
Casey Bodley
c0c00180bd
Merge pull request #28521 from alimaredia/wip-qa-rgw-ssl
qa: use curl in wait_for_radosgw() in util/rgw.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-06-13 15:00:21 -04:00
Ali Maredia
9c6afa3fb5 qa: use curl in wait_for_radosgw() in util/rgw.py
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-06-13 12:05:56 -04:00
Casey Bodley
c62f89fd75 qa/rgw: skip swift tests on rhel 7.6+
swift bootstrap fails because libev-devel is not available

Fixes: http://tracker.ceph.com/issues/40304

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-13 11:10:31 -04:00
Neha Ojha
143c1da2d2 qa/tasks/cbt.py: add support for client_endpoints
Note that this will only work for librbdfio for now.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-06-12 22:36:12 +00:00
Patrick Donnelly
c28ae6970f
Merge PR #27856 into master
* refs/pull/27856/head:
	test: remove fs/test-volume.sh workunit
	test: port fs/volume related tests to python

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-12 14:27:07 -07:00
Patrick Donnelly
9e1771472b
Merge PR #28221 into master
* refs/pull/28221/head:
	qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2019-06-12 14:15:30 -07:00
Venky Shankar
d92840b59e test: port fs/volume related tests to python
... and add subvolume related tests.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-06-12 12:43:17 -04:00
Lianne
7c7c7870d3 qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs
Fixes: http://tracker.ceph.com/issues/40184

Signed-off-by: Lianne <liyan.wang@xtaotech.com>
2019-06-11 18:27:06 +08:00
Yan, Zheng
1c8be588e3 qa/cephfs: update tests for stale session handling
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-06-08 21:15:14 +08:00
Patrick Donnelly
38fc69d0fa
Merge PR #28171 into master
* refs/pull/28171/head:
	test_volume_client: simplify test_get_authorized_ids()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-07 21:20:18 -07:00
Patrick Donnelly
2c2cf856b2
Merge PR #28293 into master
* refs/pull/28293/head:
	mds: avoid passing null to SessionmMap::hit_session()
	qa/cephfs: add test for blacklisted client eviction
	mds: fix 'is session in blacklist' check in Server::apply_blacklist()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-07 21:16:14 -07:00
Patrick Donnelly
eaaf648ccb
Merge PR #28411 into master
* refs/pull/28411/head:
	qa/cephfs: fix test_evict_client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-06-07 21:12:38 -07:00
Neha Ojha
2780813667
Merge pull request #28442 from neha-ojha/wip-40120-port
qa/tasks/cbt.py: change port to work with client_endpoints

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-06-07 09:36:52 -07:00
Rishabh Dave
c086c13b22 qa/tasks: upgrade command arguments checks in vstart_runner.py
Exempt run.Raw from checks in vstart_runner.py as most of them are
meant for strings.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-06-07 13:20:06 +05:30
Neha Ojha
ee02416c65 qa/tasks/cbt.py: change port to work with client_endpoints
hack to work with https://github.com/ceph/cbt/pull/160/

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-06-06 17:21:38 -07:00
Lenz Grimmer
e7b605ae5b
mgr/dashboard: show degraded/misplaced/unfound objects. (#28104)
mgr/dashboard: show degraded/misplaced/unfound objects.

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-06-06 11:46:36 +02:00
Yan, Zheng
4fd0202fdf qa/cephfs: fix test_evict_client
explictly kill stale session, otherwise session count check is racy.

Fixes: https://tracker.ceph.com/issues/40173
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-06-05 22:04:22 +08:00
Yan, Zheng
89759654c1 qa/cephfs: add test for blacklisted client eviction
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2019-06-05 21:05:06 +08:00
Casey Bodley
8c8a706b6f qa/rgw: add dnsmasq back to s3a-hadoop
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00
Casey Bodley
658e5932fb qa/rgw: rgw task can override --rgw-dns-name on the command line
the value for rgw_dns_name isn't known until a machine is assigned, so
it can't be set via 'override: conf:'. add a per-client config option
to the rgw task so it can add the endpoint's hostname and/or s3website
hostname on the radosgw command line

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-06-03 13:07:41 -04:00