Commit Graph

842 Commits

Author SHA1 Message Date
Vasu Kulkarni
13e100259e qa/tasks: update mirror link for maven, the original mirror no longer exists
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2018-09-05 17:08:24 -07:00
Ilya Dryomov
a0df578139
Merge pull request #23905 from idryomov/wip-cram-suite-repo
qa/tasks/cram: use suite_repo repository for all cram jobs

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-09-04 14:27:28 +02:00
Lenz Grimmer
82412896ff
Merge pull request #23491 from p-na/per-osd-settings
mgr/dashboard: Add support for managing individual OSD settings in the backend

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-04 12:01:19 +02:00
Ilya Dryomov
0d8887652d qa/tasks/cram: use suite_repo repository for all cram jobs
Currently git.ceph.com is hardcoded for all cram jobs.  Testing
modifications is a pain: one needs to push to either ceph/ceph.git or
ceph/ceph-ci.git (depending on where the ceph branch is at, triggering
unnecessary builds in the latter case) and wait for the mirror to sync.
Runs scheduled against branches in developer's forks fail.

Move away from git.ceph.com to allow mixing branches and repositories,
similar to workunits.

Fixes: https://tracker.ceph.com/issues/27211
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2018-09-03 22:07:20 +02:00
Lenz Grimmer
65781a4fa2
Merge pull request #23322 from ricardoasmarques/wip-role-management-api
mgr/dashboard: Add REST API for role management

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-03 15:43:02 +02:00
Ricardo Marques
592e4f7c10 mgr/dashboard: Add REST API for role management
Fixes: https://tracker.ceph.com/issues/25138

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-09-03 13:15:42 +01:00
Patrick Nawracay
e71466cc49 mgr/dashboard: Add support for managing individual OSD settings (backend)
Add options to mark OSDs in/out/down/reweight/lost/remove/destroy/create

Fixes: http://tracker.ceph.com/issues/24270

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-09-03 12:51:04 +02:00
Sage Weil
2c26fb0fe1 rados: drop mkpool, rmpool commands
- mkpool and rmpool users should use the normal cli/mon commands

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 09:27:36 -05:00
Sage Weil
d6def8ba11 ceph-authtool: remove auid options
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 09:26:19 -05:00
Noah Watkins
ea15b625f3 qa/mgr/selftest: handle always-on module fall out
need a non-always-on module. hello doesn't work because it isn't
installed. so switch to selftest.

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-28 13:45:58 -07:00
Patrick Donnelly
3aa392ca73
Merge PR #23439 into master
* refs/pull/23439/head:
	qa: whitelist cap revoke warning
	doc: document cap revoke non-responders client eviction
	test: validate client eviction for cap revoke non-responders
	mds: add counter for tracking cap non-responding clients
	mds: evict clients that do not respond to cap revoke by MDS
	mds: pass timeout argument for fetching late clients

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-25 13:04:58 -07:00
David Zafman
687f63e599 test: Update tests for error message changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-08-23 11:09:22 -07:00
David Zafman
b40784290f qa: Add new message to whitelist for scrub/repair tests
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-08-23 11:09:22 -07:00
Kefu Chai
f7d452e8d1
Merge pull request #23558 from liewegas/wip-mgr-always-on
mgr: keep status, balancer always on
2018-08-22 00:18:30 +08:00
Venky Shankar
c0b1dacc9f test: validate client eviction for cap revoke non-responders
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-08-21 01:58:55 -04:00
Sage Weil
00223d2364 qa/tasks/mgr/test_module_selftest: use hello instead of status for disbled command test
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-18 09:29:00 -05:00
Patrick Donnelly
0b5df6e00a
qa: add cephfs-shell skeleton test case
Right now just tests that "help" works.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:13:36 -07:00
Casey Bodley
b2fe116d97
Merge pull request #23402 from cbodley/wip-23659
qa/rgw: patch keystone requirements.txt

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-08-14 16:53:30 -04:00
Patrick Nawracay
7340e70d7f mgr/dashboard/backend: API to manage dashboard settings
Enables to change (set/unset) values of settings of the dashboard using
the REST API.

Fixes: https://tracker.ceph.com/issues/24273

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-08-10 11:32:25 +02:00
Casey Bodley
338b97a8b9 qa/rgw: patch keystone requirements.txt
an ugly workaround for a python dependency conflict that's broken the
rgw/tempest suite. allows us to preserve the pinned versions of
keystone/tempest without having to maintain a fork of the keystone
repository

Fixes: http://tracker.ceph.com/issues/23659

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-02 16:43:42 -04:00
Patrick Donnelly
2ea86fa4d3
Merge PR #21948 into master
* refs/pull/21948/head:
	ceph_volume_client: use integer division for pg_num
	packages.yaml: install py3 compatible cephfs and rados bindings...
	qa: test py2 and py3 for volume client
	qa: make test_volume_client.py py3 compatible
	qa/ceph-volume: allow executing python pyloads using python3
	cephfs.pyx: add py3 compatibility
	ceph-volume-client: add py3 compatibility

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-01 21:42:27 -07:00
Casey Bodley
ce45875d80
Merge pull request #23145 from cbodley/wip-qa-rgw-admin-rest
qa/rgw: add radosgw-admin-rest task to singleton suite

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-08-01 13:52:40 -04:00
Ricardo Dias
47a50eeba5
Merge pull request #21881 from sebastian-philipp/dashboard-pool-patch
mgr/dashboard: Add Pool update endpoint 

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-08-01 10:00:10 +01:00
Patrick Donnelly
a5e3b0512c
qa: test py2 and py3 for volume client
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-30 16:12:48 -07:00
Rishabh Dave
f28274dc70
qa: make test_volume_client.py py3 compatible
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-07-30 16:12:48 -07:00
Rishabh Dave
2f35ade05f
qa/ceph-volume: allow executing python pyloads using python3
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-07-30 16:12:48 -07:00
Casey Bodley
3a55e13c44
Merge pull request #23143 from joke-lee/qa-admin-api-user-info-through-access-key
qa: add test for https://github.com/ceph/ceph/pull/22790

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 15:27:32 -04:00
Casey Bodley
b696c8493c qa/rgw: fix 'policy show' tests in radosgw_admin_rest task
'policy show' returns a json-encoded representation of
RGWAccessControlPolicy, while key.get_xml_acl() returns
RGWAccessControlPolicy_S3 encoded as xml. so even with '&format=xml',
the strings won't match

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:48 -04:00
Casey Bodley
638fa1de42 qa/rgw: add bucket-id param to 'bucket link' admin api test
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Casey Bodley
3b795cc2c3 qa/rgw: radosgw_admin_rest task tolerates empty responses
result.json() throws a 'JSONDecodeError: Expecting value: line 1 column 1'
for requests that return no body, such as 'user rm' 'key rm' 'subuser
rm', 'bucket unlink', etc

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Casey Bodley
975f34f2f6 qa/rgw: radosgw_admin_rest task uses rgw.role_endpoints for connections
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Casey Bodley
2f37710ce7 qa/rgw: radosgw_admin_rest task uses util.rgw.rgwadmin()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Lenz Grimmer
2fa86d1683
Merge pull request #22758 from ricardoasmarques/wip-user-management
mgr/dashboard: Ceph dashboard user management from the UI

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-07-26 00:27:07 +02:00
Yuri Weinstein
72909398b7
Merge pull request #23237 from neha-ojha/wip-whitelist-slow-requests
qa/tasks/thrashosds-health.yaml: whitelist slow requests
2018-07-25 12:36:17 -07:00
Neha Ojha
c0d9f7177c qa/tasks/thrashosds-health.yaml: whitelist slow requests
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-07-25 10:20:12 -07:00
Ricardo Marques
71d952b1e2 mgr/dashboard: Add user management API
Fixes: https://tracker.ceph.com/issues/24446

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-07-25 16:16:50 +01:00
Ricardo Marques
c4a1fe6b3b mgr/dashboard: Add asserError helper method
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-07-25 16:16:50 +01:00
Sebastian Wagner
0886de94b4 Check cluster health after each pool update
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-07-24 16:20:04 +02:00
Sebastian Wagner
70aa650014 Fixed qa tests:
* `s/_post/_task_post/g' for pools.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-07-24 16:20:04 +02:00
Stephan Müller
8506f02fe1 Small backend changes:
* Assert `pg_placement_num` has the same value as `pg_num`.
* Only set `application_metadata`, if not None.
* `osd pool set` only accepts strings.
* Sync `pgp_num` with `pg_num`.

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-07-24 16:20:04 +02:00
Sebastian Wagner
1f58ca5e36 mgr/dashboard: Make use of Tasks in pool API
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-07-24 16:20:04 +02:00
Sebastian Wagner
80106bcbc0 mgr/dashboard: Add Pool update endpoint
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-07-24 16:20:04 +02:00
Stephan Müller
34638d58af qa/mgr/dashboard: compression_max_blob_size is a str
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-07-24 16:20:04 +02:00
Stephan Müller
2b04699c61 mgr/dashboard: Pool API: app_metadata is now a str list
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-07-24 16:20:04 +02:00
John Spray
1d4e71ff1b
Merge pull request #22951 from jcsp/wip-mgr-intermodule
mgr: enable inter-module calls

Reviewed-by: Tim Serong <tserong@suse.com>
2018-07-24 10:25:59 +01:00
Patrick Donnelly
9dcbe8c33e
Merge PR #22977 into master
* refs/pull/22977/head:
	qa/tasks/cephfs: add test for discontinuous mdsmap
	mds: handle discontinuous mdsmap

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-20 20:53:06 -07:00
Patrick Donnelly
f61807bf78
Merge PR #22947 into master
* refs/pull/22947/head:
	test: validate empty json output during recursive scrub
	test: subclass test_scrub.Workload from CephFSTestCase
	mds: dump minimal cli output during recursive scrub trigger

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-07-20 20:13:24 -07:00
John Spray
d24e6cb32a mgr: generic self test command
Avoid need for each module to expose a self-test
command: they can just implement the method,
and then get it called via the selftest module.

As well as fewer LOC, this means that the self
test commands are not cluttering the interface
for end users, as they've invisible until
the selftest module is loaded.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-07-20 13:09:19 -04:00
John Spray
f02316adb4 mgr: enable inter-module calls
This is being done by passing native CPython objects
back and forth.  It's safe because sub-interpreters in CPython
share memory allocation infrastructure and share the GIL.

With a view to PEP554, we limit inter-interpreter calls
to pickleable objects, so that this may be implemented
using byte-arrays in future.

This infrastructure should enable:
 - the dashboard to display the status of other modules, for
   example the set of progress indicators from `progress`
 - dashboard and restful to share an underlying long running
   job mechanism.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-07-20 13:07:17 -04:00
yuliyang
30bd588300 qa: add test for https://github.com/ceph/ceph/pull/22790
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2018-07-20 22:22:37 +08:00