Commit Graph

764 Commits

Author SHA1 Message Date
Volker Theile
a98bca6a2f mgr/dashboard: Replace RGW proxy controller
Fixes: http://tracker.ceph.com/issues/24436

To fully support the role based authentication/authorization system it is necessary to replace the RGW proxy controller by separate controllers for RGW user and bucket.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-21 14:07:51 +02:00
Patrick Donnelly
111c515ab0
Merge PR #22569 into master
* refs/pull/22569/head:
	qa/cephfs: add test for "dump inode"
	mds: add dump inode command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-19 07:13:30 -07:00
Lenz Grimmer
ae4f4d315a
Merge pull request #22416 from votdev/get_rgw_api_user_via_rest
mgr/dashboard: Get user ID via RGW Admin Ops API

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-06-18 17:17:33 +02:00
taodd
0bd385f30b qa/cephfs: add test for "dump inode"
Signed-off-by: dongdong tao <tdd21151186@gmail.com>
2018-06-16 17:46:04 +08:00
Volker Theile
ed0750699e mgr/dashboard: Get user ID via RGW Admin Ops API.
The RGW API user id (set via 'ceph dashboard set-rgw-api-user-id <xxx>') is optional but the user ID is required internally for some situations. Because of that the user ID is requested via a RGW Admin Ops API call if it is not configured via CLI.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-15 16:24:33 +02:00
Patrick Nawracay
d7de1fa067 mgr/dashboard/backend: Enable get/set of cluster-wide OSD settings
Add ability to list, set and unset cluster-wide OSD flags.

Flags can be listed and changed through the `/api/osd/flags` API
resource. By using a GET request, the list is retrieved. By using a PUT
request, the flags are updated (all at once). Flags not contained in the
data of the PUT are removed, additional once are added. Note that the
PUT requests require a JSON body with the data contained as value of the
'flags' key like so:

    {"flags": ["flag1", "flag2", ...]}

Fixes: http://tracker.ceph.com/issues/24056

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-06-15 10:26:29 +02:00
Lenz Grimmer
d785010a35
Merge pull request #22303 from ricardoasmarques/wip-help-menu
mgr/dashboard: Add help menu entry

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-14 15:56:39 +02:00
Tatjana Dehler
9ebf5eb650 mgr/dashboard: add config options to documentation page
This commit adds the config options stored by the MON database to the
configuration documentation page.
One can filter for these config options by setting the 'Source' filter
to 'mon' on the configuration documentation page.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-06-13 15:39:24 +02:00
Ricardo Marques
a97991d480 mgr/dashboard: Summary endpoint should return ceph version
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-06-12 11:46:45 +01:00
Kefu Chai
16b84f7332 qa: wait longer for osd to flush pg stats
it's the test_create_from_mon()'s counterpart of 38074726.

Fixes: http://tracker.ceph.com/issues/24321
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-09 13:51:20 +08:00
Ricardo Marques
091e01ca71 mgr/dashboard: Login failure should return HTTP 400
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-06-06 11:45:09 +01:00
Lenz Grimmer
74c639e866
Merge pull request #22122 from tspmelo/wip-osd-scrub
mgr/dashboard: Add scrub action to the OSDs table

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-05 12:33:34 +02:00
Josh Durgin
ad3c1ec5d0
Merge pull request #22405 from neha-ojha/wip-24365
qa/tasks/cbt.py: changes to run on bionic

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-04 20:00:00 -07:00
Neha Ojha
bf62e1fadc qa/tasks/cbt.py: changes to run on bionic
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-06-04 17:23:21 -07:00
Tiago Melo
2783b021ec mgr/dashboard: Add scrub methods to OSD controller and service
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-04 14:49:54 +01:00
Kefu Chai
ea61464062
Merge pull request #21913 from tspmelo/wip-cephfs-table
mgr/dashboard: Add Filesystems list component

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-03 01:53:40 +08:00
Tiago Melo
7d842f20c0 mgr/dashboard: Remove unused data from summary controller
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-05-31 22:50:43 +01:00
Tiago Melo
f4d3b23555 mgr/dashboard: Refactor CephFS controller
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-05-31 22:50:43 +01:00
Jason Dillaman
21ec764499 qa/tasks: rbd_mirror_thrash should wait for daemon exit before restarting
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-05-31 09:48:47 -04:00
Kefu Chai
8f2761edb3
Merge pull request #22275 from tchaikov/wip-24321
qa: wait longer for osd to flush pg stats

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-29 11:26:11 +08:00
Kefu Chai
380747268a qa: wait longer for osd to flush pg stats
pg sends pg-stats to mgr every 5 seconds, so we cannot check for the
number of pgs right after creating the pool, at that moment, the number
of pgs could be 0, that's why manger.wait_for_clean() returns right
away, and leaves us with 0 pgs: the pgs serving the pool are still being
created. that's why `manager.get_num_active_clean()` returns `0`
sometimes. so, we should force osd to flush their stats to mgr, and wait
until the pg stats converages.

Fixes: http://tracker.ceph.com/issues/24321
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-28 19:41:48 +08:00
Ricardo Dias
8fb798fb93
mgr/dashboard: removed browsable api
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-05-24 10:42:24 +01:00
David Zafman
151de1797b test: wait_for_pg_stats() should do another check after last 13 second sleep
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-23 17:27:14 -07:00
Casey Bodley
ac36897f72
Merge pull request #22024 from votdev/bug_24142
rgw: Do not modify email if argument is not set

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-05-22 11:19:24 -04:00
Sage Weil
7f04b17234
Merge pull request #21982 from tchaikov/mgr-brag
mgr/telemetry: Add Ceph Telemetry module to send reports back to project
2018-05-20 21:34:12 -05:00
Sage Weil
fbf0e10af0
Merge pull request #22092 from liewegas/wip-mimic-upgrades
qa/suites/upgrade/luminous-x: a few fixes
2018-05-19 12:34:52 -05:00
Yan, Zheng
0edab5fcc3
Merge pull request #21941 from ukernel/wip-24053
mds: reply session reject for open request from blacklisted client
2018-05-19 17:07:40 +08:00
Yan, Zheng
e7d0b41dea qa/tasks/cephfs: add timeout parameter to kclient umount_wait
Just make caller happy. there is no easy way to support timeout.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/24053
2018-05-19 17:06:19 +08:00
Sage Weil
459b33e146 qa/suites/thrashosds-health: whitelist REQUEST_SLOW
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-18 14:01:33 -05:00
Volker Theile
c6792a8be2 rgw: Do not modify email if argument is not set
The RGW Admin OPS API overwrites the users email either it is not set via argument, e.g. when executing /{admin}/user?uid=test5&suspended=true.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-05-16 15:49:57 +02:00
Patrick Donnelly
8937f5f41a
Merge PR #21966 into master
* refs/pull/21966/head:
	mds: handle imported session race
	mds: check for session import race

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-05-14 13:29:29 -07:00
Patrick Donnelly
fbc25b4486
mds: check for session import race
Credit to Yan Zheng for identifying the race condition [1].

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1572555#c7

Test-for: http://tracker.ceph.com/issues/24072

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-14 12:52:50 -07:00
Wido den Hollander
394b10049e mgr/telemetry: Add Ceph Telemetry module to send reports back to project
This Manager Module will send statistics and version information from
a Ceph cluster back to telemetry.ceph.com if the user has opted-in on sending
this information.

Additionally a user can tell that the information is allowed to be made
public which then allows other users to see this information.

Signed-off-by: Wido den Hollander <wido@42on.com>
(cherry picked from commit 8f6137d162d2505eaefe489e16f3adffc7977cf8)
2018-05-14 23:34:25 +08:00
Volker Theile
83441af93c mgr/dashboard: Display useful info if RGW is not configured
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-05-14 12:58:29 +02:00
Kefu Chai
01c38041bc qa/tasks/mgr: fix test_pool.py
* per command desc of "osd pool set", "val" parameter should be a "string"
  not a number. so update the test_pool.py accordingly.
* also as a follow-up of 65925511bc, we need to update the test
  accordingly to reflect the change in the error's str representation.

Fixes: http://tracker.ceph.com/issues/24077
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-12 18:34:26 +08:00
Kefu Chai
3d772f2e4e
Merge pull request #21782 from wido/mgr-telegraf
mgr/telegraf: Telegraf module for Ceph Mgr

Reveiwed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-10 17:24:46 +08:00
Wido den Hollander
d15d510bab
mgr/telegraf: Telegraf module for Ceph Mgr
Telegraf is a agent for collecting and reporting metrics.

It has multiple inputs and can send data to various outputs like
for example InfluxDB or ElasticSearch.

This module works by using the socket_listener of Telegraf and can
send data over UDP, TCP and a local Unix Socket.

Signed-off-by: Wido den Hollander <wido@42on.com>
2018-05-09 16:00:15 +02:00
Volker Theile
a3cf914ded
Merge pull request #21066 from sebastian-philipp/dashboard_error_handling
mgr/dashboard: Improve exception handling

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-05-09 11:11:24 +02:00
Sebastian Wagner
3a34bae0fe mgr/dashboard: Applied Exception handling to RBDs
* DashboardTestCase: Removed waiter-thread

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:46:47 +02:00
Patrick Donnelly
3838674f65 qa: ignore version in auth metadata comp
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-08 20:15:24 +05:30
Ramana Raja
3a7fdb8b05 ceph_volume_client: allow volumes without namespace isolation
Fixes: https://tracker.ceph.com/issues/23695

Signed-off-by: Ramana Raja <rraja@redhat.com>
2018-05-08 20:15:15 +05:30
Sebastian Wagner
a49f39f60e mgr/dashboard: Change to Status Code 400 by default.
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:39:51 +02:00
Sebastian Wagner
c08999a59c mgr/dashboard: Improved Exception handling in Tasks
* Set default status code to 400
* Added tests
* Fixed globbing in `test_task.py`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:36:44 +02:00
Sebastian Wagner
dc616c7d72 mgr/dashboard: Applied Exception Handling
* Minor changes to CephFS, OSD, Pool, RbdMirroring, Summary and RGW

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:30:54 +02:00
Patrick Donnelly
e510e29e01
Merge PR #21712 into master
* refs/pull/21712/head:
	qa/tasks/cephfs: add test for renewing stale session
	client: invalidate caps and leases when session becomes stale
	client: fix race in concurrent readdir

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-07 15:53:32 -07:00
Patrick Donnelly
6a788bf203
qa: add mds deactivation procedure for upgrades
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 16:51:43 -07:00
Patrick Donnelly
c44adca121
Merge PR #21374 into master
* refs/pull/21374/head:
	qa: add test for snap format upgrade
	mds: initialize SnapServer::snaprealm_v2_since after journal replay
	mds: properly distinguish cap update from snap flush
	mds: update dev document of cephfs snapshot
	doc: add release notes for cephfs snapshot
	mds: allow snapshot by default for new filesystem
	mds: close past parents after snaprealm format gets converted
	mds: automaticly allow multi-active MDS after scrubbing all inodes
	mds: don't mark primary dentry damaged if inode has been repaired
	mds: upgrade snaprealm format during scrub
	mds: allow scrubbing mdsdir
	mds: cleanup scrub code
	mds: show health warning if multimds with old format snapshots
	mds: automaticly allow multi-active MDS after removing all old snapshots
	mds: disallow multi-active MDS if snapshot was ever created by pre-mimic mds
	mds: validate SnapInfo::long_name before using it
	mds: don't bump snaptable last_snap when renaming snapshot
	mds: properly save snaptable after upgrading version

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 09:45:04 -07:00
Patrick Donnelly
91942df5a6
qa: add test for snap format upgrade
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 09:09:03 -07:00
Yan, Zheng
5688476513 qa/tasks/cephfs: add test for renewing stale session
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-05-03 10:50:28 +08:00
Patrick Donnelly
36b51db0e6
qa: fix blacklisted check for test_lifecycle
Caused by: 36f89c5acf

Fixes: http://tracker.ceph.com/issues/23975

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-02 15:13:39 -07:00