Commit Graph

733 Commits

Author SHA1 Message Date
Patrick Donnelly
8937f5f41a
Merge PR #21966 into master
* refs/pull/21966/head:
	mds: handle imported session race
	mds: check for session import race

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-05-14 13:29:29 -07:00
Patrick Donnelly
fbc25b4486
mds: check for session import race
Credit to Yan Zheng for identifying the race condition [1].

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1572555#c7

Test-for: http://tracker.ceph.com/issues/24072

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-14 12:52:50 -07:00
Volker Theile
83441af93c mgr/dashboard: Display useful info if RGW is not configured
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-05-14 12:58:29 +02:00
Kefu Chai
01c38041bc qa/tasks/mgr: fix test_pool.py
* per command desc of "osd pool set", "val" parameter should be a "string"
  not a number. so update the test_pool.py accordingly.
* also as a follow-up of 65925511bc, we need to update the test
  accordingly to reflect the change in the error's str representation.

Fixes: http://tracker.ceph.com/issues/24077
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-12 18:34:26 +08:00
Kefu Chai
3d772f2e4e
Merge pull request #21782 from wido/mgr-telegraf
mgr/telegraf: Telegraf module for Ceph Mgr

Reveiwed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-10 17:24:46 +08:00
Wido den Hollander
d15d510bab
mgr/telegraf: Telegraf module for Ceph Mgr
Telegraf is a agent for collecting and reporting metrics.

It has multiple inputs and can send data to various outputs like
for example InfluxDB or ElasticSearch.

This module works by using the socket_listener of Telegraf and can
send data over UDP, TCP and a local Unix Socket.

Signed-off-by: Wido den Hollander <wido@42on.com>
2018-05-09 16:00:15 +02:00
Volker Theile
a3cf914ded
Merge pull request #21066 from sebastian-philipp/dashboard_error_handling
mgr/dashboard: Improve exception handling

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-05-09 11:11:24 +02:00
Sebastian Wagner
3a34bae0fe mgr/dashboard: Applied Exception handling to RBDs
* DashboardTestCase: Removed waiter-thread

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:46:47 +02:00
Patrick Donnelly
3838674f65 qa: ignore version in auth metadata comp
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-08 20:15:24 +05:30
Ramana Raja
3a7fdb8b05 ceph_volume_client: allow volumes without namespace isolation
Fixes: https://tracker.ceph.com/issues/23695

Signed-off-by: Ramana Raja <rraja@redhat.com>
2018-05-08 20:15:15 +05:30
Sebastian Wagner
a49f39f60e mgr/dashboard: Change to Status Code 400 by default.
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:39:51 +02:00
Sebastian Wagner
c08999a59c mgr/dashboard: Improved Exception handling in Tasks
* Set default status code to 400
* Added tests
* Fixed globbing in `test_task.py`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:36:44 +02:00
Sebastian Wagner
dc616c7d72 mgr/dashboard: Applied Exception Handling
* Minor changes to CephFS, OSD, Pool, RbdMirroring, Summary and RGW

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-05-08 16:30:54 +02:00
Patrick Donnelly
e510e29e01
Merge PR #21712 into master
* refs/pull/21712/head:
	qa/tasks/cephfs: add test for renewing stale session
	client: invalidate caps and leases when session becomes stale
	client: fix race in concurrent readdir

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-07 15:53:32 -07:00
Patrick Donnelly
6a788bf203
qa: add mds deactivation procedure for upgrades
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 16:51:43 -07:00
Patrick Donnelly
c44adca121
Merge PR #21374 into master
* refs/pull/21374/head:
	qa: add test for snap format upgrade
	mds: initialize SnapServer::snaprealm_v2_since after journal replay
	mds: properly distinguish cap update from snap flush
	mds: update dev document of cephfs snapshot
	doc: add release notes for cephfs snapshot
	mds: allow snapshot by default for new filesystem
	mds: close past parents after snaprealm format gets converted
	mds: automaticly allow multi-active MDS after scrubbing all inodes
	mds: don't mark primary dentry damaged if inode has been repaired
	mds: upgrade snaprealm format during scrub
	mds: allow scrubbing mdsdir
	mds: cleanup scrub code
	mds: show health warning if multimds with old format snapshots
	mds: automaticly allow multi-active MDS after removing all old snapshots
	mds: disallow multi-active MDS if snapshot was ever created by pre-mimic mds
	mds: validate SnapInfo::long_name before using it
	mds: don't bump snaptable last_snap when renaming snapshot
	mds: properly save snaptable after upgrading version

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 09:45:04 -07:00
Patrick Donnelly
91942df5a6
qa: add test for snap format upgrade
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 09:09:03 -07:00
Yan, Zheng
5688476513 qa/tasks/cephfs: add test for renewing stale session
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-05-03 10:50:28 +08:00
Patrick Donnelly
36b51db0e6
qa: fix blacklisted check for test_lifecycle
Caused by: 36f89c5acf

Fixes: http://tracker.ceph.com/issues/23975

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-02 15:13:39 -07:00
Patrick Donnelly
36f89c5acf
Merge PR #21065 into master
* refs/pull/21065/head:
	qa/cephfs: test if evicted client unmounts without hanging
	qa/tasks: allow custom timeout for umount_wait()
	client: don't hang when MDS sessions are evicted

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-02 09:07:31 -07:00
Kefu Chai
a5e815b992
Merge pull request #21627 from jcsp/wip-mgr-dashboard-ssl
mgr/dashboard: add TLS

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-05-02 09:58:28 +08:00
Yuri Weinstein
b28ab5616d
Merge pull request #20678 from ceph/wip-s3a-fix
fix s3atests that are failing for sometime

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-01 09:28:24 -07:00
Mykola Golub
6b752a3859
Merge pull request #21697 from dillaman/wip-18753-1
rbd-mirror: additional thrasher testing

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-04-30 18:25:35 +03:00
Rishabh Dave
b14302d1fe qa/cephfs: test if evicted client unmounts without hanging
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-04-30 12:02:56 +00:00
Rishabh Dave
18a9d0c491 qa/tasks: allow custom timeout for umount_wait()
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-04-30 12:02:56 +00:00
Patrick Donnelly
b381cb7ea1
Merge PR #21625 into master
* refs/pull/21625/head:
	qa: remove racy/buggy test_purge_queue_op_rate

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-04-29 11:05:06 -07:00
John Spray
b7a5da8bf0 qa: update dashboard tests for https://
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-27 09:58:47 -04:00
Jason Dillaman
de4587012d qa/suites/rbd: rbd-mirror fsx stress test
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-04-27 08:34:42 -04:00
Josh Durgin
f9dbfbe78f
Merge pull request #21656 from neha-ojha/wip-integrate-cosbench
qa/tasks: run cosbench using the CBT task

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-26 17:38:27 -07:00
Neha Ojha
8198936df1 qa/tasks: run cosbench using the CBT task
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-04-26 16:36:57 -07:00
Sage Weil
510762f51e
Merge pull request #21061 from jan--f/jan-prometheus-file-sd-command
pybind/mgr/prometheus: add file_sd_config command

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-04-26 12:39:51 -05:00
Lenz Grimmer
893857fcbd
Merge pull request #21526 from ricardoasmarques/wip-rbd-snapshot-clone
mgr/dashboard: RBD copy, RBD flatten and snapshot clone (frontend)

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-04-26 10:22:42 +02:00
Mykola Golub
808503f4d9
Merge pull request #21541 from dillaman/wip-18753
qa: introduce rbd-mirror thrasher to existing tests

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-04-25 16:07:16 +03:00
Jan Fajerski
2eb0b41407 pybind/mgr/prometheus: add file_sd_config command
This command returns a valid list of static targets pointing to the mgr
prometheus modules for a cluster. The output can be stored in a
file and the file be listed under the file_sd_config stanza in the
prometheus configuration.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-04-25 14:24:32 +02:00
Patrick Donnelly
b39972d911
qa: remove racy/buggy test_purge_queue_op_rate
Fixes: https://tracker.ceph.com/issues/23829

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-24 12:48:40 -07:00
Ricardo Marques
eeb87d3e42 mgr/dashboard: Add RBD default features REST API endpoint
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-04-24 16:50:37 +01:00
Ricardo Marques
838c9ce9e3 mgr/dashboard: RBD flatten
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-04-24 16:50:37 +01:00
John Spray
f959371a0a
Merge pull request #21607 from jcsp/wip-mgr-selftest-fixup
mgr: reconcile can_run checks and selftest

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-24 11:17:16 +01:00
Lenz Grimmer
83a740575a
Merge pull request #21602 from votdev/fix_rbd_form
mgr/dashboard: Adapt RBD form to new application_metadata type

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-04-24 11:33:33 +02:00
Patrick Donnelly
613d3b72cf
Merge PR #21536 into master
* refs/pull/21536/head:
	qa: check old_max_mds is not wiped by marked down twice
	MDSMonitor: do not wipe old_max_mds when marked down twice

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2018-04-23 21:27:55 -07:00
Kefu Chai
60e3a2404f qa/tasks/mgr: pass "--force" to "mgr module enable"
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-23 17:30:40 -04:00
Volker Theile
9a4d379705 mgr/dashboard: Fix bug in RBD form.
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-04-23 17:13:31 +02:00
Jason Dillaman
b28b2ee875 qa/tasks: thrasher for rbd-mirror daemon
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-04-23 10:22:50 -04:00
John Spray
4b3f026d07 qa: update mgr test for MgrModule.OPTIONS
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 10:14:31 -04:00
John Spray
d4ed33c2e0 qa: test mgr live configuration updates
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:47 -04:00
Stephan Müller
1b28705be5 mgr/dashboard: Add pool listing
Adds a new top level menu entry, called "Pool", which lists all pools
and contains a minimalistic detail view.

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-04-20 16:13:34 +02:00
Patrick Donnelly
378a6fcfe8
qa: check old_max_mds is not wiped by marked down twice
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-19 11:57:45 -07:00
Volker Theile
ee5c9ad03c mgr/dashboard: Modify RGW proxy response of errors to display a detailed message in the error notification.
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-04-19 11:35:13 +02:00
Patrick Donnelly
bb95292213
Merge PR #16608 into master
* refs/pull/16608/head:
	qa: whitelist mds down wrn during cephfs testing
	mds: add config to disable fragmentation
	qa: add max_mds thrash test
	qa: mds_thrash updates for new max_mds behavior
	doc: update upgrade procedure and release notes
	qa: add test for cluster resizing
	qa: remove use of mds deactivate
	cephfs: add new down/joinable fs flags
	mds: evict all clients if last mds shutting down
	cephfs: deprecate ceph mds deactivate
	cephfs: kill allow_dirfrags
	cephfs: Kill allow_multimds
	cephfs: Change behavior of cluster_down flag
	mon/FSCommands: Set extra MDS to standby
	cephfs: Health check changes
	mon/MDSMonitor: Remove command support for legacy syntax

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-18 14:36:54 -07:00
Patrick Donnelly
dde9ee1628
qa: add max_mds thrash test
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-17 11:26:56 -07:00