RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-11 05:29:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
117,204 Commits 214 Branches 394 Tags 1.3 GiB
af6c6ace31
Commit Graph

1703 Commits

Author SHA1 Message Date
Patrick Donnelly
cfabba6668
Merge PR #34552 into master 
* refs/pull/34552/head:
	tests: add snap schedule tests
	snap-schedule: reject invalid retention specs
	mgr/snap_schedule: log snapshot name on creation
	pybind / snap_schedule: sanely dump schedules and retention specs
	pybind/snap_schedule: config option to allow minute granularity snaps
	pybind / snap_schedule: remove 'SNAP_SCHED_TESTING' check

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-18 07:54:15 -08:00
Josh Durgin
c2b9152eac
Merge pull request #37488 from kamoltat/wip-mgr-progress-turn-off-option 
mgr/progress: progress module on/off option

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2020-11-17 13:37:30 -08:00
Patrick Donnelly
f6639c80ed
Merge PR #35749 into master 
* refs/pull/35749/head:
	Update Release notes for multimds scrub
	qa/cephfs: log-ignorelist scrub errors
	qa/cephfs: Add more tests for multimds scrub
	qa/cephfs: add tests for multimds scrub
	qa/cephfs: update existing scrub test cases
	mds: don't skip validating disk state of symlink
	mds: abort/pause/resume scrubs in multiple mds
	mds: track scrub status in multiple mds
	mds: remove on_finish from {CInode,CDir}::scrub_info_t
	Continuation: don't delete self while there are in-processing stages
	mds: auth pin CInode when validating its disk state
	mds: rdlock file/nest lock when accumulating stats of subtree dirfrags
	mds: multiple mds scrub support
	include/frag: add encode/decode functions for fragset_t
	mds: remove object can't be scrubbed immediately from scrub stack
	mds: prevent dirfrag scrub/fragment from running at the same time
	mds: change scrub traverse from post-order to breadth-first search
	mds: make both CInode and CDir as entities of scrub
	mds: remove ScrubStack::scrubstack

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-17 07:33:20 -08:00
Venky Shankar
a8c8b3ade2 tests: add snap schedule tests 
Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2020-11-17 08:39:09 -05:00
Sridhar Seshasayee
b637909a91
Merge pull request #38007 from sseshasa/wip-qa-rados-perf-scheduler 
qa/suite/rados: Introduce "scheduler" directory within rados perf suite.

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
 2020-11-16 12:56:09 +05:30
Kamoltat
993bb02b30 mgr/progress: introduce turn off/on feature 
progress module can be turned off/on by using
the commands: 'progress off' and 'progress on'

As well as refractoring teuthology test suite
to prevent future bugs that can possibly occur

fixes: https://tracker.ceph.com/issues/47238

Signed-off-by: kamoltat <ksirivad@redhat.com>
 2020-11-16 03:46:42 +00:00
Yan, Zheng
c42570a329 qa/cephfs: log-ignorelist scrub errors 
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2020-11-16 09:10:03 +08:00
Yan, Zheng
904c959df4 qa/cephfs: add tests for multimds scrub 
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2020-11-16 09:02:18 +08:00
Kefu Chai
dfe9fce746
Merge pull request #35865 from tchaikov/wip-crimson-recovery-qa 
qa/suites: add crimson-rados suite

Reviewed-by: Samuel Just <sjust@redhat.com>
 2020-11-12 09:52:33 +08:00
Patrick Donnelly
d2769ff180
Merge PR #37978 into master 
* refs/pull/37978/head:
	qa: fix broken links in multimds suite

Reviewed-by: Jeff Layton <jlayton@redhat.com>
 2020-11-11 11:07:27 -08:00
David Zafman
9929588ce3
Merge pull request #37775 from dzafman/wip-upgrade-mimic-fix 
test: Remove mimic-x* upgrade testing in master

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
 2020-11-10 16:27:43 -08:00
Sridhar Seshasayee
ce5d0b37d2 qa/suite/rados: Introduce "scheduler" directory within rados perf suite. 
Introduce a "scheduler" directory under the rados:perf tree to allow perf
suite to specify tests with the default scheduler(WPQ) and also with
the dmClock scheduler. One specification also overrides the number of
shards(1) and the number of threads per shard(16) to test with apart from
the default settings. This allows testing and performance benchmarking
with the new proposal to use one shard and multiple threads per shard with
the dmClock scheduler.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
 2020-11-10 19:22:53 +05:30
Patrick Donnelly
4129ed92a2
qa: fix broken links in multimds suite 
Fixes: #37899
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-07 11:16:29 -08:00
Patrick Donnelly
a4941c1d5b
qa: ignore skip errors for kclient 
To avoid this failure:

	2020-11-01T07:21:35.117 INFO:tasks.cephfs_test_runner:test_volume_without_namespace_isolation (tasks.cephfs.test_volume_client.TestVolumeClient) ... ok
	2020-11-01T07:21:35.118 INFO:tasks.cephfs_test_runner:
	2020-11-01T07:21:35.118 INFO:tasks.cephfs_test_runner:======================================================================
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:FAIL: test_evict_client (tasks.cephfs.test_volume_client.TestVolumeClient)
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:Requires FUSE client to inject client metadata
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-11-01T07:21:35.119 INFO:tasks.cephfs_test_runner:Ran 18 tests in 732.749s
	2020-11-01T07:21:35.120 INFO:tasks.cephfs_test_runner:
	2020-11-01T07:21:35.120 INFO:tasks.cephfs_test_runner:FAILED (failures=1)

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:19 -08:00
Patrick Donnelly
f9ca58a3f3
qa: add more clients for test_volume_client 
It requires 4.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:16 -08:00
Patrick Donnelly
6afc98bd20
qa: ignore expected warning about client missing features 
2020-10-30T22:54:14.842 INFO:teuthology.orchestra.run.smithi168.stdout:2020-10-30T22:43:34.067194+0000 mds.a (mds.0) 1 : cluster [WRN] evicting session smithi168:0 (8757), missing required features '0x0000000000000400'

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:10 -08:00
Patrick Donnelly
eb3d38ccf7
qa: do not fail on skip 
Avoiding these failures:

	2020-10-30T22:49:00.248 INFO:tasks.cephfs_test_runner:test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) ...
	2020-10-30T22:49:00.248 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.248 INFO:tasks.cephfs_test_runner:FAIL: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.249 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.249 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.249 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.250 INFO:tasks.cephfs_test_runner:FAIL: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.250 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.251 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.251 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:FAIL: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.252 INFO:tasks.cephfs_test_runner:Ran 8 tests in 368.825s
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:FAILED (failures=3)
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.253 INFO:tasks.cephfs_test_runner:FAIL: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.254 INFO:tasks.cephfs_test_runner:FAIL: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:======================================================================
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:FAIL: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits)
	2020-10-30T22:49:00.255 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
	2020-10-30T22:49:00.256 INFO:tasks.cephfs_test_runner:Require FUSE client to inject client release failure

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:06 -08:00
Patrick Donnelly
3e25a080bc
qa: fix mount directory 
Otherwise we get this error:

	2020-10-30T03:57:44.256 INFO:teuthology.run_tasks:Running task exec...
	2020-10-30T03:57:44.265 INFO:teuthology.task.exec:Executing custom commands...
	2020-10-30T03:57:44.266 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi095.front.sepia.ceph.com
	2020-10-30T03:57:44.266 INFO:teuthology.orchestra.run.smithi095:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'cd $TESTDIR/mnt.* && dd if=/dev/zero of=./foo count=100'
	2020-10-30T03:57:44.380 INFO:teuthology.orchestra.run.smithi095.stderr:bash: line 0: cd: too many arguments

From: /ceph/teuthology-archive/pdonnell-2020-10-30_02:26:51-fs-master-distro-basic-smithi/5573179/teuthology.log

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:03 -08:00
Patrick Donnelly
c495b23090
qa: rename distro link to distros 
This needs to become any overrides present in "mount". Otherwise kclient
distro overrides have no effect.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:01:00 -08:00
Patrick Donnelly
83c361ff04
qa: some sessionmap tests require fuse 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:50 -08:00
Patrick Donnelly
6d880eac3f
qa: do not fail on test skip 
test_client_config only works with ceph-fuse.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:45 -08:00
Patrick Donnelly
a6ac673fc0
qa: use more OSDs for workload tests 
Running out of space / slow requests are less likely this way.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:42 -08:00
Patrick Donnelly
9861420771
qa: relocate tasks 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:37 -08:00
Patrick Donnelly
2e493a1d74
qa: rename workload suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:37 -08:00
Patrick Donnelly
9cacc92756
qa: relocate new tasks from fs:basic_functional 
These were not tested with kcephfs before, let's see if there's any
bugs!

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:37 -08:00
Patrick Donnelly
326f472950
qa: remove kcephfs suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
dbdb6537e2
qa: move kcephfs:mixed-clients to fs 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
853ce2a872
qa: remove dead kcephfs:cephfs suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
276de433d6
qa: merge snap tests for kcephfs/fs 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
218daa9a38
qa: add new fs:shell sub-suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
5458e66246
qa: remove task-less kcephfs:recovery suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
024d5b37f4
qa: add new fs:volumes sub-suite 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:36 -08:00
Patrick Donnelly
73c8c900bc
qa: merge fs:basic_functional and kcephfs:recovery 
These functional tests can be run with both clients.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
5bbd97fac1
qa: move kcephfs:thrash to fs:thrash 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
742d75a7fe
qa: reorganize thrash tasks 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
a9b7df2ebc
qa: move multifs/failover tests 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
e8642c742a
qa: run norstats workunit for klient 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
99bfa7cfe8
qa: merge workload tests from kcephfs with fs 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
43875d7bee
qa: remove inline testing 
inline feature is now deprecated and TBR.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:35 -08:00
Patrick Donnelly
49abce2290
qa: move log-rotate config to common yaml 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:34 -08:00
Patrick Donnelly
f719ebb305
qa: remove fuse default permissions config 
It is the default.

Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:34 -08:00
Patrick Donnelly
c4eaceaead
qa: fix whitespace 
Fixes: https://tracker.ceph.com/issues/23718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-11-03 13:00:34 -08:00
Jason Dillaman
9ca496a7d1 qa/suite/rbd: simple migration import test case 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2020-11-02 19:58:55 -05:00
Neha Ojha
1fa25e0780 qa/suites/rados/dashboard: ignore MON_DOWN 
This warning is expected during:

2020-10-27T16:29:40.549+0000 7fa1f0927700 10 mon.c@2(peon) e1 handle_auth_request haven't formed initial quorum, EBUSY

and is cleared after:

2020-10-27T16:29:42.597+0000 7fe7b3ada700  7 mon.a@1(peon).log v7 update_from_paxos applying incremental log 7 2020-10-27T16:29:42.319274+0000 mon.b (mon.0) 76 : cluster [INF] mon.b is new leader, mons b,a,c in quorum (ranks 0,1,2)
2020-10-27T16:29:42.597+0000 7fe7b3ada700  7 mon.a@1(peon).log v7 update_from_paxos applying incremental log 7 2020-10-27T16:29:42.326711+0000 mon.b (mon.0) 82 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum b,a)

Signed-off-by: Neha Ojha <nojha@redhat.com>
 2020-10-27 21:14:54 +00:00
Patrick Donnelly
c569036c5d
Merge PR #37629 into master 
* refs/pull/37629/head:
	qa/cephfs: add session_timeout option support
	qa/cephfs: move the cephfs's opertions setting to create()
	qa/cephfs: add 'cephfs:' section support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2020-10-25 16:26:36 -07:00
David Zafman
954b21fb13 test: Remove mimic-x* upgrade testing in master 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2020-10-24 00:01:24 +00:00
Neha Ojha
27871caa7f
Merge pull request #37678 from ideepika/wip-drop-hammer-from-qa 
qa: drop hammer branch qa tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2020-10-23 08:35:02 -07:00
Xiubo Li
0422673b61 qa/cephfs: add session_timeout option support 
When the mds revoking the Fwbl caps, the clients need to flush
the dirty data back to the OSDs, but the flush may make the OSDs
to be overloaded and slow, which may take more than 60 seconds to
finish. Then the MDS daemons will report the WRN messages.

For the teuthology test cases, let's just increase the timeout
value to make it work.

Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
 2020-10-23 14:27:37 +08:00
Xiubo Li
3b5303482f qa/cephfs: add 'cephfs:' section support 
Fixes: https://tracker.ceph.com/issues/47565
Signed-off-by: Xiubo Li <xiubli@redhat.com>
 2020-10-23 14:27:30 +08:00
Xuehan Xu
951f47fc1c qa/suites: add crimson-rados/thrash tests 
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2020-10-22 11:27:35 +08:00