Commit Graph

871 Commits

Author SHA1 Message Date
Venky Shankar
8343471a0f
Merge pull request #40933 from vshankar/wip-50266
cephfs-mirror: sanitize `daemons status` JSON

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-27 12:22:37 +05:30
Varsha Rao
2a99da961a mgr/nfs: Don't enable nfs module by default
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-04-22 11:38:30 +05:30
Venky Shankar
18deb52f5d test: adjust mirroring test to use changed daemon status JSON
Fixes: http://tracker.ceph.com/issues/50266
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-20 21:18:54 -04:00
Sage Weil
3a7c72a9ed Merge PR #40411 into master
* refs/pull/40411/head:
	doc: add note about removal of the `cephfs` nfs cluster type
	mgr/volumes/nfs: drop `type` param during cluster create

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2021-04-16 10:48:04 -04:00
Patrick Donnelly
3a30edf3de
Merge PR #39660 into master
* refs/pull/39660/head:
	qa: Update the mdsmap schema in mgr/dashboard/test_health.py
	doc: add lsflags command to Administrative Commands document
	qa: test fs lsflags command
	mon: add command to print fs flags
	mds: print each flag value

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-15 21:03:19 -07:00
Michael Fritch
e9b2c38354
mgr/volumes/nfs: drop type param during cluster create
PR #37600 introduced support for both `cephfs` and `rgw` exports
to be configured using a single nfs-ganesha cluster

Fixes: https://tracker.ceph.com/issues/50369
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-04-14 18:21:36 -06:00
Patrick Donnelly
4d29e591dd
Merge PR #40481 into master
* refs/pull/40481/head:
	qa: test standby-replay with fs:workloads

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-09 20:04:32 -07:00
Patrick Donnelly
76ac006875
Merge PR #40431 into master
* refs/pull/40431/head:
	qa/cephfs: remove create_keyring_file from cephfs_test_case.py
	qa/cephfs: don't use sudo to write files in /tmp

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-04-09 20:02:27 -07:00
Patrick Donnelly
4702be4f47
qa: test standby-replay with fs:workloads
Fixes: https://tracker.ceph.com/issues/50045
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-08 11:37:56 -07:00
Rishabh Dave
511434ac5a qa/cephfs: remove create_keyring_file from cephfs_test_case.py
Since teuthology.orchestra.remote.mktemp() can write a temporary file
and not just create it, create_keyring_file() is now redundant.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-04-08 12:11:00 +05:30
Rishabh Dave
e213849581 qa/cephfs: don't use sudo to write files in /tmp
Files in /tmp cannot be written by any user( including the root user)
other than the file owner even if the permission mode on the file is
777.

Fixes: https://tracker.ceph.com/issues/49466
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-04-08 11:56:00 +05:30
Venky Shankar
714d51301b
Merge pull request #40342 from batrick/snap_schedule-qa-fixes
qa: snap_schedule test debugging

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-08 11:51:05 +05:30
Jos Collin
58b62f10d9
qa: test fs lsflags command
Fixes: https://tracker.ceph.com/issues/48682
Signed-off-by: Jos Collin <jcollin@redhat.com>
2021-04-08 11:09:18 +05:30
Patrick Donnelly
414b5593f0
Merge PR #40465 into master
* refs/pull/40465/head:
	test: bump up retries for `test_mirroring_init_failure_with_recovery` test
	test: fix typo
	test: disable mgr/mirroring for `test_mirroring_init_failure_with_recovery` test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-06 10:43:12 -07:00
Ramana Raja
433b70a483 qa/tasks/cephfs: create enough subvolumes
... in a subvolume group so that the desired number of ephmerally pinned
subtrees are created for the subvolume group, which has the distributed
ephemeral pin policy set on it.

Fixes: https://tracker.ceph.com/issues/48411
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-03-30 16:36:21 -04:00
Venky Shankar
6f4201d15f test: bump up retries for test_mirroring_init_failure_with_recovery test
The test could fail at times since the mirror daemon periodically
retries the failed state for a mirror enabled file system. This
flips the status reported via asok interface.

Fixes: http://tracker.ceph.com/issues/50020
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-29 02:53:16 -04:00
Venky Shankar
4ff70e94ac test: fix typo
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-29 02:53:16 -04:00
Venky Shankar
c0df8cf78d test: disable mgr/mirroring for test_mirroring_init_failure_with_recovery test
The test simulates failures by enabling mirroring for file system
via mon interface. Doing this does not create `cephfs-mirror` index
obejct that trips the mirror daemon to report failed status via
asok interface -- so that the test can verify this.

However, mgr/mirroring module gets to know that mirroring is
enabled for this file system (via FSMap) and tried to load the
directory map, but fails to do so and throws a backtrace in the
logs. Fix this by disabling mgr/mirroring before mirroring is
enabled via mon command.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-29 02:53:16 -04:00
Kefu Chai
73925c488a
Merge pull request #39969 from batrick/i49684
qa: wait for daemons to come up via cephadm

Reviewed-by: Sage Weil <sage@redhat.com>
2021-03-28 20:01:32 +08:00
Patrick Donnelly
6b461745af
qa: log snapshot changes during verification
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-23 18:24:42 -07:00
Patrick Donnelly
6b58fc35da
pybind/mgr/snap_schedule: log database updates for debugging
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-23 18:24:42 -07:00
Patrick Donnelly
25a513da06
qa: improve assertion check to aid debugging
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-23 18:24:41 -07:00
Patrick Donnelly
49241859b5
Merge PR #40146 into master
* refs/pull/40146/head:
	test: pass peer uuid when adding cephfs mirror peers
	mon: check cephfs mirror peer based on remote cluster spec and file system name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-22 20:03:41 -07:00
Patrick Donnelly
5000b33180
Merge PR #40145 into master
* refs/pull/40145/head:
	doc: add note about disabling standby-replay during upgrades
	qa: add test for standby-replay disable
	mon: fail standby-replay daemons when flag is turned off

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2021-03-22 20:03:02 -07:00
Patrick Donnelly
5292e88201
qa: reduce dependence on teuthology role list for mds
It's not yet possible to completely remove the dependency on
mds_ids/mds_daemons in the CephFS tests but this commit reduces it
enough for most code paths to work with cephadm.

The main change here is use of CephManager.do_rados, with some
improvements.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:07 -07:00
Patrick Donnelly
8e45af05c9
qa: remove get_lone_mds_id
This helps remove a dependence on the list of mds_daemons from
teuthology/cephadm.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:07 -07:00
Patrick Donnelly
0825d6aa9e
qa: simplify tests which stop MDS ranks
Instead of stopping MDS daemons and individually failing MDS daemons,
just fail the ranks or the entire file system, where possible.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
6ca48f6330
qa: use mds_tell for getting mds status
mds_asok is broken with cephadm currently due to [1].

[1] https://tracker.ceph.com/issues/48019#note-5

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
fe85001de2
qa: remove shutdown lockdep not relevant to unit test
This is part of a fleet of commits trying to remove unnecessary mds_stop
calls in testing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
4c3c69b230
qa: remove fallback for non-multifs ceph version
This code was for jewel (IIRC) or older.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Patrick Donnelly
eccf961697
qa: add Filesystem.reset helper
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-21 10:35:06 -07:00
Kotresh HR
92dc982318 mgr/volumes: Retain suid/guid bits in subvolume clone
Fixes: https://tracker.ceph.com/issues/49882
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2021-03-19 09:30:04 +05:30
Patrick Donnelly
facd7a59ae
Merge PR #39847 into master
* refs/pull/39847/head:
	qa/cephfs: don't expect "file exists" error for "mkdir -p"
	qa/cephfs: don't take parameter cwd in _create_mntpt()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-03-16 20:21:52 -07:00
Venky Shankar
f276782803 test: pass peer uuid when adding cephfs mirror peers
Fixes: http://tracker.ceph.com/issues/49822
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-16 03:03:16 -04:00
Patrick Donnelly
7925394ddf
qa: add test for standby-replay disable
Causes all standby-replay daemons to be removed.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-15 20:52:07 -07:00
Venky Shankar
cecc3a6982 test: add symbolic link synchronization test for cephfs-mirror
Fixes: http://tracker.ceph.com/issues/49711
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-12 03:53:42 -05:00
Venky Shankar
8ee88f5735 pybind/mirroring: add interface to list file system mirror peers
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-11 03:41:52 -05:00
Venky Shankar
3e13f48937 test: add tests for mirroring bootstrap interfaces
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-11 03:41:52 -05:00
Venky Shankar
d1585af77b test: add test for failed filesystem mirror instances
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-11 03:41:52 -05:00
Sebastian Wagner
1d2009c3e9
Merge pull request #39640 from sebastian-philipp/cephadm-cephfs-mirror
cephadm: cephfs-mirror

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2021-03-10 18:34:03 +01:00
Patrick Donnelly
4b506bbe4e
Merge PR #38913 into master
* refs/pull/38913/head:
	qa/tasks/cephfs/nfs: Add tests for updating fs exports
	mgr/volumes/nfs: Handle rook restart error
	doc/cephfs/nfs: Add about update export interface
	mgr/volumes/nfs: Add command to update cephfs exports
	pybind/volumes/nfs: set mds caps according to user specified access type
	mgr/volumes/module: Remove unused json module

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-10 07:01:27 -08:00
Sebastian Wagner
340281fe76 qa/tasks: some type annotations
Mostly for making my IDE aware of things

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-10 15:02:41 +01:00
Rishabh Dave
60d5d7cf9c qa/cephfs: don't expect "file exists" error for "mkdir -p"
Get rid of try-except block in _create_mntpt() since "mkdir -p" doesn't
raise any error when the directory to be created already exists. Also,
use chmod command instead of mkdir command to set the permission mode on
directory since mkdir command would have no effect on the directory's
permission mode if the directory already exists.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-03-10 12:05:15 +05:30
Rishabh Dave
1b34665741 qa/cephfs: don't take parameter cwd in _create_mntpt()
Accepting "cwd" as a parameter in _create_mntpt() methods was a mistake
that happened commit 5e71e9b065.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-03-10 12:04:41 +05:30
Patrick Donnelly
1cbad56fd2
Merge PR #37711 into master
* refs/pull/37711/head:
	qa/cephfs: create class LocalCephFSMount
	vstart_runner: reuse FuseMount methods in LocalFuseMount
	vstart_runner: reuse KernelMount methods in LocalKernelMount
	qa/cephfs: move common and generic methods mount.py
	qa/cephfs: refactor FuseMount.mount method
	qa/cephfs: refactor KernelMount.mount method

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-09 13:41:53 -08:00
Patrick Donnelly
be2958f489
Merge PR #39408 into master
* refs/pull/39408/head:
	test: add test for validating cephfs-mirror daemon service status
	pybind/mirroring: interface to fetch mirror daemon status
	cephfs-mirror: register mirror daemon with service manager
	cephfs-mirror: remove unneeded json_spirit header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-09 13:40:09 -08:00
Patrick Donnelly
fe31c23964
Merge PR #39814 into master
* refs/pull/39814/head:
	qa/cephfs: move is_blocklisted() to filesystem.CephCluster

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-09 13:36:40 -08:00
Kefu Chai
434c1ce400
Merge pull request #39775 from rishabh-d-dave/fs-qa-accept-cmds-as-str
qa/ceph_manager: accepts commands as str too

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-07 23:52:54 +08:00
Rishabh Dave
4d0f56fcc5 qa/cephfs: move is_blocklisted() to filesystem.CephCluster
Using self.fs.mon_manager in mount.py can lead to a crash since self.fs
can be None. Move is_blocklisted() to tasks.filesystem.CephCluster where
it can get access to mon_manager without depending on objects
representing Ceph FSs.

Fixes: https://tracker.ceph.com/issues/49511
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-03-06 09:11:36 +05:30
Venky Shankar
c0632f6bd5 test: add test for validating cephfs-mirror daemon service status
Fixes: http://tracker.ceph.com/issues/48943
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-03-05 01:00:01 -05:00