Commit Graph

3705 Commits

Author SHA1 Message Date
Yuval Lifshitz
4aa930e9f9
Merge pull request #48911 from yuvalif/test-kafka-sasl-scram
rgw: test kafka sasl scram

reviewed-by: anthonyeleven, cbodley
2023-03-07 20:20:28 +02:00
Venky Shankar
648c6c7722 Merge PR #48894 into main
* refs/pull/48894/head:
	qa/tasks/cephfs: add "extra data pool" cephfs-data-scan tests
	qa/tasks/cephfs: use cephfs tags when recreating osd caps
	tools/cephfs-data-scan: make data pool command args optional
	tools/cephfs-data-scan: support for multi-datapool
	cls/cephfs: extend accumulate_inode_metadata client method to store pool id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-06 09:42:32 +05:30
Venky Shankar
7f65724a25 Merge PR #49756 into main
* refs/pull/49756/head:
	qa: add test for 'dump dir'
	mds: add a command to dump directory information

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-02 19:41:10 +05:30
Venky Shankar
1426cdfaab Merge PR #50217 into main
* refs/pull/50217/head:
	qa: enable the xfstests generic/317 test case
	qa: make the xfstests tmp directories to be readable and excutable

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-03-02 11:04:33 +05:30
Yuval Lifshitz
b069ea3f12 rgw/kafka/tests: add SASL mechanism tests
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-03-01 16:15:14 +00:00
Mykola Golub
0c88aaa0a3 qa/tasks/cephfs: add "extra data pool" cephfs-data-scan tests
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2023-03-01 12:50:49 +02:00
Mykola Golub
6a384b5d7f qa/tasks/cephfs: use cephfs tags when recreating osd caps
to make it work when an extra data pool is added

Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2023-03-01 12:50:33 +02:00
Venky Shankar
cca84e653d Merge PR #48720 into main
* refs/pull/48720/head:
	qa: fix api failure issue caused during a dashboard test
	PendingReleaseNotes: noted new MDSMap field refuse_client_session
	qa: added two testcases
	client: do not initiate session if flag refuse_client_session is set
	mds: do not reconnect when refuse_client_session is set
	mds: add new feature to block clients from establishing sessions

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-01 07:54:18 +05:30
Xiubo Li
b150aec6a6 qa: enable the xfstests generic/317 test case
Since the permission denied bug has been fixed, just add the 317
test back.

Fixes: https://tracker.ceph.com/issues/58760
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-28 22:02:56 +08:00
Xiubo Li
8852b4d610 qa: make the xfstests tmp directories to be readable and excutable
The user namespace test case will excute some commands as the other
user. And the temporary direcotry now has the rx permission for
other users by default. The test then will fail otherwise.

Fixes: https://tracker.ceph.com/issues/58760
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-28 22:02:56 +08:00
Rishabh Dave
b88e917461 qa/cephfs: upgrade xfstests_dev.py for FUSE mounts
Add support for testing CephFS mounted with FUSE using xfstests-dev.

Fixes: https://tracker.ceph.com/issues/55354
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-25 16:03:45 +05:30
Rishabh Dave
d8749faf21
Merge pull request #50142 from rishabh-d-dave/fs-xfstests_dev-distro
qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2023-02-24 22:51:20 +05:30
Samuel Just
acedd169e4
Merge pull request #48516 from athanatos/sjust/wip-57801
crimson,mon: add guards to avoid accidental crimson deployment and to avoid usage of unsupported features with crimson

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2023-02-23 18:39:27 -08:00
Rishabh Dave
fec9be184d qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py
The string returned by get_system_type() for RHEL 8.4 recently wasn't
one of the strings that xfstests_dev.py expects. The string returned
this time was instead "rhel". Add this string to the list of strings
that xfstests_dev.py expects for Red Hat OS family so that this failure
won't occur again in future. Also log the detected distro and version so
that it is easier to debug when this issue occurs next time.

Fixes: https://tracker.ceph.com/issues/58726
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-23 22:31:27 +05:30
Rishabh Dave
4017bfa2c5
Merge pull request #46574 from rishabh-d-dave/xfstests-dev-improvements
qa/cephfs: improvements for xfstests_dev.py

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-02-23 17:08:53 +05:30
Radoslaw Zarzynski
6668814a17
Merge pull request #49528 from NitzanMordhai/wip-nitzan-filestore-removal
Reef: filestore removal

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-23 12:20:49 +01:00
Venky Shankar
da7928adab Merge PR #50196 into main
* refs/pull/50196/head:
	qa: export DIFF_LENGTH env parameter to print the full git diff

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-02-23 11:16:21 +05:30
Rishabh Dave
92aaaf7b57 qa/cephfs: save results dir from xfstests-dev repo
The "results" directory in xfstests-dev repo contains logs that are
created by it during execution of its tests. Copying this directory to
Ceph log directory saves it from being erased during tear down conducted
by teuthology test runner. These logs allow deeper inspection in to the
cause of failure of tests.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-22 20:44:29 +05:30
Rishabh Dave
053a1fb851 qa/cephfs: don't create symlinks for xfstests-dev
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-22 20:29:02 +05:30
Rishabh Dave
18465b8f56 qa/cephfs: modify user creation code for xfstests-dev
Create user "fsgqa2" and, since xfstests-dev's README uses option "-m"
while creating user "fsgqa", do the same in our codebase.

Creating user "fsgqa2" is optional along with other users according to
xfstests-dev's README. Create all these users is a preventive step since
tests needing user/users maybe skipped during execution.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-22 20:29:02 +05:30
Rishabh Dave
392e278749 qa/cephfs: log xfstests-dev local.config
Log contents of xfstests-dev repo config file "local.config" to make
debugging easier.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-22 20:29:02 +05:30
Rishabh Dave
4d75730200 qa/cephfs: minor changes in xfstests_dev.py
In xfstests-dev repo, local.config options "SCRATCH_DEV" and
"SCRATCH_MNT" were enabled in commit
2ba6b87105 but TODO comment for the
wasn't deleted. Let's delete that and use format string instead of
format function on regular string.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-22 20:29:02 +05:30
Rishabh Dave
49c7a79f8a qa/cephfs: make it easier to use xfstests-dev using vstart_runner
The intention of this re-arrangement is to make it easier for developers
to use an already cloned and built xfstests-dev repo  with
vstart_runner.py.

The re-arrangements are -

* move tearDown() closer to setUp() (so that devs can
  enable/disable parts of them easily),

* carve out separate methods (so that these codeblocks can be disabled
  in a single go) for -
  ** deleting groups and users,
  ** deleting xfstests-dev and xfsprogs-dev repo and
  ** building xfstests-dev repo

* carve out method for deleting xfstests-dev and xfsprogs-dev repos

* add self.xfstests_repo_path comment (for devs to set path to
  xfstests-dev repo), and,

* add a note showing how to use already cloned and built xfstests-dev
  repo

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-22 20:07:48 +05:30
Rishabh Dave
4a00b2bbb1 qa/cephfs: use standard name for logging variable
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-22 20:03:05 +05:30
Venky Shankar
ae6f1b18be Merge PR #50175 into main
* refs/pull/50175/head:
	cephfs: upgrade cephfs-shell's path wherever necessary

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-02-22 19:47:43 +05:30
Xiubo Li
0f9d3f2d3d qa: export DIFF_LENGTH env parameter to print the full git diff
From the xfstests-dev's README doc set DIFF_LENGTH to 0 will print
the full diff instead of the default 10.

This will be very helpful to debug the test failures, or we will
lose many valuable debug infomation.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-22 14:15:14 +08:00
Venky Shankar
86b90286cd Merge PR #49934 into main
* refs/pull/49934/head:
	qa: add test_fscrypt_dummy_encryption test case support
	qa: add 'options' parameter support for write_local_config
	qa: add ceph.exclude file to exclude individual tests
	qa: add require_kernel_mount helper support
	qa: rename test_fscrypt to test_fscrypt_encrypt

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-02-22 11:41:44 +05:30
Rishabh Dave
48ef044477 cephfs: upgrade cephfs-shell's path wherever necessary
Commit dc69033763 moves cephfs-shell from
"<CEPH-REPO-ROOT>/src/tools/cephfs/" to
"<CEPH-REPO-ROOT>/src/tools/cephfs/shell" but cephfs-shell's location in
src/vstart.sh and qa/tasks/cephfs/test_cephfs_shell.py is left
un-updated. This produces a broken vstart_environment.sh and broken
export command in test_cephfs_shell.py.

Introduced-by: dc69033763
Fixes: https://tracker.ceph.com/issues/58795
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-02-21 19:16:27 +05:30
Xiubo Li
b420db8dba qa: add test_fscrypt_dummy_encryption test case support
This will test around 130 test cases with the test_dummy_encryption
option enabled.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-21 16:15:12 +08:00
Xiubo Li
306b8bea4a qa: add 'options' parameter support for write_local_config
This will allow the fscrypt test case to add dedicated options.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-21 12:41:33 +08:00
Xiubo Li
002d45b589 qa: add ceph.exclude file to exclude individual tests
Skip some tests, which will take to much time or will fail, for now.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-21 12:41:30 +08:00
Venky Shankar
347acdf738 Merge PR #49154 into main
* refs/pull/49154/head:
	qa: add tests for cephfs-top
	doc: updates --dump and --dumpfs
	cephfs-top: dump values to stdout

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2023-02-21 09:33:18 +05:30
Casey Bodley
2a7301dbbb
Merge pull request #49950 from cbodley/wip-qa-ragweed-tox
qa/rgw: run ragweed tests with tox

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2023-02-20 09:29:50 -05:00
Casey Bodley
cc39576353 qa/rgw: update boto3 example path in notification_tests.py
fallout from https://github.com/ceph/ceph/pull/50102

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-02-18 09:30:55 -05:00
Casey Bodley
fc81fe705c qa/ragweed: run ragweed tests with tox
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-02-16 15:37:58 -05:00
Jos Collin
ddd20d4d4d
qa: add tests for cephfs-top
* Updated the existing tests
* Added new qa tests for --dump and --dumpfs options
* Updated the cluster configuration to 2 mds, 2 clients

Fixes: https://tracker.ceph.com/issues/57014
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-02-16 15:13:19 +05:30
Xiubo Li
0ee2f80367 qa: add require_kernel_mount helper support
This will simplify the code later.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-16 08:43:39 +08:00
Xiubo Li
b699307a34 qa: rename test_fscrypt to test_fscrypt_encrypt
The test_fscrypt_encrypt will only run the 'encrypt' related test
cases without 'test_dummy_encryption' option enabled. This will
test the filename and content verification.

After this I will add the whole test cases with 'test_dummy_encryption'
option.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-02-16 08:43:39 +08:00
Samuel Just
0449a4093e qa/task/ceph.py: set-allow-crimson for crimson clusters
Signed-off-by: Samuel Just <sjust@redhat.com>
2023-02-13 22:36:35 -08:00
Nitzan Mordechai
5008369a3e ceph_manager: removing filestore objectstore-tools file apply-layout-setting
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2023-02-12 06:11:29 +00:00
Nitzan Mordechai
d8202bc67c rados: upgrade suite test filestore removal
When upgrading osd with filestore to reef, restart should not be possible
the osd won't boot and error message will be showed in the osd log

Signed-off-by: Nitzan Mordechai <nmordec@redhat.com>
2023-02-12 06:11:29 +00:00
Nitzan Mordechai
4c4967dbb9 qa/suites: change all osd objectstore filestore
Removing and changing all suites to no longer use filestore

Signed-off-by: Nitzan Mordechai <nmordec@redhat.com>

ceph_volume: remove all filestore tests suites
Since filestore removed, no need to test it

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2023-02-12 06:11:29 +00:00
dparmar18
2ecd8d6490 qa: fix api failure issue caused during a dashboard test
2022-12-28 10:16:47,812.812 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-api/qa/tasks/mgr/dashboard/helper.py", line 712, in
2022-12-28 10:16:47,812.812 INFO:__main__:    _validate_json(val[key], sub_schema, path + [key])
2022-12-28 10:16:47,812.812 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-api/qa/tasks/mgr/dashboard/helper.py", line 711, in _validate_json
2022-12-28 10:16:47,812.812 INFO:__main__:    result = all(
2022-12-28 10:16:47,812.812 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-api/qa/tasks/mgr/dashboard/helper.py", line 712, in
2022-12-28 10:16:47,812.812 INFO:__main__:    _validate_json(val[key], sub_schema, path + [key])
2022-12-28 10:16:47,812.812 INFO:__main__:  File "/home/jenkins-build/build/workspace/ceph-api/qa/tasks/mgr/dashboard/helper.py", line 710, in _validate_json
2022-12-28 10:16:47,813.813 INFO:__main__:    raise _ValError('unknown keys: {}'.format(unknown_keys), path)
2022-12-28 10:16:47,813.813 INFO:__main__:tasks.mgr.dashboard.helper._ValError: In `input['fs_map']['filesystems'][0]['mdsmap']['flags_state']`: unknown keys: {'refuse_client_session'}

Fixes the above failure

Fixes: https://tracker.ceph.com/issues/57090
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2023-02-02 16:51:51 +05:30
Zhansong Gao
d4438d32ca qa: add test for 'dump dir'
Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
2023-02-01 18:52:38 +08:00
Rishabh Dave
44d7ab943e
Merge pull request #47753 from mchangir/mon-disable-snap-id-allocation-for-fsmap-pools
mon: disable snap id allocation for fsmap pools

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-01-30 16:35:04 +05:30
Ali Maredia
334d912acc
Merge pull request #49826 from cbodley/wip-qa-rgw-s3tests-tox
qa/s3tests: run with tox instead of bootstrap+nose

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2023-01-25 17:54:35 -05:00
Casey Bodley
955b1f3841
Merge pull request #49797 from cbodley/wip-58513
qa/openssl_keys: 'rm' ignores file not found

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2023-01-25 10:01:00 -05:00
Adam King
4d0cc762d7
Merge pull request #48428 from zmc/cephadm-smoke-small
qa/suites: Add orch/cephadm/smoke-small suite

Reviewed-by: Adam King <adking@redhat.com>
2023-01-24 09:08:44 -05:00
Casey Bodley
6238eaaf0b qa/s3tests: run with tox instead of bootstrap+nose
Fixes: https://tracker.ceph.com/issues/58512

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-01-22 23:27:24 -05:00
Adam King
919b244e5c
Merge pull request #46209 from phlogistonjohn/jjm-format-nfs-mod
mgr/nfs: use object_format decorators to simplify response handling

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-01-22 11:33:24 -05:00