Commit Graph

9154 Commits

Author SHA1 Message Date
Rishabh Dave
eac83582f3 qa/cephfs: add check in test_acls.py
In xfstests-dev, "./check generic/abcd" doesn't end in error even when
there is no test abcd in generic. It's better to check the stdout to
verify success and print the returncode, stdout and stderr of the
command in logs so that such error can be found out by reading logs.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:44:37 +05:30
Rishabh Dave
d3b9543624 qa/cephfs: print cmd debug info when it fails
Print return code, stdout and stderr for the command that launches
xfstests-dev tests against CephFS when it fails.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:44:37 +05:30
Rishabh Dave
09d5e07d16 qa/cephfs: use StringIO instead of BytesIO
StringIO can be operated on without extra hassles of converting. So
replace BytesIO by StringIO in test_acls.py and xfstests_dev.py

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:43:41 +05:30
Rishabh Dave
1423f959e8 qa/cephfs: set omit_sudo to False in test_acls.py
When running "sudo ./check generic/099" in test_acls.py's test method
named test_acls(), set omit_sudo to False because without it
vstart_runner.py will remove "sudo" from command arguments and so the
command will fail unnecessarily.

Fixes: https://tracker.ceph.com/issues/55374
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:43:41 +05:30
Rishabh Dave
b60b73c0fe qa/cephfs: just import getLogger instead of whole module
Import just the necessary object instead of importing entire module.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-27 14:43:41 +05:30
Adam King
9268e32047
Merge pull request #45899 from rkachach/fix_issue_53527
mgr/cephadm: fixing upgrade candidate versions listing

Reviewed-by: Adam King <adking@redhat.com>
2022-04-26 15:09:37 -04:00
Neha Ojha
cf78cf4980
Merge pull request #46010 from gregsfortytwo/wip-55419-blocklist-test
test: Fix a blocklist API test

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-04-26 10:59:07 -07:00
Venky Shankar
76b33670b5
Merge pull request #44958 from rishabh-d-dave/qa-cephfs-timeout
qa/cephfs: change default timeout from 900 secs to 300

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-26 22:30:43 +05:30
Rishabh Dave
ac5de474cf qa/cephfs: change default timeout from 900 secs to 300
15 minutes is unnecessarily large as a default value for timeout for a
command. Not having to wait unnecessarily on a crash of a command will
reduce teuthology's testing queue and will save individual developer's
time while running tests locally.

Whatever lines are modified for this purpose are also modified to follow
the stlye guideline, specfically wrapping at 80 characters.

Fixes: https://tracker.ceph.com/issues/54236
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-26 18:34:42 +05:30
Samuel Just
f6a9ee72d7 bluestore: Revert "os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation"
Merge caused: https://tracker.ceph.com/issues/55433

Signed-off-by: Samuel Just <sjust@redhat.com>
2022-04-25 12:33:45 -07:00
Greg Farnum
63db714890 test: use the same address input format as output will generate
Otherwise, our grep fails!

Fixes: https://tracker.ceph.com/issues/55419

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2022-04-23 00:00:59 +00:00
Samuel Just
78ffeb71a0
Merge pull request #43413 from esmaeil-mirvakili/bluestore-bufferbloat-mitigation
os/bluestore: Add CoDel to BlueStore for Bufferbloat mitigation

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-04-22 14:37:04 -07:00
Redouane Kachach
671442c4b4
mgr/cephadm: fixing upgrade candidate verions listing
Fixes: https://tracker.ceph.com/issues/53527

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-04-22 15:54:57 +02:00
Adam King
5720cca2f8
Merge pull request #45920 from adk3798/stop-mgr-nfs-upgrade-fail
qa/suites/orch/cephadm: stop upgrade tests if failures are seen

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-04-22 09:28:35 -04:00
Gregory Farnum
6536d0c1af
Merge pull request #44151 from gregsfortytwo/wip-cidr-blocklist
Implement CIDR blocklisting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-04-21 08:31:16 -07:00
Venky Shankar
91dcd8bda1
Merge pull request #45971 from rishabh-d-dave/cephfs-shell-exclam-marks
qa/cephfs: bug fix and some cleanup for test_cephfs_shell.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-21 18:52:20 +05:30
Rishabh Dave
a4bbb62bd6 qa/cephfs: cleanup some code in test_cephfs_shell.py
Also delete a comment since it's incorrect.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-21 16:47:39 +05:30
Rishabh Dave
faa506798d qa/cephfs: don't use exclam mark in tests in test_cephfs_shell.py
Exclamation mark is a special character for bash as well as
cephfs-shell. For bash, it substitutes current command with matching
command from command history and for cephfs-shell it runs the command
as OS-level command and not inside the cephfs-shell.

And evey command executed in tests (say "ls") is run by passing it as a
parameter to cephfs-shell command (that is "cephfs-shell -c <conf> --
ls"). So, exclamation mark, when used in tests, is consumed by bash
instead of cephfs-shell.

To avoid these complications it's best (and even simpler!) to issue the
command meant for bash on bash without going through cephfs-shell.

Fixes: https://tracker.ceph.com/issues/55394
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-21 16:40:29 +05:30
Ionut Balutoiu
d8113881a2 qa/crontab/teuthology-cronjobs: add windows suite
Signed-off-by: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
2022-04-20 19:56:23 +03:00
Ionut Balutoiu
8054199787 qa: add basic Ceph on Windows integration test
Due to lack of Windows support in the Teuthology, the test case adopts
the following workaround:

* Deploy baremetal machine with `ubuntu_latest.yaml` and
  configure it with libvirt KVM.
* Create a libvirt VM and provision it with Windows Server 2019, using
  the official ISO from Microsoft.
* Configure SSH in the Windows VM, and run the tests remotely via SSH.

The implementation of the test case consists of workunit scripts.

`qa/workunits/windows/test_rbd_wnbd.py` is the main Python script
to test Ceph on Windows basic functionality. This is executed in the
libvirt VM configured with Windows Server 2019.

Co-authored-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
Co-authored-by: Daniel Vincze <dvincze@cloudbasesolutions.com>

Signed-off-by: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
2022-04-19 17:21:52 +03:00
Venky Shankar
3f13df8388
Merge pull request #45603 from nmshelke/feature-54472
mgr/volumes: set, get, list and remove metadata of subvolume

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-19 16:52:13 +05:30
Venky Shankar
73e806b7da
Merge pull request #43879 from rishabh-d-dave/vr-clearer-msg
qa/vstart_runner: print "success" explicitly

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-18 15:27:52 +05:30
Venky Shankar
4070f734ee
Merge pull request #45924 from rishabh-d-dave/qa-cephfs-test_cephfs_shell
qa/cephfs: expand note for test_cephfs_shell.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-18 15:02:55 +05:30
Rishabh Dave
bc02c3c7e9 qa/cephfs: expand note for test_cephfs_shell.py
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-18 13:15:10 +05:30
Rishabh Dave
902420cbd4 qa/vstart_runner: print "success" explicitly
This makes it effortless for new vstart_runner.py users to spot that the
test passed.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-04-18 10:39:08 +05:30
Venky Shankar
1ac01c60df
Merge pull request #45816 from kotreshhr/clone-failure-status
mgr/volumes: Show clone failure reason in clone status command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-18 09:43:40 +05:30
Adam King
017aa9cfe8 qa/suites/orch/cephadm: stop upgrade tests if failures are seen
Otherwise the tests may run forever. This was already done for
mds upgrade sequence, justadding it in the other two places here

Related to: https://tracker.ceph.com/issues/53939

Signed-off-by: Adam King <adking@redhat.com>
2022-04-17 12:21:44 -04:00
Adam King
5360de431d
Merge pull request #45765 from m-ildefons/1196785-cephadm-status-trace
cephadm: avoid crashing on expected non-zero exit

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-04-15 11:05:05 -04:00
Venky Shankar
b4ea90ad82
Merge pull request #45549 from nmshelke/fuse-linux-only
ceph-fuse: restrict already_fuse_mounted function only for linux

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-14 17:38:20 +05:30
Venky Shankar
8316aa95fc
Merge pull request #45636 from joscollin/wip-B54971-rank0-stale-perf-stats-assertion-error
qa: make test_perf_stats_stale_metrics check only the clients created for the tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-14 17:36:42 +05:30
Venky Shankar
1380b565b8
Merge pull request #45683 from kotreshhr/subvolume-retainsnap-rm-fix
mgr/volumes: Fix idempotent subvolume rm

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-04-14 17:31:46 +05:30
Moritz Röhrich
a02be6f22f
cephadm: avoid crashing on expected non-zero exit
- Avoid crashing when a call out to an external program expectedly does
  not return exit status zero.

There are programs that communicate other information than error/no
error through exit status. E.g. `systemctl status` will return different
exit codes depending on the actual status of the units in question.
In cases where this is expected crashing with a RuntimeError exception
is inappropriate and should be avoided.

Fixes: https://tracker.ceph.com/issues/55117
Signed-off-by: Moritz Röhrich <moritz.rohrich@suse.com>
2022-04-13 17:22:22 +02:00
Kotresh HR
916a5981cf qa: Add test for clone failure status
Fixes: https://tracker.ceph.com/issues/55190
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-04-13 14:26:20 +05:30
Greg Farnum
1ca89ca76d test: check range blocklist in cephtool/test.sh
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2022-04-13 00:14:16 +00:00
Greg Farnum
8246892172 test: fix negative blocklist tests
These tests are supposed to be validating we don't accept invalid IPs,
but they left out the "add" subcommand so they're all failing on that!

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2022-04-13 00:14:16 +00:00
Ilya Dryomov
88db8db1b4
Merge pull request #45798 from adk3798/iscsi-only-pid-limit
cephadm: only apply unlimited pids-limit to iscsi and rgw

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-04-11 16:02:50 +02:00
Ilya Dryomov
a23b9c9938 qa: test_iscsi_pids_limit.sh: increase sleep time
It could take longer than 30 seconds to fork off 40000 processes on
a busy system.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-04-11 13:15:22 +02:00
Laura Flores
bd82d21943
Merge pull request #45749 from josephsawaya/fix-rook-tests
Remove orchestrator from rook task and suite
2022-04-08 16:36:38 -05:00
Casey Bodley
1ab04ddc38
Merge pull request #45304 from dvanders/cleanup_46456
rgw_reshard: drop olh entries with empty name

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-04-08 09:05:33 -04:00
Dan van der Ster
16511fd15f workunits/rgw: reshard cleans empty name entries
Check that reshard prunes olh entries with empty name.

Fixes: https://tracker.ceph.com/issues/54500
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2022-04-07 18:12:06 +02:00
Nikhilkumar Shelke
d1f4ecd557 qa: set, get, list and remove custom metadata for subvolume
Following test are added:
1. Set custom metadata for subvolume.
2. Set custom metadata for subvolume(Idempotency).
3. Get custom metadata for specified key.
4. Get custom metadata if specified key not exist (Expecting error ENOENT).
5. Get custom metadata if no any key-value is added means section not exist (Expecting error ENOENT).
6. Update value for existing key in custom metadata.
7. List custom metadata of subvolume.
8. List custom metadata of subvolume if no any key-value is added (Expect empty json/dictionary)
9. Remove custom metadata for specified key.
10. Remove custom metadata if specified key not exist (Expecting error ENOENT).
11. Remove custom metadata if no any key-value is added means section not exist (Expecting error ENOENT).
12. Remove custom metadata with --force option.
13. Remove custom metadata with --force option if specified key not exist (Expecting command to succeed because of '--force' option)
14. Set and Get custom metadata for legacy subvolume.
15. List and Remove custom metadata from legacy subvolume.

Fixes: https://tracker.ceph.com/issues/54472
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-04-07 12:30:42 +05:30
David Galloway
fcd512b50b qa: Latest RHEL8 -> RHEL8.5
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-04-01 15:00:01 -04:00
Joseph Sawaya
043a330ed0 Remove orchestrator from rook task and suite
This commit removes orchestrator commands from the
Rook task and the Rook test suite because the Rook
orchestrator is not being maintained, and the Rook
orchestrator CLI is obsolete. This should also
clarify the issue:

https://tracker.ceph.com/issues/53680

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2022-04-01 11:37:55 -04:00
Adam King
6e4dd0e082
Merge pull request #45361 from adk3798/mds-upgrade-test
qa/suites/fs: stop looping in mds upgrade test if upgrade failed

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-30 18:56:45 -04:00
Kotresh HR
15a2ab4e26 mgr/volumes: Fix idempotent subvolume rm
The subvolume deletion of a subvolume which is already deleted
with retain snapshots option fails with 'EAGAIN: clone in progress'
error. After subvolume deletion with retain snapshots, the subvolume
exists until the trash directory (resides inside subvolume) is
cleaned up. The subvolume deletion issued while the trash directory is not empty, should
pass. This patch fixes the same.

Credit: Issue discovery and fix suggestion to John Mulligan <jmulligan@redhat.com>
Fixes: https://tracker.ceph.com/issues/54625
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-03-29 10:57:47 +05:30
Nikhilkumar Shelke
23b3a27eaa ceph-fuse: restrict already_fuse_mounted function only for linux
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-03-28 13:25:09 +05:30
Sridhar Seshasayee
3aa2df2e0f qa/standalone: Fix test_activate_osd() test in ceph-helpers.sh
Modify test_activate_osd() to get the type of scheduler in use and then
verify the value of osd_max_backfills. This is because mclock scheduler
overrides this option to 1000 upon OSD initialization.

The test earlier used to pass because the OSD daemon was killed but not
marked down and upon being brought up, the wait for OSD up check was
passing quickly. But the OSD still didn't have the latest config values.

But now upon killing the OSD, the osd_fast_shutdown sequence notifies the
mon (see PR: https://github.com/ceph/ceph/pull/44807) and is marked down
and dead. Upon bringing it up, the wait for OSD up check takes a longer
time and this is sufficient for the config values to be updated. This
results in the correct values being read from the config 'Values' map.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-25 22:10:31 +05:30
Jos Collin
1621308214
qa: make test_perf_stats_stale_metrics check only the clients created for the tests
Uses the client's global id to get the metrics, instead of using the index.
This ensures that test_perf_stats_stale_metrics checks only the clients mounted for
the tests.

Fixes: https://tracker.ceph.com/issues/54971
Signed-off-by: Jos Collin <jcollin@redhat.com>
2022-03-25 18:19:48 +05:30
Milind Changire
ac6c7240d3 qa: test snap_schedule with mgr restart
Scheduled snaps should follow the created schedule even across mgr
restart.

Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-03-24 18:01:44 +05:30
Ilya Dryomov
f0ade57458 qa/suites/orch/cephadm: restrict test_iscsi_pids_limit to CentOS
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-22 21:42:41 +01:00