Commit Graph

9402 Commits

Author SHA1 Message Date
Matan
521f83aa21
Merge pull request #47554 from Matan-B/wip-matanb-c-rados-python
qa/suite/crimson-rados: Fix rados_python test

Reviewed by: Samuel Just <sjust@redhat.com>
Reviewed by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed by: Nitzan Mordechai <nmordech@redhat.com>
2022-08-18 13:52:45 +03:00
Casey Bodley
77558ef2c4
Merge pull request #47422 from adamemerson/wip-coroutine-cleaver
rgw: Break Full and Incremental sync out into their own classes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-17 10:00:04 -04:00
Matan Breizman
5db85e6f45 qa/suites: Reduce rados_python time out
This test runs for few minutes,
reducing timeout from 3h to 1h to avoid hanging jobs.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-08-17 12:05:20 +00:00
Matan Breizman
c8b85873e0 qa/crimson-rados: add 'wait' attribute
wait_for_complete tests currently hanging with crimson-osd
and are temporary disabled in Crimson suite.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-08-17 12:02:09 +00:00
Ronen Friedman
d779902ed3
Merge pull request #46891 from ronen-fr/wip-rf-redo-noscrub
osd/scrub: modify scrub behaviour under no-scrub

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-08-14 12:09:35 +03:00
Venky Shankar
c4d6729fb8
Merge pull request #44710 from joscollin/wip-F40633-dump-recent-extraordinary-events
mds: dump recent log events for extraordinary events

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2022-08-12 15:00:49 +05:30
dparmar18
6b4a8263a5 qa/suites/fs/upgrade: added upgrade_without_reducing_max_mds for testing the fail_fs option
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
dparmar18
0bea48984b qa/tasks/fs: add cases in post_upgrade_checks() for fail_fs
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
Kefu Chai
8761314777
Merge pull request #46101 from myoungwon/wip-dedup-tool-update
tool: modify object-dedup command to run on manifest object

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-08-10 00:17:00 +08:00
Shilpa Jagannath
55d0614b4d rgw/qa: re-enable bucket_sync_disable and bucket_reshard while testing
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2022-08-08 15:44:15 -04:00
Casey Bodley
f514666f2b test/rgw: test 'data sync init' over several bucket sync states
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit b3662ccde5)
2022-08-08 15:44:15 -04:00
Shilpa Jagannath
0e370a14b5 qa/multisite: add rgw_sync_data_inject_err_probability to test
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2022-08-08 15:44:15 -04:00
Ronen Friedman
ba77676163 osd/scrub: modify scrub behaviour under no-scrub
Fix no-scrub & nodeep-scrub related code to match requirements:
- deep scrubs should be allowed to execute when no-scrub is set;
- some initiated scrubs (i.e. not periodic ones) might be changed
  from the requested 'deep' to 'shallow'.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-08 09:55:10 +00:00
Nikhilkumar Shelke
7b585d4db9 qa: filter internal directories in 'subvolumegroup ls' command
Internal directories: '_nogroup', '_index', '_legacy', '_deleting'
1. Internal directories should be filtered in 'subvolmegroup ls' command.
2. Internal directories should not be accepted as a group name.

Fixes: https://tracker.ceph.com/issues/55762
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-05 14:05:49 +05:30
Venky Shankar
a023c0c4e5
Merge pull request #47214 from nmshelke/minor-fixes
docs: minor doc fixes of showing in progress clones for a snapshot

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com
2022-08-05 12:01:13 +05:30
Kefu Chai
70d68f56b6
Merge pull request #47462 from ronen-fr/wip-rf-list-snapset
tests/osd: fix a test to follow an output formatting change

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-08-05 08:22:02 +08:00
Ronen Friedman
b04ef6ebfc tests/osd: fix a test to follow an output formatting change
PR#47255 modified the formatting of std::set-s. That broke
the osd-scrub-snaps.sh standalone test.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-04 15:46:11 +00:00
Nikhilkumar Shelke
c0c386b197 docs: minor doc fixes of showing in progress clones for a snapshot
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-04 19:16:39 +05:30
Venky Shankar
bcfc2e2089
Merge pull request #46876 from neesingh-rh/feature_55821
mgr/volumes: add interface to check the presence of subvolumegroups/subvolumes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-08-04 18:40:10 +05:30
Yuri Weinstein
dc218e4b6b
Merge pull request #47138 from kamoltat/wip-ksirivad-fix-test-pool-min-size
qa/tasks/ceph_manager.py: increase test_pool_min_size timeout

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-08-03 08:03:52 -07:00
Yuri Weinstein
e6e6e54452
Merge pull request #44774 from rishabh-d-dave/qa-cleanup
qa/ceph_manager: clean up CephManager.do_rados()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-08-03 08:01:00 -07:00
Kotresh HR
5a33f7e6f6 qa: Fix use of 'sudo' args
https://tracker.ceph.com/issues/56727
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-30 05:33:23 +05:30
myoungwon oh
ea749df517 osd/,rados/: modify TIER_FLUSH to implicitly make an object a manifest object
Existing object-dedup command always creates temporary object and
perform set-chunk to make the input object manifest---this is because
current tier-flush, which is called by object-dedup, works only if
the target object is manifest, otherwise it just return 0.

So, object-dedup may not work if the target is already manifest.
Moreover, it causes unnecessary overhead if the target object is not manifest.

To solve these, this commit makes existing tier-flush to
change object's state to manifest implicitly.

With this change, the only required operation when calling object-dedup
is a tier-flush and object-dedup can work with the manifest object.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-07-28 10:22:11 +09:00
Adam King
f1cbe5225e
Merge pull request #47269 from adk3798/fix-repo-test
qa/workunits/cephadm: update test_repos master -> main

Reviewed-by: Guillaume Abrioux gabrioux@redhat.com
2022-07-27 19:45:11 -04:00
Neeraj Pratap Singh
f182ab4676 qa: add test cases for subvolumegroup/subvolume exist command
Fixes: https://tracker.ceph.com/issues/55821
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-07-26 16:33:46 +05:30
Adam King
9b08edf939 qa/workunits/cephadm: update test_repos master -> main
Missed this one, it seems the test was still passing until
recently but I guess the "master" builds are now gone

Signed-off-by: Adam King <adking@redhat.com>
2022-07-25 16:46:39 -04:00
Patrick Donnelly
5495fe8c42
qa: test for standby-replay removal in MDSMonitor::prepare_beacon
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
David Galloway
84f158f0bf
Merge pull request #47229 from kotreshhr/mgr-legacy-to-upgrade-config-fix
mgr/volumes: Fix subvolume discover during upgrade
2022-07-22 13:42:27 -04:00
Kotresh HR
c8416c3f0e qa: Remove unused variable
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 19:20:33 +05:30
Kotresh HR
1d66216902 qa: validate subvolume discover on upgrade
Validate subvolume discover on upgrade from
legacy subvolume to v1. The handcrafted
`.meta' file on legacy subvolume root should
not be used for any subvolume apis like getpath,
authorize.

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 19:20:09 +05:30
Yuri Weinstein
48d78184f0
Merge pull request #46561 from NitzanMordhai/wip-nitzan-add-pglog-dups-length
osd, mon: add pglog dups length

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-21 13:29:07 -07:00
Rishabh Dave
82b58e3667 qa/cephfs: allow checking for multiple error messages while...
while negative testing.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-07-20 13:11:31 +05:30
Rishabh Dave
233cdea4e1
Merge pull request #47013 from rishabh-d-dave/qa-caps-method-authorize
qa/cephfs: upgrade method authorize in class Filesystem

Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-20 13:04:08 +05:30
Rishabh Dave
4c24755126
Merge pull request #46991 from rishabh-d-dave/qa-caps-helper-rm-path
qa/cephfs: delete path from cmd args after use

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-20 13:01:51 +05:30
Rishabh Dave
87d9037393
Merge pull request #42335 from rishabh-d-dave/qa-get-keyring
qa: add a method to get keyring for a client_id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-20 12:57:50 +05:30
Ali Maredia
07435866e7 qa: add iam section to cloud transitions config
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2022-07-19 14:29:50 -04:00
Ali Maredia
c4bec75221
Merge pull request #47044 from alimaredia/wip-rgw-suite-s3test-refactor
add s3tests-brach.yaml for rgw teuthology suites that run s3tests

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2022-07-18 15:21:29 -04:00
Ilya Dryomov
54a268c183
Merge pull request #47136 from idryomov/wip-48038
qa/suites/rbd: disable workunit timeout for dynamic_features_no_cache

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-07-18 16:42:42 +02:00
Kamoltat
ed73288102 qa/tasks/ceph_manager.py: Increase timeout
In test_pool_min_size():

1. Provided buffer time before we check
for recovery in ceph_manager.wait_for_recovery()

2. Increased timeout in ceph_manager.wait_for_clean()

3. Increased sleep time for
ceph_manager.all_active_or_peered()

Fixes:
https://tracker.ceph.com/issues/49777
https://tracker.ceph.com/issues/54511
https://tracker.ceph.com/issues/51904

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-07-18 12:29:53 +00:00
Ilya Dryomov
1a1fea58fe
Merge pull request #47106 from idryomov/wip-56561
rbd: don't default empty pool name unless namespace is specified

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-07-18 10:08:20 +02:00
Kamoltat
9ed53c82cf qa/tasks/ceph_manager.py: improve loggings
1. When `test_pool_min_size` hit the case where
`not all PGs are active or peered` we dump
each PG state that doesn't have active or
peered state

2. Improve logs message in `inject_pause()`.

3. Add logs for the `test_map_discontinuity()`.

4. In the function, `choose_action()`,
added more logs regarding `chance_down`.

5. Added more loggings to
`primary_affinity()`,
`thrash_pg_upmap_items()`,
`thrash_pg_upmap()`.

6. Make self.is_clean() dump the pgs that
are not active+clean.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-07-17 23:55:04 +00:00
Ilya Dryomov
0a6a70760a qa/suites/rbd: disable workunit timeout for dynamic_features_no_cache
The I/O workload in this test is xfstests (qa/run_xfstests_qemu.sh)
which isn't subjected to any timeout other than global max_job_time
limit in any other subsuite (e.g. qemu/workloads/qemu_xfstests.yaml).
But here, there is a parallel "op" workload defined as a workunit.
The workunit task has a default timeout of 3 hours which is effectively
imposed on the entire job.  In the "rbd cache = false" configuration,
it's sometimes exceeded.

Fixes: https://tracker.ceph.com/issues/48038
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-17 19:06:18 +02:00
Adam King
e7896a9c56
Merge pull request #46897 from rkachach/fix_issue_55808
mgr/cephadm: check for events key before accessing it

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-07-16 18:43:11 -04:00
Ilya Dryomov
3d710cda2f
Merge pull request #44217 from CongMinYin/fix-pwl-recovery-test
qa/suites/rbd/pwl-cache: ensure recovery is actually tested

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-07-16 11:34:55 +02:00
Ilya Dryomov
b2137e2058 rbd: don't default empty pool name unless namespace is specified
Commit 96f05a7956 ("rbd: delay determination of default pool name")
broke "rbd perf image iostat" and "rbd perf image iotop" GLOBAL_POOL_KEY
support (the ability to blend all rbd pools together into a single
view).

Fixes: https://tracker.ceph.com/issues/56561
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-16 10:04:02 +02:00
Ilya Dryomov
2de0574382 qa/tasks: rename persistent write log cache trash task
It doesn't really thrash anything, just repeatedly restarts the
workload on top of a dirty cache file.  rbd_pwl_cache_recovery is
more on point and gets covered by existing CODEOWNERS.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-16 09:46:58 +02:00
Nizamudeen A
367bf22731
Merge pull request #46644 from rhcs-dashboard/rbd-list-pagination
mgr/dashboard: rbd image pagination

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-07-14 17:04:31 +05:30
Pere Diaz Bou
80964fb520 mgr/dashboard: fix rbdconfiguration init type
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-13 17:45:37 +02:00
Yuri Weinstein
f9bd8922d7
Merge pull request #46114 from myoungwon/wip-dedup-tool-object-dedup-snapshot
tool/ceph-dedup-tool: add performing dedup option on cloned object

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-13 07:32:32 -07:00
Yin Congmin
0eab8de3c0 qa/tasks: add thrash test for persistent write log cache
add thrash test for persistent write log cache. run rbd bench
on persistent write log cache, thrashes rbd bench, test the
recovery function of persistent write log cache.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2022-07-13 13:31:02 +08:00