Commit Graph

9395 Commits

Author SHA1 Message Date
myoungwon oh
537462a102 qa: remove unused values in deduplication.py
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-09-19 13:21:07 +09:00
Sungmin Lee
f81b1b61c9 qa: add validation stage for deduplication.py
To validate sample-dedup actually works, validate() runs
separated thread from sample-dedup and verifies
two following things.
1. check sample-dedup starts properly.
2. check references of all the chunk objects' in chunk tier
   exists in designated base pool.
This routune repeats for max_valication_cnt times while
sample-dedup is running. If it doesn't raise any fail while the loop,
we can pretend sample-dedup works accurately.
If not, assert() will stop this test.

In case that a reference of chunk object doesn't exist in base pool,
validate() gives a second chance after repairing it (chunk-repair op)
to deal with false-positive reference inconsistency.

Signed-off-by: Sungmin Lee <sung_min.lee@samsung.com>
2022-09-19 13:21:00 +09:00
myoungwon oh
cbe534e0b5 qa: add deduplication test under RGW workload (s3)
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-09-19 13:20:46 +09:00
JinyongHa
4e0add1b9a qa: add test case for sample_dedup operation of dedup_tool
Signed-off-by: JinyongHa <jy200.ha@samsung.com>
2022-08-26 00:52:01 +00:00
dparmar18
6b4a8263a5 qa/suites/fs/upgrade: added upgrade_without_reducing_max_mds for testing the fail_fs option
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
dparmar18
0bea48984b qa/tasks/fs: add cases in post_upgrade_checks() for fail_fs
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
Kefu Chai
8761314777
Merge pull request #46101 from myoungwon/wip-dedup-tool-update
tool: modify object-dedup command to run on manifest object

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-08-10 00:17:00 +08:00
Nikhilkumar Shelke
7b585d4db9 qa: filter internal directories in 'subvolumegroup ls' command
Internal directories: '_nogroup', '_index', '_legacy', '_deleting'
1. Internal directories should be filtered in 'subvolmegroup ls' command.
2. Internal directories should not be accepted as a group name.

Fixes: https://tracker.ceph.com/issues/55762
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-05 14:05:49 +05:30
Venky Shankar
a023c0c4e5
Merge pull request #47214 from nmshelke/minor-fixes
docs: minor doc fixes of showing in progress clones for a snapshot

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com
2022-08-05 12:01:13 +05:30
Kefu Chai
70d68f56b6
Merge pull request #47462 from ronen-fr/wip-rf-list-snapset
tests/osd: fix a test to follow an output formatting change

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-08-05 08:22:02 +08:00
Ronen Friedman
b04ef6ebfc tests/osd: fix a test to follow an output formatting change
PR#47255 modified the formatting of std::set-s. That broke
the osd-scrub-snaps.sh standalone test.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-04 15:46:11 +00:00
Nikhilkumar Shelke
c0c386b197 docs: minor doc fixes of showing in progress clones for a snapshot
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-04 19:16:39 +05:30
Venky Shankar
bcfc2e2089
Merge pull request #46876 from neesingh-rh/feature_55821
mgr/volumes: add interface to check the presence of subvolumegroups/subvolumes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-08-04 18:40:10 +05:30
Yuri Weinstein
dc218e4b6b
Merge pull request #47138 from kamoltat/wip-ksirivad-fix-test-pool-min-size
qa/tasks/ceph_manager.py: increase test_pool_min_size timeout

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-08-03 08:03:52 -07:00
Yuri Weinstein
e6e6e54452
Merge pull request #44774 from rishabh-d-dave/qa-cleanup
qa/ceph_manager: clean up CephManager.do_rados()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-08-03 08:01:00 -07:00
Kotresh HR
5a33f7e6f6 qa: Fix use of 'sudo' args
https://tracker.ceph.com/issues/56727
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-30 05:33:23 +05:30
myoungwon oh
ea749df517 osd/,rados/: modify TIER_FLUSH to implicitly make an object a manifest object
Existing object-dedup command always creates temporary object and
perform set-chunk to make the input object manifest---this is because
current tier-flush, which is called by object-dedup, works only if
the target object is manifest, otherwise it just return 0.

So, object-dedup may not work if the target is already manifest.
Moreover, it causes unnecessary overhead if the target object is not manifest.

To solve these, this commit makes existing tier-flush to
change object's state to manifest implicitly.

With this change, the only required operation when calling object-dedup
is a tier-flush and object-dedup can work with the manifest object.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-07-28 10:22:11 +09:00
Adam King
f1cbe5225e
Merge pull request #47269 from adk3798/fix-repo-test
qa/workunits/cephadm: update test_repos master -> main

Reviewed-by: Guillaume Abrioux gabrioux@redhat.com
2022-07-27 19:45:11 -04:00
Neeraj Pratap Singh
f182ab4676 qa: add test cases for subvolumegroup/subvolume exist command
Fixes: https://tracker.ceph.com/issues/55821
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-07-26 16:33:46 +05:30
Adam King
9b08edf939 qa/workunits/cephadm: update test_repos master -> main
Missed this one, it seems the test was still passing until
recently but I guess the "master" builds are now gone

Signed-off-by: Adam King <adking@redhat.com>
2022-07-25 16:46:39 -04:00
Patrick Donnelly
5495fe8c42
qa: test for standby-replay removal in MDSMonitor::prepare_beacon
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
David Galloway
84f158f0bf
Merge pull request #47229 from kotreshhr/mgr-legacy-to-upgrade-config-fix
mgr/volumes: Fix subvolume discover during upgrade
2022-07-22 13:42:27 -04:00
Kotresh HR
c8416c3f0e qa: Remove unused variable
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 19:20:33 +05:30
Kotresh HR
1d66216902 qa: validate subvolume discover on upgrade
Validate subvolume discover on upgrade from
legacy subvolume to v1. The handcrafted
`.meta' file on legacy subvolume root should
not be used for any subvolume apis like getpath,
authorize.

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 19:20:09 +05:30
Yuri Weinstein
48d78184f0
Merge pull request #46561 from NitzanMordhai/wip-nitzan-add-pglog-dups-length
osd, mon: add pglog dups length

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-21 13:29:07 -07:00
Rishabh Dave
82b58e3667 qa/cephfs: allow checking for multiple error messages while...
while negative testing.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-07-20 13:11:31 +05:30
Rishabh Dave
233cdea4e1
Merge pull request #47013 from rishabh-d-dave/qa-caps-method-authorize
qa/cephfs: upgrade method authorize in class Filesystem

Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-20 13:04:08 +05:30
Rishabh Dave
4c24755126
Merge pull request #46991 from rishabh-d-dave/qa-caps-helper-rm-path
qa/cephfs: delete path from cmd args after use

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-20 13:01:51 +05:30
Rishabh Dave
87d9037393
Merge pull request #42335 from rishabh-d-dave/qa-get-keyring
qa: add a method to get keyring for a client_id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-07-20 12:57:50 +05:30
Ali Maredia
07435866e7 qa: add iam section to cloud transitions config
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2022-07-19 14:29:50 -04:00
Ali Maredia
c4bec75221
Merge pull request #47044 from alimaredia/wip-rgw-suite-s3test-refactor
add s3tests-brach.yaml for rgw teuthology suites that run s3tests

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2022-07-18 15:21:29 -04:00
Ilya Dryomov
54a268c183
Merge pull request #47136 from idryomov/wip-48038
qa/suites/rbd: disable workunit timeout for dynamic_features_no_cache

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-07-18 16:42:42 +02:00
Kamoltat
ed73288102 qa/tasks/ceph_manager.py: Increase timeout
In test_pool_min_size():

1. Provided buffer time before we check
for recovery in ceph_manager.wait_for_recovery()

2. Increased timeout in ceph_manager.wait_for_clean()

3. Increased sleep time for
ceph_manager.all_active_or_peered()

Fixes:
https://tracker.ceph.com/issues/49777
https://tracker.ceph.com/issues/54511
https://tracker.ceph.com/issues/51904

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-07-18 12:29:53 +00:00
Ilya Dryomov
1a1fea58fe
Merge pull request #47106 from idryomov/wip-56561
rbd: don't default empty pool name unless namespace is specified

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-07-18 10:08:20 +02:00
Kamoltat
9ed53c82cf qa/tasks/ceph_manager.py: improve loggings
1. When `test_pool_min_size` hit the case where
`not all PGs are active or peered` we dump
each PG state that doesn't have active or
peered state

2. Improve logs message in `inject_pause()`.

3. Add logs for the `test_map_discontinuity()`.

4. In the function, `choose_action()`,
added more logs regarding `chance_down`.

5. Added more loggings to
`primary_affinity()`,
`thrash_pg_upmap_items()`,
`thrash_pg_upmap()`.

6. Make self.is_clean() dump the pgs that
are not active+clean.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-07-17 23:55:04 +00:00
Ilya Dryomov
0a6a70760a qa/suites/rbd: disable workunit timeout for dynamic_features_no_cache
The I/O workload in this test is xfstests (qa/run_xfstests_qemu.sh)
which isn't subjected to any timeout other than global max_job_time
limit in any other subsuite (e.g. qemu/workloads/qemu_xfstests.yaml).
But here, there is a parallel "op" workload defined as a workunit.
The workunit task has a default timeout of 3 hours which is effectively
imposed on the entire job.  In the "rbd cache = false" configuration,
it's sometimes exceeded.

Fixes: https://tracker.ceph.com/issues/48038
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-17 19:06:18 +02:00
Adam King
e7896a9c56
Merge pull request #46897 from rkachach/fix_issue_55808
mgr/cephadm: check for events key before accessing it

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-07-16 18:43:11 -04:00
Ilya Dryomov
3d710cda2f
Merge pull request #44217 from CongMinYin/fix-pwl-recovery-test
qa/suites/rbd/pwl-cache: ensure recovery is actually tested

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-07-16 11:34:55 +02:00
Ilya Dryomov
b2137e2058 rbd: don't default empty pool name unless namespace is specified
Commit 96f05a7956 ("rbd: delay determination of default pool name")
broke "rbd perf image iostat" and "rbd perf image iotop" GLOBAL_POOL_KEY
support (the ability to blend all rbd pools together into a single
view).

Fixes: https://tracker.ceph.com/issues/56561
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-16 10:04:02 +02:00
Ilya Dryomov
2de0574382 qa/tasks: rename persistent write log cache trash task
It doesn't really thrash anything, just repeatedly restarts the
workload on top of a dirty cache file.  rbd_pwl_cache_recovery is
more on point and gets covered by existing CODEOWNERS.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-16 09:46:58 +02:00
Nizamudeen A
367bf22731
Merge pull request #46644 from rhcs-dashboard/rbd-list-pagination
mgr/dashboard: rbd image pagination

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-07-14 17:04:31 +05:30
Pere Diaz Bou
80964fb520 mgr/dashboard: fix rbdconfiguration init type
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-13 17:45:37 +02:00
Yuri Weinstein
f9bd8922d7
Merge pull request #46114 from myoungwon/wip-dedup-tool-object-dedup-snapshot
tool/ceph-dedup-tool: add performing dedup option on cloned object

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-13 07:32:32 -07:00
Yin Congmin
0eab8de3c0 qa/tasks: add thrash test for persistent write log cache
add thrash test for persistent write log cache. run rbd bench
on persistent write log cache, thrashes rbd bench, test the
recovery function of persistent write log cache.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2022-07-13 13:31:02 +08:00
Ali Maredia
71a648dc02 qa: remove iam subsuite from rgw suite, run iam tests by default
Minor refactor for RGW user creation

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2022-07-12 16:22:35 -04:00
Ali Maredia
e63ff36b7c rgw: add .yaml that configures s3tests branch for rgw suite
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2022-07-12 16:21:27 -04:00
Pere Diaz Bou
08c980ede3 mgr/dashboard: fix api tests + lint
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:03 +02:00
Pere Diaz Bou
3c308804d5 mgr/dashboard: add rbd list sorting support
Support sorting with name, pool name and namespace

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-12 19:09:02 +02:00
Rishabh Dave
15ccc52a81
Merge pull request #46861 from ajarr/fix-54108
qa/suites/fs: skip check-counters for iogen workload

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2022-07-08 19:36:22 +05:30
Rishabh Dave
17b6d4374d
Merge pull request #46191 from rishabh-d-dave/qa-cephfs-mount-rm-sudo
qa/cephfs: remove sudo parameter from run_shell()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-07-08 19:30:16 +05:30