Commit Graph

8978 Commits

Author SHA1 Message Date
Casey Bodley
bc81cd1226
Merge pull request #44561 from cbodley/wip-51727
qa/rgw: add PG_DEGRADED cluster warnings to log-ignorelist

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-01-13 09:38:49 -05:00
Venky Shankar
6b59fe1bec
Merge pull request #44397 from lxbsz/wip-53726
mds: dump tree '/' when the path is empty

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:15:24 +05:30
Venky Shankar
b52f86c8a5
Merge pull request #44422 from lxbsz/wip-51705
qa: do not use any time related suffix for *_op_timeouts

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-13 18:14:14 +05:30
Yuval Lifshitz
b709091d81
Merge pull request #43995 from TRYTOBE8TME/wip-rgw-kafka-teuth-cleanup
qa/tasks: Checking for kafka cleanup
2022-01-13 11:57:03 +02:00
Casey Bodley
95544e802b qa/rgw: add PG_DEGRADED cluster warnings to log-ignorelist
and cover rgw/singleton suite

Fixes: https://tracker.ceph.com/issues/51727

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-12 15:56:38 -05:00
Yuri Weinstein
a8bb49d4d9
Merge pull request #39440 from pdvian/wip-warn-filestore-osds
mon/OSDMonitor, osd: Add warning on filestore deprecation and force use of wpq scheduler for filestore OSDs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-12 08:49:02 -08:00
Casey Bodley
81d3517bde
Merge pull request #42891 from ofriedma/wip-ofriedma-rgw-qos-finale
rgw: Add rgw rate limiting per user and per bucket

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-11 11:35:05 -05:00
Kalpesh Pandya
6135747a06 qa/tasks: Checking for kafka cleanup
Adding a sleep after running ./kafka-server-stop.sh and ./zookeeper-server-stop.sh
scripts so that nothing gets logged into the kafka logs after the sleep time.
And finally killing the process.

This resolves: https://tracker.ceph.com/issues/53220

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2022-01-11 21:14:15 +05:30
Ernesto Puerta
f5237e8b4a
Merge pull request #44088 from ceph/feature-48388-cache
mgr: TTL cache implementation

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
2022-01-11 12:52:41 +01:00
Matan
27c6784cac
Merge pull request #44495 from Matan-B/wip-matanb-crimson-flavor
qa/suites: Crimson flavor configuration fix 

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: chunmei-liu chunmei.liu@intel.com
2022-01-10 20:30:18 +02:00
Or Friedmann
fd084fd7fc rgw: Add admin ops API for rate limiting
Add admin ops API for rate limiting and some bug fixes

Signed-off-by: Or Friedmann <ofriedma@redhat.com>
2022-01-10 16:48:56 +00:00
Matan Breizman
3dad67c9d2 qa/suites: Fix crimson flavor configuration
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-01-06 14:24:20 +00:00
Sage Weil
d2265e81fb Merge PR #44054 into master
* refs/pull/44054/head:
	doc/rados/operations: document pg_num_max
	mgr: set max of 32 pgs for .mgr pool
	mgr/dashboard: expect pg_num_max property for pools
	mon/OSDMonitor: add option --pg-num_max arg for create pool
	mon/OSDMonitor: disallow setting pg_num < min or > max
	mgr/pg_autoscaler: apply pg_num_max
	mon: add pg_num_max pool property

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-01-06 08:54:45 -05:00
Venky Shankar
452653844d
Merge pull request #44000 from nmshelke/exception-handling-48473
mgr/stats: exception handling for ceph fs perf stats command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-05 17:55:39 +05:30
Alfonso Martínez
bb56e84c71
Merge pull request #44388 from rhcs-dashboard/02-host-inventory-fix
mgr/dashboard: fix orchestrator/02-hosts-inventory.e2e failure

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-01-05 11:32:22 +01:00
Prashant D
39f5a61a3a mon/OSDMonitor: Raise health warning for filestore osds
Filestore will be deprecated in Quincy, considering
that BlueStore has been the default objectstore for
quite some time.

Fixes: https://tracker.ceph.com/issues/49275

Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-05 10:08:25 +00:00
Xiubo Li
bbc4f4461f qa: add test for dumpping subtrees
Fixes: https://tracker.ceph.com/issues/53726
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-01-05 17:58:53 +08:00
Pere Diaz Bou
15dfa71cf7 mgr: TTLCache basic implementation
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Fixes: https://tracker.ceph.com/issues/48388
2022-01-05 10:11:58 +01:00
Nikhilkumar Shelke
a00893fbba qa: test cases for ceph fs perf stats command
Fixes: https://tracker.ceph.com/issues/48473
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-01-05 10:45:05 +05:30
Yuri Weinstein
3f21194f13
Merge pull request #43716 from kamoltat/wip-ksirivad-autoscale-global-flag
mgr/autoscaler: Introduce noautoscale flag

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-04 14:42:41 -08:00
Venky Shankar
9c659f228e
Merge pull request #44067 from MrFreezeex/dirfrags-test
qa/suites/fs: add prefetch_dirfrags false to thrasher suite

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-04 15:15:41 +05:30
Venky Shankar
a612b3cb85
Merge pull request #43618 from kotreshhr/recover-symlink
mds: Store symlink target in first data object

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-04 14:39:22 +05:30
Venky Shankar
4d372e9557
Merge pull request #43236 from mchangir/mgr/snap_schedule-fix-db-connection-concurrent-usage
mgr/snap_schedule: fix db connection concurrent usage

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-04 14:36:07 +05:30
Sage Weil
2d8753f4fe mon/OSDMonitor: disallow setting pg_num < min or > max
Signed-off-by: Sage Weil <sage@newdream.net>
2022-01-03 14:12:54 -05:00
Sage Weil
4439035c32 mon: add pg_num_max pool property
Signed-off-by: Sage Weil <sage@newdream.net>
2022-01-03 14:11:14 -05:00
Nizamudeen A
7b9fb258c4 mgr/dashboard: fix orchestrator/02-hosts-inventory.e2e failed.
I removed the `02-hosts-inventory.e2e` file because it is a duplicate
test of one of the test in the `01-hosts.e2e` file and fixed the error
from that file.

Also, in the inventory Identify test, we test for an element to be not
visible. According to the latest cypress docs, this should be not.exist
instead of not.visible since the cd-modal will not even be present in
the DOM

Fixes: https://tracker.ceph.com/issues/53499
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-12-31 12:56:12 +05:30
Xiubo Li
bff8136716 qa: do not use any time related suffix for *_op_timeouts
When testing the upgration, for the old version the *_op_timeouts
options' type is TYPE_FLOAT, but when parsing them by strict_strtod
it will failed with error:

  strict_strtod: garbage at end of string. got: '15m'

This commit will remove the 'm' suffix by switch the time to 900,
thus the old version still could parse it successfully.

Introduced-by: d060c9a768
https://tracker.ceph.com/issues/51705
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-12-29 12:39:32 +08:00
Patrick Donnelly
135be96971
Merge PR #44342 into master
* refs/pull/44342/head:
	mds: trigger stray reintegration when loading dentry
	qa: test that scrub causes reintegration

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-12-27 12:55:30 -05:00
Ilya Dryomov
8fe3a1be37
Merge pull request #44243 from ideepika/wip-deepika-iscsi
qa/rbd: update the cephadm required distro

Reviewed-by: Melissa Li <melissali@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-12-27 12:29:07 +01:00
Patrick Donnelly
91a1d81eff
Merge PR #44322 into master
* refs/pull/44322/head:
	mds: skip directory size checks for reintegration
	qa: test reintegration with directory limits

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-12-23 08:52:10 -05:00
Kamoltat
bb42c71e7e qa: Added workunit test for noautoscale flag
set and unset the noautoscale flag,
evaluate if the results are what
we expected. As well as, evaluate
if the flag is correct when we
create new pools.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-22 21:42:28 +00:00
Patrick Donnelly
08194cb2a5
Merge PR #44324 into master
* refs/pull/44324/head:
	qa: set quincy require-osd-release to avoid health warning

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-12-22 14:08:26 -05:00
Neha Ojha
9d09a8191c
Merge pull request #44241 from kamoltat/wip-ksirivad-pool-bulk-flag
mon: osd pool create <pool-name> with --bulk flag

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-12-22 10:06:28 -08:00
Neha Ojha
be82f81503
Merge pull request #44385 from trociny/wip-53677
qa/tasks: improve backfill_toofull test

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-12-22 09:23:22 -08:00
Yuri Weinstein
7c326866e8
Merge pull request #43686 from myoungwon/wip-ceph-dedup-tool-make-dedup-obj
tool: add  chunk/object-dedup command

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-12-21 10:03:10 -08:00
Mykola Golub
a9a09fffae qa/tasks: improve backfill_toofull test
1) Write more data to the pool so we operate with larger ratios.
2) Round up ratios when truncating.

Fixes: https://tracker.ceph.com/issues/53677
Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-12-21 20:00:28 +02:00
Kamoltat
b218335dcc qa/workunits/cephtool: modified test.sh
Included bulk flag in the test script
such it tests the `get` and `set` of
the flag

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-20 21:46:37 +00:00
Kamoltat
c194f4a3eb qa/workunits/mon/pg_autoscaler: modified test script
Modified test scrtipt to include `bulk` and
remove all `profile` options.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-20 21:46:37 +00:00
Joseph Sawaya
8742173e20
Merge pull request #43139 from josephsawaya/rook-orch-qa
qa/tasks/rook: test reapplication of drive groups stored in mgr
2021-12-17 12:50:18 -05:00
Joseph Sawaya
280d735847 qa/tasks/rook: test reapplication of drive groups stored in mgr
This commit adds testing for the drive_group_loop in the Rook orchestrator
that reapplies drive groups that were applied previously.

This test removes an OSD, zaps the underlying device then waits for the OSD
to be re-created by the drive_group_loop.

This commit also updates the rook test suite to test v1.7.2 instead of 1.7.0
since `orch device zap` is only supported from v1.7.2 onwards.

Fixes: https://tracker.ceph.com/issues/53501

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
2021-12-16 18:17:29 -05:00
Sage Weil
867bf04b74 qa/suites/orch/cephadm/osds: test 'ceph cephadm osd activate'
Make sure this command behaves when the /var/lib/ceph osd.NNN dir is
removed.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-12-16 17:00:58 -05:00
Patrick Donnelly
bf4168245d
qa: test that scrub causes reintegration
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-16 14:29:12 -05:00
Sage Weil
735869d891 Merge PR #44211 into master
* refs/pull/44211/head:
	mon: increase mon_down_mkfs_grace to 2m

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-12-16 09:52:24 -05:00
Sebastian Wagner
e911f41672
Merge pull request #43889 from Daniel-Pivonka/cephadm-reg-cred
mgr/cephadm: store contianer registry credentials in config-key

Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-12-16 11:08:04 +01:00
Patrick Donnelly
bc2eaba8c6
qa: set quincy require-osd-release to avoid health warning
Fixes: https://tracker.ceph.com/issues/53615
Fixes: bd815bd9d6
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-15 15:32:42 -05:00
Patrick Donnelly
fe46985a63
qa: test reintegration with directory limits
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-15 11:05:18 -05:00
myoungwon oh
16e7d5578c qa: add object-dedup test
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-12-14 13:49:45 +09:00
myoungwon oh
e7e875c547 qa: add chunk-dedup test
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-12-14 12:27:43 +09:00
Casey Bodley
44d706c353
Merge pull request #44009 from cbodley/wip-qa-cls-rgw-gc
qa/rgw: run ceph_test_cls_rgw_gc in rgw/verify suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-12-13 11:18:49 -05:00
Matt Benjamin
669798af85
Merge pull request #42104 from linuxbox2/wip-rgwadminops-fsid
rgw: expose RADOS cluster_fsid via adminops
2021-12-09 18:35:03 -05:00