Commit Graph

11455 Commits

Author SHA1 Message Date
Patrick Donnelly
5ad3c86046
Merge PR #58586 into main
* refs/pull/58586/head:
	qa/suites/fs/thrash: add convolve operator for overrides
	qa/cephfs: s/prefetch_dirfrags/prefetch_oft_dirfrags

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-11-12 22:09:30 -05:00
Connor Fawcett
546423c7a2
Merge pull request #60092 from connorfawcett/vstart_runner_bytes_fix
qa/vstart-runner: Only remove non-ASCII characters from string-based command outputs
2024-11-11 23:39:41 +00:00
Nizamudeen A
9d79a06052
Merge pull request #60511 from rhcs-dashboard/health-test-fix
qa/dashboard: fix tasks.mgr.dashboard.test_health.HealthTest

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2024-11-11 15:39:08 +05:30
Connor Fawcett
6567e7d934 qa/vstart-runner: Only remove non-ASCII characters from string-based command outputs
Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/68368
2024-11-11 00:11:33 +00:00
Nizamudeen A
a2a4a3415c qa/dashboard: fix test_list_enabled_module failure
Check the ports availability and go for a new port if the current one is
not available

Fixes: https://tracker.ceph.com/issues/62972
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-11-08 15:20:18 +05:30
Matan Breizman
f55fc4599a
Merge pull request #60600 from Matan-B/wip-matanb-crimson-enable-wait
Revert "suites: crimson basic adding wait for test"

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2024-11-07 18:12:08 +02:00
Yuri Weinstein
6af80fca00
Merge pull request #60132 from li-positiveandfocus/wip-67820-lj
qa/tasks: added "is down" warning to thrash-old-clients ignorelist

Reviewed-by: Laura Flores <lflores@redhat.com>
2024-11-06 07:35:26 -08:00
Yuri Weinstein
29df6b129e
Merge pull request #60071 from shraddhaag/fix-mon-cluster-log-test
qa/standalone/mon/mon_cluster_log.sh: retry check for log line

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2024-11-06 07:34:58 -08:00
Yuri Weinstein
80c29ae812
Merge pull request #59855 from NitzanMordhai/wip-nitzan-expected-failure-wait-osd-down
qa/tasks/ceph: wait the osds down before start check the logs

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-11-06 07:33:58 -08:00
SrinivasaBharathKanta
1017b1d230
Merge pull request #59743 from sseshasa/wip-fix-mclock-low-iops-capacity-threshold
common,osd: Use last valid OSD IOPS value if measured IOPS is unrealistic
2024-11-06 15:46:54 +05:30
Kamoltat (Junior) Sirivadhna
28e38e30bb
Merge pull request #59483 from kamoltat/wip-ksirivad-exit-stretch-mode
mon [stretch mode]: support disable_stretch_mode
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2024-11-05 13:07:06 -05:00
Samuel Just
048ce81f45
Merge pull request #56677 from athanatos/sjust/for-review/wip-replica-read
osd,crimson/osd: rework of replica read and related state

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-11-04 09:49:09 -08:00
Venky Shankar
c8e3946117
Merge pull request #59725 from mchangir/mds-fallocate-return-EOPNOTSUPP-for-mode-0
client: return EOPNOTSUPP for fallocate with mode 0

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-11-04 14:54:59 +05:30
SrinivasaBharathKanta
28887e258a
Merge pull request #59486 from ceph/ceph-ec-benchmark-increase-default-buffer-size
test/erasure-code: increase ceph_erasure_code_benchmark default buffe…
2024-11-04 12:58:09 +05:30
Matan Breizman
7e5898ff41 Revert "suites: crimson basic adding wait for test"
This reverts commit a9de8be0f4.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-11-03 14:20:38 +00:00
Yuri Weinstein
c6ee081202
Merge pull request #59838 from cbodley/wip-68083
os: remove unused btrfs_ioctl.h and tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-10-30 11:14:22 -07:00
Yuri Weinstein
11454f9f54
Merge pull request #59568 from badone/wip-tracker-65235-noscrub-to-ignorelist
qa: Add ignorelist entries for reef-x tests

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2024-10-30 11:12:27 -07:00
Yuri Weinstein
408c10613e
Merge pull request #54954 from diffs/main
osd: add clear_shards_repaired command

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-10-30 11:10:42 -07:00
Adam King
81e274bd05
Merge pull request #55693 from adk3798/cephadm-nfsv3
mgr/nfs: add NFSv3 protocol to default protocols

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-10-30 13:26:38 -04:00
Milind Changire
b0690837f3
qa: test fallocate fails in mode 0
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-10-30 15:41:16 +05:30
Venky Shankar
7809b0e57d
Merge pull request #50105 from zhsgao/mds_export_state
mds: add an asok command to dump export states

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-30 07:16:11 +05:30
Venky Shankar
94ce78a599
Merge pull request #59072 from lxbsz/wip-66991
qa: increase the http.maxRequestBuffer to 100MB and enable the git debug logs

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-30 07:14:50 +05:30
Ernesto Puerta
a3cf84271f
Merge pull request #57299 from rhcs-dashboard/fix-47066-main
mgr/{restful,zabbix}: remove deprecated module

Reviewed-by: @tchaikov 
Reviewed-by: @ktdreyer 
Reviewed-by: @jmolmo
2024-10-29 17:34:41 +00:00
Adam King
dbddf1256c
Merge pull request #60190 from avanthakkar/teuthology-smb-cluster-public-addrs
qa/suites/orch: add a tests for testing public_addr for smb cluster create cmd

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-10-28 13:53:27 -04:00
Ernesto Puerta
8ccb634804
mgr/zabbix: remove deprecated module
This (already deprecated) module is removed as a side-effect of the
deprecation and removal of the `restful` module.

Fixes: https://tracker.ceph.com/issues/47066
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2024-10-28 14:17:19 +01:00
Ernesto Puerta
96ec7badb8
mgr/restful: remove deprecated module
Detailed changes:
* Remove `restful` mgr module dir,
* Remove Python depedencies (`pecan`, `werkzeug`) from ceph.spec and
  debian control,
* Remove docs,
* Remove associated QA tests,
* Update vstart.

Fixes: https://tracker.ceph.com/issues/47066
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2024-10-28 14:17:18 +01:00
Nizamudeen A
79d61bbb58 qa/dashboard: fix tasks.mgr.dashboard.test_health.HealthTest
as per: https://tracker.ceph.com/issues/47612#note-14

Fixes: https://tracker.ceph.com/issues/47612
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-10-28 11:15:25 +05:30
Patrick Donnelly
13f4266694
Merge PR #60386 into main
* refs/pull/60386/head:
	qa/cephfs: override testing kernel with -k option

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-25 12:21:34 -04:00
Avan Thakkar
eb760013c2 qa/suites/orch: add a tests for testing public_addr for smb cluster create cmd
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-10-25 18:56:52 +05:30
Rishabh Dave
adc6f2dbb5
Merge pull request #58898 from neesingh-rh/wip-fix-strict-iec-cast
src/common : proper handling of units in `strict_iec_cast`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-10-24 19:46:48 +05:30
Rishabh Dave
230d131b36
Merge pull request #59002 from neesingh-rh/wip-65820
qa/tasks/fwd_scrub: remove unnecessary traceback

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-10-24 16:57:17 +05:30
Ilya Dryomov
dcd399e666
Merge pull request #60042 from sunilangadi2/migration_with_namespace_test
qa/workunits/rbd: cover native migration between namespaces

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-10-24 12:02:09 +02:00
Venky Shankar
470cd133ec qa/suites/fs/thrash: add convolve operator for overrides
Fixes: d3946e3
Signed-off-by: Venky Shankar <vshankar@redhat.com>
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2024-10-24 04:41:24 +00:00
Venky Shankar
fa46810b5b qa/cephfs: s/prefetch_dirfrags/prefetch_oft_dirfrags
To explicitly depict what the yaml frag is setting.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-10-24 04:33:28 +00:00
Sunil Angadi
8403096655 added tests migration with namespace
Signed-off-by: Sunil Angadi <Sunil.Angadi@ibm.com>
2024-10-23 19:06:41 +05:30
Hemanth
fca07e95ea
Merge pull request #58647 from rishabh-d-dave/mgr-vol-mod-disable
mgr: allow disabling always-on modules
2024-10-23 17:57:50 +05:30
Vallari Agrawal
d10ea1f412
Merge pull request #60316 from VallariAg/wip-nvmeof-teuthology-mtls-test
qa/suites/nvmeof: add mtls test
2024-10-23 17:28:53 +05:30
Adam King
fb02706dcb
Merge pull request #59470 from adk3798/cephadm-staggered-upgrade-test-wait-check-rgw-versions
qa/cephadm: wait a bit before checking rgw daemons upgraded w/ `ceph versions`

Reviewed-by: Guillaume Abrioux <gabrioux@ibm.com>
2024-10-21 14:54:56 -04:00
Samuel Just
dda683b20c suites/rados/thrash-erasure-code/.../ec-small-objects-balanced.yaml: remove
We don't support balanced reads on ec pools.  Additionally, the yaml
actually specifies 'balanced_reads' rather than 'balance_reads' and
therefore has no actual effect.

Signed-off-by: Samuel Just <sjust@redhat.com>
2024-10-21 17:04:51 +00:00
Samuel Just
87c8a9c1b7 qa/tasks/rados: set pct_update_delay if balance_reads is set
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-10-21 17:04:51 +00:00
Patrick Donnelly
4b084c608c
qa/cephfs: override testing kernel with -k option
Normally, the fs suite overrides the kernel branch whenever the kernel client
is used, according to the matrix of configs. This prevents easily testing a new
kernel with the -k option to teuthology-suite. So, using the base config passed
to the script, detect if an alternate testing kernel is desired and use that
instead.

The scheduler still needs to do some work:

    $ teuthology-suite ... --verbose -k wip-pdonnell-i66704 --filter k-testing
    ...
    2024-10-18 00:29:43,875.875 DEBUG:teuthology.suite.merge:base kernel {'branch': 'wip-pdonnell-i66704', 'kdb': 1, 'sha1': '745cacd8f31e50d7f3b6039bbd8c9a8dfc07bf03', 'flavor': 'default'}
    2024-10-18 00:29:43,875.875 DEBUG:teuthology.suite.merge:overriding testing kernel with {'branch': 'wip-pdonnell-i66704', 'kdb': 1, 'sha1': '745cacd8f31e50d7f3b6039bbd8c9a8dfc07bf03', 'flavor': 'default'}

vs.

    $ teuthology-suite ... --verbose --filter k-testing
    ...
    2024-10-17 20:04:52,265.265 DEBUG:teuthology.suite.merge:base kernel {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}

Which will only select jobs using the "testing" kernel.

See-also: https://github.com/ceph/teuthology/pull/2008
Fixes: https://tracker.ceph.com/issues/68603
Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
2024-10-21 12:16:36 -04:00
Adam King
b39be5abe0 mgr/nfs: add NFSv3 protocol to exports
To allow users to use NFSv3 by default with
exports created through the nfs module

Signed-off-by: Adam King <adking@redhat.com>
2024-10-21 11:58:16 -04:00
Vallari Agrawal
fdc93ad15e
qa/suites/nvmeof: add mtls test
Add qa/workunits/nvmeof/mtls_test.sh which enables
mtls config and redeploy, then verify and disables
mtls config.

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>
2024-10-21 10:00:25 +05:30
Rishabh Dave
0abc227131 qa/cephfs: test enable/disable of volumes plugin
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-19 16:57:13 +05:30
Rishabh Dave
8978b85bb0
Merge pull request #59420 from rishabh-d-dave/max-mds-confirm
mon,cephfs: require confirmation when changing max_mds on unhealthy cluster

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-18 20:04:18 +05:30
Adam King
fcc9ffd670
Merge pull request #58084 from asm0deuz/mgmt_gtw_e2e
mgmt-gateway: add e2e testing

Reviewed-by: Adam King <adking@redhat.com>
2024-10-18 09:05:43 -04:00
Rishabh Dave
2bffb22d41
Merge pull request #58486 from rishabh-d-dave/ignore-osd-down
qa/cephfs: ignore when specific OSD is reported down during upgrade

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-18 17:16:23 +05:30
Rishabh Dave
f9c9a15876
Merge pull request #59712 from rishabh-d-dave/mgr-vol-clone-stats-snap
qa/cephfs: test clone progress reporter after subvol is deleted but...      

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-10-18 17:15:40 +05:30
Teoman ONAY
4b2ba587b7 mgmt-gateway: add e2e testing
Add mgmt-gateway teuthology test scenarios

Signed-off-by: Teoman ONAY <tonay@ibm.com>
2024-10-17 21:51:38 +02:00
Sridhar Seshasayee
da4b85c55a common,osd: Use last valid OSD IOPS value if measured IOPS is unrealistic
The OSD's IOPS capacity is used by the mClock scheduler to determine the
quantum of bandwidth allocation for the various operations on the OSD.
Prior to this commit, maybe_override_max_osd_capacity_for_qos() only
checked if the measured IOPS capacity exceeded the higher threshold defined
by 'osd_mclock_iops_capacity_threshold_[hdd|ssd]' and if so fallback to the
last valid or the default IOPS capacity as defined by
osd_mclock_max_capacity_iops_[hdd|ssd].

It's quite possible that the reported IOPS is unrealistically low. This
could be due to transient factors on the underlying device or it could
indicate bad health of the device. Either way, the safer option would be
to fallback to the last valid or the default IOPS setting for that OSD in
order to avoid cluster performance (slow or stalled ops) issues down the
line.

Therefore, to handle this case, the commit introduces additional config
options viz.,
 - osd_mclock_iops_capacity_low_threshold_hdd - set to 50 IOPS and
 - osd_mclock_iops_capacity_low_threshold_ssd - set to 1000 IOPS

If the measured IOPS capacity doesn't fall within the low and high
threshold range, the default or the last valid IOPS capacity is used.
The existing cluster log warning is suitably modified to convey the
reason.

Additionally, for a couple of valgrind related teuthology tests, the
cluster warning is added to the ignorelist since the reported IOPS can
be very low due to slowness.

Fixes: https://tracker.ceph.com/issues/67421
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2024-10-17 16:38:20 +05:30