Commit Graph

142466 Commits

Author SHA1 Message Date
Ronen Friedman
d294ea80cc osd/scrub: introduce a 'not before' attribute for scrub jobs
The NB enables the OSD to delay the next attempt to schedule a specific
scrub job.  This is useful for jobs that have failed for whatever
reason, especially if the primary has failed to acquire the replicas.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-22 07:25:25 -06:00
Ronen Friedman
e60c698338 osd/scrub: remove the 'penalized jobs' queue
The 'penalized jobs' queue was used to track scrub jobs that had failed
to acquire their replicas, and to prevent those jobs from being retried
too quickly.  This functionality will be replaced by a
simple 'not before' delay (see the next commits).

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-22 07:25:25 -06:00
Yuri Weinstein
e7ccff5930
Merge pull request #54973 from Matan-B/wip-matanb-should-whiteout-helper
osd/osd/PrimaryLogPG: use should_whiteout helper in _delete_oid()

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-18 07:39:25 -08:00
Yuri Weinstein
30c4873370
Merge pull request #54780 from jianwei1216/log_to_syslog_main
common: LogClient do not output meaningless logs by default

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-01-18 07:38:17 -08:00
Yuri Weinstein
db7669c3b0
Merge pull request #54116 from EdwardVitor/fix-warning-mon
mon: resolve warning about inconsistent variable types

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-18 07:37:34 -08:00
zdover23
19aa8fc73d
Merge pull request #55161 from tobydarling/patch-2
doc/rados/operations: Fix off-by-one erors in control.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-18 20:41:38 +10:00
Matan Breizman
914b986610
Merge pull request #55172 from Matan-B/wip-matanb-crimson-neorados
rados_api_tests: Crimson Skip unsupported

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-18 12:22:49 +02:00
Matan Breizman
74624a73d2
Merge pull request #53281 from xxhdx1985126/wip-crimson-recover-snapset
crimson/osd/pg: set obc's ssc when handling pull responses
2024-01-18 12:06:49 +02:00
Matan Breizman
74d985f64e
Merge pull request #55202 from zhscn/fix-ssc
crimson/osd: get SnapSetContext from head_obc

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-18 12:05:04 +02:00
Aashish Sharma
62d18d65b1
Merge pull request #53814 from rhcs-dashboard/fix-61720-main
mgr/dashboard: upgrade from old 'graph' type panels to the new 'timeseries' panel

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-01-18 13:33:49 +05:30
Redouane Kachach
4603c5b349
Merge pull request #55181 from rkachach/fix_issue_64027
mgr/rook: always recreate kvm default network + fix groups refresh
2024-01-18 06:55:38 +01:00
Venky Shankar
2f867c0697 Merge PR #53080 into main
* refs/pull/53080/head:
	mds/journal: make used_preallocated_ino crash more graceful

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:32:24 +05:30
Venky Shankar
2c5167261c Merge PR #53238 into main
* refs/pull/53238/head:
	mds: just wait the client flushes the snap and dirty buffer

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:30:00 +05:30
Venky Shankar
aeb75b5e4a Merge PR #54511 into main
* refs/pull/54511/head:
	test/libcephfs: move the snapdiff to a dedicated binary

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:29:04 +05:30
Venky Shankar
9acc0cab3c Merge PR #54958 into main
* refs/pull/54958/head:
	mds: func name fixup, plus, and additional log message

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-01-18 10:27:38 +05:30
Venky Shankar
433fe34047 Merge PR #54682 into main
* refs/pull/54682/head:
	qa: drop mon_host check from test_cephfs_mirror_peer_bootstrap
	pybind/mgr/mirroring: drop mon_host from peer_list

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:25:47 +05:30
Redouane Kachach
11a9fe8947
mgr/rook: always recreate kvm default network + fix groups refresh
Fixes: https://tracker.ceph.com/issues/64027

This change also includes:
- adding ~/.local/bin to path so behave binary can be found
- adding requirements.txt file for testing dependencies
- increasing timeout used to wait for tools deployment to 90s
- increasing timeout used to wait for kvm network to 20s

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2024-01-17 22:55:23 +01:00
Anthony D'Atri
ed2cf56d85
Merge pull request #55168 from anthonyeleven/ec-table
doc/rados/operations: add EC overhead table to erasure-code.rst
2024-01-17 15:04:43 -05:00
Anthony D'Atri
9e1999c13d doc/rados/operations: add EC overhead table to erasure-code.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2024-01-17 11:55:39 -05:00
Venky Shankar
b5d0337092 Merge PR #54041 into main
* refs/pull/54041/head:
	qa: fix error reporting string in assert_cluster_log

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-17 19:59:22 +05:30
Ronen Friedman
035b9e6d75
Merge pull request #55105 from ronen-fr/wip-rf-nonorecovery
osd/scrub: allow replicas to scrub even if their OSDs have ongoing backfills

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 14:02:26 +02:00
Matan Breizman
76b64e1db1 test/neorados/misc: Crimson - Skip NeoRadosMisc.WriteSame
See: https://tracker.ceph.com/issues/64040

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
678e8eaf60 test/librados/aio_cxx: Crimson - Skip LibRadosAio.MultiReads
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
73b5e8c15d test/neorados/list: Seperate NeoRadosECTest from NeoRadosTest
otherwise SKIP_IF_CRIMSON won't work in this case

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
b99ffc4f3e test/neorados/aio_cxx: Seperate NeoRadosECTest from NeoRadosTest
SKIP_IF_CRIMSON won't work here since we try to create EC pools
prior to the test being run.
Skip if the entire test instead by seperating EC tests.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
3a75a60aed test/neorados/io: Crimson - Skip NeoRadosIo.Limits
See: https://tracker.ceph.com/issues/64040

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:05 +00:00
Matan Breizman
c843ea6167 test/neorados/cls: Crimson - Skip NeoRadosCls.RemoteReads
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 10:57:05 +00:00
Zhang Song
3ae10a22ca crimson/osd: fix dangling reference bug
Cherry-picked from: 3fad54e154

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-01-17 10:51:42 +00:00
Pedro Gonzalez Gomez
c7bd032444
Merge pull request #54070 from rhcs-dashboard/add-multisite-sync-status-unit-tests
mgr/dashboard: add frontend unit tests for rgw multisite sync status card


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-01-17 11:03:03 +01:00
Matan Breizman
73d7cb6efc
Merge pull request #54765 from Matan-B/wip-matanb-crimson-submit-error-cleanup
crimson/osd: submit_error_log cleanup

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 11:39:38 +02:00
Matan Breizman
9f2e38926e
Merge pull request #55171 from Matan-B/wip-matanb-crimson-return-no-supp
crimson/osd/osd_operations/client_request: return OpInfo errors

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 10:51:37 +02:00
Ronen Friedman
bba3be3b47
Merge pull request #55175 from ronen-fr/wip-rf-max-test-options
qa/suites/rados/thrash: modify selection of max-scrubs configuration values

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 10:48:33 +02:00
Yingxin
704a71e332
Merge pull request #55189 from zhscn/fix-clone-indiect-mapping
crimson/os/seastore: correct the parameter passed to LBAManager::clone_mapping

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-17 16:20:30 +08:00
Zhang Song
4eeffee677 crimson/osd: get SnapSetContext from head_obc
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-01-17 11:40:30 +08:00
Laura Flores
d38b2ba335
Merge pull request #55115 from ljflores/wip-tracker-63967
qa/tasks: fix syntax for deep-scrub command
2024-01-16 13:07:10 -06:00
Yuval Lifshitz
969662837c
Merge pull request #54966 from yuvalif/wip-yuval-63855
rgw/notifications: dont send notifications if op has failed

reviewed-by: cbodley
2024-01-16 16:12:31 +02:00
zdover23
eaf6e41294
Merge pull request #55169 from zdover23/wip-doc-2024-01-14-radosgw-admin-enable-disable-user-rate-limit
docs/radosgw: edit admin.rst "enable/disable user rate limit"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-16 23:51:29 +10:00
Casey Bodley
5f3ea96c23
Merge pull request #55148 from cbodley/wip-63994
rgw: fix use of creds in forward_iam_request()

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-01-16 13:22:30 +00:00
Pedro Gonzalez Gomez
efd8b460fe
Merge pull request #54803 from rhcs-dashboard/increase-plottable-graphs-dashboard
mgr/dashboard: increase the number of plottable graphs in charts


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-01-16 14:15:48 +01:00
Matan Breizman
98f3c19104 crimson/osd/osd_operations/client_request: return OpInfo errors
See NeoRadosCls.DNE or LibRadosCls.DNE

Fixes: https://tracker.ceph.com/issues/64000

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:46:28 +00:00
Matan Breizman
4997eadda7 crimson/osd/pg: move maybe_submit_error_log
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
0f99cdc81e crimson/osd/pg: on_removal to assert empty log_entry map
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
b44c41f08c crimson/osd/pg: submit_error_log cleanup
* error log completion logic is moved into maybe_submit_error_log
* renamed it and it2
* maybe_submit_error_log is moved outside of failure_func
* failure_func no longer gets rep_tid and record_error params
* log_entry_version is removed, submit_error_log returns the version instead

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
841bc653ef crimson/osd/pg: do_osd_ops_execute drop error_func_ptr
std::move to the only user instead

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Rishabh Dave
9085e776af
Merge pull request #54484 from batrick/mds-const-mdreqref
mds: use const qualifier for MDRequestRef

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2024-01-16 17:48:21 +05:30
Rishabh Dave
2c5acead4f
Merge pull request #54390 from shminjs/feat-purgequeue-executed-ops
mds/purgequeue: add l_pq_executed_ops counter

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:47:21 +05:30
Rishabh Dave
e283219800
Merge pull request #53670 from mchangir/mds-enqueue-all-child-frags-for-scrub-for-a-given-fragset
mds/scrub: enqueue all child frags for a given fragset

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:46:08 +05:30
Rishabh Dave
158f916f25
Merge pull request #54208 from neesingh-rh/json_asok_fix
qa: fix rank_asok() to handle errors from asok commands

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:45:09 +05:30
Rishabh Dave
38d614c85d
Merge pull request #54381 from lxbsz/wip-cleanup-auth
mds: misc fixes for MDSAuthCaps code

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:44:04 +05:30
Rishabh Dave
4b39dedc5d
Merge pull request #54406 from vshankar/wip-63482
qa: enable debug mds/client for fs/nfs suite

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:42:37 +05:30