Commit Graph

142477 Commits

Author SHA1 Message Date
Yingxin Cheng
3eb3327b84 crimson/osd: drop a foreign-copy to shard-0 for every pg operation
By using ConnectionRef before pg submission, and after that, change to
use ConnectionXcoreRef.

The intent is to drop the foreign copy of the connection to shard 0 at
pg submission time. This should remove two pairs of crosscore
communications in shard 0 for each I/O, one for connection-ref foreign
copy, another for connection-ref destruction.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-22 16:52:52 +08:00
Yingxin Cheng
829a9b4d5f crimson/osd/osd_operations/client_request: don't use and move pgref at the same time
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-22 16:43:49 +08:00
Yingxin Cheng
c5157bb670 crimson/osd/osd_operations/client_request: cleanup shard_services
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-22 16:43:49 +08:00
Igor Fedotov
abd94a051d
Merge pull request #54990 from ifed01/wip-ifed-fix-expand-with-ncb
os/bluestore: fix free space update after bdev-expand in NCB mode.

Reviewed-by: Pere Diaz Bou <pere-altea@hotmail.com>
2024-01-18 21:31:00 +03:00
Samuel Just
31f7971eaf
Merge pull request #55188 from cyx1231st/wip-crimson-increase-obc-lru
common/options/crimson: increase crimson_osd_obc_lru_size to 512

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-18 08:52:15 -08:00
Casey Bodley
67874c5ea8
Merge pull request #54759 from jzhu116-bloomberg/wip-63178
rgw/lc: do not add datalog/bilog for some lc actions

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2024-01-18 16:13:19 +00:00
Yuri Weinstein
e7ccff5930
Merge pull request #54973 from Matan-B/wip-matanb-should-whiteout-helper
osd/osd/PrimaryLogPG: use should_whiteout helper in _delete_oid()

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-18 07:39:25 -08:00
Yuri Weinstein
30c4873370
Merge pull request #54780 from jianwei1216/log_to_syslog_main
common: LogClient do not output meaningless logs by default

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-01-18 07:38:17 -08:00
Yuri Weinstein
db7669c3b0
Merge pull request #54116 from EdwardVitor/fix-warning-mon
mon: resolve warning about inconsistent variable types

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-18 07:37:34 -08:00
zdover23
19aa8fc73d
Merge pull request #55161 from tobydarling/patch-2
doc/rados/operations: Fix off-by-one erors in control.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-18 20:41:38 +10:00
Matan Breizman
914b986610
Merge pull request #55172 from Matan-B/wip-matanb-crimson-neorados
rados_api_tests: Crimson Skip unsupported

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-18 12:22:49 +02:00
Matan Breizman
74624a73d2
Merge pull request #53281 from xxhdx1985126/wip-crimson-recover-snapset
crimson/osd/pg: set obc's ssc when handling pull responses
2024-01-18 12:06:49 +02:00
Matan Breizman
74d985f64e
Merge pull request #55202 from zhscn/fix-ssc
crimson/osd: get SnapSetContext from head_obc

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-18 12:05:04 +02:00
Aashish Sharma
62d18d65b1
Merge pull request #53814 from rhcs-dashboard/fix-61720-main
mgr/dashboard: upgrade from old 'graph' type panels to the new 'timeseries' panel

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-01-18 13:33:49 +05:30
Redouane Kachach
4603c5b349
Merge pull request #55181 from rkachach/fix_issue_64027
mgr/rook: always recreate kvm default network + fix groups refresh
2024-01-18 06:55:38 +01:00
Venky Shankar
2f867c0697 Merge PR #53080 into main
* refs/pull/53080/head:
	mds/journal: make used_preallocated_ino crash more graceful

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:32:24 +05:30
Venky Shankar
2c5167261c Merge PR #53238 into main
* refs/pull/53238/head:
	mds: just wait the client flushes the snap and dirty buffer

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:30:00 +05:30
Venky Shankar
aeb75b5e4a Merge PR #54511 into main
* refs/pull/54511/head:
	test/libcephfs: move the snapdiff to a dedicated binary

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:29:04 +05:30
Venky Shankar
9acc0cab3c Merge PR #54958 into main
* refs/pull/54958/head:
	mds: func name fixup, plus, and additional log message

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-01-18 10:27:38 +05:30
Venky Shankar
433fe34047 Merge PR #54682 into main
* refs/pull/54682/head:
	qa: drop mon_host check from test_cephfs_mirror_peer_bootstrap
	pybind/mgr/mirroring: drop mon_host from peer_list

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-18 10:25:47 +05:30
Redouane Kachach
11a9fe8947
mgr/rook: always recreate kvm default network + fix groups refresh
Fixes: https://tracker.ceph.com/issues/64027

This change also includes:
- adding ~/.local/bin to path so behave binary can be found
- adding requirements.txt file for testing dependencies
- increasing timeout used to wait for tools deployment to 90s
- increasing timeout used to wait for kvm network to 20s

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2024-01-17 22:55:23 +01:00
Anthony D'Atri
ed2cf56d85
Merge pull request #55168 from anthonyeleven/ec-table
doc/rados/operations: add EC overhead table to erasure-code.rst
2024-01-17 15:04:43 -05:00
Anthony D'Atri
9e1999c13d doc/rados/operations: add EC overhead table to erasure-code.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2024-01-17 11:55:39 -05:00
Venky Shankar
b5d0337092 Merge PR #54041 into main
* refs/pull/54041/head:
	qa: fix error reporting string in assert_cluster_log

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-17 19:59:22 +05:30
Ronen Friedman
035b9e6d75
Merge pull request #55105 from ronen-fr/wip-rf-nonorecovery
osd/scrub: allow replicas to scrub even if their OSDs have ongoing backfills

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 14:02:26 +02:00
Matan Breizman
19e943627d qa/config/crimson_qa_overrides.yaml: Decrease lru_size for testing
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:51:50 +00:00
Matan Breizman
76b64e1db1 test/neorados/misc: Crimson - Skip NeoRadosMisc.WriteSame
See: https://tracker.ceph.com/issues/64040

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
678e8eaf60 test/librados/aio_cxx: Crimson - Skip LibRadosAio.MultiReads
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
73b5e8c15d test/neorados/list: Seperate NeoRadosECTest from NeoRadosTest
otherwise SKIP_IF_CRIMSON won't work in this case

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
b99ffc4f3e test/neorados/aio_cxx: Seperate NeoRadosECTest from NeoRadosTest
SKIP_IF_CRIMSON won't work here since we try to create EC pools
prior to the test being run.
Skip if the entire test instead by seperating EC tests.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:46 +00:00
Matan Breizman
3a75a60aed test/neorados/io: Crimson - Skip NeoRadosIo.Limits
See: https://tracker.ceph.com/issues/64040

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 11:05:05 +00:00
Matan Breizman
c843ea6167 test/neorados/cls: Crimson - Skip NeoRadosCls.RemoteReads
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-17 10:57:05 +00:00
Zhang Song
3ae10a22ca crimson/osd: fix dangling reference bug
Cherry-picked from: 3fad54e154

Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-01-17 10:51:42 +00:00
Pedro Gonzalez Gomez
c7bd032444
Merge pull request #54070 from rhcs-dashboard/add-multisite-sync-status-unit-tests
mgr/dashboard: add frontend unit tests for rgw multisite sync status card


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-01-17 11:03:03 +01:00
Matan Breizman
73d7cb6efc
Merge pull request #54765 from Matan-B/wip-matanb-crimson-submit-error-cleanup
crimson/osd: submit_error_log cleanup

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 11:39:38 +02:00
Matan Breizman
9f2e38926e
Merge pull request #55171 from Matan-B/wip-matanb-crimson-return-no-supp
crimson/osd/osd_operations/client_request: return OpInfo errors

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 10:51:37 +02:00
Ronen Friedman
bba3be3b47
Merge pull request #55175 from ronen-fr/wip-rf-max-test-options
qa/suites/rados/thrash: modify selection of max-scrubs configuration values

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-17 10:48:33 +02:00
Yingxin
704a71e332
Merge pull request #55189 from zhscn/fix-clone-indiect-mapping
crimson/os/seastore: correct the parameter passed to LBAManager::clone_mapping

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-17 16:20:30 +08:00
Zhang Song
4eeffee677 crimson/osd: get SnapSetContext from head_obc
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-01-17 11:40:30 +08:00
Laura Flores
d38b2ba335
Merge pull request #55115 from ljflores/wip-tracker-63967
qa/tasks: fix syntax for deep-scrub command
2024-01-16 13:07:10 -06:00
Yuval Lifshitz
969662837c
Merge pull request #54966 from yuvalif/wip-yuval-63855
rgw/notifications: dont send notifications if op has failed

reviewed-by: cbodley
2024-01-16 16:12:31 +02:00
zdover23
eaf6e41294
Merge pull request #55169 from zdover23/wip-doc-2024-01-14-radosgw-admin-enable-disable-user-rate-limit
docs/radosgw: edit admin.rst "enable/disable user rate limit"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-16 23:51:29 +10:00
Casey Bodley
5f3ea96c23
Merge pull request #55148 from cbodley/wip-63994
rgw: fix use of creds in forward_iam_request()

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-01-16 13:22:30 +00:00
Pedro Gonzalez Gomez
efd8b460fe
Merge pull request #54803 from rhcs-dashboard/increase-plottable-graphs-dashboard
mgr/dashboard: increase the number of plottable graphs in charts


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-01-16 14:15:48 +01:00
Matan Breizman
98f3c19104 crimson/osd/osd_operations/client_request: return OpInfo errors
See NeoRadosCls.DNE or LibRadosCls.DNE

Fixes: https://tracker.ceph.com/issues/64000

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:46:28 +00:00
Matan Breizman
4997eadda7 crimson/osd/pg: move maybe_submit_error_log
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
0f99cdc81e crimson/osd/pg: on_removal to assert empty log_entry map
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
b44c41f08c crimson/osd/pg: submit_error_log cleanup
* error log completion logic is moved into maybe_submit_error_log
* renamed it and it2
* maybe_submit_error_log is moved outside of failure_func
* failure_func no longer gets rep_tid and record_error params
* log_entry_version is removed, submit_error_log returns the version instead

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
841bc653ef crimson/osd/pg: do_osd_ops_execute drop error_func_ptr
std::move to the only user instead

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Rishabh Dave
9085e776af
Merge pull request #54484 from batrick/mds-const-mdreqref
mds: use const qualifier for MDRequestRef

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2024-01-16 17:48:21 +05:30