Commit Graph

138697 Commits

Author SHA1 Message Date
Matan
c42efbf587
Merge pull request #49044 from rzarzynski/wip-crimson-ertr-plain-rets
crimson/ertr: let ErrVisitorT return plain value if ValueFuncT returns seastar::future

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-07-02 14:02:01 +03:00
Matan
55fcd87221
Merge pull request #52032 from Matan-B/wip-matanb-crimson-no-ignore
crimson/osd: don't ignore start_pg_operation returned future

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-02 13:53:25 +03:00
Matan
6bd7cd4c38
Merge pull request #51147 from liu-chunmei/multicore-osd
Crimson/osd: support multicore osd

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-02 13:15:02 +03:00
Matan
1f1800b26e
Merge pull request #51916 from cyx1231st/wip-seastar-msgr-multi-core-2
crimson/net: support connections in multiple shards

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-02 13:05:04 +03:00
Anthony D'Atri
00edceddba
Merge pull request #52280 from zdover23/wip-doc-2023-07-01-radosgw-multisite
doc/radosgw: refine "Zones" in multisite.rst
2023-07-01 09:46:19 -04:00
Zac Dover
8dab6c066c doc/radosgw: refine "Zones" in multisite.rst
Describe in greater detail the function of Zones in serving S3 objects,
as requested by Alexander Patrakov here:
https://github.com/ceph/ceph/pull/49981#issuecomment-1615866374.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-01 21:51:15 +10:00
zdover23
f79906237a
Merge pull request #52277 from zdover23/wip-doc-2023-07-01-radosgw-s3select-overview
doc/radosgw: s/s3select/S3 Select/

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-01 21:29:24 +10:00
Zac Dover
71c327ef4f doc/radosgw: s/s3select/S3 Select/
Correct several misspelling of "S3 Select". Hat tip to Anthony D'Atri,
who caught this in an earlier PR.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-01 21:14:30 +10:00
J. Eric Ivancich
892fd71829
Merge pull request #47595 from 5cs/fix-lc-head-marker
rgwlc: fix lc head marker point to non-exist lc entry

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-06-30 11:33:15 -04:00
J. Eric Ivancich
fb9d481188
Merge pull request #50667 from ivancich/wip-add-reupload-testing
qa/rgw: test that multipart re-upload does not leave any orphans

Reviewed-by: Cory Snyder <csnyder@iland.com>
2023-06-30 11:30:27 -04:00
Soumya Koduri
88a05a4600
Merge pull request #52252 from soumyakoduri/wip-skoduri-dbstore
rgw/dbstore: Update README

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-06-30 17:44:02 +05:30
Yingxin
ee16718511
Merge pull request #52217 from zhscn/fix-file-local-variable
crimson/os/seastore/omap_manager: correct editor settings

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-30 10:32:24 +08:00
zdover23
cb5c7ecf4a
Merge pull request #52250 from zdover23/wip-doc-2023-06-29-radosgw-s3select-basic-workflow
doc/radosgw: edit "Basic Workflow" in s3select.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-30 02:00:13 +10:00
Zac Dover
4d2c09b683 doc/radosgw: edit "Basic Workflow" in s3select.rst
Edit the "Basic Workflow" section in doc/radosgw/s3select.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-30 01:27:52 +10:00
Soumya Koduri
467c76e3dd rgw/dbstore: Update README
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-06-29 16:00:43 +05:30
Radoslaw Zarzynski
5cd4a0ec53
Merge pull request #52008 from rishabh-d-dave/improvements-authmon
mon: improvements and cleanup for AuthMonitor

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-06-29 09:32:03 +02:00
Yingxin Cheng
a870946423 crimson/osd/heartbeat: relax the order of replacement reset and accept
With the new implementation in messenger, the order of replacement reset
and accept events cannot be determined because they are from different
connections.

Modify the heatbeat logic to tolerate the both cases.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-29 14:27:58 +08:00
Ilya Dryomov
a0082f63e8
Merge pull request #52157 from pkalever/log-improve
rbd-mirror: add some assorted logs

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-06-28 11:45:50 +02:00
zdover23
2767f5a72c
Merge pull request #52194 from zdover23/wip-doc-2023-06-26-radosgw-s3select-overview
doc/radosgw: edit "Overview" in s3select.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-28 16:43:08 +10:00
Zac Dover
e051dd1a75 doc/radosgw: edit "Overview" in s3select.rst
Edit the "Overview" section in doc/radosgw/s3select.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-28 16:16:00 +10:00
Venky Shankar
809d475814 Merge PR #49971 into main
* refs/pull/49971/head:
	doc/cephfs: document MDS_CLIENTS_LAGGY health warning
	qa: ignore warnings
	qa: add test cases to check client eviction if an OSD is laggy
	mds,messages: enable beacon to report clients lagginess
	mds: do not evict client on laggy osds
	common: add new config option to defer client eviction
	osd: add method to check for laggy osds

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-06-28 10:23:54 +05:30
Yingxin
2c617c35d5
Merge pull request #52090 from xxhdx1985126/wip-fixedkv-btree-merge-fix
crimson/os/seastore/btree: should add left's size when merging levels…

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-28 12:53:06 +08:00
Prasanna Kumar Kalever
2f85530c85 rbd-mirror: add some logs
Added some logs as their values where not very clear while parsing though the
log files.

Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2023-06-28 10:16:01 +05:30
Zhang Song
3663b22916 crimson/os/seastore/omap_manager: correct editor settings
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-06-28 10:14:45 +08:00
Patrick Donnelly
f72990b451
Merge PR #51858 into main
* refs/pull/51858/head:
	pybind/mgr/devicehealth: do not crash if db not ready

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
2023-06-27 13:43:38 -04:00
Venky Shankar
94e8649304 Merge PR #52170 into main
* refs/pull/52170/head:
	qa: assign file system affinity for replaced MDS

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-06-27 17:51:31 +05:30
Aashish Sharma
a58490c1bd
Merge pull request #51283 from rhcs-dashboard/disable-delete
mgr/dashboard: disable delete on multisite

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
2023-06-27 17:28:12 +05:30
Venky Shankar
f370b581f6 qa: assign file system affinity for replaced MDS
Otherwise, the MDS that just got replaced can transition to a rank
for another file system and the test cannot deterministically infer
which MDS needs to checked.

Fixes: http://tracker.ceph.com/issues/61764
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-06-27 09:23:14 +05:30
Yingxin Cheng
2fed9397d5 crimson/net: cleanup, rename is_fixed_cpu
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-27 10:31:11 +08:00
Samarah Uriarte
fd62a8dfcb
Merge pull request #51928 from samarahu/cmake-cleanup
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-06-26 10:30:40 -04:00
Venky Shankar
cffeb112fb Merge PR #52149 into main
* refs/pull/52149/head:
	cephfs-journal-tool: disambiguate usage of all keyword (in tool help).

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-06-26 17:51:25 +05:30
Ilya Dryomov
0447bb33b6
Merge pull request #52155 from nbalacha/poolreplayer-logging
rbd-mirror: add additional logs to PoolReplayer

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-06-26 11:49:26 +02:00
Venky Shankar
f5dae89148 Merge PR #51417 into main
* refs/pull/51417/head:
	client: only wait for write MDS OPs when unmounting
	client: flush the mdlog before waiting for unsafe requests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-06-26 12:59:12 +05:30
Venky Shankar
703f265d63 Merge PR #50908 into main
* refs/pull/50908/head:
	mon/MDSMonitor: plug paxos when maybe manipulating the osdmap
	mon/MDSMonitor: force immediate propose when evicting an MDS

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-06-26 12:57:43 +05:30
Venky Shankar
8f4ae9b832 Merge PR #49295 into main
* refs/pull/49295/head:
	mgr/snap_schedule: catch all exceptions for cli

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-06-26 12:56:33 +05:30
zdover23
46cfee7ae0
Merge pull request #51845 from ssdohammer-sl/doc-update-deduplication
doc:dev update how to use deduplication

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-06-26 11:46:07 +10:00
Sungmin Lee
9b74a33fa1 doc:dev update how to use deduplication
Add prerequisite for deduplication, example outputs, and chunk-repair operation.

Signed-off-by: Sungmin Lee <sung_min.lee@samsung.com>
2023-06-26 00:29:46 +00:00
Manish M Yathnalli
52c033f85e cephfs-journal-tool: disambiguate usage of all keyword (in tool help).
The fs:all for rank option description was confusing. It seemd
like the fs was optional, but it is mandatory. This change modifies the
help message to reflect the correct way to use all in the --rank option.

Fixes: https://tracker.ceph.com/issues/61753
Signed-off-by: Manish M Yathnalli <myathnal@redhat.com>
2023-06-25 19:42:57 +05:30
zdover23
69cfd0e6d2
Merge pull request #52181 from zdover23/wip-doc-2023-06-25-radosgw-s3select-formatting
doc/radosgw: remove pipes from s3select.rst

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-06-25 23:46:11 +10:00
Yuval Lifshitz
a20a4d95b9
Merge pull request #52110 from yuvalif/wip-yuval-fix-61639
rgw/amqp: remove possible race conditions with the amqp connections
2023-06-25 15:54:26 +03:00
Zac Dover
a4d302ee1a doc/radosgw: remove pipes from s3select.rst
Remove strange formatting introduced in
61d6813726.

Note to the documentation team: This is not a line-edit. This commit
includes nothing but the removal of pipes added to the left of much of
the text in this file. Several future commits will line-edit this file
and correct its formatting.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-25 19:03:07 +10:00
Yuval Lifshitz
2e92331369 rgw/amqp: use "fmt" for converting connection_id to string
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-06-25 08:56:26 +00:00
Yingxin
a4d14062eb
Merge pull request #51980 from aisakaki/wip-fix-check_node
crimson/os/seastore: fix in check_node

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-06-25 13:46:17 +08:00
Yingxin Cheng
1e8a39f359 crimson/net: dispatch the initial acceptance from the socket core
It's meaningless to dispatch the initial acceptance always from the
msgr core.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-25 11:57:19 +08:00
Yingxin Cheng
bdd89b68ea crimson/net: keep the order of cross-core events in msgr v2
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-25 11:57:19 +08:00
Yingxin Cheng
6a01988894 crimson/net: expose is_fixed_cpu configuration at Messenger level
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-25 11:57:19 +08:00
Yingxin Cheng
7726867963 crimson/net: misc cleanups with logs around cross-core
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-25 11:57:19 +08:00
Yingxin Cheng
0b60209df6 crimson/net: convert all interactions between protocol and io-handler to be cross-core
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-25 11:57:19 +08:00
Yingxin Cheng
5b8003386d crimson/net: prevent racing in protocol to switch core and to call io-handler interfaces
Otherwise, calling io-handler interfaces may result in wrong core/order.

This needs to take special care to handle preemptive cases such as
closing and replacing.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-25 11:57:19 +08:00
Yingxin Cheng
b10f0bd3cc crimson/net: implement logic to move a io-handler to a new sid
Note that it is inevitable that the user can mark down the connection
while the protocol is trying to move the connection to another core.

In that case, the implementation should tolerate the racing, which
finally needs to cleanup resources correctly and dispatch reasonable
events.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-25 11:57:19 +08:00