Commit Graph

149880 Commits

Author SHA1 Message Date
Yuval Lifshitz
34bfbd07e7
Merge pull request #60988 from thuvh/feat/kafka_multiple_brokers
rgw: allow bucket notification send message to kafka with multiple brokers
2024-12-26 12:48:54 +02:00
Yingxin Cheng
e9a0de808b
Merge pull request #61144 from cyx1231st/wip-seastore-improve-backref
crimson/os/seastore/cache: improve committing allocations by backref entries

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Zhang Song <zhangsong02@qianxin.com>
2024-12-26 15:27:28 +08:00
Venky Shankar
afcd6a7a36 Merge PR #60653 into main
* refs/pull/60653/head:
	mds: do not process client metrics message with fast dispatch

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-12-26 09:45:08 +05:30
Venky Shankar
7870d7ffba
Merge pull request #61143 from kotreshhr/qa-nfsganesha-fio-test
qa: Add async io test to nfs ganesha using fio

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-12-26 09:41:58 +05:30
Venky Shankar
56bc82bfdb
Merge pull request #55145 from mchangir/mgr-snap_schedule-handle-volume-delete
mgr/snap_schedule: handle volume delete

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-12-26 09:34:15 +05:30
Hoai-Thu Vuong
1a34cd1be9 rgw: allow bucket notification send message to kafka with multiple brokers
- add new parameter to define list of broker
- update document
- change nose to nose-py3
- add test case for multiple brokers (happy case)

Signed-off-by: Hoai-Thu Vuong <thuvh87@gmail.com>
2024-12-26 10:33:54 +07:00
Anthony D'Atri
07fcfc5e72
Merge pull request #61177 from Skalador/wip-doc-typo-hardware-controllers
doc/start: Fixes a typo in controllers section of hardware recommendations
2024-12-25 18:57:46 -05:00
Skalador
0896362249
doc: Fixes a typo in controllers section of hardware recommendations
Signed-off-by: Kevin Niederwanger <k.niederwanger@gmail.com>
2024-12-25 23:57:00 +01:00
Yuri Weinstein
e933897f22
Merge pull request #59116 from rzarzynski/wip-constbl-compressor
compressor: switch out of get_current_ptr() for the sake of const-stricter bufferlist

Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2024-12-24 11:08:30 -08:00
Ronen Friedman
5f15a25ece
Merge pull request #60808 from ronen-fr/wip-rf-reservStat2
osd/scrub: show reservation status in 'pg dump' output

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-12-24 20:32:39 +02:00
Ronen Friedman
ef7127e8bf osd/scrub: show reservation status in 'pg dump' output
Whenever a PG is selected for scrubbing, and is waiting for
remote reservations, the 'pg dump' output will include the
following text (under the 'SCRUB_SCHEDULING' column):
Reserving. Waiting Ns for OSD.k (n/m)

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-12-24 08:29:57 -06:00
Yingxin Cheng
93df0b3e32 crimson/os/seastore/cache: move committing existing blocks to prepare_record()
So the 2 steps of remapping are atomically committed.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-12-24 16:32:28 +08:00
Yingxin Cheng
4a08c37da5 crimson/os/seastore/journal: hide RBM specific finish_commit()
By introducing a callback upon completing submission.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-12-24 16:32:28 +08:00
Yingxin Cheng
d9ff8f0419 crimson/os/seastore/cache: minor cleanup
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-12-24 16:32:22 +08:00
Matan Breizman
5061b31102
Merge pull request #60821 from Matan-B/wip-matanb-crimson-seastore-deafult
crimson: switch to SeaStore as default object store

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-12-23 11:02:04 +02:00
Ilya Dryomov
610a87a1d8
Merge pull request #61155 from idryomov/wip-69324
rbd: handle --{group,image}-namespace in "rbd group image {add,rm}"

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-12-22 23:56:28 +01:00
Ilya Dryomov
738ac4429c
Merge pull request #61150 from idryomov/wip-69319
rbd: open images in read-only mode for "rbd mirror pool status --verbose"

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-12-22 23:56:09 +01:00
Ilya Dryomov
30103a03b7
Merge pull request #61129 from idryomov/wip-68998
librbd: avoid data corruption on flatten when object map is inconsistent

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-12-22 16:23:12 +01:00
Laura Flores
7fef0e9446
Merge pull request #61125 from ljflores/wip-release-note 2024-12-20 20:58:38 -06:00
Patrick Donnelly
2c0b63ce0b
Merge PR #61149 into main
* refs/pull/61149/head:
	script/ceph-backport: allow hyphen in project during ceph fork deduction

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-12-20 11:05:57 -05:00
afreen23
919c2a6af6
Merge pull request #60777 from VallariAg/wip-nvmeof-prometheus-rbd-image-reused
monitoring: Add prometheus alert NVMeoFMultipleNamespacesOfRBDImage

Reviewed-by: Afreen Misbah <afreen@ibm.com>
2024-12-20 18:46:48 +05:30
Ilya Dryomov
1f71671dc6 rbd: drop --pool option from "rbd group image {add,rm}"
It stopped working with removal of get_special_pool_group_names() in
commit 3e8624f157 ("rbd: add support for namespaces") over six years
ago.  Given how much time has passed, stop accepting this option.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-12-20 13:29:46 +01:00
Zac Dover
0a515df7cd
Merge pull request #61146 from zdover23/wip-doc-2024-12-19-radosgw-uadk-accel
doc/radosgw: edit uadk-accel.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-12-20 22:13:35 +10:00
Ilya Dryomov
f35e3a6e9d rbd: handle --{group,image}-namespace in "rbd group image {add,rm}"
Currently only passing the namespace as part of the group or image spec
works.  If --group-namespace or --image-namespace options are used, the
namespace isn't picked up.

Fixes: https://tracker.ceph.com/issues/69324
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-12-20 11:51:18 +01:00
Laura Flores
53a27b4d09 PendingReleaseNotes: add note about tracker #69012
We merged a fix for v19.2.1 that helps alleviate
the worst of this problem (https://tracker.ceph.com/issues/68657),
but it still comes up on occasion. This release note addresses the
remaining issues tracked in https://tracker.ceph.com/issues/69012.

Signed-off-by: Laura Flores <lflores@ibm.com>
2024-12-19 13:31:32 -06:00
Ilya Dryomov
650e21dd49 rbd: open images in read-only mode for "rbd mirror pool status --verbose"
This is cleaner and makes the command run a bit faster because watches
won't be established.

Fixes: https://tracker.ceph.com/issues/69319
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-12-19 18:43:19 +01:00
J. Eric Ivancich
1c37f81fd8 script/ceph-backport: allow hyphen in project during ceph fork deduction
This will allow the fork deduction code to recognize project names
that include a hyphen, such as:

    git@github.com:USERNAME/ceph-fork.git

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2024-12-19 12:11:06 -05:00
leonidc
862ed6e9cd
Merge pull request #61113 from leonidc/wip-leonidc_no_listener_fix
nvmeofgw*: fix no-listeners
2024-12-19 17:57:25 +02:00
Casey Bodley
8c4f592eec
Merge pull request #61107 from cbodley/wip-69241
rgw/posix: std::ignore return value of write()

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2024-12-19 10:19:51 -05:00
afreen23
34dea65e0d
Merge pull request #59703 from rhcs-dashboard/usermanagement-form
mgr/dashboard: carbonize user management form

Reviewed-by: Afreen Misbah <afreen@ibm.com>
2024-12-19 20:46:59 +05:30
baum
34f0475205
Merge pull request #61130 from baum/wip-baum-20241218-00
src/nvmeof/NVMeofGwMonitorClient: remove MDS client, not needed
2024-12-19 16:57:14 +02:00
Zac Dover
ffe5bf693e doc/radosgw: edit uadk-accel.rst
Edit the sections of doc/radosgw/uadk-accel.rst that concern the
automatic and manual building of UADK.

This is one in a series of uadk-accel.rst-related changes that includes
the following PRs:
https://github.com/ceph/ceph/pull/60953
https://github.com/ceph/ceph/pull/61128

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-12-19 23:19:22 +10:00
Zac Dover
3d072b5e0d
Merge pull request #61128 from zdover23/wip-doc-2024-12-18-radosgw-uadk-accel
doc/radosgw: edit uadk-accel.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-12-19 23:13:14 +10:00
Matan Breizman
15e746bf5b vstart: use crimson_osd_objectstore
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-12-19 09:23:24 +00:00
Matan Breizman
41327dcf0f doc/dev/crimson: update SeaStore as default backend
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-12-19 09:23:24 +00:00
Matan Breizman
b85d61de7f vstart.sh: set alien cores with bluestore only
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-12-19 09:23:24 +00:00
Matan Breizman
3a6ce3cadf qa/suites/crimson-rados: make use of crimson_osd_objectstore
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-12-19 09:23:24 +00:00
Yingxin Cheng
58f7b6e077 crimson/os/seastore: make the updates to backref_entry_mset be consistent with extents
Generally, make alloc/free be consistent with add/commit/retire extents
in Cache.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-12-19 15:22:32 +08:00
Yuval Lifshitz
93498236e5
Merge pull request #60788 from oshrey16/tests-rgw-ps-list-topics-op
tests/rgw/notifications: Add tests for RGWPSListTopicsOp::execute()
2024-12-19 08:18:42 +02:00
Kotresh HR
ef942e13fa qa: Add async io test to nfs ganesha using fio
Fixes: https://tracker.ceph.com/issues/69311
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2024-12-19 11:41:12 +05:30
Vallari Agrawal
ed261a083c
Merge pull request #60431 from VallariAg/fix-nvmeof-ns-test
qa: fix nvmeof scalability and namespace test
2024-12-19 09:19:31 +05:30
Patrick Donnelly
672d7a1715
Merge PR #61018 into main
* refs/pull/61018/head:
	msg/async/Event: make the pipe byte static

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-12-18 09:33:50 -05:00
Oshrey Avraham
65614c4ca4 rgw/notifications: Add tests for RGWPSListTopicsOp::execute()
Tests:
Add comprehensive test cases to verify the behavior of `RGWPSListTopicsOp::execute()` under various scenarios:

    Migration case: Validate correct handling when `support_all_zones` is enabled, with v1 in a new state after migration and v2 topics present.
    v2 notification case: Ensure proper retrieval when v2 notifications are supported.
    v1 notification case: Verify fallback behavior when v2 notifications are unavailable.

Enhancements:
    Update `delete_all_topics` to handle v1 responses with the `result` key.

fixes: https://tracker.ceph.com/issues/68756
Signed-off-by: Oshrey Avraham <oshrey16@gmail.com>
2024-12-18 16:23:40 +02:00
Casey Bodley
9c1bf9bd84
Merge pull request #60771 from YaZasnyal/fix/complete-abort-mp
rgw/abortmp: Race condition on AbortMultipartUpload

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-12-18 09:05:50 -05:00
J. Eric Ivancich
e84c7fcc57
Merge pull request #60676 from awojno-bloomberg/rgw-admin-json
rgw-admin: Add --format option for bucket sync status

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2024-12-18 08:56:33 -05:00
J. Eric Ivancich
954ca4589b
Merge pull request #60970 from clwluvw/redirect-qs
rgw: append query string to redirect URL if present

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-12-18 08:56:08 -05:00
J. Eric Ivancich
ec81d4a454
Merge pull request #60579 from clwluvw/empty-multidelete
rgw: return MalformedXML for empty objects list in DeleteObjects

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-12-18 08:55:45 -05:00
Patrick Donnelly
b7f1f8c8bd
Merge PR #60217 into main
* refs/pull/60217/head:
	CMakeLists.txt: do not compile {Objecter,Striper}.cc twice

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-12-18 08:33:56 -05:00
leonidc
790be2d63b
Merge pull request #61091 from leonidc/wip-leonidc_publish_rebalance_index
nvmeofgw* : fix publishing rebalance index
2024-12-18 14:08:11 +02:00
Ilya Dryomov
ffcd90313b test/librbd: add TestInternal.FlattenInconsistentObjectMap
Inject an object map with all possible inconsistencies before
flattening to ensure that something similar to commit 40af4f87b6
("librbd: flatten operation should use object map") doesn't reappear
in a different form.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-12-18 12:44:36 +01:00