Commit Graph

142578 Commits

Author SHA1 Message Date
Venky Shankar
2a6c1dc36d qa: fs volume rename requires fs fail and refuse_client_session set
Introduced-by: fe3a4b9683
Fixes: http://tracker.ceph.com/issues/64174
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-01-25 12:08:50 +05:30
Samuel Just
000188f2ba
Merge pull request #55266 from athanatos/sjust/wip-63996
crimson: retain map references in OSDSingletonState::store_maps

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-24 21:05:09 -08:00
Samuel Just
db3addf01c crimson/osd/shard_services: retain map references in OSDSingletonState::store_maps
Introduced: 3f11cd94
Fixes: https://tracker.ceph.com/issues/63996
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-25 03:02:06 +00:00
Samuel Just
cb02911686 crimson/osd/shard_service.cc: convert to newer logging machinery
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-25 03:02:06 +00:00
Samuel Just
6ad175f0b9 crimson/osd/osd.cc: migrate logging to new style
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-25 03:02:04 +00:00
Samuel Just
3eebce4aab
Merge pull request #55288 from athanatos/sjust/wip-64140
Revert "crimson/os/alienstore/alien_log: _flush concurrently"

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-24 17:23:47 -08:00
Yuri Weinstein
5ddd51e819
Merge pull request #54987 from batrick/i63822
pybind/mgr/devicehealth: skip legacy objects that cannot be loaded

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
2024-01-24 13:31:31 -08:00
Yuri Weinstein
e538587e18
Merge pull request #54491 from jianwei1216/fix_osd_pg_stat_report_interval_max_cmain
fix: resolve inconsistent judgment of osd_pg_stat_report_interval_max

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2024-01-24 13:30:50 -08:00
Yuri Weinstein
6bba2bc173
Merge pull request #53250 from YiteGu/add-perfcount-for-allocator
os/bluestore: add perfcount for bluestore/bluefs allocator

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2024-01-24 13:30:07 -08:00
Yuri Weinstein
2fac6737f8
Merge pull request #52530 from amathuria/wip-amat-fix-59531
osd: Add memstore to unsupported objstores for QoS

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-24 13:28:16 -08:00
Laura Flores
cd2edcf9d9
Merge pull request #49462 from rzarzynski/wip-bug-53789
osdc: fix the ENOCONN normalization in Objecter::_linger_reconnect()
2024-01-24 14:00:03 -06:00
Casey Bodley
5ea5521383
Merge pull request #55219 from samarahu/rgw_asio_frontend_asserts
rgw/asio: Add asserts to rgw_asio_frontend.cc

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2024-01-24 18:39:14 +00:00
Gregory Farnum
e5b0db4b2f
Merge pull request #55192 from dparmar18/fix_docstrings_ceph_test_case
qa: typo fixes in ceph_test_case docstrings
2024-01-24 09:37:34 -08:00
Casey Bodley
d3256c4841
Merge pull request #53320 from jzhu116-bloomberg/wip-62710
rgw/multisite: maintain endpoints connectable status and retry the requests to them when appropriate

Reviewed-by: Mark Kogan <mkogan@ibm.com>
2024-01-24 16:01:43 +00:00
Adam King
bf084a5fd1
Merge pull request #54941 from samsungceph/vstart_network_v2
vstart: Pick only CIDR-formatted routes when cephadm enabled

Reviewed-by: Adam King <adking@redhat.com>
2024-01-24 10:25:23 -05:00
Casey Bodley
f4758e560f
Merge pull request #53668 from mdw-at-linuxbox/wip-master-update-kmip-1
Update libkmip to pull in some portability changes.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-24 13:30:25 +00:00
Samuel Just
4d52d1d22b Revert "crimson/os/alienstore/alien_log: _flush concurrently"
While submitting the log line asyncronously is reasonable,
with this implementation the EntryVector &q parameter does
not necessarily outlive the submission continuation.

This reverts commit 511af83e27.

Fixes: https://tracker.ceph.com/issues/64140
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-23 22:37:36 +00:00
Gal Salomon
a3415f7d0f
Merge pull request #55183 from galsalomon66/s3select_fixes_QE_bugs
rgw/s3select: bug fixes per QE recent defects
2024-01-23 23:59:15 +02:00
Marcus Watts
afc470ae63 Update libkmip submodule to pull in some portability changes.
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2024-01-23 16:58:38 -05:00
Ronen Friedman
0fe3ccbd78
Merge pull request #55217 from ronen-fr/wip-rf-old-reserv
osd/scrub: check reservation replies for relevance

Reviewed-by: Samuel Just <sjust@redhat.com>-
2024-01-23 21:39:35 +02:00
Laura Flores
24dcb42d41
Merge pull request #55067 from yaarith/telemetry-pool-flags
mgr/telemetry: add pool flags
2024-01-23 12:22:32 -06:00
Laura Flores
d400b21f99
Merge pull request #55240 from rosinL/wip-fix-64032
install-deps: Force remove ceph-libboost* packages
2024-01-23 10:38:46 -06:00
zdover23
02e11fbe08
Merge pull request #55278 from Himura2la/patch-2
Docs: Specify correct fs type for mkfs on volume creation

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2024-01-24 01:58:23 +10:00
galsalomon66
852c1d9735 bug fixes per QE recent defects
update for the engine_version message
s3select submodule

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2024-01-23 16:31:33 +02:00
Casey Bodley
aa42bf14cf
Merge pull request #55277 from yuvalif/wip-yuval-63578
rgw/lua: fix compilation issue when lua packages are disabled

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-23 14:18:22 +00:00
Himura Kazuto
886af37744
doc: specify correct fs type for mkfs
The default value is ext2, which is not supported (anymore?).

Signed-off-by: Vladislav Glagolev <vladislav.glagolev@devexpress.com>
2024-01-23 13:21:01 +00:00
Yuval Lifshitz
e539ca98d6 rgw/lua: fix compilation issue when lua packages are disabled
Fixes: https://tracker.ceph.com/issues/63578#change-253102

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-01-23 11:09:26 +00:00
Ronen Friedman
7559a6c0d1 osd/scrub: check reservation replies for relevance
Compare a token (nonce) carried in the reservation reply with the remembered
token of the reservation request.  If they don't match, the reply is
stale and should be ignored (and logged).

Fixes: https://tracker.ceph.com/issues/64052

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-23 03:33:03 -06:00
Ronen Friedman
ee8e4150e4
Merge pull request #55107 from ronen-fr/wip-rf-rm-penaltyq
osd/scrub: remove the 'penalty queue' from the scrubber

Reviewed-by: Samuel Just <sjust@redhat.com>-
2024-01-23 07:57:39 +02:00
zdover23
27a0fc52f1
Merge pull request #55269 from zdover23/wip-doc-2024-01-23-radosgw-admin-read-write-global-rate-limit-config
doc/radosgw: edit "read/write global rate limit" admin.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-23 12:31:46 +10:00
Zac Dover
c67a5e5d4b doc/radosgw: edit "read/write global rate limit" admin.rst
Edit "Reading/Writing Global Rate Limit Configuration" in
doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-23 12:13:10 +10:00
Samuel Just
e50c80d682
Merge pull request #55223 from athanatos/sjust/wip-64055
crimson: clear obc_registry on interval change

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-22 13:26:19 -08:00
Jane Zhu
9b36e312dd rgw/multisite: add multisite test cases with some rgw instances down
Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
2024-01-22 15:15:32 -05:00
Yuri Weinstein
18149a703b
Merge pull request #55070 from pdvian/wip-fix-progressevent
mon: initialize ProgressEvent::add_to_ceph_s

Reviewed-by: Laura Flores <lflores@redhat.com>
2024-01-22 08:18:41 -08:00
Yuri Weinstein
4bc02269cb
Merge pull request #53154 from ifed01/wip-ifed-no-death-tests
test/store_test: get rid off assert_death.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2024-01-22 08:17:35 -08:00
Yuri Weinstein
9ea5edeb04
Merge pull request #49415 from ljflores/wip-update-telemetry-upgrade
qa/workunits: update telemetry quincy workunits with `basic_pool_options_bluestore` collection

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
2024-01-22 08:13:17 -08:00
Ronen Friedman
375d01a6aa osd/scrub: update job's NB on failure
When a scrub job fails, update its NB to the current time plus a
fixed delay.  This prevents the job from being scheduled again
immediately.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-22 08:29:35 -06:00
Ronen Friedman
af8939dd88 osd/scrub: fix set_last_deep_scrub_stamp()
The call should update last_scrub_stamp, too, without
requiring an extra call to on_scrub_schedule_input_change()

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-22 08:29:25 -06:00
Ronen Friedman
d294ea80cc osd/scrub: introduce a 'not before' attribute for scrub jobs
The NB enables the OSD to delay the next attempt to schedule a specific
scrub job.  This is useful for jobs that have failed for whatever
reason, especially if the primary has failed to acquire the replicas.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-22 07:25:25 -06:00
Ronen Friedman
e60c698338 osd/scrub: remove the 'penalized jobs' queue
The 'penalized jobs' queue was used to track scrub jobs that had failed
to acquire their replicas, and to prevent those jobs from being retried
too quickly.  This functionality will be replaced by a
simple 'not before' delay (see the next commits).

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-22 07:25:25 -06:00
Matan Breizman
62be5c7cae
Merge pull request #55262 from Matan-B/wip-matanb-crimson-bluestore-submit
crimson/os/alienstore/alien_log: _flush concurrently

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-22 10:44:23 +02:00
Matan Breizman
511af83e27 crimson/os/alienstore/alien_log: _flush concurrently
In continuation to c15e56e386

Authored-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-21 09:48:39 +00:00
zdover23
f265c99628
Merge pull request #55190 from zdover23/wip-doc-2024-01-16-radosgw-admin-enable-disable-bucket-rate-limit
doc/radosgw: edit "Enable/Disable Bucket Rate Limit"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-21 19:47:10 +10:00
Matan Breizman
5ba24c0454
Merge pull request #53288 from rzarzynski/wip-crimson-dont-shadow-store-in-ecbackend
crimson: drop store from ECBackend to not shadow PGBackend::store

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-21 10:44:29 +02:00
Matan Breizman
5365f70a92
Merge pull request #54813 from amathuria/wip-crimson-amat-fix-config-set-cmd
src/crimson: Add support for the OSD to receive config changes

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-21 10:43:59 +02:00
Ilya Dryomov
5cbc4d7e7d
Merge pull request #55127 from idryomov/wip-63341
librbd: improve rbd_diff_iterate2() performance in fast-diff mode

Reviewed-by: Mykola Golub <mgolub@suse.com>
2024-01-20 18:43:35 +01:00
Ilya Dryomov
40e8813e9c PendingReleaseNotes: add rbd_diff_iterate2 note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-01-20 16:06:54 +01:00
Ilya Dryomov
89b0d9e7b4 librbd: try to preserve object map for diff-iterate in fast-diff mode
As an optimization, try to ensure that the object map for the end
version is preloaded through the acquisition of exclusive lock and
as a consequence remains around until exclusive lock is released.
If it's not around, DiffRequest would (re)load it on each call.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-01-20 16:06:54 +01:00
Ilya Dryomov
0c4bb58c90 librbd/object_map: potentially use in-memory object map in DiffRequest
If the object map for the end version is around (already loaded in
memory, either due to the end version being a snapshot or due to
exclusive lock being held), use it to run diff-iterate against the
beginning of time.  Since it's the only object map needed in that
case, such calls would be satisfied locally.

Fixes: https://tracker.ceph.com/issues/63341
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-01-20 16:06:54 +01:00
Ilya Dryomov
dabb677ba5 librbd/object_map: decouple object map processing in DiffRequest
In preparation for potentially using in-memory object map, decouple
object map processing from loading object maps and place the logic in
prepare_for_object_map() and process_object_map().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-01-20 16:06:54 +01:00