Commit Graph

152895 Commits

Author SHA1 Message Date
Casey Bodley
eb3d949d5f
Merge pull request #62736 from adamemerson/wip-unbreak-d4n
rgw: Unbreak D4N

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
Reviewed-by: Samarah Uriarte <samarah.uriarte@ibm.com>
2025-04-18 16:23:21 -04:00
J. Eric Ivancich
57e5aef64e
Merge pull request #62850 from ivancich/wip-shard-report-crash
rgw: prevent crash in `radosgw-admin bucket object shard ...`

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jesse Williamson <jfw@ibm.com>
2025-04-18 14:14:31 -04:00
Casey Bodley
716d158ea8
Merge pull request #62871 from cbodley/wip-doc-rgw-user-admin-system
doc/rgw: document Admin and System Users

Reviewed-by: Seena Fallah <seenafallah@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2025-04-18 13:34:00 -04:00
Casey Bodley
5ac19049fa
Merge pull request #61486 from cbodley/wip-qa-rgw-s3tests-logging
qa/rgw: run-s3tests.sh disables bucket_logging tests

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>
2025-04-18 12:57:54 -04:00
Laura Flores
ac8d74a4ed
Merge pull request #62497 from bill-scales/ec_rollback_changes
osd: EC optimizations: changes to rollback to support partial writes
2025-04-18 10:43:15 -05:00
Laura Flores
7530afa2ff
Merge pull request #57740 from bill-scales/wip-bscales-align-write-buffers-v2
os/transaction: page align write data buffers to improve performance - version 2
2025-04-18 10:41:13 -05:00
Casey Bodley
dc93b888f1 doc/rgw: document Admin and System Users
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2025-04-18 11:29:56 -04:00
J. Eric Ivancich
a2b76b0e09 rgw: prevent crash in radosgw-admin bucket object shard ...
This subcommand is used to ask radosgw-admin which bucket index shard
a given object in a given bucket would have its bucket index entry
on. The user is required to supply the number of shards (i.e., the
command doesn't look that up). If 0 is provided it would result in a
divide by zero runtime exception. Values less than or equal to zero
are now protected.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2025-04-18 09:25:35 -04:00
Adam King
4448e6a2b9
Merge pull request #62803 from ShwetaBhosale1/fix_issue_70870_update_log_message_for_enabling_logrotate.timer
cephadm: Updated log message for enabling logrotate.timer service while bootstrap

Reviewed-by: Adam King <adking@redhat.com>
2025-04-18 09:00:33 -04:00
Max Kellermann
4e368a948c
Merge pull request #61800 from MaxKellermann/blk_includes
blk: add missing includes

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2025-04-18 10:48:08 +02:00
Ilya Dryomov
ed22d2ef08
Merge pull request #62849 from VinayBhaskar-V/WIP-instancereplayer-crash
rbd-mirror: release lock before calling m_async_op_tracker.finish_op()

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2025-04-18 10:37:56 +02:00
Casey Bodley
cdc04b8784 doc/rgw: Admin Capabilities section links to Admin Ops API
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2025-04-17 17:51:46 -04:00
Casey Bodley
4d2aa06050
Merge pull request #62819 from pritha-srivastava/wip-rgw-iam-oidc-caps
rgw/iam: correcting the caps for OIDC Provider for a user.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2025-04-17 12:54:21 -04:00
Rishabh Dave
a14374dccc
Merge pull request #62300 from rishabh-d-dave/mgr-vol-link-docs
doc/cephfs: link section for pausing async threads in section for...

Reviewed-by: Zac Dover <zac.dover@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2025-04-17 21:49:55 +05:30
Casey Bodley
f6d6aac4a6
Merge pull request #62766 from adamemerson/wip-70864
rgw: Don't print spurious error on `radosgw-admin` exit

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2025-04-17 12:03:31 -04:00
Casey Bodley
9392c9e9be
Merge pull request #62793 from BBoozmen/wip-oozmen-70270
rgw: metadata and data sync notification to retry upon any failure case

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2025-04-17 12:00:27 -04:00
Igor Fedotov
49f7f29261
Merge pull request #62828 from ifed01/wip-ifed-fix-70802
os/bluestore: eliminate build warning

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Adam Kupczyk<akupczyk@ibm.com>
2025-04-17 18:05:02 +03:00
Anthony D'Atri
91c7007bc3
Merge pull request #62859 from bluikko/doc-fixes-radosgw
doc/radosgw: Fix formatting, cosmetic issues, typos
2025-04-17 11:02:29 -04:00
Ville Ojamo
39e21444f0 doc/radosgw: Fix formatting, cosmetic issues, typos
Fix stray example command block leftover from rebase in
cloud-transition.rst.
Remove extra character > in cloud-sync-module.rst.
Add missing formatting char ` in cloud-sync-module.rst.
Remove extra empty line between example commands that
resulted in a line with just a "#" prompt.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2025-04-17 21:52:36 +07:00
VinayBhaskar-V
07e44074ae rbd-mirror: release lock before calling m_async_op_tracker.finish_op()
m_async_op_tracker.finish_op() in InstanceReplayer::start_image_replayers
may invoke a completion that re-enters code paths that attempt to acquire
the same mutex (m_lock), violating the non-recursive lock constraint.
This can be fixed by releasing the lock before calling
m_async_op_tracker.finish_op().

Fixes: https://tracker.ceph.com/issues/70951
Signed-off-by: VinayBhaskar-V <vvarada@redhat.com>
2025-04-17 18:46:56 +05:30
Yingxin Cheng
1e29203e8f
Merge pull request #61936 from xxhdx1985126/wip-seastore-omap-tree-pointer
crimson/os/seastore/omap_manager: apply linked tree nodes to omap trees

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2025-04-17 15:05:06 +08:00
Ronen Friedman
479d6bbd09
Merge pull request #62769 from ronen-fr/wip-rf-delayready
osd/scrub: discard delay_ready_t

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2025-04-17 08:03:01 +03:00
Anthony D'Atri
5ff2eb52c4
Merge pull request #62858 from bluikko/doc-fix-radosgw
doc/radosgw: Remove extra literal blocks in cloud-transition.rst
2025-04-16 23:46:28 -04:00
Ville Ojamo
90a64b8b10 doc/radosgw: Remove extra literal blocks in cloud-transition.rst
Fix double-colon literal blocks before blocks with
prompts, missed in rebase.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2025-04-17 10:35:32 +07:00
Zac Dover
d8c56dd47d
Merge pull request #62763 from bluikko/doc-prompts-radosgw
doc/radosgw: Promptify CLI, cosmetic fixes

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2025-04-17 12:55:27 +10:00
Casey Bodley
54f723624c
Merge pull request #62754 from cbodley/wip-64895
common: CephContext::_refresh_perf_values() checks for null _mempool_perf

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2025-04-16 15:45:32 -04:00
Anthony D'Atri
3feb479d3b
Merge pull request #62775 from bluikko/doc-releases-codeblocks
doc/releases: Fix invalid triple backticks in reef.rst squid.rst
2025-04-16 09:59:21 -04:00
Ronen Friedman
ce19a4eb33
Merge pull request #62818 from ronen-fr/wip-rf-iocnt-plus
osd/scrub: performance counters: count I/Os, use unlabeled counters

Reviewed-by: Alex Ainscow <aainscow@uk.ibm.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Bill Scales <bill_scales@uk.ibm.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2025-04-16 15:44:20 +03:00
Ville Ojamo
7fdaa94181 doc/radosgw: Promptify CLI, cosmetic fixes
Use the more modern prompt block for CLI commands
and use right one $ vs #.
Fix indentation on JSON example outputs and
some CLI command switches.
Add some arguably missing comma in JSON example output.
Add a full stop at the end of a one-sentence paragraph.
Remove extra comma mid-sentence in another.
Fix missing backslashes or typo at end of multiline commands.
Lines under section headings as long as heading text.
Fix hyperlinks. Fix list items prefixed with - insted of *.
Format configuration syntax in the middle of text as code.
Fix typo "PI" to "API" and remove extra space.
Remove colons at the end of section headers in a few places.
Use Title Case in section titles consistently with short words lowercase.
Possibly controversial: don't add whitespace before and
after main title section header text.
Possibly controversial: don't indent line continuation
backslashes, leave only 1 space before them.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2025-04-16 19:11:22 +07:00
Max Kellermann
c1d8bb02dc blk/kernel: add missing includes
Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
2025-04-16 09:44:00 +02:00
Max Kellermann
594532a86f extblkdev/vdo: add missing includes
Signed-off-by: Max Kellermann <max.kellermann@ionos.com>
2025-04-16 09:34:05 +02:00
Xuehan Xu
23cc895719 crimson/os/seastore/logical_child_node: drop unnecessary
"has_parent_tracker()" check

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2025-04-16 11:00:15 +08:00
Xuehan Xu
efb30b1011 crimson/os/seastore/logical_child_node: rename child_node_t to
lba_child_node_t

To be distinguished with omap nodes' child_node_t

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2025-04-16 11:00:15 +08:00
Xuehan Xu
9828cbed20 crimson/os/seastore/linked_tree_node: move "account_absent_access()" out
of ExtentTransViewRetriever

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2025-04-16 11:00:15 +08:00
Xuehan Xu
a5181afe4e crimson/os/seastore/onode: increase the default inline snapset size to
35

So that snapsets for un-snapshoted objects can be store inline with the
onode.

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2025-04-16 11:00:15 +08:00
Xuehan Xu
22bfce956b crimson/os/seastore/omap_manager: apply linked_tree_node to omap trees
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2025-04-16 11:00:15 +08:00
Zac Dover
7a2fecff1d
Merge pull request #62795 from laimis9133/main
doc/radosgw/cloud-transition: use reStructuredText for code

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2025-04-16 05:52:49 +10:00
Zac Dover
099292fca5
Merge pull request #62798 from zdover23/wip-doc-2025-04-14-squid-upgrade-warning
doc/releases: Direct users to upgrade to 19.2.2

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2025-04-16 05:32:04 +10:00
afreen23
1c3b9abcb4
Merge pull request #62792 from prik73/70719-fix-user-form-login-typo
mgr/dashboard: fix typo in User Management form (logon → login)

Reviewed-by: Afreen Misbah <afreen@ibm.com>
2025-04-16 00:24:58 +05:30
Matan Breizman
a2be67817f
Merge pull request #62812 from Matan-B/wip-matanb-crimson-only-backfill-stuck
crimson/osd: fix do_recovery returned boolean

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Mohit Agrawal <moagrawa@redhat.com>
2025-04-15 18:24:42 +03:00
Igor Fedotov
5ab163ea45 os/bluestore: eliminate build warning
Fixes: https://tracker.ceph.com/issues/70802

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
2025-04-15 16:47:49 +03:00
Nizamudeen A
b2d72c1c0b
Merge pull request #62744 from rhcs-dashboard/accounts-e2e
mgr/dashboard: rgw accounts UI e2e tests
2025-04-15 19:12:41 +05:30
Ronen Friedman
62f9b3645f osd/scrub: fixing scrub reservation process counters
Using regular (unlabeled) OSD performance counters for
tracking the scrub reservation performance.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2025-04-15 06:01:30 -05:00
Ronen Friedman
16cf2504e6 osd/scrub: turning additional counters into unlabeled
i.e. - moving counters from the 'scrbcnt_' enums into
the ScrubCounterSet object.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2025-04-15 06:01:30 -05:00
Ronen Friedman
2fec38b728 osd/scrub: a single counters selection mechanism - step 1
Following the preceeding PR, the Scrubber now employs
two methods for selecting the specific subset of performance
counters to update (the replicated pool set or the EC one).
The first method is using labeled counters, with 4 optional labels
(Primary/Replica X Replicated/EC Pool). The second method
is by naming the specific OSD counters to use in ScrubIoCounterSet
objects, then selecting the appropriate set based on the pool type.

This commit is the first step on the path to unifying the two
methods - discarding the use of labeled counters, and only
naming OSD counters.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2025-04-15 06:01:30 -05:00
Ronen Friedman
3aa61b365c osd/scrub: perf-counters for I/O performed by the scrubber
Define two sets of performance counters to track I/O performed
by the scrubber - one set to be used when scrubbing a PG
in a replicated pool, and one - for EC PGs.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2025-04-15 04:58:05 -05:00
Pritha Srivastava
d2585f853a rgw/iam: correcting the caps for OIDC Provider for a user.
Fixes: https://tracker.ceph.com/issues/70926

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2025-04-15 15:18:51 +05:30
Matan Breizman
8451cd2b4c crimson/osd: fix stuck recovery
https://github.com/ceph/ceph/pull/62080 tested version was **different**
from the one that got merged.
The untested change was changing the boolean returned from start_recovery_ops.
While the seastar::repeat loop in BackgroundRecoveryT<T>::start() was changed accordingly,
other do_recovery() return cases were not considered.

See Tested / Merged here: https://github.com/Matan-B/ceph/pull/2/files

start_recovery_ops used by do_recovery should return whether the iteration (i.e recovery) keep going.

_Note: This has caused a regression in our suite_

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2025-04-15 09:42:41 +00:00
Venky Shankar
583d50ab36
Merge pull request #61992 from dparmar18/ib61357
qa: add parallelized cleanup step in _rebuild_metadata()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2025-04-15 14:56:34 +05:30
Venky Shankar
dfa104e346 Merge PR #62259 into main
* refs/pull/62259/head:
	qa/tasks/cephfs/mount: introduce _default_gateway method
	qa/tasks/cephfs/mount: use 'ip r' instead 'route'

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2025-04-15 14:55:21 +05:30