Commit Graph

143847 Commits

Author SHA1 Message Date
Casey Bodley
6557309f4f
Merge pull request #55657 from ceph/wip-rgw-meta-topic
rgw: replicate v2 topic/notification metadata

Reviewed-by: Krunal Chheda <kchheda3@bloomberg.net>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2024-03-08 18:10:34 +00:00
Ilya Dryomov
d84485ec53 test/librbd: add DiffIterateTruncate and DiffIterateWriteAndTruncate
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-03-08 15:45:44 +01:00
Ilya Dryomov
0ebca5fe22 librbd: don't clip expanded diff on truncate in ObjectListSnapsRequest
If the diff was expanded due to LIST_SNAPS_FLAG_WHOLE_OBJECT, clipping
it when handling a truncate is wrong -- when subtracting that interval,
we either split the expanded extent into two or chop off a piece of it.
However the point of LIST_SNAPS_FLAG_WHOLE_OBJECT is to report a single
extent covering the entire object.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-03-08 15:45:44 +01:00
Ilya Dryomov
5b11fb314a librados/snap_set_diff: ignore truncates above size at start
Because currently calc_snap_set_diff() only ever appends to the running
diff, an excessive (either too large or completely bogus) zero extent
is reported in cases where an object is first expanded (with a snapshot
taken at that point) and then truncated but still above the size of the
object as of the starting snapshot.

Fixes: https://tracker.ceph.com/issues/63770
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-03-08 15:45:44 +01:00
Pedro Gonzalez Gomez
0a9aa2faec
Merge pull request #56006 from afreen23/http-error-pools-page
mgr/dashboard: handle infinite values for pools
2024-03-08 14:14:12 +01:00
Ivo Almeida
1b77baea8d mgr/dashboard: fix snap schedule list toggle cols
Added isInvisible property to CdColumnTable interface to hide column
from 'toggle columns' drop down checkboxes.

Fixes: https://tracker.ceph.com/issues/64813

Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
2024-03-08 11:46:55 +00:00
Ilya Dryomov
7822ee4a61
Merge pull request #55984 from xxhdx1985126/wip-rbd-cls-sparsify-test
test/cls_rbd/test_cls_rbd: change to check for 4KB-aligned sparse read

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-03-08 12:26:13 +01:00
Afreen
82d100ad26 mgr/dashboard: handle infinite values for pools
Fixes https://tracker.ceph.com/issues/64724

Issue:
======
Json parsing is failing because of Infinity values present in pools
meteadata. "read_balance": {"score_acting": Infinity, "score_stable":
Infinity,}
Due to this entire pool list is not rendered.

Fix:
====
Added a handler for checking "inf" values and replacing them with a
string "Infinity" so that json parsing does not fail on frontend.

Signed-off-by: Afreen <afreen23.git@gmail.com>
2024-03-08 15:52:53 +05:30
zdover23
ae8ab82fdc
Merge pull request #56045 from zdover23/wip-doc-2024-03-07-pgcalc
doc/rados: restore PGcalc tool

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-03-08 18:42:19 +10:00
Yingxin
da00a00b0b
Merge pull request #55981 from xxhdx1985126/wip-64728
crimson/os/seastore/collection_manager: allow empty-delta-buffer collection nodes

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-08 15:57:54 +08:00
Yingxin
efc59842f6
Merge pull request #55888 from myoungwon/wip-seastore-cleanup-is-stable-fix
crimson/os/seastore: cleanup and use LBAMapping::is_stable()

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-08 15:56:49 +08:00
Yingxin Cheng
2d2df50e24 crimson/os/seastore/transaction_manager: minor refinement to remap_pin() asserts
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-08 15:50:14 +08:00
Yingxin Cheng
bc97b82dcb test/crimson: drop cout from seastore tests
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-08 15:50:14 +08:00
Yingxin Cheng
3df6477809 crimson/os/seastore/../fixed_kv_node: add comment to copy-from-source
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-08 15:50:14 +08:00
Yingxin Cheng
8bca062d04 crimson/os/seastore: reuse link_phy_tree_root_node()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-08 15:50:14 +08:00
Yingxin Cheng
06cf024341 crimson/os/cache: get_extent_viewable_by_trans, the extent should be valid
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-08 15:50:03 +08:00
Afreen
014d4468fc mgr/dashboard: Locking improvements in bucket create form
Fixes https://tracker.ceph.com/issues/64658
- Addition of help texts
- Addition of info/warnings related to modes and versioning
- change of Locking section layout
- renaming locking to 'Object Locking'
- changes default retention period to 10
- edit bucket only shows lock when its enabled

Signed-off-by: Afreen <afreen23.git@gmail.com>
2024-03-08 12:21:28 +05:30
Zac Dover
eaaf722531 doc/rados: restore PGcalc tool
Restore the PGcalc tool to the documentation suite.

Co-authored-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-03-08 16:34:53 +10:00
Casey Bodley
7ef94cdb1c qa/rgw: notification suite creates a realm
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-03-07 18:07:51 -05:00
Casey Bodley
639d182732
Merge pull request #55652 from clwluvw/rgw-blockaccesspublic
rgw: compatibility issues on BucketPublicAccessBlock

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-03-07 16:02:39 +00:00
Anthony D'Atri
6246da8ed5
Merge pull request #56010 from zdover23/wip-doc-2024-03-07-start-get-involved
doc/start: add Slack invite link
2024-03-07 10:31:55 -05:00
Casey Bodley
1b1c162bd7
Merge pull request #55390 from qiuxinyidian/rgw-admin
rgw: add help info for radosgw-admin list object in bucket

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2024-03-07 15:12:07 +00:00
Matan Breizman
3a6d793ef3
Merge pull request #56027 from Matan-B/wip-matanb-crimson-docs-walkthrough
doc/dev/crimson: add Code Walkthroughs

Reviewed-by: Rongqi Sun <sunrongqi@huawei.com>
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2024-03-07 15:29:29 +02:00
Pedro Gonzalez Gomez
77fa1c365a
Merge pull request #55226 from rhcs-dashboard/fix-64080-main
mgr/dashboard: Allow the user to add the access/secret key on zone edit and not on zone creation


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-03-07 14:06:38 +01:00
Kotresh HR
d16480c364 tools/cephfs: Fix first-damage to include missing dirs
Don't skip root and lost+found directories while
checking for damaged metadata.

Fixes: https://tracker.ceph.com/issues/64615
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2024-03-07 17:18:05 +05:30
Yuval Lifshitz
1c13850f24 rgw/kafka: set message timeout to 5 seconds
also increase the idle timeout to 30 seconds.
test instructions:
https://gist.github.com/yuvalif/33487bff19883e3409caa8a843a0b353

Fixes: https://tracker.ceph.com/issues/64710

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-03-07 10:46:34 +00:00
Yingxin Cheng
05c916ba46 crimson/os/cache: cleanup get_extent(_by_type)
Distinguish caching vs absent get_extent interfaces, and misc related
cleanups.

After the lba parent-child pointer optimization, the absent path should
be used.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 17:18:48 +08:00
Yingxin Cheng
785634262b crimson/os/seastore: remove unecessary public interfaces
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 17:18:42 +08:00
Matan Breizman
13a771931b doc/dev/crimson: add Code Walkthroughs
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-03-07 09:15:49 +00:00
Xuehan Xu
e8b9ab73f4 crimson/os/seastore/collection_manager: allow empty-delta-buffer
collection nodes

Fixes: https://tracker.ceph.com/issues/64728
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-03-07 17:03:30 +08:00
Nizamudeen A
09c50063a3 mgr/dashboard: disable applitools e2e
Temporarily disabling this so the CI could turn green. Meanwhile I'll
research for a proper way to handle the applitools e2es which I'll track
on https://tracker.ceph.com/issues/64783

Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-03-07 14:13:54 +05:30
Yingxin Cheng
0558ef8b1a crimson/os/seastore/cache: drop the unnecessary friend fixed_kv_btree
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 13:44:15 +08:00
Nizamudeen A
57106cefdf
Merge pull request #55804 from rhcs-dashboard/nvmf-traddr-fix
mgr/dashboard: listener addr is always none

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2024-03-07 10:57:17 +05:30
zdover23
d0fcaf0ced
Merge pull request #55995 from zdover23/wip-doc-2024-03-06-architecture
doc/architecture: correct typo

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-03-07 13:17:53 +10:00
Zac Dover
dee319e612 doc/start: add Slack invite link
Add a link to the ceph-storage Slack invitation page. Previously the
link went to a plain old "this is the ceph-storage Slack" page that did
not direct the reader to sign up.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-03-07 13:01:47 +10:00
Xuehan Xu
6ec3fd9c62 test/cls_rbd/test_cls_rbd: change to check for 4KB-aligned sparse read
SeaStore::fiemap() can only supported 4096-aligned sparse read.

Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-03-07 09:53:50 +08:00
J. Eric Ivancich
ac30ee6cd9
Merge pull request #55967 from mkogan1/wip-rgw-ssl-ses-id-reuse
rgw/beast: Enable SSL session-id reuse speedup mechanism

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 20:53:13 -05:00
J. Eric Ivancich
d79a95de28
Merge pull request #55895 from linuxbox2/wip-sigv4-boundary
rgw_sigv4: handle '0;' as trailer-chunk boundary

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 20:52:59 -05:00
J. Eric Ivancich
185de7c13d
Merge pull request #55885 from ivancich/wip-enhance-restore-bi
rgw: make rgw-restore-bucket-index more robust

Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
2024-03-06 20:52:31 -05:00
Yingxin
241d2c5297
Merge pull request #55977 from myoungwon/wip-allow-dirty-remap
crimson/os/seastore: allow to remap the dirty extent

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 09:39:02 +08:00
Venky Shankar
0f82aa5a6b Merge PR #55909 into main
* refs/pull/55909/head:
	qa/cephfs: add `MON_DOWN' and `deprecated feature inline_data' to ignorelist

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-03-07 07:06:39 +05:30
Venky Shankar
0b992b7fd1 Merge PR #55908 into main
* refs/pull/55908/head:
	qa: ignore container checkpoint/restore related selinux denials for centos9
	qa: use allowlist instead of whitelist for selinux denials

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-03-07 07:05:20 +05:30
Venky Shankar
e587dcd970 Merge PR #55639 into main
* refs/pull/55639/head:
	mds: relax certain asserts in mdlog replay thread

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-03-07 07:03:51 +05:30
Casey Bodley
4ac0b7df3c qa/rgw: teach rgw.py to create an optional realm
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 18:00:11 -05:00
Casey Bodley
28d56124e9
Merge pull request #56000 from cbodley/wip-64678
rpm: disable system_qat for non-x86_64 arch

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-03-06 21:07:11 +00:00
Leonid Usov
8b896a9e14 mds/quiesce-db: keep the db thread alive until shutdown
With the change we can now avoid having to join it during the membership update, preventing potential deadlocks

Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
2024-03-06 18:07:19 +02:00
Daniel Gryniewicz
2d4a3ca5c9 RGW - Swift retarget needs bucket set on object
When a bucket list is retargeted to an object get, then the object may
not yet have it's bucket set.  Ensure the bucket is set on the object.

Fixes: https://tracker.ceph.com/issues/56029
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2024-03-06 19:41:23 +04:00
Casey Bodley
25ce4845f5 rpm: disable system_qat for non-x86_64 arch
Fixes: https://tracker.ceph.com/issues/64678

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 09:25:23 -05:00
Patrick Donnelly
ea9a5688d9
Merge PR #55820 into main
* refs/pull/55820/head:
	qa/crontab: bring back nightlies of release branches
	qa/crontab: update upgrade runs for squid/main
	qa/crontab: update reef upgrade tests
	qa/crontab: update quincy upgrade tests
	qa/crontab: remove EOL branches
	qa/crontab: add spacing
	qa/crontab: update smoke tests for releases

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2024-03-06 08:58:43 -05:00
Adam King
576cf45b75
Merge pull request #55955 from guits/node-proxy-fixes-7.1-blockers-1
mgr/node-proxy: handle 'None' statuses returned by RedFish

Reviewed-by: Adam King <adking@redhat.com>
2024-03-06 08:37:45 -05:00