Commit Graph

140000 Commits

Author SHA1 Message Date
Xiubo Li
4af6a3f744 qa: add sudo paramter for read_file()
Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
77ac100979 test/libcephfs: remove reduntant test for acccess
The test.cc will be included in ceph_test_libcephfs, no need to
include it to access.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Ramana Raja
e64931b6a8 mds/Server: disallow clients that have root_squash
... MDS auth caps but don't have CEPHFS_FEATURE_MDS_AUTH_CAPS_CHECK
feature bit (i.e., can't check the auth caps sent back to it by the
MDS) from establishing a session. Do this in
Server::handle_client_session(), and Server::handle_client_reconnect(),
where old clients try to reconnect to MDS servers after an upgrade.

If the client doesn't have the ability to authorize session access
based on the MDS auth caps send back to it by the MDS, then the
client may buffer changes locally during open and setattr operations
when it's not supposed to, e.g., when enforcing root_squash MDS auth
caps.

Fixes: https://tracker.ceph.com/issues/56067
Signed-off-by: Ramana Raja <rraja@redhat.com>
2023-09-11 09:29:46 +08:00
Ramana Raja
96305b5eef mds/Locker: remove session check access when doing cap updates
as it's too late. Session access authorization already happens
before new caps are issued.

Fixes: https://tracker.ceph.com/issues/56067
Signed-off-by: Ramana Raja <rraja@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
ce216595c0 client: check the cephx mds auth access for open
Before opening the file locally we need to check the cephx access.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
f474203aee client: always set the caller_uid/gid to -1
Since the setattr will check the cephx mds auth access before
buffering the changes, so it makes no sense any more to let the
cap update to check the access in MDS again.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
b2046fc7ca mds: add CEPHFS_FEATURE_MDS_AUTH_CAPS_CHECK feature bit
This feature bit could be used to distinguish old and new clients.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
c1bf8d88e9 client: check the cephx mds auth access for setattr
If couldn't get the absolute path string we need to force it to
do the sync setattr.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
01a93986bf client: save the cap_auths in client when session being opened
Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
fd7aaab290 client: add make_path_string() helpers support
Will use this to get the path string to do the mds auth check. It
may fail when the there is no any dentry in local cache, which could
be caused by just unlinking the last dentry while the inode keeps
opening and then try to change the mode.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
429aafbb18 client: add _get_root_ino() helper support
Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
fa687be805 test/libcephfs: add a tag for each test unique directory
Make it to be easier to debug when searching the debug logs.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
27f73a9b9e client: rename MAY_* to CLIENT_MAY_* to avoid conflicts
Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:46 +08:00
Xiubo Li
c1cbb9acad mds: send the cap_auths to clients when openning the sessions
Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:29:04 +08:00
Xiubo Li
213a27aab0 mds: add cap_auths in MClientSession
It will include the uid/gids and path in each cap_auth.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:27:04 +08:00
Xiubo Li
6e4a644802 mds: add MDSCapAuth support
Need to add writeable/readable members and send them back to clients.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:27:04 +08:00
Xiubo Li
53caf31395 mds: encode/decode the MDSCapMatch
Will send this to clients.

Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:27:04 +08:00
Xiubo Li
5b6634c23d mds: add assign operator support for MDSCapMatch
Fixes: https://tracker.ceph.com/issues/57154
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-09-11 09:26:58 +08:00
Anthony D'Atri
9c233914dd
Merge pull request #53371 from zdover23/wip-doc-2023-09-11-architecture-2-of-x
doc/architecture.rst - edit a sentence
2023-09-10 13:38:53 -04:00
Zac Dover
436fbf7a3e doc/architecture.rst - edit a sentence
Change the sentence structure of a sentence because the verb
"experience" looked like the abstract noun "experience" when I read it
with fresh eyes. I chose the perhaps TESOL-unfriendly verb "incur", but
I believe it is right.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-11 02:38:26 +10:00
zdover23
e900cf5f32
Merge pull request #53353 from zdover23/wip-doc-2023-09-10-architecture-1-of-x
doc/architecture.rst - edit up to "Cluster Map"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-10 21:43:44 +10:00
Zac Dover
b3538f8ade doc/architecture.rst - edit up to "Cluster Map"
Edit doc/architecture.rst up to "Cluster Map", but not including
"Cluster Map".

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-10 21:16:33 +10:00
Anthony D'Atri
1de6ea7c8f
Merge pull request #53341 from alvinowyong/wip-doc-create-osd-warning
doc/cephadm/services: Add package conflict warning to osd.rst
2023-09-09 16:08:59 -04:00
Patrick Donnelly
7264120b26
Merge PR #53331 into main
* refs/pull/53331/head:
	Revert "Revert "Merge PR #53077 into main""

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-09-09 10:50:22 -04:00
zdover23
c51628ae66
Merge pull request #53334 from zdover23/wip-doc-2023-09-08-README-md-test-cluster-commands
doc: update test cluster commands in README.md

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-09 21:14:31 +10:00
zdover23
d787dd7e94
Merge pull request #53335 from zdover23/wip-doc-2023-09-08-rados-config-mon-config-ref-background
doc/configuration: edit "bg" in mon-config-ref.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-09 11:45:35 +10:00
Laura Flores
2810d1a5f8
Merge pull request #52539 from Matan-B/wip-matanb-61820
ceph_mon: Fix MonitorDBStore usage
2023-09-08 18:12:53 -04:00
Laura Flores
9c671cdbf9
Merge pull request #52485 from ifed01/wip-ifed-fix-btree-allocator
os/bluestore: fix btree allocator
2023-09-08 18:11:13 -04:00
Laura Flores
81c209d92b
Merge pull request #52211 from rzarzynski/wip-crimson-ec-classical-refactor
osd: dissect and abstract RMWPipeline from ECBackend for sharing it with crimson
2023-09-08 18:10:54 -04:00
Laura Flores
2ac39816dd
Merge pull request #52121 from cbodley/wip-blkdev-nodiscard
blkdev: fix nodiscard warning in get_device_metadata()
2023-09-08 18:10:33 -04:00
Alvin Owyong
38ec8e0692
docs: update warning message
truncated warning message according to comments

Signed-off-by: Alvin Owyong <70066269+alvinowyong@users.noreply.github.com>
2023-09-09 01:21:42 +08:00
Alvin Owyong
5e803567c7
docs: add warning about potential package conflict
Add warning for "creating new osds" section under cephadm services.

Signed-off-by: Alvin Owyong <70066269+alvinowyong@users.noreply.github.com>
2023-09-09 00:25:04 +08:00
Ilya Dryomov
bb8745e032
Merge pull request #51889 from idryomov/wip-61505
qa/suites/upgrade: enable default RBD image features

Reviewed-by: Mykola Golub <mgolub@suse.com>
2023-09-08 16:19:05 +02:00
Zac Dover
d009f0757c doc/configuration: edit "bg" in mon-config-ref.rst
Edit the English in the section "Background" in
doc/rados/configuration/mon-config-ref.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-08 22:03:54 +10:00
Zac Dover
8d606003af doc: update test cluster commands in README.md
The "rbd" pool has not been created by default since Luminous. This
commit removes a command that assumed the existence of the "rbd" pool.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-08 21:00:38 +10:00
Venky Shankar
7d5795dc37 Revert "Revert "Merge PR #53077 into main""
This reverts commit af4558f0ac.

Fixes: http://tracker.ceph.com/issues/62482
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-09-08 14:15:35 +05:30
Pedro Gonzalez Gomez
73fb5c76e4
Merge pull request #53244 from rhcs-dashboard/fix-62665-main
mgr/dashboard: Object gateway sync status cards keeps loading when multisite is not configured


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-08 10:21:26 +02:00
Pedro Gonzalez Gomez
db902eb0c7
Merge pull request #53239 from rhcs-dashboard/fix-62565-main
mgr/dashboard: Object gateway inventory card incorrect Buckets and user count

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-08 09:02:37 +02:00
Pedro Gonzalez Gomez
4ae1446a78
Merge pull request #53272 from rhcs-dashboard/fix-62684-main
mgr/dashboard: replace sync progress bar with last synced timestamp in rgw multisite sync status card


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-08 08:59:20 +02:00
Pedro Gonzalez Gomez
15fae5adae
Merge pull request #53248 from rhcs-dashboard/fix-62677-main
mgr/dashboard: rgw multisite topology view shows blank table for multisite entities


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-08 08:56:40 +02:00
J. Eric Ivancich
e7ed10f4d6
Merge pull request #52866 from ivancich/wip-bad-multiparts-listing
rgw: when there are a large number of multiparts, the unorder list result may miss objects

 Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-09-07 12:50:12 -04:00
J. Eric Ivancich
815481c637
Merge pull request #51071 from ivancich/wip-versioned-reindex
rgw: reindex of objects in versioned buckets

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-07 12:43:59 -04:00
J. Eric Ivancich
abfede8fb7
Merge pull request #52197 from imtzw/rm_op_ret
rgw: remove useless op ret assign

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-07 12:41:37 -04:00
J. Eric Ivancich
cbc4c2b30f
Merge pull request #52198 from ceph/wip-nitzan-ceph-dencoder-rgw-extend-types-available
ceph-dencoder: RGW - Add missing types

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-07 12:40:42 -04:00
J. Eric Ivancich
04e5c73ed9
Merge pull request #52684 from RickyMaRui/fix-2-null-versionID
rgw: fix 2 null versionID after convert_plain_entry_to_versioned

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-07 12:39:30 -04:00
J. Eric Ivancich
968573b3dd
Merge pull request #53027 from ivancich/wip-add-versioning-to-stats
rgw: add versioning status during `radosgw-admin bucket stats`

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2023-09-07 12:36:10 -04:00
Yuval Lifshitz
7077a7f51d
Merge pull request #53265 from yuvalif/wip-yuval-fix-62449
test/cls_2pc_queue: fix race condition with producers

Reviewed-by: ljflores mattbenjamin
2023-09-07 18:25:08 +03:00
Rishabh Dave
200b4aba0d
Merge pull request #53079 from rishabh-d-dave/ior-make-failures
qa/cephfs: fix ior project build failure

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-07 20:16:44 +05:30
Rishabh Dave
849fbd1d5b
Merge pull request #41779 from rishabh-d-dave/fs-auth-subcmd
mon,osd,mds: allow fs authorize to update caps

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-07 18:39:58 +05:30
NitzanMordhai
94021bb5f9 submodule: update ceph-object-corpus submodule
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2023-09-07 11:28:10 +00:00