Commit Graph

137239 Commits

Author SHA1 Message Date
zdover23
5da240be17
Merge pull request #50563 from zdover23/wip-doc-2023-03-17-rados-operations-upmap
doc/rados: line-edit upmap.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-17 15:54:32 +10:00
Zac Dover
a4a6818464 doc/rados: line-edit upmap.rst
Edit all of doc/rados/upmap.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-17 15:23:03 +10:00
Anthony D'Atri
61bc9d2564
Merge pull request #50564 from Thingee/update-foundation-202303
docs: Update Foundation members for March 2023
2023-03-16 18:32:42 -04:00
Mike Perez
ff52c3ebee docs: Update Foundation members for March 2023
Signed-off-by: Mike Perez <thingee@gmail.com>
2023-03-16 15:24:33 -07:00
Aravind Ramesh
917cba60ca crimson: fix build error
With -DWITH_SEASTAR=ON, build is failing.

src/crimson/osd/osd_operations/snaptrim_event.cc:174:29: error: ‘sleep’ is not a member of ‘seastar’

Signed-off-by: Aravind Ramesh <Aravind.Ramesh@wdc.com>
2023-03-16 14:23:47 +05:30
Lucian Petrut
5b2166fbd3 test/libcephfs: skip flaky timestamp assertion on Windows
There's a new libcephfs test that creates a snapshot and
compares ctime/mtime. The issue is that one of the assertion
fails on Windows, potentially due to reduced timestamp
precision.

For now, we'll skip those assertions on Windows.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-03-16 08:23:27 +00:00
Zac Dover
b7c19dac2d doc/rados: line-edit pg-repair.rst
Line edit pg-repair.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-16 17:12:55 +10:00
Pedro Gonzalez Gomez
21dc93ae11 mgr/dashboard: add button toggle to switch between new and old landing page
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-03-15 22:21:23 +01:00
Neha Ojha
313921afcf
Merge pull request #50534 from neha-ojha/wip-release-cl
doc/dev/release-checklists.rst: add after dev freeze section

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-15 12:50:42 -07:00
Adam King
efc6c58556 mgr/cephadm: handle HostConnectionError when checking for valid addr
Otherwise, the error is not properly passed back up the chain
and the user can get an error message like

TypeError: __init__() missing 2 required positional arguments: 'hostname' and 'addr'

when trying to add a host, despite the actual problem being

cephadm.ssh.HostConnectionError: Failed to connect to vm-01 (192.168.122.248). Permission denied

The tracker shows a bit more, but generally trying to add a host
that doesn't have the proper pub-key set as an authorized key
will get a misleasing error message. With this patch, the error message looks like

[ceph: root@vm-00 /]# ceph orch host add vm-01 192.168.122.29
Error EINVAL: Failed to connect to vm-01 (192.168.122.29). Permission denied
Log: Opening SSH connection to 192.168.122.29, port 22
[conn=1] Connected to SSH server at 192.168.122.29, port 22
[conn=1]   Local address: 192.168.122.156, port 49552
[conn=1]   Peer address: 192.168.122.29, port 22
[conn=1] Beginning auth for user root
[conn=1] Auth failed for user root
[conn=1] Connection failure: Permission denied
[conn=1] Aborting connection

which is much more useful

Fixes: https://tracker.ceph.com/issues/59081

Signed-off-by: Adam King <adking@redhat.com>
2023-03-15 13:18:02 -04:00
Matan Breizman
ee4cebedfe test/librados/snapshots_cxx: Enable OrderSnap for Crimson
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-03-15 16:17:53 +00:00
Matan Breizman
749e0ec558 crimson/osd/osd_operations/client_request: Support librados::OPERATION_ORDERSNAP
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-03-15 16:17:39 +00:00
Matan Breizman
b5ef106281 crimson/osd/client_request: Move writer SnapContext initialization
Move the initialization from PG::do_osd_ops() to ClientRequest::do_process()
in order to allow for ORDERSNAP error checking before do_osd_ops. (See next commit)

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-03-15 16:17:37 +00:00
Ilya Dryomov
3b1610997a qa/workunits/rbd: use bionic version of qemu-iotests for jammy
Same as in commit 2de2146c30 ("qa/workunits/rbd: use bionic version
of qemu-iotests for focal").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-03-15 17:12:36 +01:00
J. Eric Ivancich
637d461bf1 rgw: install rgw scripts with common files rather than radosgw files
Update ceph.spec.in and debian install files so
rgw-restore-bucket-index, rgw-orphan-list, rgw-gap-list,
rgw-gap-list-comparator are installed with common files.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2023-03-15 09:35:45 -04:00
Nizamudeen A
4ca01902bb
Merge pull request #50214 from rhcs-dashboard/landing-page-prom-error-fix
mgr/dashboard: fix prometheus api issues on landing page v3

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2023-03-15 12:11:48 +05:30
Yingxin
c2cedfb427
Merge pull request #47974 from zhscn/wip-evict
crimson/os/seastore: evict cold data to slower devices

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2023-03-15 11:02:43 +08:00
Zhang Song
c53446df68 test/crimson/seasatore: add evction test
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
5bc650a060 crimson/os/seastore/EPM: cleanup alloc_new_extent
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
6115635538 crimson/os/seasotre/segment_manager_group: ensure the types of devices are same
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
b40304092b crimson/os/seastore: add EPHEMERAL_COLD device type
rename SEGMENTED_EPHEMERAL to EPHEMERAL_MAIN

Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
45c53a26c6 crimson/os/seastore/EPM/BackgroundProcess: introduce more eviction policy
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
4aea0e266d crimson/os/seastore/EPM/BackgroundProcess: reserve space on cold cleaner
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
7b0ccecbce crimson/os/seastore: get segment info from cold segment provider
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
783c5e7662 crimson/os/seastore: support mark_space_{free, used} on cold_cleaner
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:33 +08:00
Zhang Song
b40f6421f0 src/vstart.sh: support specify the type of secondary device
doc/crimson: add options and example about SeaStore

Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:31 +08:00
Zhang Song
9283b72e47 crimson/os/seastore: change the category of COLL_BLOCK
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
1e515e8561 crimson/os/seastore: specify the device type explicitly when constructing BlockSegmentManager
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
89939e7ad7 crimson/os/seastore: make segment_manager work with HDD
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
0d20f1595a crimson/os/seasotre: add CLEANER_COLD transaction type
rename CLEANER to CLEANER_MAIN

Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
5876ef35b6 crimson/os/seastore: init cold segment cleaner
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
483e368268 crimson/os/seastore/SegmentCleaner: distinguish the cold cleaner from the normal
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
343f579748 crimson/os/seastore/EPM/BackgroundProcess: add cold_cleaner
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
944c1253bf crimson/os/seastore: move ool segment seq allocator to EPM
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
86e2f4b24b crimson/os/seastore/EPM: refactor reserve process
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Zhang Song
3adb17bf04 crimson/os/seastore/EPM/BackgroundProcess: rename cleaner to main_cleaner
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:21:08 +08:00
Matt Benjamin
3f2313f0e6 Do not duplicate query-string in ops-log
Fixes: https://tracker.ceph.com/issues/59059

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2023-03-14 20:46:09 -04:00
Neha Ojha
1e048aade9 doc/dev/release-checklists.rst: add after dev freeze section
- add release to redmine
- add milestone

Signed-off-by: Neha Ojha <nojha@redhat.com>
2023-03-14 18:45:30 +00:00
Ali Maredia
02172304dd
Merge pull request #50339 from cbodley/wip-qa-rgw-reef-upgrade
qa/rgw: add rgw/upgrade suite

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2023-03-14 13:59:34 -04:00
Pere Diaz Bou
cde9233083
Merge pull request #50409 from rhcs-dashboard/formly
mgr/dashboard: replace ajsf with formly


Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-03-14 11:41:16 -04:00
Xiubo Li
254eeb2730 libcephfs: move ClearSetuid to suidsgid.cc
And rename it to ChownClearSetuid, which will test the chown only.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 23:01:46 +08:00
Xiubo Li
8886f5f5dd libcephfs: add test cases for dropping the suid/sgid in write/truncate
Write/truncate by privileged user leaves the suid and sgid and by
unprivileged user will clear them.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 23:00:31 +08:00
Xiubo Li
36416b2df5 libcephfs: add test cases for dropping the suid/sgid in fallocate
This test cases are from xfstests-dev's generic/684.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 22:58:44 +08:00
Xiubo Li
463b932fff libcephfs: fix ClearSetuid incorrectly using SETATTR_MODE mask
Both the STATX_MODE and SETATTR_MODE equal 1, so the test didn't
fail.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 22:54:05 +08:00
Xiubo Li
c5153d77fa client: switch to clear_suid_sgid for ftruncate
Currently the ftruncate will always clear the suid/sgid even the
privileged users are truncating the file. This isn't consistent with
all the other existing filesystems in Linux.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 22:54:05 +08:00
Xiubo Li
2f9d9b9ccc client: switch to clear_suid_sgid for _write()
Currently the write will clear the suid/sgid always even the
privileged users are writing the file. This isn't consistent with
all the other existing filesystems in Linux.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 22:54:05 +08:00
Xiubo Li
1a56bf2ce7 mds/client: clear the suid/sgid in fallocate path
There is no Posix item requires that we should clear the suid/sgid
in fallocate code path but this is the default behaviour for most of
the filesystems and the VFS layer. And also the same for the write
code path, which have already support it.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 22:54:05 +08:00
Xiubo Li
db10cfc807 client: allow unprivileged users to clear suid/sgid
The fallocate path will try to clear the suid/sgid if a unprivileged
user changed the file. And the VFS will set the ATTR_MODE and at the
same time by clearing the suid/sgid mode bits.

There is no Posix item requires that we should clear the suid/sgid
in fallocate code path but this is the default behaviour for most of
the filesystems and the VFS layer. And also the same for the write
code path, which have already support it.

Fixes: https://tracker.ceph.com/issues/58680
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-14 22:54:05 +08:00
Rishabh Dave
e3c6e15165
Merge pull request #45960 from rishabh-d-dave/xfstests-dev-run-more-tests
qa/cephfs: upgrade xfstests_dev.py to run more tests

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-14 20:13:02 +05:30
zdover23
334fbf20ee
Merge pull request #50390 from Svelar/vstart-doc
doc/crimson: add SeaStore when using vstart.

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-15 00:23:02 +10:00