Commit Graph

146678 Commits

Author SHA1 Message Date
Zac Dover
0ebfb3eda8 doc/cephfs: edit "is mount helper present"
Edit the section called "Is mount helper present?", the title of which
prior to this commit was "Is mount helper is present?". Other small
disambiguating improvements have been made to the text in the section.
An unselectable prompt has been added before a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-07-14 16:40:14 +10:00
Laura Flores
415f7ca0e8
Merge pull request #58324 from kamoltat/wip-ksirivad-fix-63784
qa/standalone/mon: Fix mkfs  test & TEST_LOG failures
2024-07-12 13:43:12 -05:00
Yuri Weinstein
d526572739
Merge pull request #58554 from ceph/wip-yuriw-release-process-main
docs: removed centos 8 and added squid to the build matrix

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-07-12 08:12:49 -07:00
Yuri Weinstein
8761bbe16c docs: removed centos 8 and added squid to the build matrix
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2024-07-12 06:42:02 -07:00
Casey Bodley
dac3b7df21
Merge pull request #58416 from cbodley/wip-cmake-zfs
cmake/os: remove WITH_ZFS option

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2024-07-12 13:44:45 +01:00
Rishabh Dave
3f4aee27ee
Merge pull request #58311 from rishabh-d-dave/fs-auth-nonalpha-test
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-07-12 16:23:47 +05:30
Nizamudeen A
67afcf6ce7
Merge pull request #58386 from YiteGu/dashboard-rename-api
mgr/dashboard: add cephfs rename REST API

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-07-12 12:54:47 +05:30
Nizamudeen A
3c60f06ea8
Merge pull request #58531 from rhcs-dashboard/fix-66901-main
mgr/dashboard: fix rgw configuration e2e test  

Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-07-12 12:53:39 +05:30
Nizamudeen A
b9584cca72
Merge pull request #57989 from rhcs-dashboard/multicluster-e2e
mgr/dashboard: multicluster management e2e tests

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
2024-07-12 12:49:29 +05:30
Nizamudeen A
91d48968a5
Merge pull request #57712 from rhcs-dashboard/dashboard-nvmf-mtls-conf
mgr/dashboard: use secure_channel for grpc requests

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: baum <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2024-07-12 10:40:02 +05:30
Rishabh Dave
e392142c65
Merge pull request #58101 from rishabh-d-dave/async-clone-race
mgr/vol: handle case where clone index entry goes missing

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2024-07-12 09:25:26 +05:30
Rishabh Dave
2130ec8ebc qa/cephfs: fix test_single_path_authorize_on_nonalphanumeric_fsname
This test deletes the CephFS already present on the cluster at the very
beginning and unmounts the first client beforehand. But it leaves the
second client mounted on this deleted CephFS that doesn't exist for the
rest of the test. And then at the very end of this test it attempts to
remount the second client (during tearDown()) which hangs and causes
test runner to crash.

Unmount the second client beforehand to prevent the bug and delete
mount_b object to avoid confusion for the readers in future about
whether or not 2nd mountpoint exists.

Fixes: https://tracker.ceph.com/issues/66077
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-07-11 22:08:06 +05:30
Rishabh Dave
3cff7251c8 mgr/vol: handle case where clone index entry goes missing
In `async_cloner.py`, clone index entry is fetched to get next clone job
that needs to be executed. It might happen that the clone job was
cancelled just when it was going to be picked for execution (IOW, when
it was about to move from pending state to in-progress state).

Currently, MGR hangs in such a case because exception `ObjectNotFound`
from CephFS Python bindings is raised and is left uncaught. To prevent
this issue catch the exception, log it and return None to tell
`get_job()` of `async_job.py` to look for next job in the queue.

Increase the scope of try-except in method `get_oldest_clone_entry()` of
`async_cloner.py` so that when exception `cephfs.Error` or any exception
under it is thrown by `self.fs.lstat()` is not left uncaught.

FS object is also passed to the method `list_one_entry_at_a_time()`, so
increasing scope of try-except is useful as it will not allow exceptions
raised in other calls to CephFS Python binding methods to be left
uncaught.

Fixes: https://tracker.ceph.com/issues/66560
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-07-11 22:03:21 +05:30
Casey Bodley
d622325c17
Merge pull request #58491 from cbodley/wip-66880
rgw/datalog: fix LazyFIFO race fix

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2024-07-11 15:33:21 +01:00
Anthony D'Atri
0325fd3c11
Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication
doc/radosgw: s/http/HTTP/
2024-07-11 08:06:29 -04:00
Ilya Dryomov
f92b4f5359
Merge pull request #58507 from idryomov/wip-66886
qa: account for rbd_trash object in krbd_data_pool.sh + related ceph{,adm} task fixes

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: N Balachandran <nibalach@redhat.com>
2024-07-11 14:03:16 +02:00
Rishabh Dave
384acdeb47
Merge pull request #57492 from rishabh-d-dave/qa-fs-mds-fail-improve
qa/cephfs: improvements for "mds fail" and "fs fail"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-07-11 16:37:16 +05:30
Matan Breizman
96ef390275
Merge pull request #58225 from guojidan/fix-mem-leak
crimson/osd/osd_operation: fix dump_historic_slow_ops command works

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-07-11 12:13:58 +03:00
Matan Breizman
c07bae3bfd
Merge pull request #58396 from NitzanMordhai/wip-nitzan-crimson-stat-pybind-test
suite/crimson: enable stats tests

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-07-11 11:47:29 +03:00
Aashish Sharma
23bc23aa8d mgr/dashboard: fix rgw configuration e2e test
Fixes: https://tracker.ceph.com/issues/66901

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2024-07-11 12:35:59 +05:30
Nizamudeen A
430623015a mgr/dashboard: multicluster management e2e tests
auth, edit, reconnect and disconnect another cluster

Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-07-11 12:11:01 +05:30
Nizamudeen A
2038b3e326
Merge pull request #58224 from Serrini/fix-66490-main
mgr/dashboard: add restful api for creating crush rule with type of 'erasure'

Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-07-11 11:49:30 +05:30
Zac Dover
56c9388155 doc/radosgw: s/http/HTTP/
s/http/HTTP/ in doc/radosgw/s3/authentication.rst, as suggested by
Anthony D'Atri in the location linked in the "Fixes:" line below.

Fixes: https://github.com/ceph/ceph/pull/58436#discussion_r1667088045

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-07-11 13:50:56 +10:00
Adam King
59acb549cd
Merge pull request #58382 from adk3798/cephadm-upgrade-test-start-points
qa/cephadm: change upgrade test start point to reef/squid

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-07-10 13:09:33 -04:00
Redouane Kachach
4194303966
Merge pull request #58440 from jmolmo/tls_4_exporter
exporter: Added https(TLSv13) support

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2024-07-10 18:17:20 +02:00
Adam King
1e2414e710
Merge pull request #58343 from skritik098/rgw-module-period-commit-retry-fix
mgr/rgw: Adding a retry config while calling zone_create()

Reviewed-by: Adam King <adking@redhat.com>
2024-07-10 11:15:45 -04:00
Adam King
690f4bc835
Merge pull request #58326 from adk3798/mgr-rgw-realm-token
mgr/rgw: fix setting rgw realm token in secondary site rgw spec

Reviewed-by: Redouane Kachach <rkachach@ibm.com>
2024-07-10 11:14:04 -04:00
Adam King
581068ae0b
Merge pull request #58321 from adk3798/jinja2-cephadm-rhel9
cephadm: make cephadm compatible with jinja2 2.11.3

Reviewed-by: Adam King <adking@redhat.com>
2024-07-10 11:08:02 -04:00
Nizamudeen A
5a89eae68c mgr/dashboard: fall back to server_cert
if root_ca is not found

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 0a393ca9bde714524da369caaef1c097472f791c)
2024-07-10 20:35:50 +05:30
Adam King
216980fdd3
Merge pull request #58298 from thegreenbear/cephadm-ingress-fix-ipv6-binding
Ingress service: Fix HAProxy to listen on IPv4 and IPv6 

Reviewed-by: Adam King <adking@redhat.com>
2024-07-10 10:39:23 -04:00
Adam King
029b4ea10f
Merge pull request #57535 from rkachach/fix_issue_66095
Adding support for ceph mgmt-gateway

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2024-07-10 10:33:06 -04:00
Yuri Weinstein
f4b0bb11e8
Merge pull request #58048 from mohit84/issue_66268
mgr: the mojibake characters in the MGR OP tracker output

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-07-10 06:41:56 -07:00
Yuri Weinstein
5a0b78552a
Merge pull request #57808 from rzarzynski/wip-bug-66297
mon: validate everybody understands MSR on set-require-min-compat-client 

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2024-07-10 06:41:32 -07:00
Yuri Weinstein
16e05cfbb5
Merge pull request #57777 from rzarzynski/wip-bug-66285
osd: bump versions of decoders for upmap-primary

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Josh Salomon <josh.salomon@gmail.com>
2024-07-10 06:40:50 -07:00
Yuri Weinstein
c5a5e76804
Merge pull request #57005 from cfsnyder/wip-cfsnyder-63195
mgr/Mgr.cc: clear daemon health metrics instead of removing down/out osd from daemon state

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-07-10 06:39:33 -07:00
Adam Kupczyk
ec469b9e09
Merge pull request #58506 from aclamk/wip-aclamk-fix-deferred-tests
test/objectstore: Fix DeferredReplayTest
2024-07-10 15:17:27 +02:00
Ilya Dryomov
26cee25873 qa/tasks/cephadm: drop --cluster and sudo in create_rbd_pool()
The cluster (name) is already specified in the arguments passed to
_shell() and this command doesn't need privileges.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-07-10 12:44:12 +02:00
Ilya Dryomov
0bda782952 qa/tasks/cephadm: don't wait for OSDs in create_rbd_pool()
This fails because teuthology.wait_until_osds_up() wants to use
adjust-ulimits wrapper which isn't available in "cephadm shell"
environment.  The whole thing is also redundant because cephadm task
is supposed to wait for OSDs to come up earlier, in ceph_osds().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-07-10 12:33:45 +02:00
Ilya Dryomov
fcc440da9a qa/tasks: initialize rbd pool instead of just tagging it
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-07-10 12:33:45 +02:00
Ilya Dryomov
f8e5aecfc7 qa: krbd_data_pool.sh: account for rbd_trash object
... created since commit 0bcb5cfce9 ("librbd/image: create rbd_trash
object during RBD pool initialization").

Fixes: https://tracker.ceph.com/issues/66886
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-07-10 12:33:45 +02:00
Adam Kupczyk
2cc1e8a057 test/objectstore: Fix DeferredReplayTest
Created ch = CollectionHandle was not reset, causing valgrind & other
problems.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
2024-07-10 08:21:46 +00:00
Radoslaw Zarzynski
f25386f7bc
Merge pull request #55196 from rzarzynski/wip-osd-ec-partial-reads
osd: EC Partial Stripe Reads (Retry of #23138 and #52746)

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-07-10 09:21:51 +02:00
Juan Miguel Olmo Martínez
cb660d2783
exporter: Added https(TLSv13) support
Ceph exporter can run now as http or https server

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2024-07-10 09:17:42 +02:00
sunlan
3a7f8e5e37 mgr/dashboard: add restful api for creating crush rule with type of 'erasure'
Fixes: https://tracker.ceph.com/issues/66490
Signed-off-by: sunlan <sunlan@asiainfo.com>
2024-07-10 14:44:07 +08:00
Casey Bodley
5dfbaac15f rgw/datalog: fix LazyFIFO race fix
initialize `fifo_tmp` to prevent the race on member variable `fifo` that
was identified in 8fa844383f

Fixes: https://tracker.ceph.com/issues/66880

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-07-09 18:19:03 -04:00
Zac Dover
82c91f67f4
Merge pull request #58484 from mcv21/patch-2
doc: Correct link to "Device management"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-07-10 07:27:00 +10:00
Matthew Vernon
d1a7cc4978 doc: Correct link to "Device management"
The current link goes to `cephadm/services/rados/operations/devices` which is a 404, it instead needs to be `rados/operations/devices/`.

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
2024-07-10 06:06:30 +10:00
Redouane Kachach
11aaee1176
mgr/cephadm: introducing nobody/nogroup constants
Signed-off-by: Redouane Kachach <rkachach@ibm.com>
2024-07-09 15:27:33 +02:00
Redouane Kachach
a093ba7e38
mgr/cephadm: adding documentation for cephadm mgmt-gateway service
Signed-off-by: Redouane Kachach <rkachach@ibm.com>
2024-07-09 15:27:33 +02:00
Redouane Kachach
17481c1528
mgr/cephadm: adding new cephadm service mgmt-gateway
adding mgmt-gateway, a new cephadm service based on nginx, to act as
the front-end and single entry point to the cluster. This gateway
offers unified access to all Ceph applications, including the
Ceph dashboard and monitoring tools (Prometheus, Grafana, ..),
while enhancing security and simplifying access management
through nginx.

Fixes: https://tracker.ceph.com/issues/66095

Signed-off-by: Redouane Kachach <rkachach@ibm.com>
2024-07-09 15:27:20 +02:00