Commit Graph

140756 Commits

Author SHA1 Message Date
Nizamudeen A
f5c7649c24
Merge pull request #53991 from rhcs-dashboard/fix-cephfs-edit-form-placement
mgr/dashboard: disable hosts field while editing the filesystem 

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
2023-10-18 12:19:57 +05:30
Ilya Dryomov
c31f506768
Merge pull request #54002 from idryomov/wip-63028
pybind/rbd: don't produce info on errors in aio_mirror_image_get_info()

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-10-17 13:20:59 +02:00
Ilya Dryomov
a567f55bb6
Merge pull request #53800 from batrick/cmake-debug-wrn
CMakeLists: warn if CMAKE_BUILD_TYPE is set/unset

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-10-17 13:14:25 +02:00
Adam King
28cb4d10b1
Merge pull request #53802 from phlogistonjohn/jjm-cephadm-dtypes-2
cephadm: convert more types to be based on ContainerDaemonForm

Reviewed-by: Adam King <adking@redhat.com>
2023-10-16 15:33:53 -04:00
Casey Bodley
b2d0278750
Merge pull request #53351 from ceph/QE_defect_fixes
rgw/s3select: fix per QE defect.
2023-10-16 17:02:52 +01:00
Patrick Donnelly
b8c6ba01b2
CMakeLists: warn if CMAKE_BUILD_TYPE is set/unset
At some point the debug builds for wip branches no longer had the .git
directory available so the Debug build type was unset. This meant we are
no longer doing numerous checks (like mutex ownership checks) that we
would normally be doing in the qa suite.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-10-16 12:01:06 -04:00
zdover23
4a426ea801
Merge pull request #54022 from zdover23/wip-doc-2023-10-15-rados-troubleshooting-troubleshooting-osd-3-of-x
doc/rados: Edit troubleshooting-osd (3 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-16 09:39:20 +10:00
Zac Dover
01b5aa5d27 doc/rados: Edit troubleshooting-osd (3 of x)
Edit doc/rados/troubleshooting/troubleshooting-osd.rst (3 of x).

Follows https://github.com/ceph/ceph/pull/53986.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-16 09:25:37 +10:00
Yuval Lifshitz
9b943423e5
Merge pull request #53547 from yuvalif/wip-yuval-req-context
rgw: adding request context structure

reviewed-by: dang, cbodley
2023-10-15 09:51:25 +03:00
Anthony D'Atri
984ba140e1
Merge pull request #54006 from zdover23/wip-doc-2023-10-14-filestore-deprecation
doc/rados: remove FileStore material (in Reef)
2023-10-13 14:50:21 -04:00
Zac Dover
eab0be5ca5 doc/rados: remove FileStore material (in Reef)
Remove FileStore-related material because FileStore is not supported in
Reef.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-14 04:40:26 +10:00
Anthony D'Atri
66e596a8cd
Merge pull request #54005 from zdover23/wip-doc-2023-10-14-dev-cache-pool-removal
doc/dev: remove cache-pool
2023-10-13 14:25:59 -04:00
Zac Dover
073b0919ed doc/dev: remove cache-pool
Remove cache-pool, which is deprecated in Reef.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-14 04:17:44 +10:00
Kamoltat (Junior) Sirivadhna
cdf5c2d5fc
Merge pull request #53979 from kamoltat/wip-ksirivad-fix-63183
src/mon/Monitor: Fix set_elector_disallowed_leaders
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2023-10-13 11:44:36 -04:00
Ilya Dryomov
01fff6a72a mgr/rbd_support: make type hits on aio_mirror_image_*() callbacks better
Make it clear that mirror mode, mirror info and snap ID can be None if
the respective operation fails.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-10-13 17:39:26 +02:00
Ilya Dryomov
a81bd2db3a pybind/rbd: don't produce info on errors in aio_mirror_image_get_info()
Check completion return value before attemting to decode c_info.
Otherwise we are guaranteed to access invalid memory in decode_cstr()
while trying to compute global_id string length when the client is
blocklisted for example.

Fixes: https://tracker.ceph.com/issues/63028
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-10-13 17:39:26 +02:00
Adam Kupczyk
9b8e8d93b6
Merge pull request #53732 from pereman2/bluefs-expand-bug
os/bluestore: fix bluefs _extend_log seq update
2023-10-13 16:07:57 +02:00
zdover23
26f89fc8bc
Merge pull request #53986 from zdover23/wip-doc-2023-10-12-rados-troubleshooting-troubleshooting-osd-2-of-x
doc/rados: Edit troubleshooting-osd (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-13 23:40:38 +10:00
Zac Dover
37e7099267 doc/rados: Edit troubleshooting-osd (2 of x)
Edit doc/rados/troubleshooting/troubleshooting.rst (2 of x).

Follows https://github.com/ceph/ceph/pull/53936.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-13 23:03:33 +10:00
Yingxin
833bf7ec7e
Merge pull request #53234 from xxhdx1985126/wip-seastore-onode-manager-replay
crimson/os/seastore/onode_manager: populate delta recorders for each onode modification

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-10-13 16:28:34 +08:00
Nizamudeen A
b18a1441be mgr/dashboard: disable hosts field while editing the filesystem
Even though the Placement field was disabled, the Host field was still
showing up in UI while Editing. That option is not possible in fs form.

Fixes: https://tracker.ceph.com/issues/63193
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-10-13 13:17:05 +05:30
galsalomon66
99d12712c5 fix per QE defect.
s3select submodule

s3select engine changes

s3select submodule
aggregation functions upon no data

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2023-10-12 23:31:15 +03:00
Kamoltat
5d1b5da215 src/mon/Monitor: Fix set_elector_disallowed_leaders
Problem:

In the monitors we hold 2 copies of disallowed_leader ...
1. MonMap class 2. Elector class.
When computing the ConnectivityScore for the monitors during
the election, we use the `disallowed_leader` from Elector
class to determine which monitors we shouldn't allow to lead.

Now, we rely on the function `set_elector_disallowed_leaders`
to set the `disallowed_leader` of the Elector class, MonMap
class copy of the `disallowed_leader` contains the
`tiebreaker_monitor` so we inherit that plus we also add the
monitors that are dead due to a zone failure.

Hence, the `adding dead monitors` phase is only allowed if we can
enter stretch_mode. However, there is a problem when failing over a stretch cluster
zone and reviving the entire zone back up, the revived monitors
couldn't enter stretch_mode when they are at the state of "probing"
since PaxosServices like osdmon becomes unreadable (this is expected)

Solution:

We unconditionally add monitors that are in
`monmap->stretch_marked_down_mons` to the
`disallowed_leaders` list in
`Monitor::set_elector_disallowed_leaders` since
if the monitors are in `monmap->stretch_marked_down_mons`
we know that they probably belong in a marked down
zone and is not fit for lead.

This will fix the problem of newly revived monitors
having different disallowed_leaders set
and getting stuck in election.

Fixes: https://tracker.ceph.com/issues/63183

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2023-10-12 20:07:12 +00:00
Ilya Dryomov
4e051e66a3
Merge pull request #53914 from idryomov/wip-63149
qa/suites/rbd: drop cache tiering workload tests

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2023-10-12 21:29:05 +02:00
Adam King
b15daa4888
Merge pull request #51416 from adk3798/jaeger-agent-dep
mgr/cephadm: make jaeger-collector a dep for jaeger-agent

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-10-12 15:24:26 -04:00
Yuri Weinstein
869c1cf7af
Merge pull request #53980 from ceph/wip-yuri-crontab-main
qa/tests: fixed typo and added `--force-priority` in missing places

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-12 07:56:01 -07:00
Yingxin
b044a965af
Merge pull request #53062 from xxhdx1985126/wip-seastore-list-objects
crimson/os/seastore: return ghobject_t::max as the end when list_objects reaches the end of the listing

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2023-10-12 14:44:11 +08:00
zdover23
3a9a5e8688
Merge pull request #53936 from zdover23/wip-doc-2023-10-11-rados-troubleshooting-troubleshooting-osd-1-of-x
doc/rados: edit troubleshooting-osd (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-12 15:15:58 +10:00
Zac Dover
0fc663d793 doc/rados: edit troubleshooting-osd (1 of x)
Edit doc/rados/troubleshooting/troubleshooting-osd.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-12 15:00:35 +10:00
Yuval Lifshitz
8532f596e6 tracing/osd/rgw: using jspan as alias to opentelemetry::Span
and jspan_ptr as jspan shared pointer

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-10-12 04:54:37 +00:00
Yuval Lifshitz
c992ab86d6 rgw: adding request context structure
this structure should be created at the frontend and trickle all the way
to the RADOS layer. holding: dout prefix, optional yield and trace.
in this commit, so far it was only added to the "complete()" sal interface,
and to the "write_meta()" rados interface.

in the future, it should be added to more sal interfaces, replacing the
current way where dpp and optional yield are passed as sepearte
arguments to all functions.
in addition, if more information would be needed, it should be possible
to add that information to the request context struct without changing
many function prototypes

basic test instructions:
https://gist.github.com/yuvalif/1c7f1e80126bed5fa79345efb27fe1b1

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-10-12 04:54:37 +00:00
zdover23
b09454acd4
Merge pull request #53971 from zdover23/wip-doc-2023-10-12-start-get-involved-slack
doc/start: add Slack to get-involved

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-12 13:44:24 +10:00
Yuri Weinstein
163f79a810 qa/tests: fixed typo and added --force-priority in missing places
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-11 15:07:02 -07:00
Zack Cerza
0e959b9800
Merge pull request #53926 from zmc/workunit-assert-client-role
qa/tasks/workunit: improve assert on client names
2023-10-11 15:10:14 -06:00
Kamoltat
17bd0c6aca src/mon: Added more loggings for disallowed_leaders
Added more loggings regarding the disallowed_leaders
set so that it is easier to debug problems like:

https://tracker.ceph.com/issues/63183

Fixes: https://tracker.ceph.com/issues/63183

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2023-10-11 21:08:19 +00:00
Zac Dover
c0e9ed15e1 doc/start: add Slack to get-involved
Add a link to the Ceph Slack to doc/start/get-involved.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-12 02:29:12 +10:00
Casey Bodley
6e66389a09
Merge pull request #53846 from cbodley/wip-62989-again
rgw: fix http error checks in keystone/barbican/vault clients

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-10-11 16:59:20 +01:00
Radoslaw Zarzynski
0a193b0b1b
Merge pull request #53579 from Matan-B/wip-matanb-reset_purged_snaps_last
osd/OSD: introduce reset_purged_snaps_last

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-10-11 17:01:44 +02:00
zdover23
f747ab3d09
Merge pull request #53908 from zdover23/wip-doc-2023-10-10-troubleshooting-troubleshooting-memory-profiling
doc/rados: edit memory-profiling.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-11 10:39:53 +10:00
Yuri Weinstein
e6f7f80f55
Merge pull request #53930 from ceph/wip-yuri-crontab-main
qa/tests: Added upgrade/reef-x to the mix

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-10 16:01:19 -07:00
Yuri Weinstein
5457b5aa3e qa/tests: Added upgrade/reef-x to the mix
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-10 12:00:12 -07:00
Yuri Weinstein
139f9d1505
Merge pull request #53085 from ceph/wip-yuriw-reef-x-main
qa/tests: initial reef-x check in

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-10 11:55:24 -07:00
Zack Cerza
64d6a91cd6 workunit: Improve assert on client names
Instead of a bare AssertionError, we can mention the problematic value.

Signed-off-by: Zack Cerza <zack@redhat.com>
2023-10-10 11:23:20 -06:00
Adam King
344234c0c6
Merge pull request #53862 from adk3798/nvmeof-upgrade
mgr/cephadm: fix upgrades with nvmeof

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-10-10 12:08:43 -04:00
Laura Flores
18ac19a7ae
Merge pull request #53900 from ljflores/wip-fix-stress-split-tests
qa/suites/upgrade: fix env indentation in stress-split upgrade tests
2023-10-10 11:52:01 -04:00
John Mulligan
ead4cf25c9 cephadm: convert ceph exporter type to a ContainerDaemonForm
CephExporter was being (partially) over-shadowed by the Ceph class as
the Ceph class listed 'ceph-exporter' as one of the daemon types it
handled. This change updates CephExporter to a ContainerDaemonForm while
simultaneously breaking the link between Ceph and 'ceph-exporter',
allowing CephExporter to handle all the duty of managing ceph-exporter,
continuing the process of having clearer logical responsibilities and
class hierarchy in cephadm.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
d9314780a5 cephadm: mock os.path.listdir in daemon forms test
Prevent classes that want to check the filesystem from breaking the
simple daemon forms instantiation test case. A better future fix would
be avoiding checking the file system during __init__ of the class but
that is left for future improvements.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
28fe98bd59 cephadm: stop directly using Ceph.daemons property
The Ceph.daemons property has two unfortunate behaviors: most important,
it includes ceph-exporter which causes the other CephExporter class to
be over-shadowed the DaemonForms mechanism. Second, it couples all
functions that want to know the names of ceph daemon types to the Ceph
class preventing future refactoring of that class.

Break the existing coupling by adding a new `ceph_daemons` function
similar to `get_supported_daemons` but returning the same value that
Ceph.daemons used to provide. This will permit future fixes and
improvements.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
af2058536b cephadm: eliminate _dispatch_deploy function
Eliminate the _dispatch_deploy function, folding it into the
_common_deploy function, because the mass of if-elif lines have
been replaced and keeping it as a separate function no longer
serves much of a useful purpose.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
f8acdf01cb cephadm: convert ceph class to a ContainerDaemonForm
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00