Commit Graph

140786 Commits

Author SHA1 Message Date
zdover23
3a9a5e8688
Merge pull request #53936 from zdover23/wip-doc-2023-10-11-rados-troubleshooting-troubleshooting-osd-1-of-x
doc/rados: edit troubleshooting-osd (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-12 15:15:58 +10:00
Zac Dover
0fc663d793 doc/rados: edit troubleshooting-osd (1 of x)
Edit doc/rados/troubleshooting/troubleshooting-osd.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-12 15:00:35 +10:00
Yuval Lifshitz
8532f596e6 tracing/osd/rgw: using jspan as alias to opentelemetry::Span
and jspan_ptr as jspan shared pointer

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-10-12 04:54:37 +00:00
Yuval Lifshitz
c992ab86d6 rgw: adding request context structure
this structure should be created at the frontend and trickle all the way
to the RADOS layer. holding: dout prefix, optional yield and trace.
in this commit, so far it was only added to the "complete()" sal interface,
and to the "write_meta()" rados interface.

in the future, it should be added to more sal interfaces, replacing the
current way where dpp and optional yield are passed as sepearte
arguments to all functions.
in addition, if more information would be needed, it should be possible
to add that information to the request context struct without changing
many function prototypes

basic test instructions:
https://gist.github.com/yuvalif/1c7f1e80126bed5fa79345efb27fe1b1

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-10-12 04:54:37 +00:00
zdover23
b09454acd4
Merge pull request #53971 from zdover23/wip-doc-2023-10-12-start-get-involved-slack
doc/start: add Slack to get-involved

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-12 13:44:24 +10:00
Yuri Weinstein
163f79a810 qa/tests: fixed typo and added --force-priority in missing places
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-11 15:07:02 -07:00
Zack Cerza
0e959b9800
Merge pull request #53926 from zmc/workunit-assert-client-role
qa/tasks/workunit: improve assert on client names
2023-10-11 15:10:14 -06:00
Kamoltat
17bd0c6aca src/mon: Added more loggings for disallowed_leaders
Added more loggings regarding the disallowed_leaders
set so that it is easier to debug problems like:

https://tracker.ceph.com/issues/63183

Fixes: https://tracker.ceph.com/issues/63183

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2023-10-11 21:08:19 +00:00
Zac Dover
c0e9ed15e1 doc/start: add Slack to get-involved
Add a link to the Ceph Slack to doc/start/get-involved.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-12 02:29:12 +10:00
Casey Bodley
6e66389a09
Merge pull request #53846 from cbodley/wip-62989-again
rgw: fix http error checks in keystone/barbican/vault clients

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-10-11 16:59:20 +01:00
Radoslaw Zarzynski
0a193b0b1b
Merge pull request #53579 from Matan-B/wip-matanb-reset_purged_snaps_last
osd/OSD: introduce reset_purged_snaps_last

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-10-11 17:01:44 +02:00
Redouane Kachach
15cebf2ad9
mgr/rook: Addint UT for rook cluster
Fixes: https://tracker.ceph.com/issues/63107

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-10-11 10:59:33 +02:00
zdover23
f747ab3d09
Merge pull request #53908 from zdover23/wip-doc-2023-10-10-troubleshooting-troubleshooting-memory-profiling
doc/rados: edit memory-profiling.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-10-11 10:39:53 +10:00
Yuri Weinstein
e6f7f80f55
Merge pull request #53930 from ceph/wip-yuri-crontab-main
qa/tests: Added upgrade/reef-x to the mix

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-10 16:01:19 -07:00
Yuri Weinstein
5457b5aa3e qa/tests: Added upgrade/reef-x to the mix
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-10 12:00:12 -07:00
Yuri Weinstein
139f9d1505
Merge pull request #53085 from ceph/wip-yuriw-reef-x-main
qa/tests: initial reef-x check in

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-10 11:55:24 -07:00
Zack Cerza
64d6a91cd6 workunit: Improve assert on client names
Instead of a bare AssertionError, we can mention the problematic value.

Signed-off-by: Zack Cerza <zack@redhat.com>
2023-10-10 11:23:20 -06:00
Adam King
344234c0c6
Merge pull request #53862 from adk3798/nvmeof-upgrade
mgr/cephadm: fix upgrades with nvmeof

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-10-10 12:08:43 -04:00
Laura Flores
18ac19a7ae
Merge pull request #53900 from ljflores/wip-fix-stress-split-tests
qa/suites/upgrade: fix env indentation in stress-split upgrade tests
2023-10-10 11:52:01 -04:00
John Mulligan
ead4cf25c9 cephadm: convert ceph exporter type to a ContainerDaemonForm
CephExporter was being (partially) over-shadowed by the Ceph class as
the Ceph class listed 'ceph-exporter' as one of the daemon types it
handled. This change updates CephExporter to a ContainerDaemonForm while
simultaneously breaking the link between Ceph and 'ceph-exporter',
allowing CephExporter to handle all the duty of managing ceph-exporter,
continuing the process of having clearer logical responsibilities and
class hierarchy in cephadm.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
d9314780a5 cephadm: mock os.path.listdir in daemon forms test
Prevent classes that want to check the filesystem from breaking the
simple daemon forms instantiation test case. A better future fix would
be avoiding checking the file system during __init__ of the class but
that is left for future improvements.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
28fe98bd59 cephadm: stop directly using Ceph.daemons property
The Ceph.daemons property has two unfortunate behaviors: most important,
it includes ceph-exporter which causes the other CephExporter class to
be over-shadowed the DaemonForms mechanism. Second, it couples all
functions that want to know the names of ceph daemon types to the Ceph
class preventing future refactoring of that class.

Break the existing coupling by adding a new `ceph_daemons` function
similar to `get_supported_daemons` but returning the same value that
Ceph.daemons used to provide. This will permit future fixes and
improvements.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
af2058536b cephadm: eliminate _dispatch_deploy function
Eliminate the _dispatch_deploy function, folding it into the
_common_deploy function, because the mass of if-elif lines have
been replaced and keeping it as a separate function no longer
serves much of a useful purpose.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
John Mulligan
f8acdf01cb cephadm: convert ceph class to a ContainerDaemonForm
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-10-10 10:33:48 -04:00
Zac Dover
3be932425e doc/rados: edit memory-profiling.rst
Edit doc/rados/troubleshooting/memory-profiling.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-10 23:47:33 +10:00
Matan Breizman
680e088b8d qa/tasks/ceph_manager: thrash - add reset_purged_snaps_last
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-10-10 12:04:32 +00:00
Juan Miguel Olmo
b7b7ef90f4
Merge pull request #50132 from aruniiird/add-rbd-mirror-mon-alerts
ceph-mixin: Add RBD Mirror monitoring alerts
2023-10-10 13:37:01 +02:00
Ilya Dryomov
e40752ec25 qa/suites/rbd: drop redundant ignorelist entries
CACHE_POOL_NO_HIT_SET is retained in *api_tests*.yaml and
rbd_mirror.yaml snippets for TestLibRBD.ListChildrenTiered and
TestClusterWatcher.CachePools tests.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-10-10 12:50:36 +02:00
Redouane Kachach
90ae55f6d1
mgr/rook: fixing rook-ceph-exporter daemon type handling
Fixes: https://tracker.ceph.com/issues/63107

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-10-10 12:39:16 +02:00
Xuehan Xu
e989538a34 crimson/os/seastore: return ghobject_t::max as the end when list_objects
reaches the end of the listing

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-10-10 17:33:39 +08:00
Ilya Dryomov
83880580aa qa/suites/rbd: deduplicate (data) pool facets
With cache tiering facets gone, "pool" facets are strictly about
--data-pool option now.  Rename to "data-pool" and create symlinks
to a common directory.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-10-10 09:42:24 +02:00
Ilya Dryomov
194dd09263 qa/suites/rbd: drop cache tiering workload tests
Cache tiering facets have been a constant source of job timeouts
accompanied by "slow request" warnings on the OSDs for at least two
years.  Same workloads pass without pool/small-cache-pool.yaml or
thrashers/cache.yaml.

See cache tiering deprecation note added in commit 535b8db33e ("doc:
deprecate the cache tiering").

Fixes: https://tracker.ceph.com/issues/63149
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-10-10 09:42:11 +02:00
Rishabh Dave
1a67e0cbe6
Merge pull request #53719 from rishabh-d-dave/mon-fscmds
mon/FSCommands: clean up FSCommands

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-10 11:26:35 +05:30
Xuehan Xu
23c73912c7 crimson/os/seastore/onode_manager: drop unnecessary status
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-10-10 12:09:22 +08:00
Xuehan Xu
4ff02f53fe crimson/os/seastore/onode_manager: avoid unnecessary delta related
overhead

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-10-10 12:08:55 +08:00
Venky Shankar
a8e3a32d6c Merge PR #53885 into main
* refs/pull/53885/head:
	Revert "mds: disable delegating inode ranges to clients"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-10-10 09:35:37 +05:30
Yuri Weinstein
a9359c5c56
Merge pull request #53517 from cbodley/wip-qa-distros-s
qa/distros: remove centos/rhel8 and ubuntu20.04 from supported distros

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
2023-10-09 14:04:54 -07:00
Laura Flores
9c5755a4ac qa/suites/upgrade: fix env indentation in stress-split upgrade tests
This is an issue with the stress-split yaml files, as introduced in https://github.com/ceph/ceph/pull/51889.

The stress-split tests have an incorrectly-intented "env" section, which teuthology detects as an entry for "clients".

Fixes: https://tracker.ceph.com/issues/63158
Signed-off-by: Laura Flores <lflores@ibm.com>
2023-10-09 20:27:25 +00:00
Ilya Dryomov
425704acdf
Merge pull request #53829 from ajarr/wip-63009
librbd: kick ExclusiveLock state machine stalled waiting for lock from reacquire_lock()

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-10-09 21:38:21 +02:00
Rishabh Dave
f9626b5969
Merge pull request #53722 from rishabh-d-dave/mon-authmon
mon/AuthMonitor: clean up AuthMonitor

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-09 22:53:42 +05:30
Rishabh Dave
e7200f584e
Merge pull request #53721 from rishabh-d-dave/mon-mdsmon
mon/MDSMonitor: clean up MDSMonitor

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-09 22:52:44 +05:30
Rishabh Dave
1f047664e1
Merge pull request #53405 from rishabh-d-dave/ceph-auth-caps-val-caps
mon/AuthMonitor: make "ceph auth caps" print error messsages

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-09 22:49:28 +05:30
Patrick Donnelly
d84042aa29
Merge PR #53099 into main
* refs/pull/53099/head:
	script: update ceph-debug-docker for centos 9.stream

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-10-09 13:03:37 -04:00
Venky Shankar
c9d67526b2 Revert "mds: disable delegating inode ranges to clients"
This isn't necessary -- the MDS handles delegating inode ranges
to clients from its preallocated inode set properly - the suspected
bug involving not persisting the sessionmap and causing asserts
during replay isn't an issue. The preallocated set is persisted
with the log event and the MDS correctly rebuild the set from
this information during replay.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-10-09 22:22:21 +05:30
Patrick Donnelly
e90f0e9e00
Merge PR #53206 into main
* refs/pull/53206/head:
	mds: use LogSegment dump for debugging

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-10-09 11:53:31 -04:00
Yuval Lifshitz
d05fa0bea9
Merge pull request #52254 from vedanshbhartia/coverity_uninit
rgw: Add coverity uninitialized variable and initialize RGWBucketEntryMetadataObject

reviewed-by: yuvalif
2023-10-09 17:58:42 +03:00
Yuval Lifshitz
94d69a11ab
Merge pull request #52328 from vedanshbhartia/coverity_1512267
rgw: fix potential null dereference in rgw_iam_policy.c: ParseState::do_string

reviewed-by: yuvalif
2023-10-09 17:57:47 +03:00
Yuval Lifshitz
4bf3b6b3ca
Merge pull request #52472 from vedanshbhartia/coverity_1510724
rgw: Remove unnecessary null check from valid_s3_bucket_name

reviwed-by: soumyakoduri , yuvalif
2023-10-09 17:56:40 +03:00
Yuval Lifshitz
47c77bcf8a
Merge pull request #52734 from vedanshbhartia/coverity_ostream
rgw: Restore ostream format state after changing it

reviwed-by: yuvalif
2023-10-09 17:54:34 +03:00
Yuval Lifshitz
7b774c4e51
Merge pull request #52326 from yuvalif/wip-yuval-lua-reload
rgw/lua: support reloading lua packages on all RGWs

reviwed-by: dang, cbodle, anthonyeleven
2023-10-09 17:53:15 +03:00