Commit Graph

141319 Commits

Author SHA1 Message Date
Suyashd999
9b773eec4a qa/suites/rbd: Cleanup of MIRROR_IMAGE_MODE
Fixes: https://tracker.ceph.com/issues/63431
Signed-off-by: Suyash Dongre <suyashd999@gmail.com>
2023-11-14 18:28:02 +05:30
Anthony D'Atri
7325a8d317
Merge pull request #54479 from anthonyeleven/anthonyeleven/ceph
doc/start: fix typo in hardware-recommendations.rst
2023-11-13 11:38:13 -05:00
Yuri Weinstein
cc15663690
Merge pull request #53655 from ifed01/wip-ifed-peering-cleanup
osd: getting rid off redundant std::map/set::count() calls.

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2023-11-13 07:29:07 -08:00
Yuri Weinstein
47fce541de
Merge pull request #53597 from ifed01/wip-ifed-bluefs-perf-counters
os/bluestore: add more bluefs perf counters

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2023-11-13 07:28:39 -08:00
Yuri Weinstein
40c6bad894
Merge pull request #53530 from ifed01/wip-ifed-fast-shutdown-assert
osd: do not assert on fast shutdown timeout

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2023-11-13 07:27:39 -08:00
Yuri Weinstein
c2d216bbc1
Merge pull request #52855 from Matan-B/wip-matanb-monstore-osd_snap
tools/ceph_monstore_tool: additional commands and doc

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2023-11-13 07:27:10 -08:00
Yuri Weinstein
df780ba1ce
Merge pull request #52406 from Matan-B/wip-matanb-mon-44069-commits
mon/Config*: Cleanups and ConfigMap unit test

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2023-11-13 07:26:05 -08:00
Anthony D'Atri
48fd7ff1e1 doc/start: fix typo in hardware-recommendations.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-11-13 08:58:44 -05:00
zdover23
3cf8e3b49b
Merge pull request #54473 from zdover23/wip-doc-2023-11-13-rados-troubleshooting-mon-initial
doc/rados: format "initial troubleshooting"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-11-13 23:53:15 +10:00
Zac Dover
c581018caf doc/rados: format "initial troubleshooting"
Format the steps in the "Initial Troubleshooting" section of
doc/rados/troubleshooting/troubleshooting-mon.rst. A near-future PR (not
this one) will add context to this section and explain that the steps
described here are the first steps that you should undertake when you
determine that you have an unresponsive or down Monitor. This PR is
merely for formatting.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-13 20:57:07 +10:00
Patrick Donnelly
474f9a5483
Merge PR #54338 into main
* refs/pull/54338/head:
	script: enable checkout of specific sha1 as base

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-11-12 10:25:07 -05:00
zdover23
011cf0e991
Merge pull request #54457 from zdover23/wip-doc-2023-11-12-rados-config-ceph-conf-config-ceph
doc/config: edit "ceph-conf.rst"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-11-13 00:00:40 +10:00
Anthony D'Atri
513c3f9cc1
Merge pull request #54458 from zdover23/wip-doc-2023-11-12-rados-troubleshooting-mon-parallel-structure
doc/rados: parallelize t-mon headings
2023-11-12 08:48:40 -05:00
Zac Dover
010e5a13b9 doc/rados: parallelize t-mon headings
Give parallel structure to the questions in the Q&A section of the "The
Cluster Has Quorum But At Least One Monitor Is Down" subsection of the
"Most Common Monitor Issues" section of
doc/rados/troubleshooting/troubleshooting-mon.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-12 20:52:09 +10:00
Zac Dover
c886e05404 doc/config: edit "ceph-conf.rst"
Edit the first section of doc/rados/configuration/ceph-conf.rst.
Initially I just wanted to change "series" to "set", but once I got my
hands dirty I ended up simplifying some sentences.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-12 20:21:41 +10:00
zdover23
31d66e2622
Merge pull request #54452 from zdover23/wip-doc-2023-11-11-rados-troubleshooting-mon-common-issues-5-of-x
doc/rados: edit t-mon "common issues" (5 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmai.com>
2023-11-11 22:28:33 +10:00
Zac Dover
d98222db9b doc/rados: edit t-mon "common issues" (5 of x)
Edit the fifth part of the section "Most Common Monitor Issues" in
doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/54440.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-11 13:50:33 +10:00
Adam King
9e2d5c4972
Merge pull request #49914 from adk3798/monitoring-teuth-test
qa/cephadm: basic test for monitoring stack

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-11-10 17:09:12 -05:00
Adam King
c0fdf96009
Merge pull request #54398 from phlogistonjohn/jjm-cephadm-reorg-ctr-binds
cephadm: reorganize container binds functions

Reviewed-by: Adam King <adking@redhat.com>
2023-11-10 17:07:09 -05:00
Adam King
54c1e868f6
Merge pull request #54046 from adk3798/warn-hosts-drain-spec
mgr/cephadm: warn when draining host explicitly listed in placement

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-11-10 17:05:51 -05:00
Casey Bodley
b9ef188484
Merge pull request #54450 from cbodley/wip-test-rgw-rados-includes
test/rgw: clean up unused include dirs

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2023-11-10 18:08:16 +00:00
Casey Bodley
64eed4b82d
Merge pull request #54448 from ceph/wip-make-down-dependencies-explicit
rgw: make subclass dependencies explicit

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-11-10 18:07:53 +00:00
Patrick Donnelly
cc747a2d07
script: enable checkout of specific sha1 as base
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-11-10 10:02:14 -05:00
Casey Bodley
91c0334f62 test/rgw: clean up unused include dirs
store/rados was renamed to driver/rados, so these include directories
aren't required

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-11-10 09:20:13 -05:00
J. Eric Ivancich
78948e78d5 rgw: make subclass dependencies explicit
As part of the Zipper project generic back-end code is being teased
apart from rados-specific back-end code. This is a work in progress,
so currently generic code and other subclasses of StoreDriver (and
related high-level classes) depend on the rados-specific declarations.
Some of these dependencies are not always obvious since
src/rgw/driver/rados was put on the include path. That is now removed,
so any includes needing files from that subclass have to give a more
fully specified path.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2023-11-10 02:36:51 -05:00
Yingxin
39df30d148
Merge pull request #50419 from myoungwon/wip-rbm-partial-overwrite
crimson/os/seastore: introduce delta-based overwrite

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-11-10 09:52:04 +08:00
Casey Bodley
c7493febd7
Merge pull request #54379 from cbodley/wip-rgw-sal-bucket-owner
rgw/sal: Bucket owner as rgw_user

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-11-09 22:35:45 +00:00
zdover23
7eb04ef968
Merge pull request #54440 from zdover23/wip-doc-2023-11-10-rados-troubleshooting-mon-common-issues-4-of-x
doc/rados: edit t-mon "common issues" (4 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-11-10 08:10:54 +10:00
Casey Bodley
cbf6b3b14d
Merge pull request #54415 from jincreator/cls-fmt-ftbfs
cls: fix unable to link with system-installed fmt

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-11-09 22:00:37 +00:00
Zac Dover
f6b686ac31 doc/rados: edit t-mon "common issues" (4 of x)
Edit the fourth part of the section "Most Common Monitor Issues" in
doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/54432.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-10 06:11:04 +10:00
John Mulligan
f04c4b6c6f cephadm: convert get_container_binds to use class based approach
Since all types affected by get_container_binds now have the common
customize_container_binds, use a generic class-based approach by
creating an instance of ContainerDaemonForm and calling the method.
All other classes have a customize_container_binds that is a no-op.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
John Mulligan
451305dc8d cephadm: only call get_container_binds on types that have binds
This is a step towards not calling get_container_binds in get_container.
A future commit will replace uses of get_container_binds with direct
uses of common class methods.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
John Mulligan
9dd73e4de0 cephadm: move bind mounts assignment to a variable
Move the call to get_container_binds out of the function call.
This will aid with the next refactoring steps, so that the uses
of get_container_binds can be brought into the get_container call
directly.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
John Mulligan
93ad2993bd cephadm: add customize_container_binds method to custom container
Add a customize_container_binds function to the CustomContainer daemon
type class and use it from the common get_container_binds function.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
John Mulligan
34ef3f7554 cephadm: covert nvmeof type to provide a customize_container_binds method
Convert the CephNvmeof type's get_container_binds to
customize_container_binds and use it in the generic method.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
John Mulligan
21563528d1 cephadm: covert iscsi type to provide a customize_container_binds method
Convert the CephIscsi type's get_container_binds to
customize_container_binds and use it in the generic method.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
John Mulligan
f80cf438b3 cephadm: ensure the iscsi test can create iscsi daemon class
Ensure that the iscsi test can call CephIscsi.create inside other
functions by passing a required, but fake, gateway config file.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
John Mulligan
5c96c510db cephadm: always pass ctx to customize_container_{binds,mounts}
These functions often derive the binds and/or mounts from the context
variable. Thus we should have the base class method accept the context.
Not all subclassess will use it but it will be there for those that do.
Also, fix the type for customize_container_mounts - it should be a dict
not a list.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-09 14:50:46 -05:00
Adam King
b4db5e4ffc qa/cephadm: adjust host drain test to handle explicit placement warning
Since we're adding a warning if any host is listed explicitly
in the placement of any service when removing the host,
we need to adjust the host drain test that removes a host
without the --force flag to not have the explicit hostname
in the placement for the mon service.

Signed-off-by: Adam King <adking@redhat.com>
2023-11-09 14:31:48 -05:00
Adam King
434e5fe6aa mgr/cephadm: warn when draining host explicitly listed in placement
In the case you apply a spec like

```
service_type: node-exporter
placement:
  hosts:
  - host3
```

and then you run `ceph orch host drain host3`, cephadm will remove
the daemon from that host and the placement would now match nothing.

This is definitely an issue that should be able to be bypassed as
it generally isn't serious, but it would be good to let users
know they have the host listed explicitly in placements like this
when they want to drain it.

Fixes: https://tracker.ceph.com/issues/63220

Signed-off-by: Adam King <adking@redhat.com>
2023-11-09 14:31:48 -05:00
Adam King
8fc5d9ca23
Merge pull request #54387 from phlogistonjohn/jjm-cephadm-isolate-mounts-code
cephadm: isolate mounts code in methods

Reviewed-by: Adam King <adking@redhat.com>
2023-11-09 14:05:58 -05:00
Casey Bodley
eb4cac740e rgw/sal: Bucket owner as rgw_user
stop maintaining a User pointer for the bucket owner, and use the
stored rgw_user owner directly

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-11-09 11:15:24 -05:00
Anthony D'Atri
6dca61b2da
Merge pull request #54432 from zdover23/wip-doc-2023-11-09-rados-troubleshooting-mon-common-issues-3-of-x
doc/rados: edit t-mon "common issues" (3 of x)
2023-11-09 09:04:42 -05:00
Myoungwon Oh
99a6a32fa4 crimson/os/seastore/object_data_handler: prevent from being overwritten if cloned
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-11-09 11:51:37 +00:00
Myoungwon Oh
b48e662a9e test/crimsons/seastore/object_data_handler: add overwrite test cases
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-11-09 11:51:31 +00:00
Myoungwon Oh
d0456a9df9 crimson/os/seastore: store data as a delta using mutable extent when overwriting
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-11-09 11:51:24 +00:00
Zac Dover
91ed10bc73 doc/rados: edit t-mon "common issues" (3 of x)
Edit the second part of the section "Most Common Monitor Issues" in
doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/54417.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-09 20:20:20 +10:00
Guillaume Abrioux
a973827cb8
Merge pull request #54392 from guits/cv-revert-52429
ceph-volume: Revert "ceph-volume: fix raw list for lvm devices"
2023-11-09 08:54:06 +01:00
zdover23
54a0d2b65e
Merge pull request #54412 from zdover23/wip-doc-2023-11-08-rados-troubleshooting-mon-top-matter
doc/rados: edit t-shooting-mon.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-11-09 14:25:06 +10:00
Casey Bodley
37f8a2c00b rgw/sal: remove Bucket::get_acl_owner()
was only used under the line by rados and dbstores

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-11-08 14:05:49 -05:00