Commit Graph

140143 Commits

Author SHA1 Message Date
John Mulligan
04423ccd2d cephadm: add daemon_name property to DaemonIdentity
Add a convenience property to DaemonIdentity and DaemonSubIdentity that
produces a name in the ceph daemon naming convention: <type>.<id>.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:23:04 -04:00
John Mulligan
a7458053a4 cephadm: convert deploy_daemon to to use a DaemonIdentity argument
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:23:04 -04:00
John Mulligan
be96c64bc9 cephadm: convert deploy_daemon_units to to use a DaemonIdentity argument
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:23:04 -04:00
John Mulligan
9e5ce87614 cephadm: convert get_daemon_args to use DaemonIdentity argument
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:23:04 -04:00
John Mulligan
c2b877fc25 cephadm: assert that DaemonIdentity has valid values
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:23:04 -04:00
John Mulligan
3b2c2dc1f8 cephadm: convert get_container_mounts to use a DaemonIdentity argument
Convert get_container_mounts to use a DaemonIdentity argument, and in
order to do so: split get_container_mounts_for_type out of
get_container_mounts. get_container_mounts will take a DaemonIdentity
and safely assume that the fsid, daemon_type, daemon_id triple is
available whereas get_container_mounts_for_type has the functionality
of only requiring the fsid and daemon_type.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:22:22 -04:00
John Mulligan
b55ff25129 cephadm: convert get_container_binds to use a DaemonIdentity argument
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:09:02 -04:00
John Mulligan
b72d13af6f cephadm: convert _write_custom_conf_files to use a DaemonIdentity arg
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 15:08:53 -04:00
Laura Flores
7179ac0037 src/common: add context to tracing::Tracer::init
Followup to https://github.com/ceph/ceph/pull/50948. This wasn't originally
caught since the centos 8 default build passed, but it did fail the
crimson build: b5259484db/

Fixes: https://tracker.ceph.com/issues/62761
Signed-off-by: Laura Flores <lflores@ibm.com>
2023-09-11 18:26:13 +00:00
John Mulligan
4814de00ce cephadm: convert create_daemon_dirs to use a DaemonIdentity argument
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 13:34:11 -04:00
John Mulligan
373f611aad cephadm: replace get_data_dir & make_data_dir args with DaemonIdentity
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 13:34:11 -04:00
John Mulligan
3f953b16c3 cephadm: split get_unit_name into two functions
The previous version of get_unit_name was effectively overloaded,
so that you could pass either an fsid, daemon_type, & daemon_id OR
pass an fsid and a "daemon_type" only that wasn't actually a daemon_type
but rather the instance name of the systemd service. Separate the
two use cases into two functions, making the naming more correct and
the code more audit-able overall.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 13:34:11 -04:00
John Mulligan
dc22f7f47d cephadm: add unit_name property to DaemonIdentity
Replace some uses of get_unit_name with the new method.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 13:34:11 -04:00
John Mulligan
5c7cbceef4 cephadm: use DaemonIdentity in arguments to CephContainer.for_daemon
Previously, the CephContainer.for_daemon took separate arguments for
fsid, daemon_type, & daemon_id. Now that we have a dedicated type
for encapsulating those values, switch for_daemon to take
a DaemonIdentity instead.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 13:34:11 -04:00
John Mulligan
53c63888fb cephadm: split DaemonSubIdentity class off from DaemonIdentity
Split DaemonSubIdentity into it's own subclass of DaemonIdentity
in order to better use the type system for validation and clarity.
DaemonIdentity loses the `subcomponent` field so that there's no
mistaking a DaemonIdentity with a DaemonSubIdentity.
This will make a lot more sense once there are more uses of
DaemonSubIdentity in the codebase.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 13:34:11 -04:00
Rishabh Dave
5b1f679ff4
Merge pull request #53390 from rishabh-d-dave/cephfs-doc-admin
doc/cephfs: write cephfs commands fully in docs

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-09-11 22:19:37 +05:30
Ronen Friedman
e53ec60820
Merge pull request #53361 from ronen-fr/wip-rf-moveit
rgw/test: qualifying 'move'

Reviewed-by: Mark Kogan <mkogan@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-09-11 19:40:43 +03:00
Yuval Lifshitz
6cbc873b9a
Merge pull request #53369 from yuvalif/wip-yuval-62784
rgw/notifications: allow cross tenant notification management

reviewed-by: mattbenjamin
2023-09-11 19:08:15 +03:00
Adam King
13ea7b0807
Merge pull request #52043 from adk3798/tcmu-entrypoint
cephadm: run tcmu-runner through script to do restart on failure

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 11:32:55 -04:00
Adam King
2b839838f7
Merge pull request #52881 from adk3798/upgrade-test-start-squid
qa/cephadm: start upgrade tests from quincy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-09-11 11:29:38 -04:00
shreyanshjain7174
78cd82b6e9 RadosGW API: incorrect bucket quota in response to HEAD /{bucket}/?usage
When we try to get the bucket usage via various methods, through curl or while accessing rgw api endpoint at HEAD /{bucket}/?usage doesn't return the updated information. The endpoint was always returning the user quota and not the actual bucket quota which we see after querying the endpoint.

Fixes: https://tracker.ceph.com/issues/62737
Signed-off-by: shreyanshjain7174 <ssanchet@redhat.com>
2023-09-11 11:06:19 -04:00
Adam King
a45ade8c15
Merge pull request #52708 from vshankar/wip-62236
qa: move nfs (mgr/nfs) related tests to fs suite

Reviewed-by: Adam King <adking@redhat.com>
2023-09-11 10:56:20 -04:00
Mark Nelson
923a4d7df4
Merge pull request #53343 from markhpc/wip-rocksdb-compression
common/options: Set LZ4 compression for bluestore RocksDB.
2023-09-11 09:55:20 -05:00
Adam King
55e13ffde7
Merge pull request #53072 from adk3798/tcmu-custom-configs
cephadm: make custom_configs work for tcmu-runner container

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 10:30:06 -04:00
Adam King
a79a5ce22f
Merge pull request #53252 from adk3798/no-tags-upgrade-ls
mgr/cephadm: don't use image tag in orch upgrade ls

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 10:28:38 -04:00
Adam King
ec05c55c56
Merge pull request #53297 from phlogistonjohn/jjm-logging
cephadm: move logging configuration into cephadmlib

Reviewed-by: Adam King <adking@redhat.com>
2023-09-11 10:27:05 -04:00
Yuval Lifshitz
150c490e2d
Merge pull request #53081 from kchheda3/wip-add-log
rgw/notification: enrich the expired notification log line for persistent notificatio

reviewed-by: thotz, yuvalif
2023-09-11 17:22:51 +03:00
Yuval Lifshitz
1b954e9507
Merge pull request #53009 from kchheda3/wip-bucket-stats-notification
rgw/notification: Publish notification information in bucket stats

reviewed-by: yuvalif
2023-09-11 17:22:17 +03:00
Yuval Lifshitz
f53f3aeba9
Merge pull request #53073 from kchheda3/wip-filter-noti-uid
rgw/notification: Filter topic list based on uid

reviewed-by: yuvalif
2023-09-11 17:21:47 +03:00
Anthony D'Atri
04e5b5083a
Merge pull request #53383 from zdover23/wip-doc-2023-09-11-glossary-ceph-client-link
doc/glossary: link to "ceph clients" from entry
2023-09-11 09:53:53 -04:00
John Mulligan
15a3d93bc8 cephadm: remove duplicates when listing files in scan
Fix running tox env flake8 during a rebase/merge where git ls-files
may return duplicate file names.

An earlier version of this change used the `--deuplicate` option to `git
ls-files` in order to remove duplicate files listed when running the
tool during rebase/merge. Mysteriously, this seemed to break the `ceph
API tests` in the CI. A completely unrelated command in a tox file that,
AFAIK, is not executed in that test suite. They ways of git are
subtle and often sucky.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-11 08:57:46 -04:00
Nizamudeen A
63871e38f2
Merge pull request #53246 from rhcs-dashboard/subvolumes-in-subvolumegroups
mgr/dashboard: display the groups in cephfs subvolume tab

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-11 18:23:22 +05:30
Nizamudeen A
46ff2b50a1
Merge pull request #53323 from rhcs-dashboard/rgw-port-error
mgr/dashboard: fix rgw port manipulation error in dashboard

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2023-09-11 17:26:02 +05:30
zdover23
81cc774ccc
Merge pull request #53389 from alvinowyong/wip-doc-remove-ec-profile-warning
doc/rados/operations: Add manual CRUSH rule remove warning to erasure-code-profile.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-09-11 20:05:20 +10:00
Rishabh Dave
e63b573d3e doc/cephfs: write cephfs commands fully in docs
We write CephFS commands incompletely in docs. For example, "ceph tell
mds.a help" is simply written as "tell mds.a help". This might confuse
the reader and it won't harm to write the command in full.

Fixes: https://tracker.ceph.com/issues/62791
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-09-11 15:25:46 +05:30
Alvin Owyong
f944fa8ddb
doc: Add warning on manual CRUSH rule removal
Add warning for "osd erasure-code-profile rm" section under rados/operations.

Signed-off-by: Alvin Owyong <70066269+alvinowyong@users.noreply.github.com>
2023-09-11 17:15:15 +08:00
Nizamudeen A
6b878906ed
Merge pull request #53071 from rhcs-dashboard/disable-features-rbd-edit
mgr/dashboard: images -> edit -> disable checkboxes for layering and deef-flatten

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-11 13:57:28 +05:30
Pedro Gonzalez Gomez
041bc0c362 mgr/dashboard: CephFS add groups in subvolume tab
Adds subvolume groups into the subvolume tabs in order to select the subvolumes from the appropiate group.
Also adds the capabilities to manage the subvolume groups of the subvolume in the different actions, create, edit, remove.

Fixes: https://tracker.ceph.com/issues/62675
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-09-11 08:44:37 +02:00
Zac Dover
fd9c8c9e2f doc/glossary: link to "ceph clients" from entry
Link to the "Ceph Clients" section of doc/architecture.rst from the
"Ceph Clients" entry in the glossary. A glossary entry should be a short
summary of the topic with which it deals, and it should direct the
reader to further and more detailed reading if the reader is interested.
This does that.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-11 15:18:40 +10:00
Nizamudeen A
dfa63ee549
Merge pull request #53236 from rhcs-dashboard/subvolume-size-validator-fix
mgr/dashboard: add validator for size field in the forms 

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2023-09-11 10:05:52 +05:30
Xuehan Xu
6c236bb63a crimson/os/seastore/onode_manager: populate value recorders of onodes to
be erased

Otherwise, the following modification sequence with the same transaction
might lead to onode extents' crc inconsistency during journal replay:

1. modify the last mapping in an onode extent;
2. erase the last mapping in that onode extent.

During journal replay, if the first modification is not recorded in the
delta, the onode extent's content would be inconsistent with that before
the system reboot

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-09-11 11:19:25 +08:00
Myoungwon Oh
670a19f277 test/crimson/seastore/rbm: add sub-tests regarding RBM to the existing tests
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-09-11 11:30:07 +09:00
Anthony D'Atri
9c233914dd
Merge pull request #53371 from zdover23/wip-doc-2023-09-11-architecture-2-of-x
doc/architecture.rst - edit a sentence
2023-09-10 13:38:53 -04:00
Zac Dover
436fbf7a3e doc/architecture.rst - edit a sentence
Change the sentence structure of a sentence because the verb
"experience" looked like the abstract noun "experience" when I read it
with fresh eyes. I chose the perhaps TESOL-unfriendly verb "incur", but
I believe it is right.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-11 02:38:26 +10:00
Ronen Friedman
b46a12e277 rgw/test: adding a qualifier to 'move'
rgw: adding a qualifier to 'move'

as Clang now requires fully specifying std::move, as
per https://reviews.llvm.org/D119670?id=408276

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-09-10 19:31:48 +03:00
Konstantin Monakhov
608c7111aa examples: fixed errors with the if-match header in the examples of rgw-cache nginx configs
Signed-off-by: Konstantin Monakhov <stangerkm@gmail.com>
2023-09-10 22:08:50 +06:00
Yuval Lifshitz
25f82210ab rgw/notifications: allow cross tenant notification management
testing instructions:
https://gist.github.com/yuvalif/60063dc67d981b387b382ff0f7f88d91

Fixes: https://tracker.ceph.com/issues/62784

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-09-10 14:40:37 +00:00
zdover23
e900cf5f32
Merge pull request #53353 from zdover23/wip-doc-2023-09-10-architecture-1-of-x
doc/architecture.rst - edit up to "Cluster Map"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-10 21:43:44 +10:00
Zac Dover
b3538f8ade doc/architecture.rst - edit up to "Cluster Map"
Edit doc/architecture.rst up to "Cluster Map", but not including
"Cluster Map".

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-10 21:16:33 +10:00
Anthony D'Atri
1de6ea7c8f
Merge pull request #53341 from alvinowyong/wip-doc-create-osd-warning
doc/cephadm/services: Add package conflict warning to osd.rst
2023-09-09 16:08:59 -04:00