Commit Graph

679 Commits

Author SHA1 Message Date
Zac Dover 54a75a0e40
Merge pull request #60448 from anthonyeleven/improve-mgr-disable
doc: improve pending release notes and CephFS

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-11-08 19:33:57 +10:00
Milind Changire ac34dd3309
PendingReleaseNotes: add note about fallocate mode 0
fallocate now returns EOPNOTSUPP for mode 0

Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-10-30 15:41:16 +05:30
Ernesto Puerta b0085bf224
mgr/{restful,zabbix}: document removal
Fixes: https://tracker.ceph.com/issues/47066
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2024-10-28 14:17:19 +01:00
Zac Dover 9c3c8d48a2 doc: improve pending release notes and CephFS
fixup

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-10-27 09:40:45 +10:00
Rishabh Dave 3232f6b7af PendingReleaseNote: add release note that mgr/volumes plugin can be...
disabled now.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-19 16:57:16 +05:30
Rishabh Dave 8978b85bb0
Merge pull request #59420 from rishabh-d-dave/max-mds-confirm
mon,cephfs: require confirmation when changing max_mds on unhealthy cluster

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-18 20:04:18 +05:30
Rishabh Dave a71c8e8d11 PendingReleaseNotes: add a release note about confirm flag for max_mds
Add a release note for the fact that users now need to pass the
confirmation flag for modifying "max_mds" when cluster is unhealthy.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-01 12:45:31 +05:30
Sridhar Seshasayee aa19cd30da
Merge pull request #58509 from sseshasa/wip-hdd-osd-shard-params-for-mclock
common/options: Change HDD OSD shard configuration defaults for mClock

Reviewed-by: Mark Nelson  <mark.a.nelson@gmail.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-09-25 12:34:41 +05:30
Adam King 4adee01313
Merge pull request #54277 from rhcs-dashboard/nfs-export-apply-fix
mgr/nfs: generate user_id & access_key for apply_export(CephFS)

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-09-17 09:08:01 -04:00
Avan Thakkar b895e596a8 doc: nit fixes for nfs doc
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Fixes some doc lint and also fixed qa tests for having both 3 & 4 protocols
by default in expot config.
2024-09-17 00:46:00 +05:30
Sridhar Seshasayee 0d81e72137 common/options: Change HDD OSD shard configuration defaults for mClock
Based on tests performed at scale on a HDD based cluster, it was found
that scheduling with mClock was not optimal with multiple OSD shards. For
e.g., in the scaled cluster with multiple OSD node failures, the client
throughput was found to be inconsistent across test runs coupled with
multiple reported slow requests.

However, the same test with a single OSD shard and with multiple worker
threads yielded significantly better results in terms of consistency of
client and recovery throughput across multiple test runs.

For more details see https://tracker.ceph.com/issues/66289.

Therefore, as an interim measure until the issue with multiple OSD shards
(or multiple mClock queues per OSD) is investigated and fixed, the
following change to the default HDD OSD shard configuration is made:

 - osd_op_num_shards_hdd = 1 (was 5)
 - osd_op_num_threads_per_shard_hdd = 5 (was 1)

The other changes in this commit include:
 - Doc change to the OSD and mClock config reference describing
   this change.
 - OSD troubleshooting entry on the procedure to change the shard
   configuration for clusters affected by this issue running on older
   releases.
 - Add release note for this change.

Fixes: https://tracker.ceph.com/issues/66289
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>

# Conflicts:
#	doc/rados/troubleshooting/troubleshooting-osd.rst
2024-09-03 11:09:08 +05:30
Yuval Lifshitz f490629992 rgw/notifications: update release notes with fix to principalId
Fixes: https://tracker.ceph.com/issues/67857

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-09-02 14:07:19 +03:00
Avan Thakkar af63b47425 doc: Update pendingreleasenotes for CephFS NFS exports
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-08-27 22:02:48 +05:30
Casey Bodley 59891f06d5
Merge pull request #59422 from cbodley/wip-67697
rgw: ignore zoneless default realm when not configured

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-08-26 17:52:22 -04:00
Venky Shankar 409001969e
Merge pull request #54620 from rishabh-d-dave/mgr-vol-clone-stats
mgr/vol: show progress and stats for the subvolume snapshot clones

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-26 15:44:53 +05:30
Casey Bodley d64e273de1 rgw: realm create only sets default realm on --default
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-23 16:12:33 -04:00
nmordech@redhat.com 7b251cad2c PendingReleaseNotes: Adding note about rest module change and adding max_request option
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2024-08-20 10:35:49 +00:00
Rishabh Dave 645cc6e6a8 doc/cephfs: add release notes and docs for clone progress report
Update docs and add release notes about the progress report that is
printed in output of "ceph fs clone status" command and progress bars
that is/are printed in output of "ceph status" command.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:05:46 +05:30
Yuri Weinstein 1a2a617edd
Merge pull request #54671 from baum/ceph-nvmeof-mon
mon: add NVMe-oF gateway monitor and HA

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-07-31 09:05:41 -07:00
Leonid Chernin 5843c6b04b mon: add NVMe-oF gateway monitor and HA
- gateway submodule

Fixes: https://tracker.ceph.com/issues/64777

This PR adds high availability support for the nvmeof Ceph service. High availability means that even in the case that a certain GW is down, there will be another available path for the initiator to be able to continue the IO through another GW. High availability is achieved by running nvmeof service consisting of at least 2 nvmeof GWs in the Ceph cluster. Every GW will be seen by the host (initiator) as a separate path to the nvme namespaces (volumes).

The implementation consists of the following main modules:

- NVMeofGWMon - a PaxosService. It is a monitor that tracks the status of the nvmeof running services, and take actions in case that services fail, and in case services restored.
- NVMeofGwMonitorClient – It is an agent that is running as a part of each nvmeof GW. It is sending beacons to the monitor to signal that the GW is alive. As a part of the beacon, the client also sends information about the service. This information is used by the monitor to take decisions and perform some operations.
- MNVMeofGwBeacon – It is a structure used by the client and the monitor to send/recv the beacons.
- MNVMeofGwMap – The map is tracking the nvmeof GWs status. It also defines what should be the new role of every GW. So in the events of GWs go down or GWs restored, the map will reflect the new role of each GW resulted by these events. The map is distributed to the NVMeofGwMonitorClient on each GW, and it knows to update the GW with the required changes.

It is also adding 3 new mon commands:
- nvme-gw create
- nvme-gw delete
- nvme-gw show

The commands are used by the ceph adm to update the monitor that a new GW is deployed. The monitor will update the map accordingly and will start tracking this GW until it is deleted.

Signed-off-by: Leonid Chernin <lechernin@gmail.com>
Signed-off-by: Alexander Indenbaum <aindenba@redhat.com>
2024-07-31 08:50:10 +00:00
Ramana Raja e5ccce14c4 rbd: add group snap info command
... to show information about a group snapshot.

And also include group snap ID in `group snap ls` output.

Fixes: https://tracker.ceph.com/issues/66011
Signed-off-by: Ramana Raja <rraja@redhat.com>
2024-07-22 12:40:11 -04:00
Casey Bodley 12c4973367
Merge pull request #57537 from kchheda3/wip_fix_notification_caching
rgw/notification: Fix the caching issues of notification brokers, where the cache was not invalidated if topic attributes were changed

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-07-02 13:40:58 +01:00
Ilya Dryomov 92f82d6c89
Merge pull request #58265 from idryomov/wip-rbd-pybind-utc-timestamps
pybind/rbd: change to return "aware" datetime objects

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-06-28 11:54:41 +02:00
Venky Shankar cac7dcd634 Merge PR #53755 into main
* refs/pull/53755/head:
	PendingReleaseNotes: add note about CephFS set_vxattrs
	doc/cephfs: Update docs to match remove functionality and respective vxattrs
	qa: Add test coverage for vxattr behavior
	qa: Add removexattr to support setfattr removal.
	mds: Implement remove for ceph vxattrs

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-06-27 19:58:50 +05:30
Patrick Donnelly c8053b11e7
Merge PR #53503 into main
* refs/pull/53503/head:
	qa: add tests for `mds last-seen` command
	doc/cephfs: add documentation for `mds last-seen`
	PendingReleaseNotes: add note on last-seen command
	mon/MDSMonitor: add command to lookup when mds was last seen
	mon/MDSMonitor: set birth time on FSMap during encode
	pybind/mgr/dashboard: show context diff for openapi check

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-06-25 12:27:28 -04:00
Ilya Dryomov c31d307c27 pybind/rbd: change to return "aware" datetime objects
utcfromtimestamp() and utcnow() have been deprecated in Python 3.12.
Let's follow suit because it turns out that many datetime methods in
Python 3 interpret "naive" objects that we are currently returning as
local times.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-25 17:31:04 +02:00
Patrick Donnelly 7b482ada77
PendingReleaseNotes: add note on last-seen command
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-06-20 21:32:56 -04:00
Patrick Donnelly deab0443ef
PendingReleaseNotes: add note for new `auth rotate`
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-06-20 21:31:12 -04:00
Ilya Dryomov e5c3dd391c rbd: include original namespace type in "rbd snap ls --all" output
Before (snap 22 comes from "rbd group snap create", snap 23 created
manually with "rbd snap create"):

SNAPID  NAME                                  SIZE   PROTECTED  TIMESTAMP                 NAMESPACE
    21  f7cfdcfe-5f71-40e4-be82-3fb0e7caf2aa  1 GiB             Mon Jun 10 09:23:40 2024  trash (mysnap)
    22  bd67397f-32cb-48fe-b1ac-ef6f02319239  1 GiB             Mon Jun 10 09:26:06 2024  trash (.group.2_1491b049b556_1497bf66f586)
    23  27a5f053-8431-428e-ab33-be9d8b6cf51e  1 GiB             Mon Jun 10 09:28:30 2024  trash (.group.2_1491b049b556_1497bf66f586)

After:

SNAPID  NAME                                  SIZE   PROTECTED  TIMESTAMP                 NAMESPACE
    21  f7cfdcfe-5f71-40e4-be82-3fb0e7caf2aa  1 GiB             Mon Jun 10 09:23:40 2024  trash (user mysnap)
    22  bd67397f-32cb-48fe-b1ac-ef6f02319239  1 GiB             Mon Jun 10 09:26:06 2024  trash (group .group.2_1491b049b556_1497bf66f586)
    23  27a5f053-8431-428e-ab33-be9d8b6cf51e  1 GiB             Mon Jun 10 09:28:30 2024  trash (user .group.2_1491b049b556_1497bf66f586)

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-13 14:08:46 +02:00
Ilya Dryomov 06c0dd2b33 rbd: add --snap-id option to "rbd clone"
Enable cloning from non-user snapshots via the CLI.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-13 14:08:46 +02:00
Ilya Dryomov fafa911b51 pybind/rbd: parse access and modify timestamps in UTC
It appears that commits 08cee16d0a ("pybind/rbd: always parse
timestamps in UTC") and 809c5430c2 ("librbd: add image access/last
modified timestamps") raced with each other and we ended up with two
more timezone-dependent timestamps.

Fixes: https://tracker.ceph.com/issues/66359
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-05 08:50:40 +02:00
kchheda3 85fc96b0cd rgw/notification doc: doc: Update pendingreleasenotes for notification.
Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
2024-06-03 14:44:31 -04:00
Christopher Hoffman f5fe6a5185 PendingReleaseNotes: add note about CephFS set_vxattrs
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2024-05-29 13:43:32 +00:00
Venky Shankar 75bcfd1bbf Merge PR #55758 into main
* refs/pull/55758/head:
	doc: update 'journal reset' command with --yes-i-really-really-mean-it
	qa: fix cephfs-journal-tool command options and make fs inactive
	cephfs-journal-tool: Add warning messages during 'journal reset' and prevent execution on active fs

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-05-29 15:04:58 +05:30
Nizamudeen A 423a086601
Merge pull request #57584 from rhcs-dashboard/dashboard-pendingreleasenotes
doc: Update pendingreleasenotes for dashboard

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2024-05-27 00:51:12 -04:00
Nizamudeen A ef3e179b99 doc: Update pendingreleasenotes for dashboard
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-05-23 12:12:29 +05:30
Patrick Donnelly 3767887144
Merge PR #57215 into main
* refs/pull/57215/head:
	doc: document new --output-file switch
	test/cli: ignore tmp_file_template
	qa/workunits: add --output-file test in cephtool workunit
	common,ceph: add output file switch to dump json to
	common/options: add configs for temporary files made by daemons
	common/Formatter: write the pending string on flush

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2024-05-22 21:15:07 -04:00
Jos Collin 42953ece97
doc: update 'journal reset' command with --yes-i-really-really-mean-it
Fixes: https://tracker.ceph.com/issues/62925
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-05-13 12:39:44 +05:30
Patrick Donnelly 8664fe9c06
doc: document new --output-file switch
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-10 20:59:38 -04:00
nmordech@redhat.com 6cddadffcd objclass: deprecate cls_cxx_gather
cls_cxx_gather is not maintained and having issues with retry.
since there is no current use of it, we will deprecate it.

Fixes: https://tracker.ceph.com/issues/64258
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2024-05-09 08:31:17 +00:00
Patrick Donnelly e70f005f1b
PendingReleaseNotes: add note on the client incompatibility health warning and feature bit
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-07 08:19:28 -04:00
Ilya Dryomov bbc3230dd3
Merge pull request #57212 from idryomov/wip-65624
pybind/rbd: expose CLONE_FORMAT and FLATTEN image options

Reviewed-by: Mykola Golub <mgolub@suse.com>
2024-05-06 17:43:57 +02:00
Ilya Dryomov 39f207ff65 pybind/rbd: expose RBD_IMAGE_OPTION_FLATTEN option
It takes effect with deep_copy() and migration_prepare().

Fixes: https://tracker.ceph.com/issues/65624
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-05-06 10:13:15 +02:00
Ilya Dryomov 39fafe7462 pybind/rbd: expose RBD_IMAGE_OPTION_CLONE_FORMAT option
It takes effect with clone(), deep_copy() and migration_prepare().

Fixes: https://tracker.ceph.com/issues/65624
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-05-06 10:13:15 +02:00
Rishabh Dave 18c7799cce
Merge pull request #56066 from rishabh-d-dave/mds-fail-confirm
mon,cephfs: require confirmation flag to bring down unhealthy MDS

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-03 13:13:34 +05:30
Rishabh Dave 4a05c14f27
Merge pull request #52024 from lxbsz/wip-61660
mds: fix the description for inotable testing only options

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-04-26 16:26:48 +05:30
Rishabh Dave 24816428e6 PendingReleaseNotes: note need of confirmation for "ceph fs fail"
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-04-19 17:16:47 +05:30
Rishabh Dave f241a3c5d0 PendingReleaseNotes: note need of confirmation for "ceph mds fail"
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-04-19 17:16:46 +05:30
Casey Bodley 09f44129f9 doc/rgw: add release note for changes to rgw_realm init
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-04-18 17:57:46 -04:00
Yuri Weinstein 8f4c22c109
Merge pull request #47502 from pdvian/wip-clog-level
mon/LogMonitor: Use generic cluster log level config

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2024-04-17 09:10:28 -07:00