Commit Graph

675 Commits

Author SHA1 Message Date
Rishabh Dave
3232f6b7af PendingReleaseNote: add release note that mgr/volumes plugin can be...
disabled now.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-19 16:57:16 +05:30
Rishabh Dave
8978b85bb0
Merge pull request #59420 from rishabh-d-dave/max-mds-confirm
mon,cephfs: require confirmation when changing max_mds on unhealthy cluster

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-18 20:04:18 +05:30
Rishabh Dave
a71c8e8d11 PendingReleaseNotes: add a release note about confirm flag for max_mds
Add a release note for the fact that users now need to pass the
confirmation flag for modifying "max_mds" when cluster is unhealthy.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-01 12:45:31 +05:30
Sridhar Seshasayee
aa19cd30da
Merge pull request #58509 from sseshasa/wip-hdd-osd-shard-params-for-mclock
common/options: Change HDD OSD shard configuration defaults for mClock

Reviewed-by: Mark Nelson  <mark.a.nelson@gmail.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-09-25 12:34:41 +05:30
Adam King
4adee01313
Merge pull request #54277 from rhcs-dashboard/nfs-export-apply-fix
mgr/nfs: generate user_id & access_key for apply_export(CephFS)

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2024-09-17 09:08:01 -04:00
Avan Thakkar
b895e596a8 doc: nit fixes for nfs doc
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Fixes some doc lint and also fixed qa tests for having both 3 & 4 protocols
by default in expot config.
2024-09-17 00:46:00 +05:30
Sridhar Seshasayee
0d81e72137 common/options: Change HDD OSD shard configuration defaults for mClock
Based on tests performed at scale on a HDD based cluster, it was found
that scheduling with mClock was not optimal with multiple OSD shards. For
e.g., in the scaled cluster with multiple OSD node failures, the client
throughput was found to be inconsistent across test runs coupled with
multiple reported slow requests.

However, the same test with a single OSD shard and with multiple worker
threads yielded significantly better results in terms of consistency of
client and recovery throughput across multiple test runs.

For more details see https://tracker.ceph.com/issues/66289.

Therefore, as an interim measure until the issue with multiple OSD shards
(or multiple mClock queues per OSD) is investigated and fixed, the
following change to the default HDD OSD shard configuration is made:

 - osd_op_num_shards_hdd = 1 (was 5)
 - osd_op_num_threads_per_shard_hdd = 5 (was 1)

The other changes in this commit include:
 - Doc change to the OSD and mClock config reference describing
   this change.
 - OSD troubleshooting entry on the procedure to change the shard
   configuration for clusters affected by this issue running on older
   releases.
 - Add release note for this change.

Fixes: https://tracker.ceph.com/issues/66289
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>

# Conflicts:
#	doc/rados/troubleshooting/troubleshooting-osd.rst
2024-09-03 11:09:08 +05:30
Yuval Lifshitz
f490629992 rgw/notifications: update release notes with fix to principalId
Fixes: https://tracker.ceph.com/issues/67857

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-09-02 14:07:19 +03:00
Avan Thakkar
af63b47425 doc: Update pendingreleasenotes for CephFS NFS exports
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2024-08-27 22:02:48 +05:30
Casey Bodley
59891f06d5
Merge pull request #59422 from cbodley/wip-67697
rgw: ignore zoneless default realm when not configured

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-08-26 17:52:22 -04:00
Venky Shankar
409001969e
Merge pull request #54620 from rishabh-d-dave/mgr-vol-clone-stats
mgr/vol: show progress and stats for the subvolume snapshot clones

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-08-26 15:44:53 +05:30
Casey Bodley
d64e273de1 rgw: realm create only sets default realm on --default
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-08-23 16:12:33 -04:00
nmordech@redhat.com
7b251cad2c PendingReleaseNotes: Adding note about rest module change and adding max_request option
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2024-08-20 10:35:49 +00:00
Rishabh Dave
645cc6e6a8 doc/cephfs: add release notes and docs for clone progress report
Update docs and add release notes about the progress report that is
printed in output of "ceph fs clone status" command and progress bars
that is/are printed in output of "ceph status" command.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-08-14 15:05:46 +05:30
Yuri Weinstein
1a2a617edd
Merge pull request #54671 from baum/ceph-nvmeof-mon
mon: add NVMe-oF gateway monitor and HA

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-07-31 09:05:41 -07:00
Leonid Chernin
5843c6b04b mon: add NVMe-oF gateway monitor and HA
- gateway submodule

Fixes: https://tracker.ceph.com/issues/64777

This PR adds high availability support for the nvmeof Ceph service. High availability means that even in the case that a certain GW is down, there will be another available path for the initiator to be able to continue the IO through another GW. High availability is achieved by running nvmeof service consisting of at least 2 nvmeof GWs in the Ceph cluster. Every GW will be seen by the host (initiator) as a separate path to the nvme namespaces (volumes).

The implementation consists of the following main modules:

- NVMeofGWMon - a PaxosService. It is a monitor that tracks the status of the nvmeof running services, and take actions in case that services fail, and in case services restored.
- NVMeofGwMonitorClient – It is an agent that is running as a part of each nvmeof GW. It is sending beacons to the monitor to signal that the GW is alive. As a part of the beacon, the client also sends information about the service. This information is used by the monitor to take decisions and perform some operations.
- MNVMeofGwBeacon – It is a structure used by the client and the monitor to send/recv the beacons.
- MNVMeofGwMap – The map is tracking the nvmeof GWs status. It also defines what should be the new role of every GW. So in the events of GWs go down or GWs restored, the map will reflect the new role of each GW resulted by these events. The map is distributed to the NVMeofGwMonitorClient on each GW, and it knows to update the GW with the required changes.

It is also adding 3 new mon commands:
- nvme-gw create
- nvme-gw delete
- nvme-gw show

The commands are used by the ceph adm to update the monitor that a new GW is deployed. The monitor will update the map accordingly and will start tracking this GW until it is deleted.

Signed-off-by: Leonid Chernin <lechernin@gmail.com>
Signed-off-by: Alexander Indenbaum <aindenba@redhat.com>
2024-07-31 08:50:10 +00:00
Ramana Raja
e5ccce14c4 rbd: add group snap info command
... to show information about a group snapshot.

And also include group snap ID in `group snap ls` output.

Fixes: https://tracker.ceph.com/issues/66011
Signed-off-by: Ramana Raja <rraja@redhat.com>
2024-07-22 12:40:11 -04:00
Casey Bodley
12c4973367
Merge pull request #57537 from kchheda3/wip_fix_notification_caching
rgw/notification: Fix the caching issues of notification brokers, where the cache was not invalidated if topic attributes were changed

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-07-02 13:40:58 +01:00
Ilya Dryomov
92f82d6c89
Merge pull request #58265 from idryomov/wip-rbd-pybind-utc-timestamps
pybind/rbd: change to return "aware" datetime objects

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-06-28 11:54:41 +02:00
Venky Shankar
cac7dcd634 Merge PR #53755 into main
* refs/pull/53755/head:
	PendingReleaseNotes: add note about CephFS set_vxattrs
	doc/cephfs: Update docs to match remove functionality and respective vxattrs
	qa: Add test coverage for vxattr behavior
	qa: Add removexattr to support setfattr removal.
	mds: Implement remove for ceph vxattrs

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-06-27 19:58:50 +05:30
Patrick Donnelly
c8053b11e7
Merge PR #53503 into main
* refs/pull/53503/head:
	qa: add tests for `mds last-seen` command
	doc/cephfs: add documentation for `mds last-seen`
	PendingReleaseNotes: add note on last-seen command
	mon/MDSMonitor: add command to lookup when mds was last seen
	mon/MDSMonitor: set birth time on FSMap during encode
	pybind/mgr/dashboard: show context diff for openapi check

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-06-25 12:27:28 -04:00
Ilya Dryomov
c31d307c27 pybind/rbd: change to return "aware" datetime objects
utcfromtimestamp() and utcnow() have been deprecated in Python 3.12.
Let's follow suit because it turns out that many datetime methods in
Python 3 interpret "naive" objects that we are currently returning as
local times.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-25 17:31:04 +02:00
Patrick Donnelly
7b482ada77
PendingReleaseNotes: add note on last-seen command
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-06-20 21:32:56 -04:00
Patrick Donnelly
deab0443ef
PendingReleaseNotes: add note for new auth rotate
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-06-20 21:31:12 -04:00
Ilya Dryomov
e5c3dd391c rbd: include original namespace type in "rbd snap ls --all" output
Before (snap 22 comes from "rbd group snap create", snap 23 created
manually with "rbd snap create"):

SNAPID  NAME                                  SIZE   PROTECTED  TIMESTAMP                 NAMESPACE
    21  f7cfdcfe-5f71-40e4-be82-3fb0e7caf2aa  1 GiB             Mon Jun 10 09:23:40 2024  trash (mysnap)
    22  bd67397f-32cb-48fe-b1ac-ef6f02319239  1 GiB             Mon Jun 10 09:26:06 2024  trash (.group.2_1491b049b556_1497bf66f586)
    23  27a5f053-8431-428e-ab33-be9d8b6cf51e  1 GiB             Mon Jun 10 09:28:30 2024  trash (.group.2_1491b049b556_1497bf66f586)

After:

SNAPID  NAME                                  SIZE   PROTECTED  TIMESTAMP                 NAMESPACE
    21  f7cfdcfe-5f71-40e4-be82-3fb0e7caf2aa  1 GiB             Mon Jun 10 09:23:40 2024  trash (user mysnap)
    22  bd67397f-32cb-48fe-b1ac-ef6f02319239  1 GiB             Mon Jun 10 09:26:06 2024  trash (group .group.2_1491b049b556_1497bf66f586)
    23  27a5f053-8431-428e-ab33-be9d8b6cf51e  1 GiB             Mon Jun 10 09:28:30 2024  trash (user .group.2_1491b049b556_1497bf66f586)

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-13 14:08:46 +02:00
Ilya Dryomov
06c0dd2b33 rbd: add --snap-id option to "rbd clone"
Enable cloning from non-user snapshots via the CLI.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-13 14:08:46 +02:00
Ilya Dryomov
fafa911b51 pybind/rbd: parse access and modify timestamps in UTC
It appears that commits 08cee16d0a ("pybind/rbd: always parse
timestamps in UTC") and 809c5430c2 ("librbd: add image access/last
modified timestamps") raced with each other and we ended up with two
more timezone-dependent timestamps.

Fixes: https://tracker.ceph.com/issues/66359
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-06-05 08:50:40 +02:00
kchheda3
85fc96b0cd rgw/notification doc: doc: Update pendingreleasenotes for notification.
Signed-off-by: kchheda3 <kchheda3@bloomberg.net>
2024-06-03 14:44:31 -04:00
Christopher Hoffman
f5fe6a5185 PendingReleaseNotes: add note about CephFS set_vxattrs
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2024-05-29 13:43:32 +00:00
Venky Shankar
75bcfd1bbf Merge PR #55758 into main
* refs/pull/55758/head:
	doc: update 'journal reset' command with --yes-i-really-really-mean-it
	qa: fix cephfs-journal-tool command options and make fs inactive
	cephfs-journal-tool: Add warning messages during 'journal reset' and prevent execution on active fs

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-05-29 15:04:58 +05:30
Nizamudeen A
423a086601
Merge pull request #57584 from rhcs-dashboard/dashboard-pendingreleasenotes
doc: Update pendingreleasenotes for dashboard

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2024-05-27 00:51:12 -04:00
Nizamudeen A
ef3e179b99 doc: Update pendingreleasenotes for dashboard
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-05-23 12:12:29 +05:30
Patrick Donnelly
3767887144
Merge PR #57215 into main
* refs/pull/57215/head:
	doc: document new --output-file switch
	test/cli: ignore tmp_file_template
	qa/workunits: add --output-file test in cephtool workunit
	common,ceph: add output file switch to dump json to
	common/options: add configs for temporary files made by daemons
	common/Formatter: write the pending string on flush

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2024-05-22 21:15:07 -04:00
Jos Collin
42953ece97
doc: update 'journal reset' command with --yes-i-really-really-mean-it
Fixes: https://tracker.ceph.com/issues/62925
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-05-13 12:39:44 +05:30
Patrick Donnelly
8664fe9c06
doc: document new --output-file switch
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-10 20:59:38 -04:00
nmordech@redhat.com
6cddadffcd objclass: deprecate cls_cxx_gather
cls_cxx_gather is not maintained and having issues with retry.
since there is no current use of it, we will deprecate it.

Fixes: https://tracker.ceph.com/issues/64258
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2024-05-09 08:31:17 +00:00
Patrick Donnelly
e70f005f1b
PendingReleaseNotes: add note on the client incompatibility health warning and feature bit
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-07 08:19:28 -04:00
Ilya Dryomov
bbc3230dd3
Merge pull request #57212 from idryomov/wip-65624
pybind/rbd: expose CLONE_FORMAT and FLATTEN image options

Reviewed-by: Mykola Golub <mgolub@suse.com>
2024-05-06 17:43:57 +02:00
Ilya Dryomov
39f207ff65 pybind/rbd: expose RBD_IMAGE_OPTION_FLATTEN option
It takes effect with deep_copy() and migration_prepare().

Fixes: https://tracker.ceph.com/issues/65624
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-05-06 10:13:15 +02:00
Ilya Dryomov
39fafe7462 pybind/rbd: expose RBD_IMAGE_OPTION_CLONE_FORMAT option
It takes effect with clone(), deep_copy() and migration_prepare().

Fixes: https://tracker.ceph.com/issues/65624
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-05-06 10:13:15 +02:00
Rishabh Dave
18c7799cce
Merge pull request #56066 from rishabh-d-dave/mds-fail-confirm
mon,cephfs: require confirmation flag to bring down unhealthy MDS

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-03 13:13:34 +05:30
Rishabh Dave
4a05c14f27
Merge pull request #52024 from lxbsz/wip-61660
mds: fix the description for inotable testing only options

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-04-26 16:26:48 +05:30
Rishabh Dave
24816428e6 PendingReleaseNotes: note need of confirmation for "ceph fs fail"
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-04-19 17:16:47 +05:30
Rishabh Dave
f241a3c5d0 PendingReleaseNotes: note need of confirmation for "ceph mds fail"
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-04-19 17:16:46 +05:30
Casey Bodley
09f44129f9 doc/rgw: add release note for changes to rgw_realm init
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-04-18 17:57:46 -04:00
Yuri Weinstein
8f4c22c109
Merge pull request #47502 from pdvian/wip-clog-level
mon/LogMonitor: Use generic cluster log level config

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2024-04-17 09:10:28 -07:00
Casey Bodley
339981f8b3 PendingReleaseNotes: announce the rgw user account feature
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-04-10 13:09:17 -04:00
Casey Bodley
ea6a7a5162 rgw/pubsub: CreateTopic validates topic name
existing topics may have invalid names, so this is only enforced by
CreateTopic

Fixes: https://tracker.ceph.com/issues/65212

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-03-28 16:11:08 -04:00
Casey Bodley
fae9b9a7b3
Merge pull request #56179 from cbodley/wip-doc-rgw-notification_v2
doc/rgw: document the notification_v2 zone feature

Reviewed-by: Krunal Chheda <kchheda3@bloomberg.net>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-03-15 15:43:10 +00:00
Casey Bodley
4f0ff0f80b PendingReleaseNotes: announce the notification_v2 feature and its migration
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-03-15 09:54:07 -04:00