Commit Graph

612 Commits

Author SHA1 Message Date
Ilya Dryomov
40e8813e9c PendingReleaseNotes: add rbd_diff_iterate2 note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-01-20 16:06:54 +01:00
Milind Changire
b3ff5f7949
PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:37 +05:30
Laura Flores
159751b680 doc/rados/operations: document ceph balancer status detail
Document change in https://github.com/ceph/ceph/pull/54801

Signed-off-by: Laura Flores <lflores@ibm.com>
2024-01-03 17:33:32 +00:00
Samuel Just
dfb4b26a71 PendingReleaseNotes: add release note for 62338
See https://tracker.ceph.com/issues/62338 and
2fc5486e.

Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-02 09:10:51 -08:00
Ilya Dryomov
d17c1332d1
Merge pull request #54644 from idryomov/wip-63607
librados: make querying pools for selfmanaged snaps reliable

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-28 18:03:24 +01:00
Patrick Donnelly
47342a8b3c
mds: add balance_automate fs setting
To turn off the automatic ("default") balancer in multiple MDS clusters. The
new default is "off" as the balancer  is a constant source of problems and
surprise for administrators trying multiple actives. Instead, it should be a
deliberate decision to turn it on and usually with customization like the
"bal_rank_mask" setting or pinning.

Fixes: https://tracker.ceph.com/issues/61378
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-12 11:23:29 -05:00
Patrick Donnelly
23af075146
Merge PR #54726 into main
* refs/pull/54726/head:
	PendingReleaseNotes: announce cephfs-shell avail. on rhel9
	qa: test fs:shell on all distros
	qa: add cephfs-shell to installed rpm packages
	ceph.spec.in: enable support for cephfs-shell by default via EPEL9

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-12-11 08:37:39 -05:00
Rishabh Dave
6f581fb588 cephfs: move release note for PR #41779 to right spot
Release note for PR #41779 applies releases after Reef, not  Reef
onwards. Move the release note accordingly.

Fixes: https://github.com/ceph/ceph/pull/41779
Fixes: https://tracker.ceph.com/issues/47264
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-12-08 15:11:29 +05:30
Rishabh Dave
4bd2d6bcf1 cephfs: add a release note for PR #53899
With merging of PR #53899 it is mandatory now for CephFS to be offline
and refuse_client_session to be set before an attempt to rename the
CephFS is made. Add a release note for this.

Fixes: https://github.com/ceph/ceph/pull/53899
Fixes: https://tracker.ceph.com/issues/63154
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-12-05 11:30:45 +05:30
Ilya Dryomov
0999e63bfb librados: make querying pools for selfmanaged snaps reliable
If get_pool_is_selfmanaged_snaps_mode() is invoked on a fresh RADOS
client instance that still lacks an osdmap, it returns false, same as
for "this pool is not in selfmanaged snaps mode".  The same happens if
the pool in question doesn't exist since the signature doesn't allow to
return an error.

The motivation for this API was to prevent users from running "rados
cppool" on a pool with unmanaged snapshots and deleting the original
thinking that they have a full copy.  Unfortunately, it's exactly
"rados cppool" that fell into this trap, so no warning is printed and
--yes-i-really-mean-it flag isn't enforced.

Fixes: https://tracker.ceph.com/issues/63607
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-12-04 18:55:24 +01:00
Patrick Donnelly
04a54fbd82
PendingReleaseNotes: announce cephfs-shell avail. on rhel9
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-12-04 08:53:53 -05:00
Casey Bodley
1fd4309fbb rgw: object lock uses 64-bit encoding for RetainUntilDate
the default encoding of ceph::real_time truncates seconds to uint32_t,
so stores the wrong timestamp for object lock enforcement

Fixes: https://tracker.ceph.com/issues/63537

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-11-23 19:16:38 -05:00
Casey Bodley
c02129eb8c ReleaseNotes: document support for partNumber
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-11-21 11:09:23 -05:00
Prashant D
44886efc64 PendingReleaseNotes: Add note for POOL_APP_NOT_ENABLED
Adds release notes for the fix added in #47560

Signed-off-by: Prashant D <pdhange@redhat.com>
2023-11-16 12:13:12 -05:00
Rishabh Dave
7170314542 cephfs: add command "ceph fs swap"
Add a FS command that enables users to swap names of two file systems in
a single PAXOS transaction. Add an option to this command that swaps
FSCIDS along with FS names. This commands also updates the application
pool tags and fails when mirroring is enabled on either or both FSs.

Fixes: https://tracker.ceph.com/issues/58129
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-11-03 13:05:14 +05:30
Venky Shankar
c9d67526b2 Revert "mds: disable delegating inode ranges to clients"
This isn't necessary -- the MDS handles delegating inode ranges
to clients from its preallocated inode set properly - the suspected
bug involving not persisting the sessionmap and causing asserts
during replay isn't an issue. The preallocated set is persisted
with the log event and the MDS correctly rebuild the set from
this information during replay.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-10-09 22:22:21 +05:30
Venky Shankar
689b3d5ae1 PendingReleaseNotes: add a note about disallowing delegating inodes
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-10-05 16:54:32 +05:30
Laura Flores
35506db4a4
Merge pull request #52906 from sseshasa/wip-fix-config-dump-pretty-print
mon/ConfigMonitor: Show localized name in "config dump --format json" output
2023-09-26 10:22:08 -04:00
Sridhar Seshasayee
401b30f19f PendingReleaseNotes: Note change to 'ceph config dump' pretty-print output.
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2023-09-21 17:10:10 +05:30
Cory Snyder
152aadb71b rgw: fix rgw versioned bucket stat accounting during reshard and check index
Fixes: https://tracker.ceph.com/issues/62760
Signed-off-by: Cory Snyder <csnyder@1111systems.com>
2023-09-15 18:46:27 +00:00
Milind Changire
7e2546f945
PendingReleaseNotes: add note about 'm' and 'M' periods
Signed-off-by: Milind Changire <mchangir@redhat.com>
2023-09-12 14:11:03 +05:30
Rishabh Dave
849fbd1d5b
Merge pull request #41779 from rishabh-d-dave/fs-auth-subcmd
mon,osd,mds: allow fs authorize to update caps

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-07 18:39:58 +05:30
Rishabh Dave
f9a01cf385
Merge pull request #51942 from trociny/wip-61599
mds: optionally forbid to use standby for another fs as last resort

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-09-06 20:26:33 +05:30
Milind Changire
71c6356f0a
PendingReleaseNotes: note about mandatory fs argument
Signed-off-by: Milind Changire <mchangir@redhat.com>
2023-08-25 21:34:40 +05:30
Venky Shankar
ac3ab1a203 PendingReleaseNotes: add a note for mds_session_metadata_threshold mds config
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-08-22 00:47:27 -04:00
Casey Bodley
61cf6eec7b ReleaseNotes: document recovery of encrypted multipart objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 17:21:03 -04:00
Rishabh Dave
23f1fdbcb3 AuthMonitor: allow "fs authorize" to update caps
When "fs authorize" subcommand is executed for the second time with
different caps, the subcommand exits with error. Modify the behaviour so
that the caps passed every subsequent time is incorporated in to the caps
that are already present in the entity's keyring.

Behaviour before this commit -

$ ./bin/ceph fs authorize a client.x1 / rw
[client.x1]
	key = AQBirqxg5KHeFxAAgOm6lHMYych6OTI+y1HJKw==

$ ./bin/ceph fs authorize b client.x1 / rw
Error EINVAL: client.x1 already has fs capabilities that differ from those supplied. To generate a new auth key for client.x1, first remove client.x1 from configuration files, execute 'ceph auth rm client.x1', then execute this command again.

$ ./bin/ceph auth get client.x1
[client.x1]
	key = AQBirqxg5KHeFxAAgOm6lHMYych6OTI+y1HJKw==
	caps mds = "allow rw fsname=a"
	caps mon = "allow r fsname=a"
	caps osd = "allow rw tag cephfs data=a"
exported keyring for client.x1

After this commit -

$ ./bin/ceph fs authorize a client.x1 / rw
[client.x1]
	key = AQDvrqxgU3I3FBAAJWwF6ZtcOVeHH8TA8CwWmQ==

$ ./bin/ceph fs authorize b client.x1 / rw
updated caps for client.x1

$ ./bin/ceph auth get client.x1
[client.x1]
	key = AQDvrqxgU3I3FBAAJWwF6ZtcOVeHH8TA8CwWmQ==
	caps mds = "allow rw fsname=a, allow rw fsname=b"
	caps mon = "allow r fsname=a, allow r fsname=b"
	caps osd = "allow rw tag cephfs data=a, allow rw tag cephfs data=b"
exported keyring for client.x1

Fixes: https://tracker.ceph.com/issues/47264
Signed-off-by: Rishabh Dave <ridave@redhat.com>

MDSAuthCaps: bug fixes

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-07-30 23:03:22 +05:30
Venky Shankar
94f3e167a0 Merge PR #51278 into main
* refs/pull/51278/head:
	mgr/snap_schedule: rephrase log message when pruning
	doc: add note about snap-schedule snapshot retention
	qa: test user defined number of snaps retention spec
	mgr/snap_schedule: adapt test to new argument list
	doc/cephfs: Add note how mds_max_snaps_per_dir affects snapshot retention
	mgr/snap_schedule: Use mds_max_snaps_per_dir as snapshot count limit

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-13 11:17:16 +05:30
Casey Bodley
fd2ec27f53 PendingReleaseNotes: note rgw's compress-encrypted zonegroup feature flag
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-07 14:39:56 -04:00
Mykola Golub
386c4bbb81 mds: optionally forbid to use standby for another fs as last resort
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2023-06-28 15:57:25 +01:00
Yuri Weinstein
b1ed114a66
Merge pull request #51450 from batrick/i59716
pybind/rados: keep byte representation if decode fails

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-06-21 17:12:08 -04:00
Milind Changire
414ad9619b
doc: add note about snap-schedule snapshot retention
Signed-off-by: Milind Changire <mchangir@redhat.com>
2023-06-20 20:22:33 +05:30
Sridhar Seshasayee
49aad118aa PendingReleaseNotes: Document mClock scheduler fixes and enhancements
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2023-06-07 13:08:23 +05:30
Patrick Donnelly
2aa7becc55
PendingReleaseNotes: add note that pyrados may have omap keys as bytes
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-06-06 21:39:42 -04:00
Radosław Zarzyński
535b8db33e doc: deprecate the cache tiering
This topic has been discussed many times; recently at the Dev
Summit of Cephalocon 2023.

This commit is the minial version of the work, contained entirely
within the `doc`. However, likely it will be expanded as there
were ideas like e.g. adding cache tiering back experimental feature
list (Sam) to warn users when deploying a new cluster.

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-05-17 16:06:17 +02:00
Venky Shankar
85ce1607a3 PendingReleaseNotes: add a note about deleting files from lost+found directory
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-05-06 11:03:11 -04:00
Yaarit Hatuka
750772d71b PendingReleaseNotes: add a note about telemetry leaderboard
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2023-04-21 18:17:10 +00:00
Ilya Dryomov
e89f581513 PendingReleaseNotes: add a note for rbd-mirror daemon perf counters
This was missed in commit 1a1477b9fd ("rbd-mirror: add and rename
perf counters for journal and snapshot mirroring").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-06 12:32:11 +02:00
Ilya Dryomov
e11097bc4c librbd: clear Image::list_watchers() list before populating it
The "append to the passed list" behavior is confusing and not what the
corresponding C API (rbd_watchers_list) or other similar C++ APIs (e.g.
list_lockers) do.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-03-31 12:23:45 +02:00
Rishabh Dave
29c1000ca9
Merge pull request #50307 from dparmar18/fix_pendingreleasenotes
PendingReleaseNotes: remove duplicate note and unwanted tracker link

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-29 21:42:14 +05:30
Laura Flores
cda85937c4
Merge pull request #50065 from ajarr/fix-58691
mgr: store names of modules that register RADOS clients in the MgrMap
2023-03-09 13:09:04 -06:00
Dhairya Parmar
0c6a6aada0 PendingReleaseNotes: remove duplicate note and unwanted tracker link
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2023-03-01 18:43:49 +05:30
Luís Henriques
b70c752e4a PendingReleaseNotes: add reference to the new mdsmap max_xattr_size field
Signed-off-by: Luís Henriques <lhenriques@suse.de>
2023-03-01 10:38:11 +00:00
Venky Shankar
cca84e653d Merge PR #48720 into main
* refs/pull/48720/head:
	qa: fix api failure issue caused during a dashboard test
	PendingReleaseNotes: noted new MDSMap field refuse_client_session
	qa: added two testcases
	client: do not initiate session if flag refuse_client_session is set
	mds: do not reconnect when refuse_client_session is set
	mds: add new feature to block clients from establishing sessions

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-01 07:54:18 +05:30
Ramana Raja
b545fb9f56 mgr: store names of modules that register RADOS clients in the MgrMap
The MgrMap stores a list of RADOS clients' addresses registered by the
mgr modules. During failover of ceph-mgr, the list is used to blocklist
clients belonging to the failed ceph-mgr.

Store the names of the mgr modules that registered the RADOS clients
along with the clients' addresses in the MgrMap. During debugging, this
allows easy identification of the mgr module that registered a
particular RADOS client by just dumping the MgrMap (`ceph mgr dump`).

Following is the MgrMap output with a module's client name displayed
along with its client addrvec,
$ ceph mgr dump | jq '.active_clients[0]'
{
  "name": "devicehealth",
  "addrvec": [
    {
      "type": "v2",
      "addr": "10.0.0.148:0",
      "nonce": 612376578
    }
  ]
}

Fixes: https://tracker.ceph.com/issues/58691
Signed-off-by: Ramana Raja <rraja@redhat.com>
2023-02-28 09:20:28 -05:00
Ilya Dryomov
7b5e16130a mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level
Currently last_failure_osd_epoch and active_clients are dumped in the
always_on_modules dictionary in "ceph mgr dump" output.  This goes back
to when these fields were added in commits f2986a4400 ("mon/MgrMonitor:
blacklist previous instance") and df507cde8d ("mgr: forward RADOS
client instances for potential blacklist") but is wrong as these fields
have nothing to do with always-on modules.

Fixes: https://tracker.ceph.com/issues/58647
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-02-27 21:17:04 +01:00
Ali Maredia
56e2a1006f common: Add labeled perf counters
Add the ability to dump labeled perf counters
for a daemon. Labeled perf counters are stored
in a CephContext's PerfCountersCollection.

Labeled and unlabeled perf counters are dumped
to the admin socket via `counters dump` command.

The schema for labeled and unlabeled perf
counters are dumped to the admin socket via
`counters schema` command.

This commit includes docs and additional unit tests

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-02-23 12:05:36 -05:00
Xiubo Li
b9edab80f0 client: move a client's option to mds-client.yaml
mds_max_retries_on_remount_failure option is used by Client.cc only.

Fixes: https://tracker.ceph.com/issues/56532
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-01-30 15:34:57 +08:00
Yuval Lifshitz
6e94076086 rgw/notifications: add const to APIs when possible
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-01-23 17:45:44 +00:00
dparmar18
c71583d8a2 PendingReleaseNotes: noted new MDSMap field refuse_client_session
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-12-22 20:35:54 +05:30