Commit Graph

597 Commits

Author SHA1 Message Date
Venky Shankar
c9d67526b2 Revert "mds: disable delegating inode ranges to clients"
This isn't necessary -- the MDS handles delegating inode ranges
to clients from its preallocated inode set properly - the suspected
bug involving not persisting the sessionmap and causing asserts
during replay isn't an issue. The preallocated set is persisted
with the log event and the MDS correctly rebuild the set from
this information during replay.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-10-09 22:22:21 +05:30
Venky Shankar
689b3d5ae1 PendingReleaseNotes: add a note about disallowing delegating inodes
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-10-05 16:54:32 +05:30
Laura Flores
35506db4a4
Merge pull request #52906 from sseshasa/wip-fix-config-dump-pretty-print
mon/ConfigMonitor: Show localized name in "config dump --format json" output
2023-09-26 10:22:08 -04:00
Sridhar Seshasayee
401b30f19f PendingReleaseNotes: Note change to 'ceph config dump' pretty-print output.
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2023-09-21 17:10:10 +05:30
Cory Snyder
152aadb71b rgw: fix rgw versioned bucket stat accounting during reshard and check index
Fixes: https://tracker.ceph.com/issues/62760
Signed-off-by: Cory Snyder <csnyder@1111systems.com>
2023-09-15 18:46:27 +00:00
Milind Changire
7e2546f945
PendingReleaseNotes: add note about 'm' and 'M' periods
Signed-off-by: Milind Changire <mchangir@redhat.com>
2023-09-12 14:11:03 +05:30
Rishabh Dave
849fbd1d5b
Merge pull request #41779 from rishabh-d-dave/fs-auth-subcmd
mon,osd,mds: allow fs authorize to update caps

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-07 18:39:58 +05:30
Rishabh Dave
f9a01cf385
Merge pull request #51942 from trociny/wip-61599
mds: optionally forbid to use standby for another fs as last resort

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-09-06 20:26:33 +05:30
Milind Changire
71c6356f0a
PendingReleaseNotes: note about mandatory fs argument
Signed-off-by: Milind Changire <mchangir@redhat.com>
2023-08-25 21:34:40 +05:30
Venky Shankar
ac3ab1a203 PendingReleaseNotes: add a note for mds_session_metadata_threshold mds config
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-08-22 00:47:27 -04:00
Casey Bodley
61cf6eec7b ReleaseNotes: document recovery of encrypted multipart objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 17:21:03 -04:00
Rishabh Dave
23f1fdbcb3 AuthMonitor: allow "fs authorize" to update caps
When "fs authorize" subcommand is executed for the second time with
different caps, the subcommand exits with error. Modify the behaviour so
that the caps passed every subsequent time is incorporated in to the caps
that are already present in the entity's keyring.

Behaviour before this commit -

$ ./bin/ceph fs authorize a client.x1 / rw
[client.x1]
	key = AQBirqxg5KHeFxAAgOm6lHMYych6OTI+y1HJKw==

$ ./bin/ceph fs authorize b client.x1 / rw
Error EINVAL: client.x1 already has fs capabilities that differ from those supplied. To generate a new auth key for client.x1, first remove client.x1 from configuration files, execute 'ceph auth rm client.x1', then execute this command again.

$ ./bin/ceph auth get client.x1
[client.x1]
	key = AQBirqxg5KHeFxAAgOm6lHMYych6OTI+y1HJKw==
	caps mds = "allow rw fsname=a"
	caps mon = "allow r fsname=a"
	caps osd = "allow rw tag cephfs data=a"
exported keyring for client.x1

After this commit -

$ ./bin/ceph fs authorize a client.x1 / rw
[client.x1]
	key = AQDvrqxgU3I3FBAAJWwF6ZtcOVeHH8TA8CwWmQ==

$ ./bin/ceph fs authorize b client.x1 / rw
updated caps for client.x1

$ ./bin/ceph auth get client.x1
[client.x1]
	key = AQDvrqxgU3I3FBAAJWwF6ZtcOVeHH8TA8CwWmQ==
	caps mds = "allow rw fsname=a, allow rw fsname=b"
	caps mon = "allow r fsname=a, allow r fsname=b"
	caps osd = "allow rw tag cephfs data=a, allow rw tag cephfs data=b"
exported keyring for client.x1

Fixes: https://tracker.ceph.com/issues/47264
Signed-off-by: Rishabh Dave <ridave@redhat.com>

MDSAuthCaps: bug fixes

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-07-30 23:03:22 +05:30
Venky Shankar
94f3e167a0 Merge PR #51278 into main
* refs/pull/51278/head:
	mgr/snap_schedule: rephrase log message when pruning
	doc: add note about snap-schedule snapshot retention
	qa: test user defined number of snaps retention spec
	mgr/snap_schedule: adapt test to new argument list
	doc/cephfs: Add note how mds_max_snaps_per_dir affects snapshot retention
	mgr/snap_schedule: Use mds_max_snaps_per_dir as snapshot count limit

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-13 11:17:16 +05:30
Casey Bodley
fd2ec27f53 PendingReleaseNotes: note rgw's compress-encrypted zonegroup feature flag
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-07 14:39:56 -04:00
Mykola Golub
386c4bbb81 mds: optionally forbid to use standby for another fs as last resort
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2023-06-28 15:57:25 +01:00
Yuri Weinstein
b1ed114a66
Merge pull request #51450 from batrick/i59716
pybind/rados: keep byte representation if decode fails

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-06-21 17:12:08 -04:00
Milind Changire
414ad9619b
doc: add note about snap-schedule snapshot retention
Signed-off-by: Milind Changire <mchangir@redhat.com>
2023-06-20 20:22:33 +05:30
Sridhar Seshasayee
49aad118aa PendingReleaseNotes: Document mClock scheduler fixes and enhancements
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2023-06-07 13:08:23 +05:30
Patrick Donnelly
2aa7becc55
PendingReleaseNotes: add note that pyrados may have omap keys as bytes
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-06-06 21:39:42 -04:00
Radosław Zarzyński
535b8db33e doc: deprecate the cache tiering
This topic has been discussed many times; recently at the Dev
Summit of Cephalocon 2023.

This commit is the minial version of the work, contained entirely
within the `doc`. However, likely it will be expanded as there
were ideas like e.g. adding cache tiering back experimental feature
list (Sam) to warn users when deploying a new cluster.

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-05-17 16:06:17 +02:00
Venky Shankar
85ce1607a3 PendingReleaseNotes: add a note about deleting files from lost+found directory
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-05-06 11:03:11 -04:00
Yaarit Hatuka
750772d71b PendingReleaseNotes: add a note about telemetry leaderboard
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2023-04-21 18:17:10 +00:00
Ilya Dryomov
e89f581513 PendingReleaseNotes: add a note for rbd-mirror daemon perf counters
This was missed in commit 1a1477b9fd ("rbd-mirror: add and rename
perf counters for journal and snapshot mirroring").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-06 12:32:11 +02:00
Ilya Dryomov
e11097bc4c librbd: clear Image::list_watchers() list before populating it
The "append to the passed list" behavior is confusing and not what the
corresponding C API (rbd_watchers_list) or other similar C++ APIs (e.g.
list_lockers) do.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-03-31 12:23:45 +02:00
Rishabh Dave
29c1000ca9
Merge pull request #50307 from dparmar18/fix_pendingreleasenotes
PendingReleaseNotes: remove duplicate note and unwanted tracker link

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-29 21:42:14 +05:30
Laura Flores
cda85937c4
Merge pull request #50065 from ajarr/fix-58691
mgr: store names of modules that register RADOS clients in the MgrMap
2023-03-09 13:09:04 -06:00
Dhairya Parmar
0c6a6aada0 PendingReleaseNotes: remove duplicate note and unwanted tracker link
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2023-03-01 18:43:49 +05:30
Luís Henriques
b70c752e4a PendingReleaseNotes: add reference to the new mdsmap max_xattr_size field
Signed-off-by: Luís Henriques <lhenriques@suse.de>
2023-03-01 10:38:11 +00:00
Venky Shankar
cca84e653d Merge PR #48720 into main
* refs/pull/48720/head:
	qa: fix api failure issue caused during a dashboard test
	PendingReleaseNotes: noted new MDSMap field refuse_client_session
	qa: added two testcases
	client: do not initiate session if flag refuse_client_session is set
	mds: do not reconnect when refuse_client_session is set
	mds: add new feature to block clients from establishing sessions

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-01 07:54:18 +05:30
Ramana Raja
b545fb9f56 mgr: store names of modules that register RADOS clients in the MgrMap
The MgrMap stores a list of RADOS clients' addresses registered by the
mgr modules. During failover of ceph-mgr, the list is used to blocklist
clients belonging to the failed ceph-mgr.

Store the names of the mgr modules that registered the RADOS clients
along with the clients' addresses in the MgrMap. During debugging, this
allows easy identification of the mgr module that registered a
particular RADOS client by just dumping the MgrMap (`ceph mgr dump`).

Following is the MgrMap output with a module's client name displayed
along with its client addrvec,
$ ceph mgr dump | jq '.active_clients[0]'
{
  "name": "devicehealth",
  "addrvec": [
    {
      "type": "v2",
      "addr": "10.0.0.148:0",
      "nonce": 612376578
    }
  ]
}

Fixes: https://tracker.ceph.com/issues/58691
Signed-off-by: Ramana Raja <rraja@redhat.com>
2023-02-28 09:20:28 -05:00
Ilya Dryomov
7b5e16130a mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level
Currently last_failure_osd_epoch and active_clients are dumped in the
always_on_modules dictionary in "ceph mgr dump" output.  This goes back
to when these fields were added in commits f2986a4400 ("mon/MgrMonitor:
blacklist previous instance") and df507cde8d ("mgr: forward RADOS
client instances for potential blacklist") but is wrong as these fields
have nothing to do with always-on modules.

Fixes: https://tracker.ceph.com/issues/58647
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-02-27 21:17:04 +01:00
Ali Maredia
56e2a1006f common: Add labeled perf counters
Add the ability to dump labeled perf counters
for a daemon. Labeled perf counters are stored
in a CephContext's PerfCountersCollection.

Labeled and unlabeled perf counters are dumped
to the admin socket via `counters dump` command.

The schema for labeled and unlabeled perf
counters are dumped to the admin socket via
`counters schema` command.

This commit includes docs and additional unit tests

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-02-23 12:05:36 -05:00
Xiubo Li
b9edab80f0 client: move a client's option to mds-client.yaml
mds_max_retries_on_remount_failure option is used by Client.cc only.

Fixes: https://tracker.ceph.com/issues/56532
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-01-30 15:34:57 +08:00
Yuval Lifshitz
6e94076086 rgw/notifications: add const to APIs when possible
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-01-23 17:45:44 +00:00
dparmar18
c71583d8a2 PendingReleaseNotes: noted new MDSMap field refuse_client_session
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-12-22 20:35:54 +05:30
Adam C. Emerson
0dd2ef4245 rgw: Add rgw_policy_reject_invalid_principals and messages
Reject policies with invalid principals by default and provide more
useful error messages while doing so.

(Log them but do *not* reject the policy if it's set to false.)

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-12-13 16:35:05 -05:00
Ilya Dryomov
51d8c526f0 doc/rbd: add clone encryption details and examples
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:24:06 +01:00
Ilya Dryomov
d642f7804b rbd, rbd-nbd: don't strip trailing newline in passphrase files
One of the stated goals is compatibility with standard LUKS tools,
in particular being able to load encryption on images formatted with
cryptsetup.  cryptsetup doesn't do this and this really interferes
with randomly generated (binary) passphrases.

While at it, open passphrase files as binary -- it communicates the
intent if nothing else on POSIX.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:19:19 +01:00
yuval Lifshitz
1af8ad21ba rgw: update release notes on the removal of pubsub
Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-12-01 21:12:01 +02:00
Casey Bodley
a36895ae77 PendingReleaseNotes: add note for rgw compression+encryption
adds release notes for the feature added in
https://github.com/ceph/ceph/pull/46188

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-12-01 11:28:40 -05:00
Ilya Dryomov
9db96c33d2
Merge pull request #48367 from stefan-chivu/namespace-optarg-fix
rbd: device map/unmap --namespace handling fixes

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-11 11:58:15 +02:00
Ilya Dryomov
2df426bd97 PendingReleaseNotes: add "rbd device unmap --namespace" note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-10 20:21:11 +02:00
Ilya Dryomov
06bb82c10c
Merge pull request #48301 from PepperJo/cmp_write_C_vec
librbd: add compare-and-write vector C API

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 14:07:36 +02:00
Ilya Dryomov
bd98a66d03 PendingReleaseNotes: add rbd_aio_compare_and_writev note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 12:36:00 +02:00
Adam King
2784a70271
Merge pull request #47756 from dparmar18/wip-dparmar-cephadm-after-revert
pybind/mgr/cephadm/upgrade: allow upgrades without reducing max_mds

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-22 09:54:06 -04:00
Neha Ojha
b81ece50ae
Merge pull request #47770 from rzarzynski/wip-doc-dups-trimming-relnotes
PendingReleaseNotes: document online and offline trimming of PG Log's…

Reviewed-By: Neha Ojha <nojha@redhat.com>
2022-09-09 10:00:41 -07:00
Radoslaw Zarzynski
dbfb50453c PendingReleaseNotes: document online and offline trimming of PG Log's dups
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-09-08 15:35:38 +00:00
Sridhar Seshasayee
b6e36cb4a9
Merge pull request #47630 from sseshasa/wip-add-mclk-cpu-util-rel-note
PendingReleaseNotes: Note the fix for high CPU utilization during recovery

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-09-06 20:45:02 +05:30
dparmar18
5eee69df10 PendingReleaseNotes: added note related to new mds upgrade option using cephadm
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-26 20:48:11 +05:30
Venky Shankar
5ef57ea4a0
Merge pull request #47182 from lxbsz/wip-56638
libcephfs: define AT_NO_ATTR_SYNC back for backward compatibility

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-23 19:39:40 +05:30