Commit Graph

571 Commits

Author SHA1 Message Date
Laura Flores
cda85937c4
Merge pull request #50065 from ajarr/fix-58691
mgr: store names of modules that register RADOS clients in the MgrMap
2023-03-09 13:09:04 -06:00
Luís Henriques
b70c752e4a PendingReleaseNotes: add reference to the new mdsmap max_xattr_size field
Signed-off-by: Luís Henriques <lhenriques@suse.de>
2023-03-01 10:38:11 +00:00
Venky Shankar
cca84e653d Merge PR #48720 into main
* refs/pull/48720/head:
	qa: fix api failure issue caused during a dashboard test
	PendingReleaseNotes: noted new MDSMap field refuse_client_session
	qa: added two testcases
	client: do not initiate session if flag refuse_client_session is set
	mds: do not reconnect when refuse_client_session is set
	mds: add new feature to block clients from establishing sessions

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-01 07:54:18 +05:30
Ramana Raja
b545fb9f56 mgr: store names of modules that register RADOS clients in the MgrMap
The MgrMap stores a list of RADOS clients' addresses registered by the
mgr modules. During failover of ceph-mgr, the list is used to blocklist
clients belonging to the failed ceph-mgr.

Store the names of the mgr modules that registered the RADOS clients
along with the clients' addresses in the MgrMap. During debugging, this
allows easy identification of the mgr module that registered a
particular RADOS client by just dumping the MgrMap (`ceph mgr dump`).

Following is the MgrMap output with a module's client name displayed
along with its client addrvec,
$ ceph mgr dump | jq '.active_clients[0]'
{
  "name": "devicehealth",
  "addrvec": [
    {
      "type": "v2",
      "addr": "10.0.0.148:0",
      "nonce": 612376578
    }
  ]
}

Fixes: https://tracker.ceph.com/issues/58691
Signed-off-by: Ramana Raja <rraja@redhat.com>
2023-02-28 09:20:28 -05:00
Ilya Dryomov
7b5e16130a mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level
Currently last_failure_osd_epoch and active_clients are dumped in the
always_on_modules dictionary in "ceph mgr dump" output.  This goes back
to when these fields were added in commits f2986a4400 ("mon/MgrMonitor:
blacklist previous instance") and df507cde8d ("mgr: forward RADOS
client instances for potential blacklist") but is wrong as these fields
have nothing to do with always-on modules.

Fixes: https://tracker.ceph.com/issues/58647
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-02-27 21:17:04 +01:00
Ali Maredia
56e2a1006f common: Add labeled perf counters
Add the ability to dump labeled perf counters
for a daemon. Labeled perf counters are stored
in a CephContext's PerfCountersCollection.

Labeled and unlabeled perf counters are dumped
to the admin socket via `counters dump` command.

The schema for labeled and unlabeled perf
counters are dumped to the admin socket via
`counters schema` command.

This commit includes docs and additional unit tests

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-02-23 12:05:36 -05:00
Xiubo Li
b9edab80f0 client: move a client's option to mds-client.yaml
mds_max_retries_on_remount_failure option is used by Client.cc only.

Fixes: https://tracker.ceph.com/issues/56532
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-01-30 15:34:57 +08:00
Yuval Lifshitz
6e94076086 rgw/notifications: add const to APIs when possible
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-01-23 17:45:44 +00:00
dparmar18
c71583d8a2 PendingReleaseNotes: noted new MDSMap field refuse_client_session
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-12-22 20:35:54 +05:30
Adam C. Emerson
0dd2ef4245 rgw: Add rgw_policy_reject_invalid_principals and messages
Reject policies with invalid principals by default and provide more
useful error messages while doing so.

(Log them but do *not* reject the policy if it's set to false.)

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-12-13 16:35:05 -05:00
Ilya Dryomov
51d8c526f0 doc/rbd: add clone encryption details and examples
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:24:06 +01:00
Ilya Dryomov
d642f7804b rbd, rbd-nbd: don't strip trailing newline in passphrase files
One of the stated goals is compatibility with standard LUKS tools,
in particular being able to load encryption on images formatted with
cryptsetup.  cryptsetup doesn't do this and this really interferes
with randomly generated (binary) passphrases.

While at it, open passphrase files as binary -- it communicates the
intent if nothing else on POSIX.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:19:19 +01:00
yuval Lifshitz
1af8ad21ba rgw: update release notes on the removal of pubsub
Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-12-01 21:12:01 +02:00
Casey Bodley
a36895ae77 PendingReleaseNotes: add note for rgw compression+encryption
adds release notes for the feature added in
https://github.com/ceph/ceph/pull/46188

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-12-01 11:28:40 -05:00
Ilya Dryomov
9db96c33d2
Merge pull request #48367 from stefan-chivu/namespace-optarg-fix
rbd: device map/unmap --namespace handling fixes

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-11 11:58:15 +02:00
Ilya Dryomov
2df426bd97 PendingReleaseNotes: add "rbd device unmap --namespace" note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-10 20:21:11 +02:00
Ilya Dryomov
06bb82c10c
Merge pull request #48301 from PepperJo/cmp_write_C_vec
librbd: add compare-and-write vector C API

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 14:07:36 +02:00
Ilya Dryomov
bd98a66d03 PendingReleaseNotes: add rbd_aio_compare_and_writev note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 12:36:00 +02:00
Adam King
2784a70271
Merge pull request #47756 from dparmar18/wip-dparmar-cephadm-after-revert
pybind/mgr/cephadm/upgrade: allow upgrades without reducing max_mds

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-22 09:54:06 -04:00
Neha Ojha
b81ece50ae
Merge pull request #47770 from rzarzynski/wip-doc-dups-trimming-relnotes
PendingReleaseNotes: document online and offline trimming of PG Log's…

Reviewed-By: Neha Ojha <nojha@redhat.com>
2022-09-09 10:00:41 -07:00
Radoslaw Zarzynski
dbfb50453c PendingReleaseNotes: document online and offline trimming of PG Log's dups
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-09-08 15:35:38 +00:00
Sridhar Seshasayee
b6e36cb4a9
Merge pull request #47630 from sseshasa/wip-add-mclk-cpu-util-rel-note
PendingReleaseNotes: Note the fix for high CPU utilization during recovery

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-09-06 20:45:02 +05:30
dparmar18
5eee69df10 PendingReleaseNotes: added note related to new mds upgrade option using cephadm
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-26 20:48:11 +05:30
Venky Shankar
5ef57ea4a0
Merge pull request #47182 from lxbsz/wip-56638
libcephfs: define AT_NO_ATTR_SYNC back for backward compatibility

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-23 19:39:40 +05:30
Patrick Donnelly
a8a86789c7
Revert "Merge pull request #47092 from dparmar18/wip-dparmar-cephadm-simple-1"
This reverts commit 1c4da3dbd2, reversing
changes made to ee1e163b1e.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-08-22 13:10:27 -04:00
Xiubo Li
bb0d56a93a libcephfs: define AT_NO_ATTR_SYNC back for backward compatibility
This was introduce by commit e2a67f2a65,
for the third part applications they may still use the old macro.

Add it back and marked it as deprecated.

Fixes: https://tracker.ceph.com/issues/56638
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-08-22 14:09:31 +08:00
Matan Breizman
02113c9cf6 PendingReleaseNotes: fix typo in 15.2.17
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-08-17 16:43:48 +00:00
Sridhar Seshasayee
d698202232 PendingReleaseNotes: Note the fix for high CPU utilization during recovery
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-08-16 17:15:29 +05:30
Ilya Dryomov
61df853f8c
Merge pull request #45628 from PepperJo/comparev_and_writev_v7
librbd: add compare-and-write compare length limit, remove sector size restriction

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-16 11:53:05 +02:00
Ilya Dryomov
4ddcb7ff92 PendingReleaseNotes: add rbd compare-and-write notes
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-12 13:57:54 +02:00
dparmar18
c3fb65a245 PendingReleaseNotes: added note related to new mds upgrade option using cephadm
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
Matan Breizman
131f8bedfa PendingReleaseNotes: add a note about SnapMapper key coversion
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-07-21 16:52:59 +00:00
Casey Bodley
f6565dfef6 rgw: add 'rgw_access' log subsys for frontend http access log
this allows the log level of this http access log to be configured
separately from the 'rgw' subsystem, though the defaults are the same

Fixes: https://tracker.ceph.com/issues/54405

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-08 11:12:52 -04:00
Yaarit Hatuka
1742d1b365 PendingReleaseNotes: add a note about Rook telemetry
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-06-06 19:34:19 +00:00
Laura Flores
fce2a7782d PendingReleaseNotes: add note about bluestore_zero_block_detection config option
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-05-27 13:36:18 -05:00
Kefu Chai
6677658992 common/ceph_json: dump bool using f->dump_bool()
as per https://www.json.org/json-en.html, JSON encodes bool as
"true" or "false", without the quotes. before this change, the quotes
are always added when encoding boolean values.

but this change is not backward compatible.

encode_json()'s bool overload is used by rgw. it uses JSONObj
defined in common/ceph_json.h to decode JSON-encoded structs.
and it does not differentiate bool from str when decoding a boolean
value despite that it could have check the "quoted" member variable
of JSONObj for validating the type of value. so we should be fine.

Fixes: https://tracker.ceph.com/issues/55189
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-05-21 16:32:14 +08:00
Ziye Yang
27b7ccacd4 blk/spdk: Add the support to use nvme device provided by NVMe-of Target
This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2022-05-15 09:15:40 +08:00
Zac Dover
e3d8428dd0 doc: clean up PendingReleaseNotes for reef
This PR removes all of the release notes up to
version 17 (Quincy) inclusive.

As far as I know, for as long as I have worked
on the Ceph project, we have never cleaned up
the release notes from release to release.

Until now.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-04-27 03:15:27 +10:00
Casey Bodley
7bc93fcae7
Merge pull request #45737 from cbodley/wip-rgw-ops-log-defaults
rgw: change default ops log backend from rados to file

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
2022-04-26 12:43:44 -04:00
Sridhar Seshasayee
97043a8c13 PendingReleaseNotes: Update mclock release note regarding an existing issue
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-04-06 11:48:31 +05:30
Casey Bodley
4045b7cb46 PendingReleaseNotes for ops log backend
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-04-05 17:20:22 -04:00
Sridhar Seshasayee
0511a8eadc PendingReleaseNotes: Add mclock config reference link to an existing note
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-24 15:12:19 +05:30
Yuri Weinstein
2624f51a72
Merge pull request #44588 from kamoltat/wip-ksirivad-disable-progress-by-default
pybind/mgr/progress: disable pg recovery event by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-02-11 14:49:17 -08:00
Yaarit Hatuka
85f4b5b839 PendingReleaseNotes: add a note about perf channel
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-02-09 21:48:51 +00:00
Venky Shankar
b7af2a94a4
Merge pull request #42549 from ajarr/wip-add-volume-rename
mgr/volumes: Add `fs volume rename` command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:34:32 +05:30
Kamoltat
f06da20dff pybind/mgr/progress: disable pg recovery event by default
The progress module disabled the pg recovery event by default
since the event is expensive and has interrupted other serviceis
when there is OSDs being marked in/out from the the cluster.

To turn the event on manually:

ceph config set mgr mgr/progress/allow_pg_recovery_event true

Updated qa/tasks/mgr/test_progress.py to enable
the pg recovery event when testing the progress module.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-02-03 17:51:42 +00:00
Yuri Weinstein
e419a29be5
Merge pull request #42735 from amathuria/wip-amathuria-scrub-stats
osd/scrub: Add stats to PG dump for number of objects scrubbed

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-14 10:46:28 -08:00
Yuri Weinstein
f5b4f3f4d9
Merge pull request #44251 from yaarith/telemetry-opt-in
mgr/telemetry: introduce new design for varying report data

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-01-14 09:06:11 -08:00
Aishwarya Mathuria
0484c76b73 doc: document new OBJECTS_SCRUBBED column in pg dump
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-01-14 19:40:33 +05:30
Yaarit Hatuka
30c4944938 PendingReleaseNotes: add a note about telemetry
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-01-13 21:54:07 +00:00