Commit Graph

562 Commits

Author SHA1 Message Date
Adam C. Emerson 0dd2ef4245 rgw: Add `rgw_policy_reject_invalid_principals` and messages
Reject policies with invalid principals by default and provide more
useful error messages while doing so.

(Log them but do *not* reject the policy if it's set to false.)

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-12-13 16:35:05 -05:00
Ilya Dryomov 51d8c526f0 doc/rbd: add clone encryption details and examples
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:24:06 +01:00
Ilya Dryomov d642f7804b rbd, rbd-nbd: don't strip trailing newline in passphrase files
One of the stated goals is compatibility with standard LUKS tools,
in particular being able to load encryption on images formatted with
cryptsetup.  cryptsetup doesn't do this and this really interferes
with randomly generated (binary) passphrases.

While at it, open passphrase files as binary -- it communicates the
intent if nothing else on POSIX.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:19:19 +01:00
yuval Lifshitz 1af8ad21ba rgw: update release notes on the removal of pubsub
Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-12-01 21:12:01 +02:00
Casey Bodley a36895ae77 PendingReleaseNotes: add note for rgw compression+encryption
adds release notes for the feature added in
https://github.com/ceph/ceph/pull/46188

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-12-01 11:28:40 -05:00
Ilya Dryomov 9db96c33d2
Merge pull request #48367 from stefan-chivu/namespace-optarg-fix
rbd: device map/unmap --namespace handling fixes

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-11 11:58:15 +02:00
Ilya Dryomov 2df426bd97 PendingReleaseNotes: add "rbd device unmap --namespace" note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-10 20:21:11 +02:00
Ilya Dryomov 06bb82c10c
Merge pull request #48301 from PepperJo/cmp_write_C_vec
librbd: add compare-and-write vector C API

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 14:07:36 +02:00
Ilya Dryomov bd98a66d03 PendingReleaseNotes: add rbd_aio_compare_and_writev note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 12:36:00 +02:00
Adam King 2784a70271
Merge pull request #47756 from dparmar18/wip-dparmar-cephadm-after-revert
pybind/mgr/cephadm/upgrade: allow upgrades without reducing max_mds

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-22 09:54:06 -04:00
Neha Ojha b81ece50ae
Merge pull request #47770 from rzarzynski/wip-doc-dups-trimming-relnotes
PendingReleaseNotes: document online and offline trimming of PG Log's…

Reviewed-By: Neha Ojha <nojha@redhat.com>
2022-09-09 10:00:41 -07:00
Radoslaw Zarzynski dbfb50453c PendingReleaseNotes: document online and offline trimming of PG Log's dups
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-09-08 15:35:38 +00:00
Sridhar Seshasayee b6e36cb4a9
Merge pull request #47630 from sseshasa/wip-add-mclk-cpu-util-rel-note
PendingReleaseNotes: Note the fix for high CPU utilization during recovery

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-09-06 20:45:02 +05:30
dparmar18 5eee69df10 PendingReleaseNotes: added note related to new mds upgrade option using cephadm
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-26 20:48:11 +05:30
Venky Shankar 5ef57ea4a0
Merge pull request #47182 from lxbsz/wip-56638
libcephfs: define AT_NO_ATTR_SYNC back for backward compatibility

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-23 19:39:40 +05:30
Patrick Donnelly a8a86789c7
Revert "Merge pull request #47092 from dparmar18/wip-dparmar-cephadm-simple-1"
This reverts commit 1c4da3dbd2, reversing
changes made to ee1e163b1e.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-08-22 13:10:27 -04:00
Xiubo Li bb0d56a93a libcephfs: define AT_NO_ATTR_SYNC back for backward compatibility
This was introduce by commit e2a67f2a65,
for the third part applications they may still use the old macro.

Add it back and marked it as deprecated.

Fixes: https://tracker.ceph.com/issues/56638
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-08-22 14:09:31 +08:00
Matan Breizman 02113c9cf6 PendingReleaseNotes: fix typo in 15.2.17
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-08-17 16:43:48 +00:00
Sridhar Seshasayee d698202232 PendingReleaseNotes: Note the fix for high CPU utilization during recovery
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-08-16 17:15:29 +05:30
Ilya Dryomov 61df853f8c
Merge pull request #45628 from PepperJo/comparev_and_writev_v7
librbd: add compare-and-write compare length limit, remove sector size restriction

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-16 11:53:05 +02:00
Ilya Dryomov 4ddcb7ff92 PendingReleaseNotes: add rbd compare-and-write notes
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-12 13:57:54 +02:00
dparmar18 c3fb65a245 PendingReleaseNotes: added note related to new mds upgrade option using cephadm
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
Matan Breizman 131f8bedfa PendingReleaseNotes: add a note about SnapMapper key coversion
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-07-21 16:52:59 +00:00
Casey Bodley f6565dfef6 rgw: add 'rgw_access' log subsys for frontend http access log
this allows the log level of this http access log to be configured
separately from the 'rgw' subsystem, though the defaults are the same

Fixes: https://tracker.ceph.com/issues/54405

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-08 11:12:52 -04:00
Yaarit Hatuka 1742d1b365 PendingReleaseNotes: add a note about Rook telemetry
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-06-06 19:34:19 +00:00
Laura Flores fce2a7782d PendingReleaseNotes: add note about `bluestore_zero_block_detection` config option
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-05-27 13:36:18 -05:00
Kefu Chai 6677658992 common/ceph_json: dump bool using f->dump_bool()
as per https://www.json.org/json-en.html, JSON encodes bool as
"true" or "false", without the quotes. before this change, the quotes
are always added when encoding boolean values.

but this change is not backward compatible.

encode_json()'s bool overload is used by rgw. it uses JSONObj
defined in common/ceph_json.h to decode JSON-encoded structs.
and it does not differentiate bool from str when decoding a boolean
value despite that it could have check the "quoted" member variable
of JSONObj for validating the type of value. so we should be fine.

Fixes: https://tracker.ceph.com/issues/55189
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-05-21 16:32:14 +08:00
Ziye Yang 27b7ccacd4 blk/spdk: Add the support to use nvme device provided by NVMe-of Target
This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2022-05-15 09:15:40 +08:00
Zac Dover e3d8428dd0 doc: clean up PendingReleaseNotes for reef
This PR removes all of the release notes up to
version 17 (Quincy) inclusive.

As far as I know, for as long as I have worked
on the Ceph project, we have never cleaned up
the release notes from release to release.

Until now.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-04-27 03:15:27 +10:00
Casey Bodley 7bc93fcae7
Merge pull request #45737 from cbodley/wip-rgw-ops-log-defaults
rgw: change default ops log backend from rados to file

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
2022-04-26 12:43:44 -04:00
Sridhar Seshasayee 97043a8c13 PendingReleaseNotes: Update mclock release note regarding an existing issue
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-04-06 11:48:31 +05:30
Casey Bodley 4045b7cb46 PendingReleaseNotes for ops log backend
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-04-05 17:20:22 -04:00
Sridhar Seshasayee 0511a8eadc PendingReleaseNotes: Add mclock config reference link to an existing note
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-24 15:12:19 +05:30
Yuri Weinstein 2624f51a72
Merge pull request #44588 from kamoltat/wip-ksirivad-disable-progress-by-default
pybind/mgr/progress: disable pg recovery event by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-02-11 14:49:17 -08:00
Yaarit Hatuka 85f4b5b839 PendingReleaseNotes: add a note about perf channel
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-02-09 21:48:51 +00:00
Venky Shankar b7af2a94a4
Merge pull request #42549 from ajarr/wip-add-volume-rename
mgr/volumes: Add `fs volume rename` command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:34:32 +05:30
Kamoltat f06da20dff pybind/mgr/progress: disable pg recovery event by default
The progress module disabled the pg recovery event by default
since the event is expensive and has interrupted other serviceis
when there is OSDs being marked in/out from the the cluster.

To turn the event on manually:

ceph config set mgr mgr/progress/allow_pg_recovery_event true

Updated qa/tasks/mgr/test_progress.py to enable
the pg recovery event when testing the progress module.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-02-03 17:51:42 +00:00
Yuri Weinstein e419a29be5
Merge pull request #42735 from amathuria/wip-amathuria-scrub-stats
osd/scrub: Add stats to PG dump for number of objects scrubbed

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-14 10:46:28 -08:00
Yuri Weinstein f5b4f3f4d9
Merge pull request #44251 from yaarith/telemetry-opt-in
mgr/telemetry: introduce new design for varying report data

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-01-14 09:06:11 -08:00
Aishwarya Mathuria 0484c76b73 doc: document new OBJECTS_SCRUBBED column in pg dump
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-01-14 19:40:33 +05:30
Yaarit Hatuka 30c4944938 PendingReleaseNotes: add a note about telemetry
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-01-13 21:54:07 +00:00
Adam King b064b1fb4f
Merge pull request #44394 from melissa-kun-li/enable-autotune
Enable autotune for osd_memory_target on bootstrap

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2022-01-13 12:06:46 -05:00
Ramana Raja 70697629bf mgr/volumes: Add `fs volume rename` command
The `fs volume rename` command renames the volume, i.e.,
orchestrator MDS service, file system, and the data and
metadata pool of the file system.

Fixes: https://tracker.ceph.com/issues/51162
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-01-13 10:36:46 -05:00
Yuri Weinstein a8bb49d4d9
Merge pull request #39440 from pdvian/wip-warn-filestore-osds
mon/OSDMonitor, osd: Add warning on filestore deprecation and force use of wpq scheduler for filestore OSDs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-12 08:49:02 -08:00
Or Friedmann fd084fd7fc rgw: Add admin ops API for rate limiting
Add admin ops API for rate limiting and some bug fixes

Signed-off-by: Or Friedmann <ofriedma@redhat.com>
2022-01-10 16:48:56 +00:00
Melissa Li 787f30a1b0 PendingReleaseNotes: note default enabling of `osd_memory_target_autotune`
Fixes: https://tracker.ceph.com/issues/51562
Signed-off-by: Melissa Li <melissali@redhat.com>
2022-01-05 16:06:07 -05:00
Sridhar Seshasayee e65c4bcd96 osd, mon/OSDMonitor: Force the scheduler type to 'wpq' for filestore OSDs
The 'mclock_scheduler' is not supported for filestore OSDs. Enforce the
usage of 'wpq' scheduler for such OSDs to avoid issues.

Also, in this scenario, the override of various config settings for the
'mclock_scheduler' are not performed.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-01-05 10:08:25 +00:00
Prashant D 39f5a61a3a mon/OSDMonitor: Raise health warning for filestore osds
Filestore will be deprecated in Quincy, considering
that BlueStore has been the default objectstore for
quite some time.

Fixes: https://tracker.ceph.com/issues/49275

Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-05 10:08:25 +00:00
Kamoltat 9baed0394e docs: Added noautoscale to docs + release notes
Updated the docs in
https://docs.ceph.com/en/latest/rados/operations/placement-groups/
and updated the release notes to reflect noautoscale flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-22 21:42:52 +00:00
Kamoltat abaab51dd8 Added ReleasesNotes and documentation
Add Release Notes and remove any `profile`
related stuff in the autoscaler documentation
and replace it with `bulk` flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-21 07:56:37 +00:00