Commit Graph

562 Commits

Author SHA1 Message Date
Adam C. Emerson
0dd2ef4245 rgw: Add rgw_policy_reject_invalid_principals and messages
Reject policies with invalid principals by default and provide more
useful error messages while doing so.

(Log them but do *not* reject the policy if it's set to false.)

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-12-13 16:35:05 -05:00
Ilya Dryomov
51d8c526f0 doc/rbd: add clone encryption details and examples
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:24:06 +01:00
Ilya Dryomov
d642f7804b rbd, rbd-nbd: don't strip trailing newline in passphrase files
One of the stated goals is compatibility with standard LUKS tools,
in particular being able to load encryption on images formatted with
cryptsetup.  cryptsetup doesn't do this and this really interferes
with randomly generated (binary) passphrases.

While at it, open passphrase files as binary -- it communicates the
intent if nothing else on POSIX.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-04 18:19:19 +01:00
yuval Lifshitz
1af8ad21ba rgw: update release notes on the removal of pubsub
Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-12-01 21:12:01 +02:00
Casey Bodley
a36895ae77 PendingReleaseNotes: add note for rgw compression+encryption
adds release notes for the feature added in
https://github.com/ceph/ceph/pull/46188

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-12-01 11:28:40 -05:00
Ilya Dryomov
9db96c33d2
Merge pull request #48367 from stefan-chivu/namespace-optarg-fix
rbd: device map/unmap --namespace handling fixes

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-11 11:58:15 +02:00
Ilya Dryomov
2df426bd97 PendingReleaseNotes: add "rbd device unmap --namespace" note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-10 20:21:11 +02:00
Ilya Dryomov
06bb82c10c
Merge pull request #48301 from PepperJo/cmp_write_C_vec
librbd: add compare-and-write vector C API

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 14:07:36 +02:00
Ilya Dryomov
bd98a66d03 PendingReleaseNotes: add rbd_aio_compare_and_writev note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-06 12:36:00 +02:00
Adam King
2784a70271
Merge pull request #47756 from dparmar18/wip-dparmar-cephadm-after-revert
pybind/mgr/cephadm/upgrade: allow upgrades without reducing max_mds

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-09-22 09:54:06 -04:00
Neha Ojha
b81ece50ae
Merge pull request #47770 from rzarzynski/wip-doc-dups-trimming-relnotes
PendingReleaseNotes: document online and offline trimming of PG Log's…

Reviewed-By: Neha Ojha <nojha@redhat.com>
2022-09-09 10:00:41 -07:00
Radoslaw Zarzynski
dbfb50453c PendingReleaseNotes: document online and offline trimming of PG Log's dups
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-09-08 15:35:38 +00:00
Sridhar Seshasayee
b6e36cb4a9
Merge pull request #47630 from sseshasa/wip-add-mclk-cpu-util-rel-note
PendingReleaseNotes: Note the fix for high CPU utilization during recovery

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-09-06 20:45:02 +05:30
dparmar18
5eee69df10 PendingReleaseNotes: added note related to new mds upgrade option using cephadm
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-26 20:48:11 +05:30
Venky Shankar
5ef57ea4a0
Merge pull request #47182 from lxbsz/wip-56638
libcephfs: define AT_NO_ATTR_SYNC back for backward compatibility

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-23 19:39:40 +05:30
Patrick Donnelly
a8a86789c7
Revert "Merge pull request #47092 from dparmar18/wip-dparmar-cephadm-simple-1"
This reverts commit 1c4da3dbd20d9683fe681cd7083478809cbb19b9, reversing
changes made to ee1e163b1e69c4db558cdf6b857c7c82cd4820d8.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-08-22 13:10:27 -04:00
Xiubo Li
bb0d56a93a libcephfs: define AT_NO_ATTR_SYNC back for backward compatibility
This was introduce by commit e2a67f2a65553ad45721bb391081bc61aa97e0e9,
for the third part applications they may still use the old macro.

Add it back and marked it as deprecated.

Fixes: https://tracker.ceph.com/issues/56638
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-08-22 14:09:31 +08:00
Matan Breizman
02113c9cf6 PendingReleaseNotes: fix typo in 15.2.17
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-08-17 16:43:48 +00:00
Sridhar Seshasayee
d698202232 PendingReleaseNotes: Note the fix for high CPU utilization during recovery
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-08-16 17:15:29 +05:30
Ilya Dryomov
61df853f8c
Merge pull request #45628 from PepperJo/comparev_and_writev_v7
librbd: add compare-and-write compare length limit, remove sector size restriction

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-16 11:53:05 +02:00
Ilya Dryomov
4ddcb7ff92 PendingReleaseNotes: add rbd compare-and-write notes
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-12 13:57:54 +02:00
dparmar18
c3fb65a245 PendingReleaseNotes: added note related to new mds upgrade option using cephadm
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-08-10 00:13:43 +05:30
Matan Breizman
131f8bedfa PendingReleaseNotes: add a note about SnapMapper key coversion
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-07-21 16:52:59 +00:00
Casey Bodley
f6565dfef6 rgw: add 'rgw_access' log subsys for frontend http access log
this allows the log level of this http access log to be configured
separately from the 'rgw' subsystem, though the defaults are the same

Fixes: https://tracker.ceph.com/issues/54405

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-08 11:12:52 -04:00
Yaarit Hatuka
1742d1b365 PendingReleaseNotes: add a note about Rook telemetry
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-06-06 19:34:19 +00:00
Laura Flores
fce2a7782d PendingReleaseNotes: add note about bluestore_zero_block_detection config option
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-05-27 13:36:18 -05:00
Kefu Chai
6677658992 common/ceph_json: dump bool using f->dump_bool()
as per https://www.json.org/json-en.html, JSON encodes bool as
"true" or "false", without the quotes. before this change, the quotes
are always added when encoding boolean values.

but this change is not backward compatible.

encode_json()'s bool overload is used by rgw. it uses JSONObj
defined in common/ceph_json.h to decode JSON-encoded structs.
and it does not differentiate bool from str when decoding a boolean
value despite that it could have check the "quoted" member variable
of JSONObj for validating the type of value. so we should be fine.

Fixes: https://tracker.ceph.com/issues/55189
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-05-21 16:32:14 +08:00
Ziye Yang
27b7ccacd4 blk/spdk: Add the support to use nvme device provided by NVMe-of Target
This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2022-05-15 09:15:40 +08:00
Zac Dover
e3d8428dd0 doc: clean up PendingReleaseNotes for reef
This PR removes all of the release notes up to
version 17 (Quincy) inclusive.

As far as I know, for as long as I have worked
on the Ceph project, we have never cleaned up
the release notes from release to release.

Until now.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-04-27 03:15:27 +10:00
Casey Bodley
7bc93fcae7
Merge pull request #45737 from cbodley/wip-rgw-ops-log-defaults
rgw: change default ops log backend from rados to file

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
2022-04-26 12:43:44 -04:00
Sridhar Seshasayee
97043a8c13 PendingReleaseNotes: Update mclock release note regarding an existing issue
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-04-06 11:48:31 +05:30
Casey Bodley
4045b7cb46 PendingReleaseNotes for ops log backend
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-04-05 17:20:22 -04:00
Sridhar Seshasayee
0511a8eadc PendingReleaseNotes: Add mclock config reference link to an existing note
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-24 15:12:19 +05:30
Yuri Weinstein
2624f51a72
Merge pull request #44588 from kamoltat/wip-ksirivad-disable-progress-by-default
pybind/mgr/progress: disable pg recovery event by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-02-11 14:49:17 -08:00
Yaarit Hatuka
85f4b5b839 PendingReleaseNotes: add a note about perf channel
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-02-09 21:48:51 +00:00
Venky Shankar
b7af2a94a4
Merge pull request #42549 from ajarr/wip-add-volume-rename
mgr/volumes: Add `fs volume rename` command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:34:32 +05:30
Kamoltat
f06da20dff pybind/mgr/progress: disable pg recovery event by default
The progress module disabled the pg recovery event by default
since the event is expensive and has interrupted other serviceis
when there is OSDs being marked in/out from the the cluster.

To turn the event on manually:

ceph config set mgr mgr/progress/allow_pg_recovery_event true

Updated qa/tasks/mgr/test_progress.py to enable
the pg recovery event when testing the progress module.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-02-03 17:51:42 +00:00
Yuri Weinstein
e419a29be5
Merge pull request #42735 from amathuria/wip-amathuria-scrub-stats
osd/scrub: Add stats to PG dump for number of objects scrubbed

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-14 10:46:28 -08:00
Yuri Weinstein
f5b4f3f4d9
Merge pull request #44251 from yaarith/telemetry-opt-in
mgr/telemetry: introduce new design for varying report data

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-01-14 09:06:11 -08:00
Aishwarya Mathuria
0484c76b73 doc: document new OBJECTS_SCRUBBED column in pg dump
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-01-14 19:40:33 +05:30
Yaarit Hatuka
30c4944938 PendingReleaseNotes: add a note about telemetry
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-01-13 21:54:07 +00:00
Adam King
b064b1fb4f
Merge pull request #44394 from melissa-kun-li/enable-autotune
Enable autotune for osd_memory_target on bootstrap

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2022-01-13 12:06:46 -05:00
Ramana Raja
70697629bf mgr/volumes: Add fs volume rename command
The `fs volume rename` command renames the volume, i.e.,
orchestrator MDS service, file system, and the data and
metadata pool of the file system.

Fixes: https://tracker.ceph.com/issues/51162
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-01-13 10:36:46 -05:00
Yuri Weinstein
a8bb49d4d9
Merge pull request #39440 from pdvian/wip-warn-filestore-osds
mon/OSDMonitor, osd: Add warning on filestore deprecation and force use of wpq scheduler for filestore OSDs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-12 08:49:02 -08:00
Or Friedmann
fd084fd7fc rgw: Add admin ops API for rate limiting
Add admin ops API for rate limiting and some bug fixes

Signed-off-by: Or Friedmann <ofriedma@redhat.com>
2022-01-10 16:48:56 +00:00
Melissa Li
787f30a1b0 PendingReleaseNotes: note default enabling of osd_memory_target_autotune
Fixes: https://tracker.ceph.com/issues/51562
Signed-off-by: Melissa Li <melissali@redhat.com>
2022-01-05 16:06:07 -05:00
Sridhar Seshasayee
e65c4bcd96 osd, mon/OSDMonitor: Force the scheduler type to 'wpq' for filestore OSDs
The 'mclock_scheduler' is not supported for filestore OSDs. Enforce the
usage of 'wpq' scheduler for such OSDs to avoid issues.

Also, in this scenario, the override of various config settings for the
'mclock_scheduler' are not performed.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-01-05 10:08:25 +00:00
Prashant D
39f5a61a3a mon/OSDMonitor: Raise health warning for filestore osds
Filestore will be deprecated in Quincy, considering
that BlueStore has been the default objectstore for
quite some time.

Fixes: https://tracker.ceph.com/issues/49275

Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-05 10:08:25 +00:00
Kamoltat
9baed0394e docs: Added noautoscale to docs + release notes
Updated the docs in
https://docs.ceph.com/en/latest/rados/operations/placement-groups/
and updated the release notes to reflect noautoscale flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-22 21:42:52 +00:00
Kamoltat
abaab51dd8 Added ReleasesNotes and documentation
Add Release Notes and remove any `profile`
related stuff in the autoscaler documentation
and replace it with `bulk` flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-21 07:56:37 +00:00