Commit Graph

530 Commits

Author SHA1 Message Date
Sridhar Seshasayee
0511a8eadc PendingReleaseNotes: Add mclock config reference link to an existing note
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-24 15:12:19 +05:30
Yuri Weinstein
2624f51a72
Merge pull request #44588 from kamoltat/wip-ksirivad-disable-progress-by-default
pybind/mgr/progress: disable pg recovery event by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-02-11 14:49:17 -08:00
Yaarit Hatuka
85f4b5b839 PendingReleaseNotes: add a note about perf channel
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-02-09 21:48:51 +00:00
Venky Shankar
b7af2a94a4
Merge pull request #42549 from ajarr/wip-add-volume-rename
mgr/volumes: Add `fs volume rename` command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:34:32 +05:30
Kamoltat
f06da20dff pybind/mgr/progress: disable pg recovery event by default
The progress module disabled the pg recovery event by default
since the event is expensive and has interrupted other serviceis
when there is OSDs being marked in/out from the the cluster.

To turn the event on manually:

ceph config set mgr mgr/progress/allow_pg_recovery_event true

Updated qa/tasks/mgr/test_progress.py to enable
the pg recovery event when testing the progress module.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-02-03 17:51:42 +00:00
Yuri Weinstein
e419a29be5
Merge pull request #42735 from amathuria/wip-amathuria-scrub-stats
osd/scrub: Add stats to PG dump for number of objects scrubbed

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-14 10:46:28 -08:00
Yuri Weinstein
f5b4f3f4d9
Merge pull request #44251 from yaarith/telemetry-opt-in
mgr/telemetry: introduce new design for varying report data

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-01-14 09:06:11 -08:00
Aishwarya Mathuria
0484c76b73 doc: document new OBJECTS_SCRUBBED column in pg dump
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-01-14 19:40:33 +05:30
Yaarit Hatuka
30c4944938 PendingReleaseNotes: add a note about telemetry
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-01-13 21:54:07 +00:00
Adam King
b064b1fb4f
Merge pull request #44394 from melissa-kun-li/enable-autotune
Enable autotune for osd_memory_target on bootstrap

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2022-01-13 12:06:46 -05:00
Ramana Raja
70697629bf mgr/volumes: Add fs volume rename command
The `fs volume rename` command renames the volume, i.e.,
orchestrator MDS service, file system, and the data and
metadata pool of the file system.

Fixes: https://tracker.ceph.com/issues/51162
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-01-13 10:36:46 -05:00
Yuri Weinstein
a8bb49d4d9
Merge pull request #39440 from pdvian/wip-warn-filestore-osds
mon/OSDMonitor, osd: Add warning on filestore deprecation and force use of wpq scheduler for filestore OSDs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-12 08:49:02 -08:00
Or Friedmann
fd084fd7fc rgw: Add admin ops API for rate limiting
Add admin ops API for rate limiting and some bug fixes

Signed-off-by: Or Friedmann <ofriedma@redhat.com>
2022-01-10 16:48:56 +00:00
Melissa Li
787f30a1b0 PendingReleaseNotes: note default enabling of osd_memory_target_autotune
Fixes: https://tracker.ceph.com/issues/51562
Signed-off-by: Melissa Li <melissali@redhat.com>
2022-01-05 16:06:07 -05:00
Sridhar Seshasayee
e65c4bcd96 osd, mon/OSDMonitor: Force the scheduler type to 'wpq' for filestore OSDs
The 'mclock_scheduler' is not supported for filestore OSDs. Enforce the
usage of 'wpq' scheduler for such OSDs to avoid issues.

Also, in this scenario, the override of various config settings for the
'mclock_scheduler' are not performed.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-01-05 10:08:25 +00:00
Prashant D
39f5a61a3a mon/OSDMonitor: Raise health warning for filestore osds
Filestore will be deprecated in Quincy, considering
that BlueStore has been the default objectstore for
quite some time.

Fixes: https://tracker.ceph.com/issues/49275

Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-05 10:08:25 +00:00
Kamoltat
9baed0394e docs: Added noautoscale to docs + release notes
Updated the docs in
https://docs.ceph.com/en/latest/rados/operations/placement-groups/
and updated the release notes to reflect noautoscale flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-22 21:42:52 +00:00
Kamoltat
abaab51dd8 Added ReleasesNotes and documentation
Add Release Notes and remove any `profile`
related stuff in the autoscaler documentation
and replace it with `bulk` flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-21 07:56:37 +00:00
Adam C. Emerson
e2406c1777 doc: Add PendingReleaseNote for LevelDB removal
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2021-12-13 14:30:41 -05:00
Sridhar Seshasayee
34f18fa45f PendingReleaseNotes: Release note 'require-osd-release' health warning
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2021-12-03 15:26:02 +05:30
Kamoltat
a9f9f7b3fd pybind/mgr/pg_autoscale: revert to default profile scale-up
pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-11-19 18:55:36 +00:00
Ronen Friedman
5108647a55 doc: document new scrub-related 'pg dump' columns
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-11-05 17:16:28 +02:00
Sage Weil
d87d2bd146 Merge PR #43611 into master
* refs/pull/43611/head:
	doc/mgr/nfs: document rgw user and bucket exports
	PendingReleaseNotes: add note about nfs CLI change(s)
	qa/suites/orch/cephadm/smoke-roleless: add rgw user nfs export case
	mgr/nfs: take user-id and/or bucket for 'nfs export create rgw'
	mgr/nfs: reorder 'nfs export creage rgw' arguments
	mgr/nfs: reorder 'nfs export create cephfs' arguments
	mgr/nfs: use keyword args for 'nfs export create rgw'
	mgr/nfs: document and use keyword args for 'nfs export create cephfs'
	qa/tasks/cephfs/test_nfs: use keyword args
	pybind/ceph_argparse: handle misordered keyword arguments

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-11-04 14:33:45 -04:00
Sage Weil
48ce4e9568 PendingReleaseNotes: add note about nfs CLI change(s)
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-04 10:42:50 -04:00
Igor Fedotov
dfacf162af PendingReleaseNotes: document OMAP upgrade bug.
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
2021-11-03 00:03:51 +03:00
Patrick Donnelly
20509bb6c8
MDSMonitor: handle damaged from standby-replay
This change does a few things:

- if a state transition is invalid or a beacon is garbage, the
  MDSMonitor now evicts the MDS instead of ignoring the problem.

- standby state validation is moved to prepare_beacon where eviction can
  happen.

- standby-replay may indicate the rank is damaged (failure to replay the
  journal).

- if the rank is damaged, both the rank holder and standby-replay daemon
  (if any) will be removed.

Fixes: https://tracker.ceph.com/issues/52565
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-09 19:47:01 -04:00
Kamoltat
ea094f769f PendingReleaseNotes: add autoscaler profile
Added autoscaler profile release notes for
>=17.0.0

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-08-26 20:20:43 +00:00
Sage Weil
6010eae66c rgw: default auth_client_required=cephx
This makes this warning go away:

2021-08-09T15:51:52.882+0000 7f2373837400 -1 warn_if_insecure(): WARNING: rgw is configured to optionally allow insecure connections to the monitors (auth_supported, ms_mon_client_mode), ssl certificates stored at the monitor configuration could leak

7e22d2a31d only fixed half of the problem.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-08-09 11:59:54 -04:00
Kefu Chai
065ff536a1 cmake: disable kvs rados cls by default
libcls_kvs was introduced back in
73d016fdb3, but we don't have an internal
user so far. to reduce the build time. let's disable the build of it by
default.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-04 10:21:10 +08:00
Patrick Donnelly
efb70f2b33 doc: update MDS upgrade procedure
Now that CompatSet changes to the FSMap no longer cause old MDS to
suicide.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-30 16:28:54 -07:00
Yuval Lifshitz
e527b8ce55
Merge pull request #42350 from TRYTOBE8TME/wip-rgw-notification
rgw/notifications: Change in multipart upload notification behavior
2021-07-28 10:13:10 +03:00
Kalpesh Pandya
3be2b4bcc5 rgw/notifications: Changing the Multipart Upload notification behavior
Changing the notification behavior in case of Multipart Upload, updating
the related test cases and adding the documentation changes for the same.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-07-26 21:22:33 +05:30
Patrick Donnelly
0e71ea4a13
Merge PR #42106 into master
* refs/pull/42106/head:
	mds: create file system with specific ID

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-23 11:15:33 -07:00
Casey Bodley
61b112e12d
Merge pull request #41579 from trociny/wip-50932
rgw: allow to set ssl options and ciphers for beast frontend

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:17:41 -04:00
Sage Weil
c100812bff PendingReleaseNotes: document workaround for NFS storage change
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Mykola Golub
fb31c87c2d rgw: set default ssl options for beast frontend
to 'no_sslv2:no_sslv3:no_tlsv1:no_tlsv1_1'

Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-07-14 09:20:15 +01:00
Ramana Raja
a0a8ba5087 mds: create file system with specific ID
File system will need to be recreated when monitor databases are lost
and rebuilt. Some applications (e.g., CSI) expect that the recovered
file system have the same ID as before. Allow creating a file system
with a specific ID to help in such scenarios. This can now be done by
the `fs new` command using the argument 'fscid' and 'force' flag.
Newer file systems will no longer have increasing IDs as a corollary.

Fixes: https://tracker.ceph.com/issues/51340
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-07-09 21:14:01 -04:00
Sage Weil
436d2de35a PendingReleaseNotes: note min/max_size removal
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-02 10:36:25 -04:00
Ramana Raja
bd83fac803 mon/FSCommands: add command to rename a file system
The fs_name of the relevant MDSMap is set to the new name. Also,
the application tags of the data pools and the meta data pool of
the file system is set to the new name.

Fixes: https://tracker.ceph.com/issues/47276
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-06-17 13:59:08 -04:00
Patrick Donnelly
f5fa58cb1f
doc: document new .mgr pool
And that pool names beginning with `.` are reserved names.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:17 -07:00
Kefu Chai
814fb28892 debian/control: ceph-mgr-modules-core does not Recommend ceph-mgr-rook anymore
per https://www.debian.org/doc/debian-policy/ch-relationships.html

> Recommends
>   This declares a strong, but not absolute, dependency.
>
> The Recommends field should list packages that would be found together
> with this one in all but unusual installations.

ceph-mgr-modules-core provides a set of ceph-mgr modules which are
always enabeld. but the rook module enables ceph-mgr to install and
configure a Ceph cluster using Rook. this module is very useful but
it does not have such a strong connection with ceph-mgr-modules-core.
we can always install it separately for using better intergration with
Rook.

See-also: https://tracker.ceph.com/issues/45574
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-04 16:18:23 +08:00
Sage Weil
fe03c85b43 PendingReleaseNotes: clarify deprecated
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-25 10:15:45 -04:00
Sage Weil
0ca1400e4b PendingReleaseNotes: note breaking CLI changes
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-25 10:15:45 -04:00
Tom Schoonjans
893ce6b64a rgw: remove s3: prefix in eventName value of s3 event message structure
This change is necessary to match the event message structure seen on
AWS.

Signed-off-by: Tom Schoonjans <Tom.Schoonjans@rfi.ac.uk>
2021-05-08 06:30:02 +00:00
Tom Schoonjans
4c824d78a6 rgw: fix spelling of eTag in S3 message structure
An S3 object event contains its eTag, currently spelled as 'etag' in the message structure, which does not correspond to the documentation example (https://docs.ceph.com/en/latest/radosgw/notifications/#events), or what is used by AWS (https://docs.aws.amazon.com/AmazonS3/latest/userguide/notification-content-structure.html).

Fixes bug https://tracker.ceph.com/issues/50115

Signed-off-by: Tom Schoonjans <Tom.Schoonjans@rfi.ac.uk>
2021-05-08 05:38:27 +00:00
Neha Ojha
ba27bfa53f PendingReleaseNotes: mclock_scheduler is the default scheduler for quincy
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-05-06 17:54:38 +00:00
Varsha Rao
2a99da961a mgr/nfs: Don't enable nfs module by default
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-04-22 11:38:30 +05:30
Sage Weil
3a7c72a9ed Merge PR #40411 into master
* refs/pull/40411/head:
	doc: add note about removal of the `cephfs` nfs cluster type
	mgr/volumes/nfs: drop `type` param during cluster create

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2021-04-16 10:48:04 -04:00
Michael Fritch
81ae87437c
doc: add note about removal of the cephfs nfs cluster type
Fixes: https://tracker.ceph.com/issues/50369
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-04-14 18:21:56 -06:00
Kefu Chai
aaa9441eec rgw/rgw_admin: s/realm delete/realm rm/
it was an oversight of fa5398d31f

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-01 20:03:52 +08:00