Commit Graph

505 Commits

Author SHA1 Message Date
Patrick Donnelly
20509bb6c8
MDSMonitor: handle damaged from standby-replay
This change does a few things:

- if a state transition is invalid or a beacon is garbage, the
  MDSMonitor now evicts the MDS instead of ignoring the problem.

- standby state validation is moved to prepare_beacon where eviction can
  happen.

- standby-replay may indicate the rank is damaged (failure to replay the
  journal).

- if the rank is damaged, both the rank holder and standby-replay daemon
  (if any) will be removed.

Fixes: https://tracker.ceph.com/issues/52565
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-09 19:47:01 -04:00
Kamoltat
ea094f769f PendingReleaseNotes: add autoscaler profile
Added autoscaler profile release notes for
>=17.0.0

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-08-26 20:20:43 +00:00
Sage Weil
6010eae66c rgw: default auth_client_required=cephx
This makes this warning go away:

2021-08-09T15:51:52.882+0000 7f2373837400 -1 warn_if_insecure(): WARNING: rgw is configured to optionally allow insecure connections to the monitors (auth_supported, ms_mon_client_mode), ssl certificates stored at the monitor configuration could leak

7e22d2a31d only fixed half of the problem.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-08-09 11:59:54 -04:00
Kefu Chai
065ff536a1 cmake: disable kvs rados cls by default
libcls_kvs was introduced back in
73d016fdb3, but we don't have an internal
user so far. to reduce the build time. let's disable the build of it by
default.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-04 10:21:10 +08:00
Patrick Donnelly
efb70f2b33 doc: update MDS upgrade procedure
Now that CompatSet changes to the FSMap no longer cause old MDS to
suicide.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-30 16:28:54 -07:00
Yuval Lifshitz
e527b8ce55
Merge pull request #42350 from TRYTOBE8TME/wip-rgw-notification
rgw/notifications: Change in multipart upload notification behavior
2021-07-28 10:13:10 +03:00
Kalpesh Pandya
3be2b4bcc5 rgw/notifications: Changing the Multipart Upload notification behavior
Changing the notification behavior in case of Multipart Upload, updating
the related test cases and adding the documentation changes for the same.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-07-26 21:22:33 +05:30
Patrick Donnelly
0e71ea4a13
Merge PR #42106 into master
* refs/pull/42106/head:
	mds: create file system with specific ID

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-23 11:15:33 -07:00
Casey Bodley
61b112e12d
Merge pull request #41579 from trociny/wip-50932
rgw: allow to set ssl options and ciphers for beast frontend

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:17:41 -04:00
Sage Weil
c100812bff PendingReleaseNotes: document workaround for NFS storage change
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Mykola Golub
fb31c87c2d rgw: set default ssl options for beast frontend
to 'no_sslv2:no_sslv3:no_tlsv1:no_tlsv1_1'

Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-07-14 09:20:15 +01:00
Ramana Raja
a0a8ba5087 mds: create file system with specific ID
File system will need to be recreated when monitor databases are lost
and rebuilt. Some applications (e.g., CSI) expect that the recovered
file system have the same ID as before. Allow creating a file system
with a specific ID to help in such scenarios. This can now be done by
the `fs new` command using the argument 'fscid' and 'force' flag.
Newer file systems will no longer have increasing IDs as a corollary.

Fixes: https://tracker.ceph.com/issues/51340
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-07-09 21:14:01 -04:00
Sage Weil
436d2de35a PendingReleaseNotes: note min/max_size removal
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-02 10:36:25 -04:00
Ramana Raja
bd83fac803 mon/FSCommands: add command to rename a file system
The fs_name of the relevant MDSMap is set to the new name. Also,
the application tags of the data pools and the meta data pool of
the file system is set to the new name.

Fixes: https://tracker.ceph.com/issues/47276
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-06-17 13:59:08 -04:00
Patrick Donnelly
f5fa58cb1f
doc: document new .mgr pool
And that pool names beginning with `.` are reserved names.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:17 -07:00
Kefu Chai
814fb28892 debian/control: ceph-mgr-modules-core does not Recommend ceph-mgr-rook anymore
per https://www.debian.org/doc/debian-policy/ch-relationships.html

> Recommends
>   This declares a strong, but not absolute, dependency.
>
> The Recommends field should list packages that would be found together
> with this one in all but unusual installations.

ceph-mgr-modules-core provides a set of ceph-mgr modules which are
always enabeld. but the rook module enables ceph-mgr to install and
configure a Ceph cluster using Rook. this module is very useful but
it does not have such a strong connection with ceph-mgr-modules-core.
we can always install it separately for using better intergration with
Rook.

See-also: https://tracker.ceph.com/issues/45574
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-04 16:18:23 +08:00
Sage Weil
fe03c85b43 PendingReleaseNotes: clarify deprecated
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-25 10:15:45 -04:00
Sage Weil
0ca1400e4b PendingReleaseNotes: note breaking CLI changes
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-25 10:15:45 -04:00
Tom Schoonjans
893ce6b64a rgw: remove s3: prefix in eventName value of s3 event message structure
This change is necessary to match the event message structure seen on
AWS.

Signed-off-by: Tom Schoonjans <Tom.Schoonjans@rfi.ac.uk>
2021-05-08 06:30:02 +00:00
Tom Schoonjans
4c824d78a6 rgw: fix spelling of eTag in S3 message structure
An S3 object event contains its eTag, currently spelled as 'etag' in the message structure, which does not correspond to the documentation example (https://docs.ceph.com/en/latest/radosgw/notifications/#events), or what is used by AWS (https://docs.aws.amazon.com/AmazonS3/latest/userguide/notification-content-structure.html).

Fixes bug https://tracker.ceph.com/issues/50115

Signed-off-by: Tom Schoonjans <Tom.Schoonjans@rfi.ac.uk>
2021-05-08 05:38:27 +00:00
Neha Ojha
ba27bfa53f PendingReleaseNotes: mclock_scheduler is the default scheduler for quincy
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-05-06 17:54:38 +00:00
Varsha Rao
2a99da961a mgr/nfs: Don't enable nfs module by default
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-04-22 11:38:30 +05:30
Sage Weil
3a7c72a9ed Merge PR #40411 into master
* refs/pull/40411/head:
	doc: add note about removal of the `cephfs` nfs cluster type
	mgr/volumes/nfs: drop `type` param during cluster create

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2021-04-16 10:48:04 -04:00
Michael Fritch
81ae87437c
doc: add note about removal of the cephfs nfs cluster type
Fixes: https://tracker.ceph.com/issues/50369
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-04-14 18:21:56 -06:00
Kefu Chai
aaa9441eec rgw/rgw_admin: s/realm delete/realm rm/
it was an oversight of fa5398d31f

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-01 20:03:52 +08:00
Ilya Dryomov
e5744672db auth: require CEPHX_V2 by default
It's been almost three years and support is present in all relevant
clients.

From the security perspective, roughly the same could be achieved
with "ceph osd set-require-min-compat-client nautilus", but this is
more user friendly as the client gets ENOTSUP instead of spinning on
"feature set mismatch" faults.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-03-25 12:17:32 +01:00
Patrick Donnelly
5000b33180
Merge PR #40145 into master
* refs/pull/40145/head:
	doc: add note about disabling standby-replay during upgrades
	qa: add test for standby-replay disable
	mon: fail standby-replay daemons when flag is turned off

Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2021-03-22 20:03:02 -07:00
Patrick Donnelly
d08a977a76
doc: add libcephsqlite
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-19 08:52:55 -07:00
Patrick Donnelly
29b4c0d9d5
doc: add note about disabling standby-replay during upgrades
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-16 08:35:17 -07:00
David Zafman
8bc0719ac1
Merge pull request #38853 from dzafman/wip-48843
osd: Try other PGs when reservation failures occur

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-12 09:20:51 -08:00
Sage Weil
f4ff70941f PendingReleaseNodes: note changes in cephadm rgw behavior
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-09 14:29:43 -05:00
Marcus Watts
7c3ef90913 rgw/kms/vault - PendingReleaseNotes pointer
The "new" transit logic requires configure changes to be
effective.  Here is a pointer to the revised
documentation for those who already have data encrypted
using the previous version.

Fixes: http://tracker.ceph.com/issues/48746
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2021-03-05 23:05:13 -05:00
David Zafman
08c3ede084 osd: Try other PGs when reservation failures occur
Fixes: https://tracker.ceph.com/issues/48843

Signed-off-by: David Zafman <dzafman@redhat.com>
2021-03-05 11:41:26 -08:00
Sage Weil
5290ed3777 Merge PR #38909 into master
* refs/pull/38909/head:
	PendingReleaseNotes: document option osd_fast_shutdown_notify_mon
	osd: add osd_fast_shutdown_notify_mon option (default false)

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-03 08:38:58 -05:00
Kamoltat
f9f18bb5df PendingReleaseNotes: mgr/pg_autoscaler
Added details describing the changes that
occured after merging #39248 into target
upstream.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-02-11 15:44:09 +00:00
Zac Dover
fa62671167 doc/PendingReleaseNotes: grammar and wording
This commit vets the PendingReleaseNotes for Octopus.
This might not be the only commit that updates the
release notes, but it is the first by me.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-02-02 01:37:59 +10:00
Mauricio Faria de Oliveira
7f5aaef5d4 PendingReleaseNotes: document option osd_fast_shutdown_notify_mon
Let's add the ``osd_fast_shutdown_notify_mon`` option to PendingReleaseNotes
so it is documented.

Signed-off-by: Mauricio Faria de Oliveira <mfo@canonical.com>
2021-01-26 13:14:38 -03:00
Xiubo Li
39f3440e36
mds: add new CDentry tags support
This will add new tag 'i' for inode and new tag 'l' for remote link
for the CDentry. And at the same time will add one proper dentry
version, which will be helpful to add new features/members in future
for the CDentry.

Fixes: https://tracker.ceph.com/issues/47162
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-01-15 17:30:39 -08:00
Patrick Donnelly
b4935c06d6
Merge PR #38708 into master
* refs/pull/38708/head:
	doc: update multiple mds scrub docs

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-01-14 09:22:40 -08:00
Patrick Donnelly
a3db265ad5
*: remove legacy ceph_volume_client.py library
This library is obsolete with the mgr volumes plugin since Nautilus.

The last remaining user of this library was Manila which will be using
the volumes plugin with Pacific and onwards.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-12 06:54:29 -08:00
Patrick Donnelly
71c7315ef2
Merge PR #38510 into master
* refs/pull/38510/head:
	PendingReleaseNotes: Update about volume/nfs cluster id changes
	mgr/volumes/nfs: remove 'ganesha-' prefix from cluster id

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 10:39:38 -08:00
Varsha Rao
ef3660bb96 PendingReleaseNotes: Update about volume/nfs cluster id changes
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-01-08 12:38:57 +05:30
Patrick Donnelly
03e7f9d827
doc: update multiple mds scrub docs
Fixes: https://tracker.ceph.com/issues/44192
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-06 13:32:10 -08:00
Yin Congmin
2093c88229 tools: update immutable object cache water mark
Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2021-01-06 09:18:48 +08:00
Igor Fedotov
711505e8f9 os/bluestore: introduce bluestore_rocksdb_options_annex config parameter.
This simplifies modifying a subset of rocksdb settings since it
eliminates the need to re-provide bluestore's rocksdb settings.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-12-22 20:03:14 +03:00
Patrick Donnelly
0376ce721a
doc: add documentation for new multifs feature
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-15 06:46:49 -08:00
Matt Benjamin
146a8e5543
Merge pull request #38171 from yuvalif/wip-yuval-fix-46296
rgw/notification: support GetTopicAttributes API
2020-12-02 07:42:03 -05:00
Yuval Lifshitz
3906884aa6 rgw/notification: support GetTopicAttributes API
fixes: https://tracker.ceph.com/issues/46296

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-11-25 11:23:52 +02:00
Xiubo Li
73a48dfe8e global: reexpand the conf meta in all the child processes
Especially for the tools or the daemons whose config options need
to expand the '$pid', they will be always expanded with the parent
processes. We need to reexpand them in child processes just after
the fork is done.

Fixes: https://tracker.ceph.com/issues/48240
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-11-23 14:07:07 +08:00
Josh Durgin
c2b9152eac
Merge pull request #37488 from kamoltat/wip-mgr-progress-turn-off-option
mgr/progress: progress module on/off option

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-11-17 13:37:30 -08:00