2020-05-19 14:06:03 +00:00
|
|
|
>=16.0.0
|
2019-01-23 19:20:33 +00:00
|
|
|
--------
|
2020-12-21 21:01:52 +00:00
|
|
|
* New bluestore_rocksdb_options_annex config parameter. Complements
|
|
|
|
bluestore_rocksdb_options and allows setting rocksdb options without repeating
|
|
|
|
the existing defaults.
|
2020-11-13 08:08:31 +00:00
|
|
|
* $pid expansion in config paths like `admin_socket` will now properly expand
|
|
|
|
to the daemon pid for commands like `ceph-mds` or `ceph-osd`. Previously only
|
|
|
|
`ceph-fuse`/`rbd-nbd` expanded `$pid` with the actual daemon pid.
|
|
|
|
|
2020-04-30 19:06:13 +00:00
|
|
|
* The allowable options for some "radosgw-admin" commands have been changed.
|
|
|
|
|
|
|
|
* "mdlog-list", "datalog-list", "sync-error-list" no longer accepts
|
|
|
|
start and end dates, but does accept a single optional start marker.
|
|
|
|
* "mdlog-trim", "datalog-trim", "sync-error-trim" only accept a
|
|
|
|
single marker giving the end of the trimmed range.
|
2020-04-30 20:38:41 +00:00
|
|
|
* Similarly the date ranges and marker ranges have been removed on
|
|
|
|
the RESTful DATALog and MDLog list and trim operations.
|
2020-04-30 19:06:13 +00:00
|
|
|
|
2020-10-07 07:45:42 +00:00
|
|
|
* ceph-volume: The ``lvm batch` subcommand received a major rewrite. This closed
|
|
|
|
a number of bugs and improves usability in terms of size specification and
|
|
|
|
calculation, as well as idempotency behaviour and disk replacement process.
|
|
|
|
Please refer to https://docs.ceph.com/en/latest/ceph-volume/lvm/batch/ for
|
|
|
|
more detailed information.
|
|
|
|
|
2020-11-03 03:26:57 +00:00
|
|
|
* Configuration variables for permitted scrub times have changed. The legal
|
|
|
|
values for ``osd_scrub_begin_hour`` and ``osd_scrub_end_hour`` are 0 - 23.
|
|
|
|
The use of 24 is now illegal. Specifying ``0`` for both values causes every
|
|
|
|
hour to be allowed. The legal vaues for ``osd_scrub_begin_week_day`` and
|
|
|
|
``osd_scrub_end_week_day`` are 0 - 6. The use of 7 is now illegal.
|
|
|
|
Specifying ``0`` for both values causes every day of the week to be allowed.
|
|
|
|
|
2020-12-09 02:57:44 +00:00
|
|
|
* Multiple file systems in a single Ceph cluster is now stable. New Ceph clusters
|
|
|
|
enable support for multiple file systems by default. Existing clusters
|
|
|
|
must still set the "enable_multiple" flag on the fs. Please see the CephFS
|
|
|
|
documentation for more information.
|
|
|
|
|
2020-11-10 22:29:08 +00:00
|
|
|
* A new health check, DAEMON_OLD_VERSION, will warn if different versions of Ceph are running
|
|
|
|
on daemons. It will generate a health error if multiple versions are detected.
|
|
|
|
This condition must exist for over mon_warn_older_version_delay (set to 1 week by default) in order for the
|
2020-11-08 17:07:04 +00:00
|
|
|
health condition to be triggered. This allows most upgrades to proceed
|
2020-11-10 22:29:08 +00:00
|
|
|
without falsely seeing the warning. If upgrade is paused for an extended
|
2020-11-08 17:07:04 +00:00
|
|
|
time period, health mute can be used like this
|
|
|
|
"ceph health mute DAEMON_OLD_VERSION --sticky". In this case after
|
2020-11-10 22:29:08 +00:00
|
|
|
upgrade has finished use "ceph health unmute DAEMON_OLD_VERSION".
|
2020-11-03 03:26:57 +00:00
|
|
|
|
2020-09-30 05:44:23 +00:00
|
|
|
* MGR: progress module can now be turned on/off, using the commands:
|
|
|
|
``ceph progress on`` and ``ceph progress off``.
|
2020-11-18 16:43:16 +00:00
|
|
|
* An AWS-compliant API: "GetTopicAttributes" was added to replace the existing "GetTopic" API. The new API
|
|
|
|
should be used to fetch information about topics used for bucket notifications.
|
2020-09-30 05:44:23 +00:00
|
|
|
|
2020-04-30 19:06:13 +00:00
|
|
|
>=15.0.0
|
|
|
|
--------
|
2019-01-23 19:20:33 +00:00
|
|
|
|
2020-10-30 10:40:43 +00:00
|
|
|
* MON: The cluster log now logs health detail every ``mon_health_to_clog_interval``,
|
|
|
|
which has been changed from 1hr to 10min. Logging of health detail will be
|
|
|
|
skipped if there is no change in health summary since last known.
|
|
|
|
|
2020-08-26 10:17:05 +00:00
|
|
|
* The ``ceph df`` command now lists the number of pgs in each pool.
|
|
|
|
|
2020-02-12 14:38:29 +00:00
|
|
|
* Monitors now have config option ``mon_allow_pool_size_one``, which is disabled
|
|
|
|
by default. However, if enabled, user now have to pass the
|
|
|
|
``--yes-i-really-mean-it`` flag to ``osd pool set size 1``, if they are really
|
|
|
|
sure of configuring pool size 1.
|
2020-03-28 04:26:45 +00:00
|
|
|
|
|
|
|
* librbd now inherits the stripe unit and count from its parent image upon creation.
|
|
|
|
This can be overridden by specifying different stripe settings during clone creation.
|
2020-04-14 20:46:41 +00:00
|
|
|
|
|
|
|
* The balancer is now on by default in upmap mode. Since upmap mode requires
|
|
|
|
``require_min_compat_client`` luminous, new clusters will only support luminous
|
|
|
|
and newer clients by default. Existing clusters can enable upmap support by running
|
|
|
|
``ceph osd set-require-min-compat-client luminous``. It is still possible to turn
|
|
|
|
the balancer off using the ``ceph balancer off`` command. In earlier versions,
|
|
|
|
the balancer was included in the ``always_on_modules`` list, but needed to be
|
|
|
|
turned on explicitly using the ``ceph balancer on`` command.
|
2020-04-24 11:47:03 +00:00
|
|
|
|
2020-08-17 07:35:25 +00:00
|
|
|
* MGR: the "cloud" mode of the diskprediction module is not supported anymore
|
|
|
|
and the ``ceph-mgr-diskprediction-cloud`` manager module has been removed. This
|
|
|
|
is because the external cloud service run by ProphetStor is no longer accessible
|
|
|
|
and there is no immediate replacement for it at this time. The "local" prediction
|
|
|
|
mode will continue to be supported.
|
|
|
|
|
2020-04-24 11:47:03 +00:00
|
|
|
* Cephadm: There were a lot of small usability improvements and bug fixes:
|
|
|
|
|
|
|
|
* Grafana when deployed by Cephadm now binds to all network interfaces.
|
|
|
|
* ``cephadm check-host`` now prints all detected problems at once.
|
|
|
|
* Cephadm now calls ``ceph dashboard set-grafana-api-ssl-verify false``
|
|
|
|
when generating an SSL certificate for Grafana.
|
|
|
|
* The Alertmanager is now correctly pointed to the Ceph Dashboard
|
|
|
|
* ``cephadm adopt`` now supports adopting an Alertmanager
|
|
|
|
* ``ceph orch ps`` now supports filtering by service name
|
|
|
|
* ``ceph orch host ls`` now marks hosts as offline, if they are not
|
|
|
|
accessible.
|
|
|
|
|
|
|
|
* Cephadm can now deploy NFS Ganesha services. For example, to deploy NFS with
|
|
|
|
a service id of mynfs, that will use the RADOS pool nfs-ganesha and namespace
|
|
|
|
nfs-ns::
|
|
|
|
|
|
|
|
ceph orch apply nfs mynfs nfs-ganesha nfs-ns
|
|
|
|
|
|
|
|
* Cephadm: ``ceph orch ls --export`` now returns all service specifications in
|
|
|
|
yaml representation that is consumable by ``ceph orch apply``. In addition,
|
2020-05-11 19:18:08 +00:00
|
|
|
the commands ``orch ps`` and ``orch ls`` now support ``--format yaml`` and
|
2020-04-24 11:47:03 +00:00
|
|
|
``--format json-pretty``.
|
|
|
|
|
2020-06-09 22:30:28 +00:00
|
|
|
* CephFS: Automatic static subtree partitioning policies may now be configured
|
|
|
|
using the new distributed and random ephemeral pinning extended attributes on
|
|
|
|
directories. See the documentation for more information:
|
|
|
|
https://docs.ceph.com/docs/master/cephfs/multimds/
|
|
|
|
|
2020-04-24 11:47:03 +00:00
|
|
|
* Cephadm: ``ceph orch apply osd`` supports a ``--preview`` flag that prints a preview of
|
|
|
|
the OSD specification before deploying OSDs. This makes it possible to
|
|
|
|
verify that the specification is correct, before applying it.
|
2020-05-11 19:16:36 +00:00
|
|
|
|
|
|
|
* RGW: The ``radosgw-admin`` sub-commands dealing with orphans --
|
2020-06-24 19:01:00 +00:00
|
|
|
``radosgw-admin orphans find``, ``radosgw-admin orphans finish``, and
|
|
|
|
``radosgw-admin orphans list-jobs`` -- have been deprecated. They have
|
2020-05-11 19:16:36 +00:00
|
|
|
not been actively maintained and they store intermediate results on
|
|
|
|
the cluster, which could fill a nearly-full cluster. They have been
|
|
|
|
replaced by a tool, currently considered experimental,
|
|
|
|
``rgw-orphan-list``.
|
2020-05-18 17:59:31 +00:00
|
|
|
|
|
|
|
* RBD: The name of the rbd pool object that is used to store
|
|
|
|
rbd trash purge schedule is changed from "rbd_trash_trash_purge_schedule"
|
|
|
|
to "rbd_trash_purge_schedule". Users that have already started using
|
|
|
|
``rbd trash purge schedule`` functionality and have per pool or namespace
|
|
|
|
schedules configured should copy "rbd_trash_trash_purge_schedule"
|
|
|
|
object to "rbd_trash_purge_schedule" before the upgrade and remove
|
|
|
|
"rbd_trash_purge_schedule" using the following commands in every RBD
|
|
|
|
pool and namespace where a trash purge schedule was previously
|
|
|
|
configured::
|
|
|
|
|
|
|
|
rados -p <pool-name> [-N namespace] cp rbd_trash_trash_purge_schedule rbd_trash_purge_schedule
|
|
|
|
rados -p <pool-name> [-N namespace] rm rbd_trash_trash_purge_schedule
|
|
|
|
|
|
|
|
or use any other convenient way to restore the schedule after the
|
|
|
|
upgrade.
|
2020-05-20 20:09:53 +00:00
|
|
|
|
|
|
|
* librbd: The shared, read-only parent cache has been moved to a separate librbd
|
|
|
|
plugin. If the parent cache was previously in-use, you must also instruct
|
|
|
|
librbd to load the plugin by adding the following to your configuration::
|
|
|
|
|
|
|
|
rbd_plugins = parent_cache
|
2020-06-10 02:24:00 +00:00
|
|
|
|
|
|
|
* Monitors now have a config option ``mon_osd_warn_num_repaired``, 10 by default.
|
|
|
|
If any OSD has repaired more than this many I/O errors in stored data a
|
|
|
|
``OSD_TOO_MANY_REPAIRS`` health warning is generated.
|
2020-03-09 13:14:30 +00:00
|
|
|
|
|
|
|
* Introduce commands that manipulate required client features of a file system::
|
|
|
|
|
|
|
|
ceph fs required_client_features <fs name> add <feature>
|
|
|
|
ceph fs required_client_features <fs name> rm <feature>
|
|
|
|
ceph fs feature ls
|
2020-06-16 19:50:19 +00:00
|
|
|
|
|
|
|
* OSD: A new configuration option ``osd_compact_on_start`` has been added which triggers
|
|
|
|
an OSD compaction on start. Setting this option to ``true`` and restarting an OSD
|
|
|
|
will result in an offline compaction of the OSD prior to booting.
|
2020-07-02 17:05:57 +00:00
|
|
|
|
2020-09-01 02:05:11 +00:00
|
|
|
* OSD: the option named ``bdev_nvme_retry_count`` has been removed. Because
|
|
|
|
in SPDK v20.07, there is no easy access to bdev_nvme options, and this
|
|
|
|
option is hardly used, so it was removed.
|
|
|
|
|
2020-07-02 17:05:57 +00:00
|
|
|
* Now when noscrub and/or nodeep-scrub flags are set globally or per pool,
|
|
|
|
scheduled scrubs of the type disabled will be aborted. All user initiated
|
|
|
|
scrubs are NOT interrupted.
|
2020-08-08 08:57:37 +00:00
|
|
|
|
|
|
|
* Alpine build related script, documentation and test have been removed since
|
|
|
|
the most updated APKBUILD script of Ceph is already included by Alpine Linux's
|
|
|
|
aports repository.
|
2020-07-31 13:01:57 +00:00
|
|
|
|
|
|
|
* fs: Names of new FSs, volumes, subvolumes and subvolume groups can only
|
|
|
|
contain alphanumeric and ``-``, ``_`` and ``.`` characters. Some commands
|
|
|
|
or CephX credentials may not work with old FSs with non-conformant names.
|
2020-06-15 15:27:03 +00:00
|
|
|
|
2020-09-16 19:28:55 +00:00
|
|
|
* It is now possible to specify the initial monitor to contact for Ceph tools
|
|
|
|
and daemons using the ``mon_host_override`` config option or
|
|
|
|
``--mon-host-override <ip>`` command-line switch. This generally should only
|
|
|
|
be used for debugging and only affects initial communication with Ceph's
|
|
|
|
monitor cluster.
|
|
|
|
|
2020-06-15 15:27:03 +00:00
|
|
|
* `blacklist` has been replaced with `blocklist` throughout. The following commands have changed:
|
|
|
|
|
|
|
|
- ``ceph osd blacklist ...`` are now ``ceph osd blocklist ...``
|
|
|
|
- ``ceph <tell|daemon> osd.<NNN> dump_blacklist`` is now ``ceph <tell|daemon> osd.<NNN> dump_blocklist``
|
|
|
|
|
|
|
|
* The following config options have changed:
|
|
|
|
|
|
|
|
- ``mon osd blacklist default expire`` is now ``mon osd blocklist default expire``
|
|
|
|
- ``mon mds blacklist interval`` is now ``mon mds blocklist interval``
|
|
|
|
- ``mon mgr blacklist interval`` is now ''mon mgr blocklist interval``
|
|
|
|
- ``rbd blacklist on break lock`` is now ``rbd blocklist on break lock``
|
|
|
|
- ``rbd blacklist expire seconds`` is now ``rbd blocklist expire seconds``
|
|
|
|
- ``mds session blacklist on timeout`` is now ``mds session blocklist on timeout``
|
|
|
|
- ``mds session blacklist on evict`` is now ``mds session blocklist on evict``
|
|
|
|
|
2020-08-04 02:48:59 +00:00
|
|
|
* CephFS: Compatibility code for old on-disk format of snapshot has been removed.
|
|
|
|
Current on-disk format of snapshot was introduced by Mimic release. If there
|
|
|
|
are any snapshots created by Ceph release older than Mimic. Before upgrading,
|
|
|
|
either delete them all or scrub the whole filesystem:
|
|
|
|
|
|
|
|
ceph daemon <mds of rank 0> scrub_path / force recursive repair
|
|
|
|
ceph daemon <mds of rank 0> scrub_path '~mdsdir' force recursive repair
|
|
|
|
|
2020-11-17 05:10:51 +00:00
|
|
|
* CephFS: Scrub is supported in multiple active mds setup. MDS rank 0 handles
|
|
|
|
scrub commands, and forward scrub to other mds if nessesary.
|
|
|
|
|
2020-06-15 15:27:03 +00:00
|
|
|
* The following librados API calls have changed:
|
|
|
|
|
|
|
|
- ``rados_blacklist_add`` is now ``rados_blocklist_add``; the former will issue a deprecation warning and be removed in a future release.
|
|
|
|
- ``rados.blacklist_add`` is now ``rados.blocklist_add`` in the C++ API.
|
|
|
|
|
|
|
|
* The JSON output for the following commands now shows ``blocklist`` instead of ``blacklist``:
|
|
|
|
|
|
|
|
- ``ceph osd dump``
|
|
|
|
- ``ceph <tell|daemon> osd.<N> dump_blocklist``
|
2019-03-01 16:41:45 +00:00
|
|
|
|
|
|
|
* caps: MON and MDS caps can now be used to restrict client's ability to view
|
|
|
|
and operate on specific Ceph file systems. The FS can be specificed using
|
|
|
|
``fsname`` in caps. This also affects subcommand ``fs authorize``, the caps
|
|
|
|
produce by it will be specific to the FS name passed in its arguments.
|
2020-03-17 12:39:47 +00:00
|
|
|
|
2020-08-02 12:53:43 +00:00
|
|
|
* fs: root_squash flag can be set in MDS caps. It disallows file system
|
|
|
|
operations that need write access for clients with uid=0 or gid=0. This
|
|
|
|
feature should prevent accidents such as an inadvertent `sudo rm -rf /<path>`.
|
|
|
|
|
2020-03-17 12:39:47 +00:00
|
|
|
* fs: "fs authorize" now sets MON cap to "allow <perm> fsname=<fsname>"
|
|
|
|
instead of setting it to "allow r" all the time.
|
2020-09-15 00:11:07 +00:00
|
|
|
|
|
|
|
* ``ceph pg #.# list_unfound`` output has been enhanced to provide
|
|
|
|
might_have_unfound information which indicates which OSDs may
|
|
|
|
contain the unfound objects.
|