2018-03-15 12:47:17 +00:00
|
|
|
===
|
|
|
|
NFS
|
|
|
|
===
|
|
|
|
|
|
|
|
CephFS namespaces can be exported over NFS protocol using the
|
2021-01-05 06:12:11 +00:00
|
|
|
`NFS-Ganesha NFS server`_.
|
2018-03-15 12:47:17 +00:00
|
|
|
|
|
|
|
Requirements
|
|
|
|
============
|
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
- Ceph file system
|
|
|
|
- ``libcephfs2``, ``nfs-ganesha`` and ``nfs-ganesha-ceph`` packages on NFS
|
|
|
|
server host machine.
|
2018-03-15 12:47:17 +00:00
|
|
|
- NFS-Ganesha server host connected to the Ceph public network
|
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
.. note::
|
|
|
|
Ceph packages should preferably be latest stable luminous or a higher
|
|
|
|
version and NFS-Ganesha packages must be v2.5 stable or higher versions.
|
|
|
|
|
2018-03-15 12:47:17 +00:00
|
|
|
Configuring NFS-Ganesha to export CephFS
|
|
|
|
========================================
|
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
NFS-Ganesha provides a File System Abstraction Layer (FSAL) to plug in
|
|
|
|
different storage backends. FSAL_CEPH_ is the plugin FSAL for CephFS. For
|
|
|
|
each NFS-Ganesha export, FSAL_CEPH_ uses a libcephfs client to mount the
|
|
|
|
CephFS path that NFS-Ganesha exports.
|
2018-03-15 12:47:17 +00:00
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
Setting up NFS-Ganesha with CephFS, involves setting up NFS-Ganesha's and
|
|
|
|
Ceph's configuration file and CephX access credentials for the Ceph clients
|
|
|
|
created by NFS-Ganesha to access CephFS.
|
2018-03-15 12:47:17 +00:00
|
|
|
|
|
|
|
NFS-Ganesha configuration
|
|
|
|
-------------------------
|
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
Here's a `sample ganesha.conf`_ configured with FSAL_CEPH_. It is suitable
|
|
|
|
for a standalone NFS-Ganesha server, or an active/passive configuration of
|
|
|
|
NFS-Ganesha servers, to be managed by some sort of clustering software
|
|
|
|
(e.g., Pacemaker). Important details about the options are added as comments
|
|
|
|
in the sample conf. There are options to do the following:
|
2018-03-15 12:47:17 +00:00
|
|
|
|
|
|
|
- minimize Ganesha caching wherever possible since the libcephfs clients
|
2021-01-05 06:12:11 +00:00
|
|
|
(of FSAL_CEPH_) also cache aggressively
|
2018-03-15 12:47:17 +00:00
|
|
|
|
2018-04-04 09:42:02 +00:00
|
|
|
- read from Ganesha config files stored in RADOS objects
|
2018-03-15 12:47:17 +00:00
|
|
|
|
2018-04-04 09:42:02 +00:00
|
|
|
- store client recovery data in RADOS OMAP key-value interface
|
2018-03-15 12:47:17 +00:00
|
|
|
|
|
|
|
- mandate NFSv4.1+ access
|
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
- enable read delegations (need at least v13.0.1 ``libcephfs2`` package
|
|
|
|
and v2.6.0 stable ``nfs-ganesha`` and ``nfs-ganesha-ceph`` packages)
|
2018-03-15 12:47:17 +00:00
|
|
|
|
|
|
|
Configuration for libcephfs clients
|
|
|
|
-----------------------------------
|
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
``ceph.conf`` for libcephfs clients includes a ``[client]`` section with
|
|
|
|
``mon_host`` option set to let the clients connect to the Ceph cluster's
|
|
|
|
monitors, usually generated via ``ceph config generate-minimal-conf``.
|
|
|
|
For example::
|
2018-03-15 12:47:17 +00:00
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
[client]
|
2019-03-18 04:16:49 +00:00
|
|
|
mon host = [v2:192.168.1.7:3300,v1:192.168.1.7:6789], [v2:192.168.1.8:3300,v1:192.168.1.8:6789], [v2:192.168.1.9:3300,v1:192.168.1.9:6789]
|
2018-03-15 12:47:17 +00:00
|
|
|
|
|
|
|
Mount using NFSv4 clients
|
|
|
|
=========================
|
|
|
|
|
|
|
|
It is preferred to mount the NFS-Ganesha exports using NFSv4.1+ protocols
|
|
|
|
to get the benefit of sessions.
|
|
|
|
|
|
|
|
Conventions for mounting NFS resources are platform-specific. The
|
|
|
|
following conventions work on Linux and some Unix platforms:
|
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
.. code:: bash
|
2018-03-15 12:47:17 +00:00
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
mount -t nfs -o nfsvers=4.1,proto=tcp <ganesha-host-name>:<ganesha-pseudo-path> <mount-point>
|
2018-03-15 12:47:17 +00:00
|
|
|
|
2021-01-05 06:12:11 +00:00
|
|
|
|
|
|
|
.. _FSAL_CEPH: https://github.com/nfs-ganesha/nfs-ganesha/tree/next/src/FSAL/FSAL_CEPH
|
|
|
|
.. _NFS-Ganesha NFS server: https://github.com/nfs-ganesha/nfs-ganesha/wiki
|
|
|
|
.. _sample ganesha.conf: https://github.com/nfs-ganesha/nfs-ganesha/blob/next/src/config_samples/ceph.conf
|