2013-11-21 03:27:47 +00:00
===================
Manual Deployment
===================
All Ceph clusters require at least one monitor, and at least as many OSDs as
copies of an object stored on the cluster. Bootstrapping the initial monitor(s)
is the first step in deploying a Ceph Storage Cluster. Monitor deployment also
2013-12-03 19:07:53 +00:00
sets important criteria for the entire cluster, such as the number of replicas
for pools, the number of placement groups per OSD, the heartbeat intervals,
whether authentication is required, etc. Most of these values are set by
default, so it's useful to know about them when setting up your cluster for
production.
2013-11-21 03:27:47 +00:00
Following the same configuration as `Installation (Quick)`_ , we will set up a
2017-08-17 12:08:04 +00:00
cluster with `` node1 `` as the monitor node, and `` node2 `` and `` node3 `` for
2013-11-21 03:27:47 +00:00
OSD nodes.
2017-08-17 12:08:04 +00:00
.. ditaa ::
2013-11-21 03:27:47 +00:00
/------------------\ /----------------\
| Admin Node | | node1 |
| +-------->+ |
| | | cCCC |
\---------+--------/ \----------------/
|
| /----------------\
| | node2 |
+----------------->+ |
| | cCCC |
| \----------------/
|
| /----------------\
| | node3 |
+----------------->| |
| cCCC |
\----------------/
Monitor Bootstrapping
=====================
Bootstrapping a monitor (a Ceph Storage Cluster, in theory) requires
a number of things:
2017-08-17 12:08:04 +00:00
- **Unique Identifier:** The `` fsid `` is a unique identifier for the cluster,
and stands for File System ID from the days when the Ceph Storage Cluster was
principally for the Ceph Filesystem. Ceph now supports native interfaces,
block devices, and object storage gateway interfaces too, so `` fsid `` is a
2013-12-03 19:07:53 +00:00
bit of a misnomer.
2013-11-21 03:27:47 +00:00
2013-12-03 19:07:53 +00:00
- **Cluster Name:** Ceph clusters have a cluster name, which is a simple string
2013-12-04 00:05:49 +00:00
without spaces. The default cluster name is `` ceph `` , but you may specify
2017-08-17 12:08:04 +00:00
a different cluster name. Overriding the default cluster name is
especially useful when you are working with multiple clusters and you need to
clearly understand which cluster your are working with.
2018-08-20 21:52:56 +00:00
For example, when you run multiple clusters in a :ref: `multisite configuration <multisite>` ,
2013-12-03 19:07:53 +00:00
the cluster name (e.g., `` us-west `` , `` us-east `` ) identifies the cluster for
2017-08-17 12:08:04 +00:00
the current CLI session. **Note:** To identify the cluster name on the
command line interface, specify the Ceph configuration file with the
2013-12-04 00:05:49 +00:00
cluster name (e.g., `` ceph.conf `` , `` us-west.conf `` , `` us-east.conf `` , etc.).
Also see CLI usage (`` ceph --cluster {cluster-name} `` ).
2017-08-17 12:08:04 +00:00
- **Monitor Name:** Each monitor instance within a cluster has a unique name.
2013-11-21 03:27:47 +00:00
In common practice, the Ceph Monitor name is the host name (we recommend one
2017-08-17 12:08:04 +00:00
Ceph Monitor per host, and no commingling of Ceph OSD Daemons with
2013-12-04 00:05:49 +00:00
Ceph Monitors). You may retrieve the short hostname with `` hostname -s `` .
2013-11-21 03:27:47 +00:00
2017-08-17 12:08:04 +00:00
- **Monitor Map:** Bootstrapping the initial monitor(s) requires you to
generate a monitor map. The monitor map requires the `` fsid `` , the cluster
2013-11-21 03:27:47 +00:00
name (or uses the default), and at least one host name and its IP address.
2017-08-17 12:08:04 +00:00
- **Monitor Keyring** : Monitors communicate with each other via a
secret key. You must generate a keyring with a monitor secret and provide
2013-11-21 03:27:47 +00:00
it when bootstrapping the initial monitor(s).
2017-08-17 12:08:04 +00:00
2013-11-21 03:27:47 +00:00
- **Administrator Keyring** : To use the `` ceph `` CLI tools, you must have
a `` client.admin `` user. So you must generate the admin user and keyring,
and you must also add the `` client.admin `` user to the monitor keyring.
2017-08-17 12:08:04 +00:00
The foregoing requirements do not imply the creation of a Ceph Configuration
file. However, as a best practice, we recommend creating a Ceph configuration
2013-11-21 03:27:47 +00:00
file and populating it with the `` fsid `` , the `` mon initial members `` and the
2013-12-04 00:05:49 +00:00
`` mon host `` settings.
2013-12-03 19:07:53 +00:00
You can get and set all of the monitor settings at runtime as well. However,
2017-08-17 12:08:04 +00:00
a Ceph Configuration file may contain only those settings that override the
2013-12-03 19:07:53 +00:00
default values. When you add settings to a Ceph configuration file, these
2017-08-17 12:08:04 +00:00
settings override the default settings. Maintaining those settings in a
2013-12-03 19:07:53 +00:00
Ceph configuration file makes it easier to maintain your cluster.
2013-11-21 03:27:47 +00:00
The procedure is as follows:
#. Log in to the initial monitor node(s)::
ssh {hostname}
2013-12-03 19:07:53 +00:00
2017-08-17 12:08:04 +00:00
For example::
2013-12-03 19:07:53 +00:00
2013-11-21 03:27:47 +00:00
ssh node1
2017-08-17 12:08:04 +00:00
#. Ensure you have a directory for the Ceph configuration file. By default,
Ceph uses `` /etc/ceph `` . When you install `` ceph `` , the installer will
2013-12-03 19:07:53 +00:00
create the `` /etc/ceph `` directory automatically. ::
2013-11-21 03:27:47 +00:00
2017-08-17 12:08:04 +00:00
ls /etc/ceph
2013-11-21 03:27:47 +00:00
2013-12-03 19:07:53 +00:00
**Note:** Deployment tools may remove this directory when purging a
cluster (e.g., `` ceph-deploy purgedata {node-name} `` , `` ceph-deploy purge
{node-name}`` ).
2013-11-21 03:27:47 +00:00
2017-08-17 12:08:04 +00:00
#. Create a Ceph configuration file. By default, Ceph uses
2013-11-21 03:27:47 +00:00
`` ceph.conf `` , where `` ceph `` reflects the cluster name. ::
sudo vim /etc/ceph/ceph.conf
2017-08-17 12:08:04 +00:00
#. Generate a unique ID (i.e., `` fsid `` ) for your cluster. ::
2013-11-21 03:27:47 +00:00
uuidgen
2017-08-17 12:08:04 +00:00
#. Add the unique ID to your Ceph configuration file. ::
2013-11-21 03:27:47 +00:00
fsid = {UUID}
2013-12-03 19:07:53 +00:00
2017-08-17 12:08:04 +00:00
For example::
2013-12-03 19:07:53 +00:00
2013-11-21 03:27:47 +00:00
fsid = a7f64266-0894-4f1e-a635-d0aeaca0e993
2017-08-17 12:08:04 +00:00
#. Add the initial monitor(s) to your Ceph configuration file. ::
2013-11-21 03:27:47 +00:00
mon initial members = {hostname}[,{hostname}]
2013-12-03 19:07:53 +00:00
2017-08-17 12:08:04 +00:00
For example::
2013-12-03 19:07:53 +00:00
2013-11-21 03:27:47 +00:00
mon initial members = node1
2017-08-17 12:08:04 +00:00
#. Add the IP address(es) of the initial monitor(s) to your Ceph configuration
file and save the file. ::
2013-11-21 03:27:47 +00:00
mon host = {ip-address}[,{ip-address}]
2013-12-03 19:07:53 +00:00
For example::
2013-11-21 03:27:47 +00:00
mon host = 192.168.0.1
2017-02-08 17:29:58 +00:00
**Note:** You may use IPv6 addresses instead of IPv4 addresses, but
you must set `` ms bind ipv6 `` to `` true `` . See `Network Configuration
Reference`_ for details about network configuration.
2013-11-21 03:27:47 +00:00
#. Create a keyring for your cluster and generate a monitor secret key. ::
ceph-authtool --create-keyring /tmp/ceph.mon.keyring --gen-key -n mon. --cap mon 'allow *'
#. Generate an administrator keyring, generate a `` client.admin `` user and add
2017-08-17 12:08:04 +00:00
the user to the keyring. ::
2013-11-21 03:27:47 +00:00
2018-08-11 16:21:30 +00:00
sudo ceph-authtool --create-keyring /etc/ceph/ceph.client.admin.keyring --gen-key -n client.admin --cap mon 'allow *' --cap osd 'allow * ' --cap mds 'allow *' --cap mgr 'allow * '
2013-11-21 03:27:47 +00:00
2017-06-19 08:55:56 +00:00
#. Generate a bootstrap-osd keyring, generate a `` client.bootstrap-osd `` user and add
the user to the keyring. ::
2013-11-21 03:27:47 +00:00
2017-06-19 08:55:56 +00:00
sudo ceph-authtool --create-keyring /var/lib/ceph/bootstrap-osd/ceph.keyring --gen-key -n client.bootstrap-osd --cap mon 'profile bootstrap-osd'
2013-11-21 03:27:47 +00:00
2017-06-19 08:55:56 +00:00
#. Add the generated keys to the `` ceph.mon.keyring `` . ::
2013-11-21 03:27:47 +00:00
2017-06-19 08:55:56 +00:00
sudo ceph-authtool /tmp/ceph.mon.keyring --import-keyring /etc/ceph/ceph.client.admin.keyring
sudo ceph-authtool /tmp/ceph.mon.keyring --import-keyring /var/lib/ceph/bootstrap-osd/ceph.keyring
2013-11-21 03:27:47 +00:00
2017-08-17 12:08:04 +00:00
#. Generate a monitor map using the hostname(s), host IP address(es) and the FSID.
Save it as `` /tmp/monmap `` ::
2013-11-21 03:27:47 +00:00
monmaptool --create --add {hostname} {ip-address} --fsid {uuid} /tmp/monmap
2013-12-03 19:07:53 +00:00
For example::
2013-11-21 03:27:47 +00:00
monmaptool --create --add node1 192.168.0.1 --fsid a7f64266-0894-4f1e-a635-d0aeaca0e993 /tmp/monmap
#. Create a default data directory (or directories) on the monitor host(s). ::
sudo mkdir /var/lib/ceph/mon/{cluster-name}-{hostname}
2013-12-03 19:07:53 +00:00
For example::
2017-06-19 08:55:56 +00:00
sudo -u ceph mkdir /var/lib/ceph/mon/ceph-node1
2013-11-21 03:27:47 +00:00
2013-12-04 00:05:49 +00:00
See `Monitor Config Reference - Data`_ for details.
2013-11-21 03:27:47 +00:00
#. Populate the monitor daemon(s) with the monitor map and keyring. ::
2016-05-04 20:27:24 +00:00
sudo -u ceph ceph-mon [--cluster {cluster-name}] --mkfs -i {hostname} --monmap /tmp/monmap --keyring /tmp/ceph.mon.keyring
2013-12-03 19:07:53 +00:00
For example::
2016-05-04 20:27:24 +00:00
sudo -u ceph ceph-mon --mkfs -i node1 --monmap /tmp/monmap --keyring /tmp/ceph.mon.keyring
2013-11-21 03:27:47 +00:00
2017-08-17 12:08:04 +00:00
#. Consider settings for a Ceph configuration file. Common settings include
2013-11-21 03:27:47 +00:00
the following::
[global]
fsid = {cluster-id}
mon initial members = {hostname}[, {hostname}]
mon host = {ip-address}[, {ip-address}]
public network = {network}[, {network}]
cluster network = {network}[, {network}]
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
osd journal size = {n}
osd pool default size = {n} # Write an object n times.
2017-06-19 08:55:56 +00:00
osd pool default min size = {n} # Allow writing n copies in a degraded state.
2013-11-21 03:27:47 +00:00
osd pool default pg num = {n}
2017-08-17 12:08:04 +00:00
osd pool default pgp num = {n}
2013-11-21 03:27:47 +00:00
osd crush chooseleaf type = {n}
In the foregoing example, the `` [global] `` section of the configuration might
look like this::
[global]
fsid = a7f64266-0894-4f1e-a635-d0aeaca0e993
mon initial members = node1
mon host = 192.168.0.1
public network = 192.168.0.0/24
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
osd journal size = 1024
2017-09-22 12:51:53 +00:00
osd pool default size = 3
osd pool default min size = 2
2013-11-21 03:27:47 +00:00
osd pool default pg num = 333
2017-08-17 12:08:04 +00:00
osd pool default pgp num = 333
2013-11-21 03:27:47 +00:00
osd crush chooseleaf type = 1
#. Start the monitor(s).
2017-06-19 08:55:56 +00:00
For most distributions, services are started via systemd now::
sudo systemctl start ceph-mon@node1
For older Debian/CentOS/RHEL, use sysvinit::
2013-11-21 03:27:47 +00:00
sudo /etc/init.d/ceph start mon.node1
2017-08-17 12:08:04 +00:00
#. Verify that the monitor is running. ::
2013-11-21 03:27:47 +00:00
ceph -s
2013-12-04 00:05:49 +00:00
You should see output that the monitor you started is up and running, and
you should see a health error indicating that placement groups are stuck
2017-08-17 12:08:04 +00:00
inactive. It should look something like this::
2013-11-21 03:27:47 +00:00
2017-06-19 08:55:56 +00:00
cluster:
id: a7f64266-0894-4f1e-a635-d0aeaca0e993
2017-10-23 11:16:14 +00:00
health: HEALTH_OK
2017-06-19 08:55:56 +00:00
services:
mon: 1 daemons, quorum node1
mgr: node1(active)
osd: 0 osds: 0 up, 0 in
data:
2017-10-23 11:16:14 +00:00
pools: 0 pools, 0 pgs
2017-06-19 08:55:56 +00:00
objects: 0 objects, 0 bytes
usage: 0 kB used, 0 kB / 0 kB avail
2017-10-23 11:16:14 +00:00
pgs:
2017-06-19 08:55:56 +00:00
2013-11-21 03:27:47 +00:00
2013-12-04 00:05:49 +00:00
**Note:** Once you add OSDs and start them, the placement group health errors
2017-06-19 08:55:56 +00:00
should disappear. See `Adding OSDs`_ for details.
2013-11-21 03:27:47 +00:00
2017-06-14 13:52:58 +00:00
Manager daemon configuration
============================
On each node where you run a ceph-mon daemon, you should also set up a ceph-mgr daemon.
2017-10-23 11:16:14 +00:00
See :ref: `mgr-administrator-guide`
2013-11-21 03:27:47 +00:00
Adding OSDs
===========
Once you have your initial monitor(s) running, you should add OSDs. Your cluster
cannot reach an `` active + clean `` state until you have enough OSDs to handle the
number of copies of an object (e.g., `` osd pool default size = 2 `` requires at
least two OSDs). After bootstrapping your monitor, your cluster has a default
2017-08-17 12:08:04 +00:00
CRUSH map; however, the CRUSH map doesn't have any Ceph OSD Daemons mapped to
2013-11-21 03:27:47 +00:00
a Ceph Node.
2013-12-04 00:05:49 +00:00
Short Form
----------
2017-11-29 16:13:47 +00:00
Ceph provides the `` ceph-volume `` utility, which can prepare a logical volume, disk, or partition
for use with Ceph. The `` ceph-volume `` utility creates the OSD ID by
incrementing the index. Additionally, `` ceph-volume `` will add the new OSD to the
CRUSH map under the host for you. Execute `` ceph-volume -h `` for CLI details.
The `` ceph-volume `` utility automates the steps of the `Long Form`_ below. To
2013-12-04 00:05:49 +00:00
create the first two OSDs with the short form procedure, execute the following
on `` node2 `` and `` node3 `` :
2017-11-29 16:13:47 +00:00
bluestore
^^^^^^^^^
#. Create the OSD. ::
ssh {node-name}
sudo ceph-volume lvm create --data {data-path}
For example::
ssh node1
sudo ceph-volume lvm create --data /dev/hdd1
Alternatively, the creation process can be split in two phases (prepare, and
activate):
2013-12-04 00:05:49 +00:00
#. Prepare the OSD. ::
ssh {node-name}
2017-11-29 16:13:47 +00:00
sudo ceph-volume lvm prepare --data {data-path} {data-path}
2013-12-04 00:05:49 +00:00
For example::
ssh node1
2018-03-01 19:22:01 +00:00
sudo ceph-volume lvm prepare --data /dev/hdd1
2017-11-29 16:13:47 +00:00
Once prepared, the `` ID `` and `` FSID `` of the prepared OSD are required for
activation. These can be obtained by listing OSDs in the current server::
2013-12-04 00:05:49 +00:00
2017-11-29 16:13:47 +00:00
sudo ceph-volume lvm list
2013-12-04 00:05:49 +00:00
#. Activate the OSD::
2017-11-29 16:13:47 +00:00
sudo ceph-volume lvm activate {ID} {FSID}
For example::
sudo ceph-volume lvm activate 0 a7f64266-0894-4f1e-a635-d0aeaca0e993
filestore
^^^^^^^^^
#. Create the OSD. ::
ssh {node-name}
sudo ceph-volume lvm create --filestore --data {data-path} --journal {journal-path}
For example::
ssh node1
sudo ceph-volume lvm create --filestore --data /dev/hdd1 --journal /dev/hdd2
Alternatively, the creation process can be split in two phases (prepare, and
activate):
#. Prepare the OSD. ::
ssh {node-name}
sudo ceph-volume lvm prepare --filestore --data {data-path} --journal {journal-path}
2013-12-04 00:05:49 +00:00
2017-08-17 12:08:04 +00:00
For example::
2013-12-04 00:05:49 +00:00
2017-11-29 16:13:47 +00:00
ssh node1
2018-03-01 19:22:01 +00:00
sudo ceph-volume lvm prepare --filestore --data /dev/hdd1 --journal /dev/hdd2
2017-11-29 16:13:47 +00:00
Once prepared, the `` ID `` and `` FSID `` of the prepared OSD are required for
activation. These can be obtained by listing OSDs in the current server::
sudo ceph-volume lvm list
#. Activate the OSD::
sudo ceph-volume lvm activate --filestore {ID} {FSID}
For example::
2013-12-04 00:05:49 +00:00
2017-11-29 16:13:47 +00:00
sudo ceph-volume lvm activate --filestore 0 a7f64266-0894-4f1e-a635-d0aeaca0e993
2013-12-04 00:05:49 +00:00
Long Form
---------
2016-05-04 20:27:24 +00:00
Without the benefit of any helper utilities, create an OSD and add it to the
cluster and CRUSH map with the following procedure. To create the first two
2017-07-26 02:41:52 +00:00
OSDs with the long form procedure, execute the following steps for each OSD.
2013-12-04 00:05:49 +00:00
2017-07-26 02:41:52 +00:00
.. note :: This procedure does not describe deployment on top of dm-crypt
making use of the dm-crypt 'lockbox'.
2013-12-04 00:05:49 +00:00
2017-07-26 02:41:52 +00:00
#. Connect to the OSD host and become root. ::
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
ssh {node-name}
sudo bash
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
#. Generate a UUID for the OSD. ::
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
UUID=$(uuidgen)
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
#. Generate a cephx key for the OSD. ::
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
OSD_SECRET=$(ceph-authtool --gen-print-key)
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
#. Create the OSD. Note that an OSD ID can be provided as an
additional argument to `` ceph osd new `` if you need to reuse a
previously-destroyed OSD id. We assume that the
`` client.bootstrap-osd `` key is present on the machine. You may
alternatively execute this command as `` client.admin `` on a
different host where that key is present.::
2017-08-17 12:08:04 +00:00
2017-07-26 02:41:52 +00:00
ID=$(echo "{\"cephx_secret\": \"$OSD_SECRET\"}" | \
ceph osd new $UUID -i - \
-n client.bootstrap-osd -k /var/lib/ceph/bootstrap-osd/ceph.keyring)
2013-11-21 03:27:47 +00:00
2018-01-12 23:10:11 +00:00
It is also possible to include a `` crush_device_class `` property in the JSON
to set an initial class other than the default (`` ssd `` or `` hdd `` based on
the auto-detected device type).
2017-07-26 02:41:52 +00:00
#. Create the default directory on your new OSD. ::
2013-12-03 19:07:53 +00:00
2017-07-26 02:41:52 +00:00
mkdir /var/lib/ceph/osd/ceph-$ID
2013-12-03 19:07:53 +00:00
2017-08-17 12:08:04 +00:00
#. If the OSD is for a drive other than the OS drive, prepare it
2017-07-26 02:41:52 +00:00
for use with Ceph, and mount it to the directory you just created. ::
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
mkfs.xfs /dev/{DEV}
mount /dev/{DEV} /var/lib/ceph/osd/ceph-$ID
2013-12-03 19:07:53 +00:00
2017-07-26 02:41:52 +00:00
#. Write the secret to the OSD keyring file. ::
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
ceph-authtool --create-keyring /var/lib/ceph/osd/ceph-$ID/keyring \
--name osd.$ID --add-key $OSD_SECRET
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
#. Initialize the OSD data directory. ::
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
ceph-osd -i $ID --mkfs --osd-uuid $UUID
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
#. Fix ownership. ::
2013-11-21 21:52:36 +00:00
2017-07-26 02:41:52 +00:00
chown -R ceph:ceph /var/lib/ceph/osd/ceph-$ID
2013-12-03 19:07:53 +00:00
2017-08-17 12:08:04 +00:00
#. After you add an OSD to Ceph, the OSD is in your configuration. However,
it is not yet running. You must start
2013-12-03 19:07:53 +00:00
your new OSD before it can begin receiving data.
2013-11-21 03:27:47 +00:00
2017-07-26 02:41:52 +00:00
For modern systemd distributions::
2013-12-03 19:07:53 +00:00
2017-07-26 02:41:52 +00:00
systemctl enable ceph-osd@$ID
systemctl start ceph-osd@$ID
2017-08-17 12:08:04 +00:00
2013-12-03 19:07:53 +00:00
For example::
2017-07-26 02:41:52 +00:00
systemctl enable ceph-osd@12
systemctl start ceph-osd@12
2013-11-21 03:27:47 +00:00
2013-12-04 00:05:49 +00:00
2016-09-17 20:29:49 +00:00
Adding MDS
==========
In the below instructions, `` {id} `` is an arbitrary name, such as the hostname of the machine.
#. Create the mds data directory.::
mkdir -p /var/lib/ceph/mds/{cluster-name}-{id}
#. Create a keyring.::
ceph-authtool --create-keyring /var/lib/ceph/mds/{cluster-name}-{id}/keyring --gen-key -n mds.{id}
2017-08-17 12:08:04 +00:00
2016-09-17 20:29:49 +00:00
#. Import the keyring and set caps.::
ceph auth add mds.{id} osd "allow rwx" mds "allow" mon "allow profile mds" -i /var/lib/ceph/mds/{cluster}-{id}/keyring
2017-08-17 12:08:04 +00:00
2016-09-17 20:29:49 +00:00
#. Add to ceph.conf.::
[mds.{id}]
host = {id}
#. Start the daemon the manual way.::
ceph-mds --cluster {cluster-name} -i {id} -m {mon-hostname}:{mon-port} [-f]
#. Start the daemon the right way (using ceph.conf entry).::
service ceph start
#. If starting the daemon fails with this error::
mds.-1.0 ERROR: failed to authenticate: (22) Invalid argument
Then make sure you do not have a keyring set in ceph.conf in the global section; move it to the client section; or add a keyring setting specific to this mds daemon. And verify that you see the same key in the mds data directory and `` ceph auth get mds.{id} `` output.
#. Now you are ready to `create a Ceph filesystem`_ .
2013-12-04 00:05:49 +00:00
2013-11-21 03:27:47 +00:00
Summary
=======
Once you have your monitor and two OSDs up and running, you can watch the
2017-08-17 12:08:04 +00:00
placement groups peer by executing the following::
2013-11-21 03:27:47 +00:00
ceph -w
2017-08-17 12:08:04 +00:00
To view the tree, execute the following::
2013-11-21 03:27:47 +00:00
ceph osd tree
2017-08-17 12:08:04 +00:00
You should see output that looks something like this::
2013-11-21 03:27:47 +00:00
# id weight type name up/down reweight
-1 2 root default
2013-12-03 19:07:53 +00:00
-2 2 host node1
2013-11-21 03:27:47 +00:00
0 1 osd.0 up 1
2013-12-03 19:07:53 +00:00
-3 1 host node2
2017-08-17 12:08:04 +00:00
1 1 osd.1 up 1
2013-11-21 03:27:47 +00:00
2017-08-17 12:08:04 +00:00
To add (or remove) additional monitors, see `Add/Remove Monitors`_ .
2013-11-21 03:27:47 +00:00
To add (or remove) additional Ceph OSD Daemons, see `Add/Remove OSDs`_ .
2013-12-03 19:07:53 +00:00
2013-11-21 03:27:47 +00:00
.. _Installation (Quick): ../../start
.. _Add/Remove Monitors: ../../rados/operations/add-or-rm-mons
2013-12-03 19:07:53 +00:00
.. _Add/Remove OSDs: ../../rados/operations/add-or-rm-osds
2013-12-04 00:05:49 +00:00
.. _Network Configuration Reference: ../../rados/configuration/network-config-ref
2014-03-14 22:45:51 +00:00
.. _Monitor Config Reference - Data: ../../rados/configuration/mon-config-ref#data
2016-09-17 20:29:49 +00:00
.. _create a Ceph filesystem: ../../cephfs/createfs