2012-11-01 17:41:38 +00:00
|
|
|
===========
|
|
|
|
Snapshots
|
|
|
|
===========
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2013-06-14 23:58:04 +00:00
|
|
|
.. index:: Ceph Block Device; snapshots
|
|
|
|
|
2020-10-07 22:21:28 +00:00
|
|
|
A snapshot is a read-only logical copy of an image at a particular point in
|
2022-12-09 17:42:14 +00:00
|
|
|
time: a checkpoint. One of the advanced features of Ceph block devices is that
|
|
|
|
you can create snapshots of images to retain point-in-time state history. Ceph
|
|
|
|
also supports snapshot layering, which allows you to clone images (for example,
|
|
|
|
VM images) quickly and easily. Ceph block device snapshots are managed using
|
|
|
|
the ``rbd`` command and several higher-level interfaces, including `QEMU`_,
|
2023-12-15 15:54:02 +00:00
|
|
|
`libvirt`_, `OpenStack`_, `OpenNebula`_ and `CloudStack`_.
|
2012-06-19 17:15:35 +00:00
|
|
|
|
2020-03-17 17:00:51 +00:00
|
|
|
.. important:: To use RBD snapshots, you must have a running Ceph cluster.
|
2012-06-19 17:15:35 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
|
|
|
|
.. note:: Because RBD is unaware of any file system within an image (volume),
|
|
|
|
snapshots are merely `crash-consistent` unless they are coordinated within
|
|
|
|
the mounting (attaching) operating system. We therefore recommend that you
|
2023-12-15 15:54:02 +00:00
|
|
|
pause or stop I/O before taking a snapshot.
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
If the volume contains a file system, the file system should be in an
|
|
|
|
internally consistent state before a snapshot is taken. Snapshots taken
|
|
|
|
without write quiescing could need an `fsck` pass before they are mounted
|
|
|
|
again. To quiesce I/O you can use `fsfreeze` command. See the `fsfreeze(8)`
|
2023-12-15 15:54:02 +00:00
|
|
|
man page for more details.
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For virtual machines, `qemu-guest-agent` can be used to automatically freeze
|
|
|
|
file systems when creating a snapshot.
|
2018-12-20 18:33:38 +00:00
|
|
|
|
2020-04-09 13:25:39 +00:00
|
|
|
.. ditaa::
|
|
|
|
|
|
|
|
+------------+ +-------------+
|
2012-11-01 17:41:38 +00:00
|
|
|
| {s} | | {s} c999 |
|
|
|
|
| Active |<-------*| Snapshot |
|
|
|
|
| Image | | of Image |
|
|
|
|
| (stop i/o) | | (read only) |
|
|
|
|
+------------+ +-------------+
|
2012-06-19 17:15:35 +00:00
|
|
|
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
Cephx Notes
|
|
|
|
===========
|
|
|
|
|
2020-10-07 22:21:28 +00:00
|
|
|
When `cephx`_ authentication is enabled (it is by default), you must specify a
|
|
|
|
user name or ID and a path to the keyring containing the corresponding key. See
|
2023-12-15 15:54:02 +00:00
|
|
|
:ref:`User Management <user-management>` for details.
|
2022-12-09 17:42:14 +00:00
|
|
|
|
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd --id {user-ID} --keyring /path/to/secret [commands]
|
|
|
|
rbd --name {username} --keyring /path/to/secret [commands]
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd --id admin --keyring /etc/ceph/ceph.keyring [commands]
|
|
|
|
rbd --name client.admin --keyring /etc/ceph/ceph.keyring [commands]
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. tip:: Add the user and secret to the ``CEPH_ARGS`` environment variable to
|
|
|
|
avoid re-entry of these parameters.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
|
|
|
Snapshot Basics
|
2012-09-18 20:01:50 +00:00
|
|
|
===============
|
2012-06-19 17:15:35 +00:00
|
|
|
|
2012-11-01 17:41:38 +00:00
|
|
|
The following procedures demonstrate how to create, list, and remove
|
2020-10-07 22:21:28 +00:00
|
|
|
snapshots using the ``rbd`` command.
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2012-11-01 17:41:38 +00:00
|
|
|
Create Snapshot
|
|
|
|
---------------
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
To create a snapshot, use the ``rbd snap create`` command and specify the pool
|
|
|
|
name, the image name, and the snap name:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap create {pool-name}/{image-name}@{snap-name}
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd snap create rbd/foo@snapname
|
2023-12-15 15:54:02 +00:00
|
|
|
|
2012-06-19 17:15:35 +00:00
|
|
|
|
|
|
|
List Snapshots
|
2012-11-01 17:41:38 +00:00
|
|
|
--------------
|
2012-06-19 17:15:35 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
To list the snapshots of an image, use the ``rbd snap ls`` command and specify
|
|
|
|
the pool name and the image name:
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap ls {pool-name}/{image-name}
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
2012-06-19 17:15:35 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-09-18 20:01:50 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap ls rbd/foo
|
2012-07-03 15:46:14 +00:00
|
|
|
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
Roll back Snapshot
|
|
|
|
------------------
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
To roll back to a snapshot, use the ``rbd snap rollback`` command and specify
|
|
|
|
the pool name, the image name, and the snap name:
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap rollback {pool-name}/{image-name}@{snap-name}
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd snap rollback rbd/foo@snapname
|
|
|
|
|
|
|
|
|
|
|
|
.. note:: Rolling back an image to a snapshot means overwriting the current
|
|
|
|
version of the image with data from a snapshot. The time it takes to execute
|
|
|
|
a rollback increases with the size of the image. It is **faster to clone**
|
|
|
|
from a snapshot **than to roll back** an image to a snapshot. Cloning from a
|
|
|
|
snapshot is the preferred method of returning to a pre-existing state.
|
2012-06-19 17:15:35 +00:00
|
|
|
|
|
|
|
|
|
|
|
Delete a Snapshot
|
2012-11-01 17:41:38 +00:00
|
|
|
-----------------
|
2012-09-18 20:01:50 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
To delete a snapshot, use the ``rbd snap rm`` command and specify the pool
|
|
|
|
name, the image name, and the snap name:
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd snap rm {pool-name}/{image-name}@{snap-name}
|
2023-12-15 15:54:02 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
2012-07-03 15:46:14 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap rm rbd/foo@snapname
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. note:: Ceph OSDs delete data asynchronously, so deleting a snapshot does
|
|
|
|
not immediately free up the capacity of the underlying OSDs. This process is
|
|
|
|
known as "snaptrim", and is referred to as such in ``ceph status`` output.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
Purge Snapshots
|
|
|
|
---------------
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
To delete all snapshots, use the ``rbd snap purge`` command and specify the
|
|
|
|
pool name and the image name:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd snap purge {pool-name}/{image-name}
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap purge rbd/foo
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
2013-06-14 23:58:04 +00:00
|
|
|
.. index:: Ceph Block Device; snapshot layering
|
|
|
|
|
2012-11-01 17:41:38 +00:00
|
|
|
Layering
|
|
|
|
========
|
|
|
|
|
|
|
|
Ceph supports the ability to create many copy-on-write (COW) clones of a block
|
2018-08-28 06:56:16 +00:00
|
|
|
device snapshot. Snapshot layering enables Ceph block device clients to create
|
2012-11-01 17:41:38 +00:00
|
|
|
images very quickly. For example, you might create a block device image with a
|
2022-12-09 17:42:14 +00:00
|
|
|
Linux VM written to it, snapshot the image, protect the snapshot, and create as
|
|
|
|
many copy-on-write clones as you like. A snapshot is read-only, so cloning a
|
|
|
|
snapshot simplifies semantics, making it possible to create clones rapidly.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
2020-04-09 13:25:39 +00:00
|
|
|
.. ditaa::
|
|
|
|
|
|
|
|
+-------------+ +-------------+
|
2012-11-01 17:41:38 +00:00
|
|
|
| {s} c999 | | {s} |
|
|
|
|
| Snapshot | Child refers | COW Clone |
|
|
|
|
| of Image |<------------*| of Snapshot |
|
|
|
|
| | to Parent | |
|
2012-11-01 19:55:18 +00:00
|
|
|
| (read only) | | (writable) |
|
2012-11-01 17:41:38 +00:00
|
|
|
+-------------+ +-------------+
|
2023-12-15 15:54:02 +00:00
|
|
|
|
2012-11-01 17:41:38 +00:00
|
|
|
Parent Child
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. note:: The terms "parent" and "child" refer to a Ceph block device snapshot
|
|
|
|
(parent) and the corresponding image cloned from the snapshot (child).
|
|
|
|
These terms are important for the command line usage below.
|
2023-12-15 15:54:02 +00:00
|
|
|
|
2012-11-01 17:41:38 +00:00
|
|
|
Each cloned image (child) stores a reference to its parent image, which enables
|
2022-12-09 17:42:14 +00:00
|
|
|
the cloned image to open the parent snapshot and read it.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
A copy-on-write clone of a snapshot behaves exactly like any other Ceph
|
|
|
|
block device image. You can read to, write from, clone, and resize cloned
|
|
|
|
images. There are no special restrictions with cloned images. However, the
|
2023-12-15 15:54:02 +00:00
|
|
|
copy-on-write clone of a snapshot depends on the snapshot, so you must
|
2022-12-09 17:42:14 +00:00
|
|
|
protect the snapshot before you clone it. The diagram below depicts this
|
|
|
|
process.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. note:: Ceph supports the cloning of only "RBD format 2" images (that is,
|
|
|
|
images created without specifying ``--image-format 1``). The Linux kernel
|
|
|
|
client supports cloned images beginning with the 3.10 release.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
Getting Started with Layering
|
|
|
|
-----------------------------
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
Ceph block device layering is a simple process. You must have an image. You
|
|
|
|
must create a snapshot of the image. You must protect the snapshot. After you
|
|
|
|
have performed these steps, you can begin cloning the snapshot.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2020-04-09 13:25:39 +00:00
|
|
|
.. ditaa::
|
|
|
|
|
|
|
|
+----------------------------+ +-----------------------------+
|
2012-11-01 17:41:38 +00:00
|
|
|
| | | |
|
|
|
|
| Create Block Device Image |------->| Create a Snapshot |
|
|
|
|
| | | |
|
|
|
|
+----------------------------+ +-----------------------------+
|
|
|
|
|
|
2023-12-15 15:54:02 +00:00
|
|
|
+--------------------------------------+
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
v
|
|
|
|
+----------------------------+ +-----------------------------+
|
|
|
|
| | | |
|
|
|
|
| Protect the Snapshot |------->| Clone the Snapshot |
|
|
|
|
| | | |
|
|
|
|
+----------------------------+ +-----------------------------+
|
|
|
|
|
|
|
|
|
|
|
|
The cloned image has a reference to the parent snapshot, and includes the pool
|
2022-12-09 17:42:14 +00:00
|
|
|
ID, the image ID, and the snapshot ID. The inclusion of the pool ID means that
|
|
|
|
you may clone snapshots from one pool to images in another pool.
|
|
|
|
|
|
|
|
#. **Image Template:** A common use case for block device layering is to create
|
|
|
|
a base image and a snapshot that serves as a template for clones. For
|
|
|
|
example: a user may create an image for a Linux distribution (for example,
|
|
|
|
Ubuntu 22.04) and create a snapshot of it. The user may occasionally update
|
|
|
|
the image and create a new snapshot (by using such commands as ``sudo
|
|
|
|
apt-get update``, ``sudo apt-get upgrade``, or ``sudo apt-get dist-upgrade``
|
|
|
|
followed by ``rbd snap create``). As the image matures, the user can clone
|
|
|
|
any one of the snapshots.
|
|
|
|
|
|
|
|
#. **Extended Template:** A more advanced use case includes extending a
|
|
|
|
template image to provide more information than a base image. For
|
|
|
|
example, a user may clone an image (for example, a VM template) and install
|
|
|
|
other software (for example, a database, a content management system, an
|
|
|
|
analytics system) and then snapshot the extended image, which may itself be
|
|
|
|
updated just like the base image.
|
|
|
|
|
|
|
|
#. **Template Pool:** One way to use block device layering is to create a pool
|
|
|
|
that contains (1) base images that act as templates and (2) snapshots of
|
|
|
|
those templates. You may then extend read-only privileges to users so that
|
|
|
|
they may clone the snapshots even though they do not have permissions that
|
|
|
|
allow them to write or execute within the pool.
|
|
|
|
|
|
|
|
#. **Image Migration/Recovery:** One way to use block device layering is to
|
|
|
|
migrate or recover data from one pool into another pool.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
Protecting a Snapshot
|
|
|
|
---------------------
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
Clones access the parent snapshots. All clones would break if a user
|
2023-12-15 15:54:02 +00:00
|
|
|
inadvertently deleted the parent snapshot. To prevent data loss, you must
|
2022-12-09 17:42:14 +00:00
|
|
|
protect the snapshot before you can clone it:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap protect {pool-name}/{image-name}@{snapshot-name}
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd snap protect rbd/foo@snapname
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
.. note:: You cannot delete a protected snapshot.
|
|
|
|
|
|
|
|
Cloning a Snapshot
|
|
|
|
------------------
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
To clone a snapshot, specify the parent pool, the parent image, and the parent
|
|
|
|
snapshot; and also the child pool together with the image name. You must
|
|
|
|
protect the snapshot before you can clone it:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd clone {pool-name}/{parent-image-name}@{snap-name} {pool-name}/{child-image-name}
|
2023-12-15 15:54:02 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd clone rbd/foo@snapname rbd/bar
|
2023-12-15 15:54:02 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
|
|
|
|
.. note:: You may clone a snapshot from one pool to an image in another pool.
|
|
|
|
For example, you may maintain read-only images and snapshots as templates in
|
|
|
|
one pool, and writeable clones in another pool.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
Unprotecting a Snapshot
|
|
|
|
-----------------------
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
Before you can delete a snapshot, you must first unprotect it. Additionally,
|
2012-11-01 17:41:38 +00:00
|
|
|
you may *NOT* delete snapshots that have references from clones. You must
|
2022-12-09 17:42:14 +00:00
|
|
|
flatten or delete each clone of a snapshot before you can unprotect the
|
|
|
|
snapshot:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd snap unprotect {pool-name}/{image-name}@{snapshot-name}
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd snap unprotect rbd/foo@snapname
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
|
|
|
Listing Children of a Snapshot
|
|
|
|
------------------------------
|
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
To list the children of a snapshot, use the ``rbd children`` command and
|
|
|
|
specify the pool name, the image name, and the snap name:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd children {pool-name}/{image-name}@{snapshot-name}
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd children rbd/foo@snapname
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
|
|
|
Flattening a Cloned Image
|
|
|
|
-------------------------
|
|
|
|
|
|
|
|
Cloned images retain a reference to the parent snapshot. When you remove the
|
2022-12-09 17:42:14 +00:00
|
|
|
reference to the parent snapshot from the clone, you effectively "flatten" the
|
|
|
|
clone by copying the data stored in the snapshot to the clone. The time it
|
|
|
|
takes to flatten a clone increases with the size of the snapshot. To delete a
|
|
|
|
snapshot, you must first flatten the child images (or delete them):
|
|
|
|
|
|
|
|
.. prompt:: bash $
|
|
|
|
|
|
|
|
rbd flatten {pool-name}/{image-name}
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
For example:
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. prompt:: bash $
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
rbd flatten rbd/bar
|
2012-11-01 17:41:38 +00:00
|
|
|
|
2022-12-09 17:42:14 +00:00
|
|
|
.. note:: Since a flattened image contains all the data stored in the snapshot,
|
|
|
|
a flattened image takes up more storage space than a layered clone does.
|
2012-11-01 17:41:38 +00:00
|
|
|
|
|
|
|
|
2014-09-11 17:50:22 +00:00
|
|
|
.. _cephx: ../../rados/configuration/auth-config-ref/
|
2012-11-01 17:41:38 +00:00
|
|
|
.. _QEMU: ../qemu-rbd/
|
|
|
|
.. _OpenStack: ../rbd-openstack/
|
2023-12-15 15:54:02 +00:00
|
|
|
.. _OpenNebula: https://docs.opennebula.io/stable/management_and_operations/vm_management/vm_instances.html?highlight=ceph#managing-disk-snapshots
|
2012-11-01 17:41:38 +00:00
|
|
|
.. _CloudStack: ../rbd-cloudstack/
|
2013-11-12 15:29:19 +00:00
|
|
|
.. _libvirt: ../libvirt/
|