2017-01-20 17:47:55 +00:00
|
|
|
# go-ceph - Go bindings for Ceph APIs
|
2014-05-24 18:13:54 +00:00
|
|
|
|
2020-08-26 17:48:34 +00:00
|
|
|
[![Godoc](http://img.shields.io/badge/godoc-reference-blue.svg?style=flat)](https://godoc.org/github.com/ceph/go-ceph) [![license](http://img.shields.io/badge/license-MIT-red.svg?style=flat)](https://raw.githubusercontent.com/ceph/go-ceph/master/LICENSE)
|
2014-12-04 04:14:04 +00:00
|
|
|
|
2020-08-26 18:03:32 +00:00
|
|
|
## Introduction
|
|
|
|
|
|
|
|
The go-ceph project is a collection of API bindings that support the use of
|
|
|
|
native Ceph APIs, which are C language functions, in Go. These bindings make
|
|
|
|
use of Go's cgo feature.
|
|
|
|
There are three main Go sub-packages that make up go-ceph:
|
|
|
|
* rados - exports functionality from Ceph's librados
|
|
|
|
* rbd - exports functionality from Ceph's librbd
|
|
|
|
* cephfs - exports functionality from Ceph's libcephfs
|
2021-05-12 12:38:18 +00:00
|
|
|
* rgw/admin - interact with [radosgw admin ops API](https://docs.ceph.com/en/latest/radosgw/adminops)
|
2020-08-26 18:03:32 +00:00
|
|
|
|
|
|
|
We aim to provide comprehensive support for the Ceph APIs over time. This
|
|
|
|
includes both I/O related functions and management functions. If your project
|
|
|
|
makes use of Ceph command line tools and is written in Go, you may be able to
|
|
|
|
switch away from shelling out to the CLI and to these native function calls.
|
|
|
|
|
2014-05-24 18:13:54 +00:00
|
|
|
## Installation
|
|
|
|
|
2020-08-26 18:10:52 +00:00
|
|
|
The code in go-ceph is purely a library module. Typically, one will import
|
|
|
|
go-ceph in another Go based project. When building the code the native RADOS,
|
|
|
|
RBD, & CephFS library and development headers are expected to be installed.
|
2014-05-24 18:13:54 +00:00
|
|
|
|
2020-08-26 18:10:52 +00:00
|
|
|
On debian based systems (apt) these may be:
|
2018-10-10 22:06:47 +00:00
|
|
|
```sh
|
|
|
|
libcephfs-dev librbd-dev librados-dev
|
|
|
|
```
|
|
|
|
|
2020-08-26 18:10:52 +00:00
|
|
|
On rpm based systems (dnf, yum, etc) these may be:
|
2018-10-10 22:06:47 +00:00
|
|
|
```sh
|
|
|
|
libcephfs-devel librbd-devel librados-devel
|
|
|
|
```
|
|
|
|
|
2021-12-14 19:05:32 +00:00
|
|
|
NOTE: CentOS users may want to use a
|
|
|
|
[CentOS Storage SIG](https://wiki.centos.org/SpecialInterestGroup/Storage/Ceph)
|
|
|
|
repository to enable packages for a supported ceph version.
|
|
|
|
Example: `dnf -y install centos-release-ceph-pacific`.
|
|
|
|
(CentOS 7 users should use "yum" rather than "dnf")
|
|
|
|
|
|
|
|
|
2020-08-26 18:10:52 +00:00
|
|
|
To quickly test if one can build with go-ceph on your system, run:
|
|
|
|
```sh
|
|
|
|
go get github.com/ceph/go-ceph
|
|
|
|
```
|
|
|
|
|
2020-08-26 18:14:03 +00:00
|
|
|
Once compiled, code using go-ceph is expected to dynamically link to the Ceph
|
|
|
|
libraries. These libraries must be available on the system where the go based
|
2020-08-27 13:22:34 +00:00
|
|
|
binaries will be run. Our use of cgo and ceph libraries does not allow for
|
|
|
|
fully static binaries.
|
2020-08-26 18:14:03 +00:00
|
|
|
|
2020-01-29 07:38:33 +00:00
|
|
|
go-ceph tries to support different Ceph versions. However some functions might
|
2020-08-10 18:07:22 +00:00
|
|
|
only be available in recent versions, and others may be deprecated. In order to
|
|
|
|
work with non-current versions of Ceph, it is required to pass build-tags to
|
2020-08-10 18:41:28 +00:00
|
|
|
the `go` command line. A tag with the named Ceph release will enable/disable
|
2020-01-29 07:38:33 +00:00
|
|
|
certain features of the go-ceph packages, and prevent warnings or compile
|
2020-08-10 18:13:09 +00:00
|
|
|
problems. For example, to ensure you select the library features that match
|
2021-10-18 14:22:14 +00:00
|
|
|
the "pacific" release, use:
|
2020-01-29 07:38:33 +00:00
|
|
|
```sh
|
2021-10-18 14:22:14 +00:00
|
|
|
go build -tags pacific ....
|
|
|
|
go test -tags pacific ....
|
2020-01-29 07:38:33 +00:00
|
|
|
```
|
|
|
|
|
2020-08-10 18:42:00 +00:00
|
|
|
### Supported Ceph Versions
|
|
|
|
|
|
|
|
| go-ceph version | Supported Ceph Versions | Deprecated Ceph Versions |
|
|
|
|
| --------------- | ------------------------| -------------------------|
|
2022-04-12 11:00:20 +00:00
|
|
|
| v0.15.0 | octopus, pacific | nautilus |
|
2022-02-15 15:52:20 +00:00
|
|
|
| v0.14.0 | octopus, pacific | nautilus |
|
2021-12-14 18:23:23 +00:00
|
|
|
| v0.13.0 | octopus, pacific | nautilus |
|
2021-10-18 14:22:14 +00:00
|
|
|
| v0.12.0 | octopus, pacific | nautilus |
|
2021-08-10 14:35:08 +00:00
|
|
|
| v0.11.0 | nautilus, octopus, pacific | |
|
2021-06-14 13:29:12 +00:00
|
|
|
| v0.10.0 | nautilus, octopus, pacific | |
|
2021-04-13 17:03:42 +00:00
|
|
|
| v0.9.0 | nautilus, octopus | |
|
2021-02-09 18:30:15 +00:00
|
|
|
| v0.8.0 | nautilus, octopus | |
|
2020-12-08 15:29:33 +00:00
|
|
|
| v0.7.0 | nautilus, octopus | |
|
2020-10-13 15:23:27 +00:00
|
|
|
| v0.6.0 | nautilus, octopus | mimic |
|
2020-08-10 18:42:00 +00:00
|
|
|
| v0.5.0 | nautilus, octopus | luminous, mimic |
|
|
|
|
| v0.4.0 | luminous, mimic, nautilus, octopus | |
|
|
|
|
| v0.3.0 | luminous, mimic, nautilus, octopus | |
|
|
|
|
| v0.2.0 | luminous, mimic, nautilus | |
|
|
|
|
| (pre release) | luminous, mimic (see note) | |
|
|
|
|
|
|
|
|
These tags affect what is supported at compile time. What version of the Ceph
|
|
|
|
cluster the client libraries support, and vice versa, is determined entirely
|
|
|
|
by what version of the Ceph C libraries go-ceph is compiled with.
|
|
|
|
|
|
|
|
NOTE: Prior to 2020 the project did not make versioned releases. The ability to
|
|
|
|
compile with a particular Ceph version before go-ceph v0.2.0 is not guaranteed.
|
|
|
|
|
2020-08-10 18:13:09 +00:00
|
|
|
|
2014-05-24 18:13:54 +00:00
|
|
|
## Documentation
|
|
|
|
|
2020-08-26 18:25:11 +00:00
|
|
|
Detailed API documentation is available at
|
2020-02-12 18:55:50 +00:00
|
|
|
<https://pkg.go.dev/github.com/ceph/go-ceph>.
|
2014-05-26 18:14:12 +00:00
|
|
|
|
2020-08-26 18:25:11 +00:00
|
|
|
Some [API Hints and How-Tos](./docs/hints.md) are also available to quickly
|
|
|
|
introduce how some of API calls work together.
|
2014-05-26 18:14:12 +00:00
|
|
|
|
2015-07-17 17:06:27 +00:00
|
|
|
|
2020-08-26 18:28:21 +00:00
|
|
|
## Development
|
2018-07-07 17:34:56 +00:00
|
|
|
|
|
|
|
```
|
2018-10-10 22:06:47 +00:00
|
|
|
docker run --rm -it --net=host \
|
2021-04-12 13:47:44 +00:00
|
|
|
--security-opt apparmor:unconfined \
|
2018-10-10 22:06:47 +00:00
|
|
|
-v ${PWD}:/go/src/github.com/ceph/go-ceph:z \
|
|
|
|
-v /home/nwatkins/src/ceph/build:/home/nwatkins/src/ceph/build:z \
|
|
|
|
-e CEPH_CONF=/home/nwatkins/src/ceph/build/ceph.conf \
|
2018-07-07 17:34:56 +00:00
|
|
|
ceph-golang
|
|
|
|
```
|
|
|
|
|
2018-07-28 17:08:19 +00:00
|
|
|
Run against a `vstart.sh` cluster without installing Ceph:
|
|
|
|
|
|
|
|
```
|
|
|
|
export CGO_CPPFLAGS="-I/ceph/src/include"
|
|
|
|
export CGO_LDFLAGS="-L/ceph/build/lib"
|
|
|
|
go build
|
|
|
|
```
|
|
|
|
|
2015-07-17 17:06:27 +00:00
|
|
|
## Contributing
|
|
|
|
|
|
|
|
Contributions are welcome & greatly appreciated, every little bit helps. Make code changes via Github pull requests:
|
|
|
|
|
|
|
|
- Fork the repo and create a topic branch for every feature/fix. Avoid
|
|
|
|
making changes directly on master branch.
|
|
|
|
- All incoming features should be accompanied with tests.
|
|
|
|
- Make sure that you run `go fmt` before submitting a change
|
|
|
|
set. Alternatively the Makefile has a flag for this, so you can call
|
|
|
|
`make fmt` as well.
|
|
|
|
- The integration tests can be run in a docker container, for this run:
|
|
|
|
|
|
|
|
```
|
|
|
|
make test-docker
|
|
|
|
```
|
2020-04-07 17:45:07 +00:00
|
|
|
|
|
|
|
### Interactive "Office Hours"
|
|
|
|
|
|
|
|
The maintenance team plans to be available regularly for questions, comments,
|
|
|
|
pings, etc for about an hour twice a week. The current schedule is:
|
|
|
|
|
|
|
|
* 2:00pm EDT (currently 18:00 UTC) Mondays
|
|
|
|
* 9:00am EDT (currently 13:00 UTC) Thursdays
|
|
|
|
|
|
|
|
We will use the [#ceph-devel IRC channel](https://ceph.io/irc/)
|