2017-01-20 17:47:55 +00:00
|
|
|
# go-ceph - Go bindings for Ceph APIs
|
2014-05-24 18:13:54 +00:00
|
|
|
|
2017-01-12 23:23:11 +00:00
|
|
|
[![Build Status](https://travis-ci.org/ceph/go-ceph.svg)](https://travis-ci.org/ceph/go-ceph) [![Godoc](http://img.shields.io/badge/godoc-reference-blue.svg?style=flat)](https://godoc.org/github.com/ceph/go-ceph) [![license](http://img.shields.io/badge/license-MIT-red.svg?style=flat)](https://raw.githubusercontent.com/ceph/go-ceph/master/LICENSE)
|
2014-12-04 04:14:04 +00:00
|
|
|
|
2014-05-24 18:13:54 +00:00
|
|
|
## Installation
|
|
|
|
|
2015-08-31 14:34:42 +00:00
|
|
|
go get github.com/ceph/go-ceph
|
2014-05-24 18:13:54 +00:00
|
|
|
|
|
|
|
The native RADOS library and development headers are expected to be installed.
|
|
|
|
|
2018-10-10 22:06:47 +00:00
|
|
|
On debian systems (apt):
|
|
|
|
```sh
|
|
|
|
libcephfs-dev librbd-dev librados-dev
|
|
|
|
```
|
|
|
|
|
|
|
|
On rpm based systems (dnf, yum, etc):
|
|
|
|
```sh
|
|
|
|
libcephfs-devel librbd-devel librados-devel
|
|
|
|
```
|
|
|
|
|
2020-01-29 07:38:33 +00:00
|
|
|
go-ceph tries to support different Ceph versions. However some functions might
|
|
|
|
only be available in recent versions, and others can be deprecated. In order to
|
|
|
|
work with non-current versions of Ceph, it is required to pass build-tags to on
|
|
|
|
the `go` commandline. A tag with the named Ceph release will enable/disable
|
|
|
|
certain features of the go-ceph packages, and prevent warnings or compile
|
|
|
|
problems. E.g. build against libcephfs/librados/librbd from Mimic, or run `go
|
|
|
|
test` against Limunous, use:
|
|
|
|
```sh
|
|
|
|
go build -tags mimic ....
|
|
|
|
go test -tags luminous ....
|
|
|
|
```
|
|
|
|
|
2014-05-24 18:13:54 +00:00
|
|
|
## Documentation
|
|
|
|
|
|
|
|
Detailed documentation is available at
|
2020-02-12 18:55:50 +00:00
|
|
|
<https://pkg.go.dev/github.com/ceph/go-ceph>.
|
2014-05-26 18:14:12 +00:00
|
|
|
|
2014-08-31 01:36:50 +00:00
|
|
|
### Connecting to a cluster
|
2014-05-26 18:14:12 +00:00
|
|
|
|
2014-08-31 01:36:50 +00:00
|
|
|
Connect to a Ceph cluster using a configuration file located in the default
|
|
|
|
search paths.
|
2014-05-26 18:14:12 +00:00
|
|
|
|
|
|
|
```go
|
|
|
|
conn, _ := rados.NewConn()
|
|
|
|
conn.ReadDefaultConfigFile()
|
|
|
|
conn.Connect()
|
2014-08-31 01:36:50 +00:00
|
|
|
```
|
|
|
|
|
|
|
|
A connection can be shutdown by calling the `Shutdown` method on the
|
|
|
|
connection object (e.g. `conn.Shutdown()`). There are also other methods for
|
|
|
|
configuring the connection. Specific configuration options can be set:
|
|
|
|
|
|
|
|
```go
|
|
|
|
conn.SetConfigOption("log_file", "/dev/null")
|
|
|
|
```
|
|
|
|
|
|
|
|
and command line options can also be used using the `ParseCmdLineArgs` method.
|
|
|
|
|
|
|
|
```go
|
|
|
|
args := []string{ "--mon-host", "1.1.1.1" }
|
|
|
|
err := conn.ParseCmdLineArgs(args)
|
|
|
|
```
|
|
|
|
|
|
|
|
For other configuration options see the full documentation.
|
|
|
|
|
2014-12-04 05:05:08 +00:00
|
|
|
### Object I/O
|
|
|
|
|
|
|
|
Object in RADOS can be written to and read from with through an interface very
|
|
|
|
similar to a standard file I/O interface:
|
|
|
|
|
|
|
|
```go
|
2014-12-04 05:05:59 +00:00
|
|
|
// open a pool handle
|
2015-01-09 19:33:02 +00:00
|
|
|
ioctx, err := conn.OpenIOContext("mypool")
|
2014-12-04 05:05:08 +00:00
|
|
|
|
2014-12-04 05:05:59 +00:00
|
|
|
// write some data
|
2018-10-07 07:36:09 +00:00
|
|
|
bytesIn := []byte("input data")
|
|
|
|
err = ioctx.Write("obj", bytesIn, 0)
|
2014-12-04 05:05:08 +00:00
|
|
|
|
2014-12-04 05:05:59 +00:00
|
|
|
// read the data back out
|
2018-10-07 07:36:09 +00:00
|
|
|
bytesOut := make([]byte, len(bytesIn))
|
|
|
|
_, err := ioctx.Read("obj", bytesOut, 0)
|
2014-12-04 05:05:08 +00:00
|
|
|
|
2018-10-07 07:36:09 +00:00
|
|
|
if !bytes.Equal(bytesIn, bytesOut) {
|
2014-12-04 05:05:59 +00:00
|
|
|
fmt.Println("Output is not input!")
|
|
|
|
}
|
2014-12-04 05:05:08 +00:00
|
|
|
```
|
|
|
|
|
2014-08-31 01:36:50 +00:00
|
|
|
### Pool maintenance
|
|
|
|
|
|
|
|
The list of pools in a cluster can be retreived using the `ListPools` method
|
|
|
|
on the connection object. On a new cluster the following code snippet:
|
|
|
|
|
|
|
|
```go
|
2014-05-26 18:14:12 +00:00
|
|
|
pools, _ := conn.ListPools()
|
2014-08-31 01:36:50 +00:00
|
|
|
fmt.Println(pools)
|
|
|
|
```
|
|
|
|
|
|
|
|
will produce the output `[data metadata rbd]`, along with any other pools that
|
|
|
|
might exist in your cluster. Pools can also be created and destroyed. The
|
|
|
|
following creates a new, empty pool with default settings.
|
|
|
|
|
|
|
|
```go
|
|
|
|
conn.MakePool("new_pool")
|
2014-05-26 18:14:12 +00:00
|
|
|
```
|
|
|
|
|
2014-08-31 01:36:50 +00:00
|
|
|
Deleting a pool is also easy. Call `DeletePool(name string)` on a connection object to
|
|
|
|
delete a pool with the given name. The following will delete the pool named
|
|
|
|
`new_pool` and remove all of the pool's data.
|
2014-05-26 18:14:12 +00:00
|
|
|
|
2014-08-31 01:36:50 +00:00
|
|
|
```go
|
|
|
|
conn.DeletePool("new_pool")
|
|
|
|
```
|
2015-07-17 17:06:27 +00:00
|
|
|
|
2018-07-07 17:34:56 +00:00
|
|
|
# Development
|
|
|
|
|
|
|
|
```
|
2018-10-10 22:06:47 +00:00
|
|
|
docker run --rm -it --net=host \
|
|
|
|
--device /dev/fuse --cap-add SYS_ADMIN --security-opt apparmor:unconfined \
|
|
|
|
-v ${PWD}:/go/src/github.com/ceph/go-ceph:z \
|
|
|
|
-v /home/nwatkins/src/ceph/build:/home/nwatkins/src/ceph/build:z \
|
|
|
|
-e CEPH_CONF=/home/nwatkins/src/ceph/build/ceph.conf \
|
2018-07-07 17:34:56 +00:00
|
|
|
ceph-golang
|
|
|
|
```
|
|
|
|
|
2018-07-28 17:08:19 +00:00
|
|
|
Run against a `vstart.sh` cluster without installing Ceph:
|
|
|
|
|
|
|
|
```
|
|
|
|
export CGO_CPPFLAGS="-I/ceph/src/include"
|
|
|
|
export CGO_LDFLAGS="-L/ceph/build/lib"
|
|
|
|
go build
|
|
|
|
```
|
|
|
|
|
2015-07-17 17:06:27 +00:00
|
|
|
## Contributing
|
|
|
|
|
|
|
|
Contributions are welcome & greatly appreciated, every little bit helps. Make code changes via Github pull requests:
|
|
|
|
|
|
|
|
- Fork the repo and create a topic branch for every feature/fix. Avoid
|
|
|
|
making changes directly on master branch.
|
|
|
|
- All incoming features should be accompanied with tests.
|
|
|
|
- Make sure that you run `go fmt` before submitting a change
|
|
|
|
set. Alternatively the Makefile has a flag for this, so you can call
|
|
|
|
`make fmt` as well.
|
|
|
|
- The integration tests can be run in a docker container, for this run:
|
|
|
|
|
|
|
|
```
|
|
|
|
make test-docker
|
|
|
|
```
|