Ceph is a distributed object, block, and file storage platform
Go to file
Joao Eduardo Luis 25a9bd3251 osd: OSD: limit the value of 'size' and 'count' on 'osd bench'
Otherwise, a high enough 'count' value will trigger all sorts of timeouts
on the OSD; a low enough 'size' value will have the same effect for a
high enough value of 'count' (even the default value may have ill effects
on the osd's behaviour).  Limiting these values do not fix how 'osd bench'
should behave, but avoid someone from inadvertently bork an OSD.

Four options have been added and the user may adjust them if he so
desires to play with the OSD's fate:

 - 'osd_bench_small_size_max_iops' [default: 100] defines the amount of
   expected IOPS for a small block size (i.e., <1MB).
 - 'osd_bench_large_size_max_throughput' [default: 100<<20] defines
   the expected throughput in B/s.  We assume 100MB/s.
 - 'osd_bench_max_block_size' [default: 64 << 20] caps the block size
   allowed.  We have defined 64 MB.
 - 'osd_bench_duration' [default: 30] caps the expected duration.  This
   values is used when calculating the maximum allowed 'count', and is
   not enforced as the maximum duration of the operation.  If other IO
   is undergoing, or 'osd bench' is somehow slowed down, 'osd bench' may
   go over this duration.  Adjusting this option does however allow the
   user to specify higher 'count' values for (e.g.) a small block size,
   as the operation is assumed to perform the operation over a longer
   time span.

These options attempt to avoid combinations of dangerous parameters.  For
instance, we limit the block size to 64 MB (by default) so that there is
no temptation to specify a large enough block size, along with a very small
'count', such that the end result is similar to specifying a big count with
a sane block size.

Fixes: 7248

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-03-03 14:41:13 +00:00
admin
ceph-object-corpus@d9870cdfd8 ceph-object-corpus: prune some old releases 2014-02-21 13:57:24 -08:00
debian Fix python-requests package dependencies. 2014-02-28 08:34:43 -08:00
doc Added a note that the ceph-osd command requires the cluster option. 2014-02-21 18:26:58 -08:00
examples/librados
fusetrace libc++: use ceph:: namespaced data types 2014-01-18 14:03:20 -08:00
keys
m4 assert: choose function-var name on non-gnu 2013-11-06 14:16:28 -08:00
man doc: format man pages with s/2013/2014/ 2014-01-12 18:06:06 +01:00
qa erasure-code: test that changing the pool size is not allowed 2014-02-23 07:52:59 -08:00
share
src osd: OSD: limit the value of 'size' and 'count' on 'osd bench' 2014-03-03 14:41:13 +00:00
udev
wireshark librados: remove constant for CMPXATTR_NOP 2014-02-18 12:34:32 -08:00
.gitignore
.gitmodules civetweb: fix module uri 2014-01-23 09:41:00 -08:00
.mailmap mailmap: Eric Mourgaya is with Credit Mutuel Arkea 2014-02-11 10:37:52 +01:00
.organizationmap mailmap: Derek Yarnell is with University of Mississippi 2014-02-11 10:38:26 +01:00
AUTHORS
autogen.sh autogen: re-run aclocal after libtoolize 2014-01-15 10:43:49 -08:00
ceph.spec.in Fix python-requests package dependencies. 2014-02-28 08:34:43 -08:00
ChangeLog
CodingStyle
configure.ac Merge branch 'next' 2014-02-20 03:06:00 +00:00
COPYING Merge pull request #638 from ceph/wip-bloom 2013-10-03 12:13:41 -07:00
COPYING-LGPL2.1
do_autogen.sh autogen: test compare strings with != not -ne 2013-12-19 13:40:06 +01:00
Doxyfile
INSTALL
Makefile.am
NEWS
PendingReleaseNotes osd: increase default leveldb write buffer, cache size 2014-02-23 10:05:39 -08:00
README correct one command line at building packages section 2014-02-12 10:38:16 +08:00
SubmittingPatches SubmittingPatches: describe github pull-request process 2013-11-25 09:24:19 -08:00

============================================
Ceph - a scalable distributed storage system
============================================

Please see http://ceph.com/ for current info.

Contributing Code
=================

Most of Ceph is licensed under the LGPL version 2.1.  Some
miscellaneous code is under BSD-style license or is public domain.
The documentation is licensed under Creative Commons
Attribution-ShareAlike (CC BY-SA).  There are a handful of headers
included here that are licensed under the GPL.  Please see the file
COPYING for a full inventory of licenses by file.

Code contributions must include a valid "Signed-off-by" acknowledging
the license for the modified or contributed file.  Please see the file
SubmittingPatches for details on what that means and on how to
generate and submit patches.

We do not require assignment of copyright to contribute code; code is
contributed under the terms of the applicable license.


Building Ceph
=============

To prepare the source tree after it has been git cloned,

	$ git submodule update --init

To build the server daemons, and FUSE client, execute the following:

	$ ./autogen.sh
	$ ./configure
	$ make

(Note that the FUSE client will only be built if libfuse is present.)

Dependencies
------------

The configure script will complain about any missing dependencies as
it goes.  You can also refer to debian/control or ceph.spec.in for the
package build dependencies on those platforms.  In many cases,
dependencies can be avoided with --with-foo or --without-bar switches.
For example,

$ ./configure --with-nss         # use libnss instead of libcrypto++
$ ./configure --without-radosgw  # do not build radosgw and avoid libfcgi-dev
$ ./configure --without-tcmalloc # avoid google-perftools dependency


Building packages
-----------------

You can build packages for Debian or Debian-derived (e.g., Ubuntu)
systems with

$ sudo apt-get install dpkg-dev
$ dpkg-checkbuilddeps        # make sure we have all dependencies
$ dpkg-buildpackage

For RPM-based systems (Redhat, Suse, etc.),

$ rpmbuild


Building the Documentation
==========================

Prerequisites
-------------
To build the documentation, you must install the following:

- python-dev
- python-pip
- python-virtualenv
- doxygen
- ditaa
- libxml2-dev
- libxslt-dev
- dot
- graphviz

For example:

	sudo apt-get install python-dev python-pip python-virtualenv doxygen ditaa libxml2-dev libxslt-dev dot graphviz

Building the Documentation
--------------------------

To build the documentation, ensure that you are in the top-level `/ceph directory, and execute the build script. For example:

	$ admin/build-doc


Build Prerequisites
===================

debian-based
------------
To build the source code, you must install the following:

- automake
- autoconf
- pkg-config
- gcc
- g++
- make
- libboost-dev
- libedit-dev
- libssl-dev
- libtool
- libfcgi
- libfcgi-dev
- libfuse-dev
- linux-kernel-headers
- libcrypto++-dev
- libaio-dev
- libgoogle-perftools-dev
- libkeyutils-dev
- uuid-dev
- libblkid-dev
- libatomic-ops-dev
- libboost-program-options-dev
- libboost-thread-dev
- libexpat1-dev
- libleveldb-dev
- libsnappy-dev
- libcurl4-gnutls-dev
- python-argparse
- python-flask

For example:

	$ apt-get install automake autoconf pkg-config gcc g++ make libboost-dev libedit-dev libssl-dev libtool libfcgi libfcgi-dev libfuse-dev linux-kernel-headers libcrypto++-dev libaio-dev libgoogle-perftools-dev libkeyutils-dev uuid-dev libblkid-dev libatomic-ops-dev libboost-program-options-dev libboost-thread-dev libexpat1-dev libleveldb-dev libsnappy-dev libcurl4-gnutls-dev python-argparse python-flask

rpm-based
---------
These are the rpm packages needed to install in an rpm-based OS:

    autoconf
    automake
    gcc
    gcc-c++
    make
    libtool
    python-argparse
    python-flask
    libuuid-devel
    libblkid-devel
    keyutils-libs-devel
    cryptopp-devel
    nss-devel
    fcgi-devel
    expat-devel
    libcurl-devel
    fuse-devel
    gperftools-devel
    libedit-devel
    libatomic_ops-devel
    snappy-devel
    leveldb-devel
    libaio-devel
    boost-devel

For example:

	$ yum install autoconf automake gcc gcc-c++ make libtool python-argparse python-flask libuuid-devel libblkid-devel keyutils-libs-devel cryptopp-devel nss-devel fcgi-devel expat-devel libcurl-devel fuse-devel gperftools-devel libedit-devel libatomic_ops-devel snappy-devel leveldb-devel libaio-devel boost-devel