mirror of
https://github.com/ceph/ceph
synced 2024-12-23 03:44:23 +00:00
8f9ee150cb
Documentation of a few of Async Messenger configuration options. Signed-off-by: Piotr Dałek <git@predictor.org.pl>
155 lines
3.8 KiB
ReStructuredText
155 lines
3.8 KiB
ReStructuredText
===========
|
|
Messaging
|
|
===========
|
|
|
|
General Settings
|
|
================
|
|
|
|
``ms tcp nodelay``
|
|
|
|
:Description: Disables nagle's algorithm on messenger tcp sessions.
|
|
:Type: Boolean
|
|
:Required: No
|
|
:Default: ``true``
|
|
|
|
|
|
``ms initial backoff``
|
|
|
|
:Description: The initial time to wait before reconnecting on a fault.
|
|
:Type: Double
|
|
:Required: No
|
|
:Default: ``.2``
|
|
|
|
|
|
``ms max backoff``
|
|
|
|
:Description: The maximum time to wait before reconnecting on a fault.
|
|
:Type: Double
|
|
:Required: No
|
|
:Default: ``15.0``
|
|
|
|
|
|
``ms nocrc``
|
|
|
|
:Description: Disables crc on network messages. May increase performance if cpu limited.
|
|
:Type: Boolean
|
|
:Required: No
|
|
:Default: ``false``
|
|
|
|
|
|
``ms die on bad msg``
|
|
|
|
:Description: Debug option; do not configure.
|
|
:Type: Boolean
|
|
:Required: No
|
|
:Default: ``false``
|
|
|
|
|
|
``ms dispatch throttle bytes``
|
|
|
|
:Description: Throttles total size of messages waiting to be dispatched.
|
|
:Type: 64-bit Unsigned Integer
|
|
:Required: No
|
|
:Default: ``100 << 20``
|
|
|
|
|
|
``ms bind ipv6``
|
|
|
|
:Description: Enable if you want your daemons to bind to IPv6 address instead of IPv4 ones. (Not required if you specify a daemon or cluster IP.)
|
|
:Type: Boolean
|
|
:Required: No
|
|
:Default: ``false``
|
|
|
|
|
|
``ms rwthread stack bytes``
|
|
|
|
:Description: Debug option for stack size; do not configure.
|
|
:Type: 64-bit Unsigned Integer
|
|
:Required: No
|
|
:Default: ``1024 << 10``
|
|
|
|
|
|
``ms tcp read timeout``
|
|
|
|
:Description: Controls how long (in seconds) the messenger will wait before closing an idle connection.
|
|
:Type: 64-bit Unsigned Integer
|
|
:Required: No
|
|
:Default: ``900``
|
|
|
|
|
|
``ms inject socket failures``
|
|
|
|
:Description: Debug option; do not configure.
|
|
:Type: 64-bit Unsigned Integer
|
|
:Required: No
|
|
:Default: ``0``
|
|
|
|
Async messenger options
|
|
=======================
|
|
|
|
|
|
``ms async transport type``
|
|
|
|
:Description: Transport type used by Async Messenger. Can be ``posix``, ``dpdk``
|
|
or ``rdma``. Posix uses standard TCP/IP networking and is default.
|
|
Other transports may be experimental and support may be limited.
|
|
:Type: String
|
|
:Required: No
|
|
:Default: ``posix``
|
|
|
|
|
|
``ms async op threads``
|
|
|
|
:Description: Initial number of worker threads used by each Async Messenger instance.
|
|
Should be at least equal to highest number of replicas, but you can
|
|
decrease it if you're low on CPU core count and/or you host a lot of
|
|
OSDs on single server.
|
|
:Type: 64-bit Unsigned Integer
|
|
:Required: No
|
|
:Default: ``3``
|
|
|
|
|
|
``ms async max op threads``
|
|
|
|
:Description: Maximum number of worker threads used by each Async Messenger instance.
|
|
Set to lower values when your machine has limited CPU count, and increase
|
|
when your CPUs are underutilized (i. e. one or more of CPUs are
|
|
constantly on 100% load during I/O operations).
|
|
:Type: 64-bit Unsigned Integer
|
|
:Required: No
|
|
:Default: ``5``
|
|
|
|
|
|
``ms async set affinity``
|
|
|
|
:Description: Set to true to bind Async Messenger workers to particular CPU cores.
|
|
:Type: Boolean
|
|
:Required: No
|
|
:Default: ``true``
|
|
|
|
|
|
``ms async affinity cores``
|
|
|
|
:Description: When ``ms async set affinity`` is true, this string specifies how Async
|
|
Messenger workers are bound to CPU cores. For example, "0,2" will bind
|
|
workers #1 and #2 to CPU cores #0 and #2, respectively.
|
|
NOTE: when manually setting affinity, make sure to not assign workers to
|
|
processors that are virtual CPUs created as an effect of Hyperthreading
|
|
or similar technology, because they're slower than regular CPU cores.
|
|
:Type: String
|
|
:Required: No
|
|
:Default: ``(empty)``
|
|
|
|
|
|
``ms async send inline``
|
|
|
|
:Description: Send messages directly from the thread that generated them instead of
|
|
queuing and sending from Async Messenger thread. This option is known
|
|
to decrease performance on systems with a lot of CPU cores, so it's
|
|
disabled by default.
|
|
:Type: Boolean
|
|
:Required: No
|
|
:Default: ``false``
|
|
|
|
|