Commit Graph

278 Commits

Author SHA1 Message Date
Kefu Chai
fa6a69288c
Merge pull request #26099 from jdurgin/wip-remove-ms-async-affinity
common/options: remove unused ms async affinity options

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-27 21:41:10 +08:00
Ilya Dryomov
ae88c63d04 doc/rados/configuration: refresh osdmap section
"osd map cache size" and "osd map message max" were reduced in commit
855955e58e ("osd: reduce size of osdmap cache, messages").

"osd map cache bl size" and "osd map cache bl inc size" were removed
six years ago.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-01-24 21:16:30 +01:00
Josh Durgin
62ac23bfdc common/options: remove unused ms async affinity options
These were never implemented. They can be added back if they are
implemented and shown to help performance.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2019-01-23 11:17:41 -05:00
Neha Ojha
3659a8c5f6 doc/rados/configuration: add osd scrub {begin,end} week day
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-01-11 12:55:51 -08:00
Sage Weil
251f667ef8 Merge PR #25009 into master
* refs/pull/25009/head:
	librbd: stringify locker name with get_legacy_str()
	osdc/Objecter: fix list_watchers addr rendering to match legacy
	test/crimson: disable unittest_seastar_messenger test
	msg/msg_types: encode entity_addr_t TYPE_ANY as TYPE_LEGACY for pre-nautilus
	client: make blacklist detection handle TYPE_ANY entries
	mon/OSDMonitor: maintain compat output for 'blacklist ls'
	client: maintain compat for {inst,addr}_str in status dump
	qa/tasks/ceph_manager: compare osd flush seq #'s as ints
	qa/suites/fs: make use of simple.yaml where appropriate
	qa/msgr: move msgr factet into generic re-usable dir
	crimson: fix monmap build for seastar
	doc/start/ceph.conf: trim the sample ceph.conf file
	doc/rados/operations: only describe --public-{addr,network} method for adding mons
	PendingReleaseNotes: deprecate 'mon addr'
	doc: fix some 'mon addr' references
	doc/rados/configuration: fix some 'mon addr' references
	doc/rados/configuration/network-config-ref: revise network docs somewhat
	doc/rados/configuration/network-config-ref: remove totally obsolete section
	qa/suites/rados: replace mon_seesaw.py task with a small bash script
	qa/suites/fs/upgrade: don't bind to v2 addrs
	qa/tasks/mon_thrash: avoid 'mon addr' in mon section
	mon/MonClient: disable ms_bind_msgr2 if NAUTILUS feature not set
	osd/OSDMap: maintain compat addr fields
	msg/msg_types: add get_legacy_str()
	mds/MDSMap.h: maintain compat addr field
	mon/MgrMap: maintain compat active_addr field
	mon/MonClient: reconnect to mon if it's addrvec appears to have changed
	qa/tasks/ceph.conf.template: increase mon_mgr_mkfs_grace
	msg/async/ProtocolV2: fill in IP for all peer_addrs
	msg/async: print all addrs on debug lines
	mon/MonMap: no noname- mon name prefix when for_mkfs
	ceph-monstore-tool: print initial monmap
	msg/async/ProtocolV2: advertise ourselves as a v2 addr when using v2 protocol
	msg/async: assert existing protocol matches current protocol
	msg/async: add missing modelines
	mon/MonMap: add missing modeline
	vstart.sh: put mon addrs in mon_host, not 'mon addr'
	msg/async: better debug around conn map lookups and updates
	mon/MonClient: dump initial monmap at debug level 10
	qa/standalone/osd/osd-fast-mark-down: use v1 addr w/ simplemessenger
	qa/tasks/ceph: set initial monmap features with using addrvec addrs
	monmaptool: add --enable-all-features option
	qa/tasks/ceph: only use monmaptool --addv if addr has [,:v]
	qa/tasks/ceph_manager: make get_mon_status use mon addr
	qa/tasks/ceph: keep mon addrs in ctx namespace
	mon/OSDMonitor: log all osd addrs on boot
	msg/simple: behave when v2 and v1 addrs are present at target
	mon/MonClient: warn if global_id changes
	msg/Connection: add warning/note on get_peer_global_id
	mds/MDSDaemon: clean up handle_mds_map debug output a bit
	qa/suites/rados/upgrade: debug mds
	mds/MDSRank: improve is_stale_message to handle addrvecs
	msg/async: make loopback detect when sending to one of our many addrs
	qa/suites/rados/upgrade: no aggressive pg num changes
	mon/OSDMonitor: require nautilus mons for require_osd_release=nautilus
	mon/OSDMonitor: require mimic mons for require_osd_release=mimic
	qa/suites/rados/thrash-old-clients: use legacy addr syntax in ceph.conf
	msg/async: preserve peer features when replacing a connection
	qa/tasks/ceph.py: move methods from teuthology.git into ceph.py directly; support mon bind * options
	mon/MonMap: adjust build_initial behavior for mkfs vs probe
	mon/MonMap: improve ambiguous addr behavior
	qa/suites/rados/upgrade: spread mons a bit
	qa/rados/thrash-old-clients: keep mons on separate hosts
	qa/standalone/mon/misc.sh: tweak test to be more robust
	qa/tasks/mon_seesaw: expect v1/v2 prefix in addr
	osd/OSDMap: fix is_blacklisted() check to assume type ANY
	mon/OSDMonitor: use ANY addr type for blacklisting
	mon/msg_types: TYPE_V1ORV2 -> TYPE_ANY
	qa/workunits/cephtool: fix blacklist test
	qa/suites/upgrade: install old version with only v1 addrs
	common/options: by default, bind to both msgr v1 and v2 addresses
	vstart.sh: add --msgr1, --msgr2, --msgr21 options
	msg/async/ProtocolV2: be flexible with server identity check
	msg/msg_types: fix entity_addrvec_t::parse() with null end arg
	qa/suites/rados/basic/msgr: no msgr2 addrs in initial monmaps
	qa/tasks/ceph: add 'mon_bind_addrvec' and 'mon_bind_msgr2' options
	monmaptool: add --addv argument to pass in addrvec directly
	qa/suites/rados/basic/msgr: do not use msgr2 with simplemessenger
	qa/suites/rados/basic/msgr: async is not experimental
	messages/MOSDBoot: fix compat with pre-nautilus
	mon/MonMap: allow v1 or v2 to be explicitly specified along with part
	msg/msg_types: allow parsing of IPs without assuming v1 vs v2
	msg/msg_types: default parse to v2 addrs
	msg: standarize on v1: and v2: prefixes for *all* entity_addr_t's
	vstart.sh: use msgr2 by default
	mon/MonMap: remove get_addr() methods
	ceph-mon: adjust startup/bind/join sequence to use addrs
	mon: use MonMap::get_addrs() (instead of get_addr())
	mon/MonClient: change pending_cons to addrvec-based map
	mon/MonMap: fix set_addr() caller, kill wrapper
	mon/MonMap: remove addr-based add()
	monmaptool: fix --add to do either legacy or msgr2+legacy
	monmaptool: clean up iterator use a bit
	mon/MonMap: handle ambiguous mon addrs by trying both legacy and msgr
	mon/MonMap: take addrvec for set_initial_members
	mon/MonMap: use addrvecs for test instances
	mon: pass addrvec via MMonJoin
	mon/MonmapMonitor: fix 'mon add' to populate addrvec
	mon/MonMap: addr -> addrvec
	msg/async/ProtocolV2: only update socket_addr if we learned our addr
	osd: go active even if mon only accepted our v1 addr
	test/msgr: add test for msgr2 protocol
	msg/async/ProtocolV2: share socket_addr and all addrs during handshake
	msg/async: print socket_addr for the connection
	msg/async: msgr2 protocol placeholder
	msg/async: move ProtocolV1 class to its own source file
	msg/async: keep listen addr in ServerSocket, pass to new connections
	msg/async/AsyncMessenger: fix set_addr_unknowns

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-04 13:42:09 -06:00
Sage Weil
1675cd5096 doc/rados/configuration: fix some 'mon addr' references
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Sage Weil
369dadea44 doc/rados/configuration/network-config-ref: revise network docs somewhat
These still could use a larger rewrite, but this is a bit better.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Sage Weil
bef7c62fe8 doc/rados/configuration/network-config-ref: remove totally obsolete section
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Jos Collin
a0b3562b24
doc: Fixed double spaces
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-12-26 11:24:48 +05:30
Jos Collin
c1ddc49b2d
doc: Fixed Create a Cluster url
Fixes: http://tracker.ceph.com/issues/37764
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-12-26 11:24:11 +05:30
Mark Nelson
9e2d1a52ab doc/rados: Add bluestore memory autotuning docs.
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2018-11-13 13:19:24 -06:00
Kefu Chai
0e5bdd9d56 librados: remove rados_tmap_*
we have switched from tmap to omap long ago.

but keep the server side implementation around, in case ancient
client is still using these tmap APIs.

also, tmap_update() is kept, because librbd is using it for v1 image
backward compatibility.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-07 14:05:25 -08:00
James McClune
dafdd0f29f
doc: updated crush map tunables link
Updated crush map tunables link in rados/configuration/mon-config-ref.rst
Fixes: https://tracker.ceph.com/issues/36339

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-10-07 22:13:32 -04:00
Kefu Chai
78116ce147 bluestore/NVMe: use PCIe selector as the path name
as the latest SPDK deprecated and removed spdk_pci_get_device(),
we cannot use the PCI device's serial number as its identifier and the
filename of the file representing the device. in this change, we
are using the PCI device's selector instead, it is also used by SPDK as
part of the transport id.

Tested-by: Tone Zhang <tone.zhang@arm.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-26 17:47:38 +08:00
Kefu Chai
5ee1fd2c32 doc: fix typos
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:41:42 +08:00
James McClune
f38426a766 doc: fixed hit set type link
Fixed reference link for hit set type value. Restructured wording in description.
Fixes: https://tracker.ceph.com/issues/34539

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-09-09 21:41:08 -04:00
Kefu Chai
9bef451aa7
Merge pull request #23719 from bstillwell/config-doc-fixes
doc: Fixed spelling errors in configuration section

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-24 14:15:58 +08:00
Bryan Stillwell
2e98517d36 doc: Fixed spelling errors in configuration section
Correct a number of spelling mistakes and word omissions in the cluster
configuration section of the docs.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-23 16:17:08 -06:00
Bryan Stillwell
41ae1d2ecd doc: Spelling fixes in BlueStore config reference
Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-23 15:05:05 -06:00
Alfredo Deza
35a48728ae doc/rados update journal size defaults to 5GB
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-10 13:14:30 -04:00
Alfredo Deza
20e556b624 doc/bluestore detail the different sizing strategies for block.db based on cluster workload
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-06 15:57:56 -04:00
Alfredo Deza
2534df34b1 doc/bluestore expand on configuration with fast and slow devices
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-06 15:57:56 -04:00
Sage Weil
6090545cc7 Merge PR #22433 into master
* refs/pull/22433/head:
	common/config: Add description to (near)full ratio settings

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-06 08:57:03 -05:00
Nathan Cutler
73124c8df8 doc: cleanup: prune Argonaut-specific verbiage
Also drop all release-specific upgrading instructions (they only go up to
Firefly, anyway - none of the current releases are covered).

Note that all of this verbiage I am removing here can still be accessed
on docs.ceph.com via e.g. http://docs.ceph.com/docs/firefly/

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-17 12:20:01 +02:00
Sage Weil
6564adc878 Merge remote-tracking branch 'private/wip-cx'
Conflicts:
	src/include/ceph_features.h
	src/msg/async/AsyncConnection.cc
	src/msg/async/AsyncConnection.h

- SERVER_NAUTLIUS feature recently added to default
- msgr2 bool
- ceph::shared_ptr -> std::shared_ptr
2018-07-09 08:07:29 -05:00
David Disseldorp
fbc3330102 doc/bluestore: fix minor typos in compression section
Signed-off-by: David Disseldorp <ddiss@suse.de>
2018-07-05 13:41:35 +02:00
Brad Fitzpatrick
64212f3e6d doc: fix some it's -> its typos
Signed-off-by: Brad Fitzpatrick <brad@danga.com>
2018-07-02 19:16:23 -07:00
Douglas Fuller
75f55f2dfc osd/filestore: Change default filestore_merge_threshold to -1
Performance evaluations of medium to large size Ceph clusters have
demonstrated negligible performance impact from unnecessarily deep
directory hierarchies but significant performance impact from filestore
split and merge activity. Disable merges by default.

Fixes: http://tracker.ceph.com/issues/24686
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-06-29 11:45:12 -04:00
Alfredo Deza
fda9b6cf0d doc/bluestore: data doesn't use two partitions (ceph-disk era)
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-06-18 15:21:50 -04:00
Wido den Hollander
1213f0f9f1
common/config: Add description to (near)full ratio settings
For many users it is not clear that these only apply to initial creation
of the cluster and that afterwards these commands need to be used:

  ceph osd set-nearfull-ratio <float[0.0-1.0]>
  ceph osd set-full-ratio <float[0.0-1.0]>

Signed-off-by: Wido den Hollander <wido@42on.com>
2018-06-06 13:17:24 +02:00
tone-zhang
78012eed1b doc: update the description for SPDK in bluestore-config-ref.rst
Add more information to show the device initialization in SPDK.

Signed-off-by: tone-zhang <tone.zhang@arm.com>
2018-06-03 06:37:45 +00:00
Sage Weil
1004c050a1 cephx: update docs
Remove confusing references to ancient releases.  Be a bit more clear
about what signatures do/don't protect.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-24 14:17:43 -05:00
Dirk Sarpe
6f1701d432 doc: fix error in osd scrub load threshold
OSD::scrub_load_below_threshold divides the 1 min load by the number of
online cpus.  The documentation said it would use the load without
division by number of cpus.

Signed-off-by: Dirk Sarpe <dirk.sarpe@idiv.de>
2018-04-26 16:48:39 +02:00
Nathan Cutler
fd32bcf9ef
Merge pull request #21268 from smithfarm/wip-doc-config-ceph
doc: some improvements to ceph-conf.rst

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-04-12 13:25:54 +02:00
Jianpeng Ma
59f69643c7 doc: remove unused config: "osd op threads"
This option already removed.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-04-10 05:39:59 +08:00
Nathan Cutler
97fb840c2c doc: ceph-conf: eliminate duplicate verbiage
The "Config file section names" section was duplicating some of the content
that is now covered better by the "Configuration sections" section.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-04-06 18:48:09 +02:00
Sage Weil
577737d007 osd: osd_mon_report_interval_min -> osd_mon_report_interval, kill _max
The _max isn't used.  Drop the _min suffix.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-06 11:00:14 -05:00
Nathan Cutler
b5de809fbb doc: ceph-conf: RGW configuration goes in "client" section
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-04-06 09:42:42 +02:00
Sage Weil
5ddc551516 doc/rados/configuration: big update
- remove a bunch of outdated info
- update to reflect new monitor-based configuration
- move a bunch of common settings to another document/page

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:49 -06:00
Kefu Chai
8c2037effa doc: update mgr related auth settings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-26 15:24:47 +08:00
Adam Wolfe Gordon
75d6b377fb doc: Update config file search paths to reflect reality
The config file paths listed in the docs don't match the config file
paths actually searched by ceph (see `src/common/config.cc`). Update the
docs to reflect the current reality.

Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
2018-01-09 23:07:53 +00:00
Nathan Cutler
aea9fa01ae doc: globally change CRUSH ruleset to CRUSH rule
Since kraken, Ceph enforces a 1:1 correspondence between CRUSH ruleset and
CRUSH rule, so effectively ruleset and rule are the same thing, although
the term "ruleset" still survives - notably in the CRUSH rule itself, where it
effectively denotes the number of the rule.

This commit updates the documentation to more faithfully reflect the current
state of the code.

Fixes: http://tracker.ceph.com/issues/20559
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-12-11 17:15:23 +01:00
Alfredo Deza
4243085d11 doc/rados update bluestore config to use ceph-volume
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-12-04 09:51:11 -05:00
Alfredo Deza
8bbcaa7070 doc/rados update auth config examples to use ceph-volume
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-12-04 09:51:11 -05:00
Katie Holly
40e20986cd doc: correcting typos in bluestore-config-ref and bluestore-migration
Signed-off-by: Katie Holly <git@meo.ws>
2017-11-26 17:47:35 +01:00
John Spray
6fc92dc981 doc: replace injectargs usage with "config set"
Cleaner and easier.  Also implicitly documents
the config set command, which hadn't been explicitly
called out in the docs before.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-11-07 11:32:26 +00:00
Kefu Chai
127d25ccbd doc: fix warning reported by "build-doc linkcheck"
all the HTTP 301 (moved permanently) should be killed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 15:58:48 +08:00
Kefu Chai
d940f62203 doc: fix the desc of "osd max pg per osd hard ratio"
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-18 16:07:50 +08:00
Kefu Chai
4c7df944c7 osd: add max-pg-per-osd limit
osd will refused to create new pgs, until its pg number is lower
than the max-pg-per-osd upper bound setting.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-17 23:08:40 +08:00
Yao Zongyou
7966d3cd1d doc: fix bluestore config type error.
Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
2017-10-10 11:34:26 +08:00