Commit Graph

189 Commits

Author SHA1 Message Date
Ken Dreyer
4fb89a6317 doc: "mds blacklist interval" vs manually blacklisting
The "mds blacklist interval" setting has no effect on the time that
the "ceph osd blacklist" command will use by default. Clarify this in
the docs.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-10-09 09:28:38 -06:00
Patrick Donnelly
1da4a5090a
Merge PR #16036 into HEAD
* refs/remotes/upstream/pull/16036/head:
	mds: improve cap min/max ratio descriptions
	mds: fix whitespace
	mds: cap client recall to min caps per client
	mds: fix conf types
	mds: fix whitespace
	doc/cephfs: add client min cache and max cache ratio describe
	mds: adding tunable features for caps_per_client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-28 17:00:39 -07:00
Patrick Donnelly
dcf97d1735
mds: improve cap min/max ratio descriptions
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-28 16:01:00 -07:00
ren.huanwen
d879ff91e7 doc/cephfs: add client min cache and max cache ratio describe
Signed-off-by: ren.huanwen <ren.huanwen@zte.com.cn>
2017-09-22 09:57:13 +08:00
John Spray
30b16ac814 Merge pull request #17372 from ceph/wip-doc-cephfs-pools
doc: add example of setting pool in cephfs layout

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-09-18 11:37:28 +01:00
Yao Zongyou
69129b73a5 doc: change boolean option default value from zero to false.
Signed-off-by: Yao Zongyou yaozongyou@vip.qq.com
2017-09-14 21:37:04 +08:00
Patrick Donnelly
d929dae49b
Merge PR #17657 into master
* refs/remotes/upstream/pull/17657/head:
	mds: optimize MDCache::rejoin_scour_survivor_replicas()
	mds: fix MDSCacheObject::clear_replica_map
	mds: support limiting cache by memory
	common: refactor of lru
	mds: resolve unsigned coercion compiler warning
	common: use safer uint64_t for list size
	common: add bytes2str pretty print function
	mds: check if waiting is allocated before use
	mds: go back to compact_map for replicas
	mds: use mempool for cache objects
	mds: cleanup replica_map access
	common: add alloc_ptr smart pointer
	common: add warning on base class use of mempool
	common: use atomic uin64_t for counter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-13 20:08:51 -07:00
Patrick Donnelly
a73ad7676a
Merge PR #17608 into master
* refs/remotes/upstream/pull/17608/head:
	doc/cephfs/posix: put posix notes in perspective

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-13 13:37:57 -07:00
Patrick Donnelly
06c94de584
mds: support limiting cache by memory
This introduces two config parameters:

    mds_cache_memory_limit: Sets the soft maximum of the cache to the given
    byte count. (Like mds_cache_size, this doesn't actually limit the maximum
    size of the cache. It just dictates the steady-state size.)

    mds_cache_reservation: This replaces mds_health_cache_threshold everywhere
    except the Beacon heartbeat sent to the mons. The idea here is to specify a
    reservation of memory (5% by default) for operations and the MDS tries to
    always maintain that reservation. So, the MDS will recall caps from clients
    when it begins dipping into its reservation of memory.

mds_cache_size still limits the cache by Inode count but is now by-default 0
(i.e. unlimited). The new preferred way of specifying cache limits is by memory
size. The default is 1GB.

Fixes: http://tracker.ceph.com/issues/20594
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1464976

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-12 20:02:41 -07:00
Yan, Zheng
f27bf0ce54 doc/cephfs/posix: remove stale information for seekdir
Current cephfs can support seekdir efficiently. The diverge was
fixed by https://github.com/ceph/ceph/pull/14317

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-12 09:49:34 +08:00
Sage Weil
8222a05096 doc/cephfs/posix: put posix notes in perspective
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-08 16:17:27 -04:00
John Spray
dee090e87a doc: add example of setting pool in cephfs layout
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-07 15:41:43 +02:00
John Spray
5dea164a01 doc/cephfs: add info on using EC pools with CephFS
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-30 14:23:27 +01:00
Sage Weil
3cf248c04d Merge pull request #15847 from jan--f/doc-fix-multimds-cmds
doc: add allow_multimds and fs_name parameter

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-08-29 22:19:59 -05:00
Zhu Shangzhong
6b75f2d840 doc/cephfs: s/rados_max_object_size/osd_max_object_size
Signed-off-by: Zhu Shangzhong <zhu.shangzhong@zte.com.cn>
2017-08-22 21:51:28 +08:00
Kefu Chai
1cb188db01 Merge pull request #17044 from baruza/wip-doc-21007
doc: Improve the ceph fs set max_mds command

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-21 22:53:46 +08:00
Barbora Ančincová
2e46cc706e doc: Improve the ceph fs set max_mds command
Fixes: http://tracker.ceph.com/issues/21007
Signed-off-by: Bara Ancincova <bara@redhat.com>
2017-08-21 16:37:40 +02:00
Alfredo Deza
d8b287011c doc/cephfs add label to health messages for use in refs linking
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-16 08:20:00 -04:00
Douglas Fuller
f249e3d2d5 doc/cephfs: Document ceph auth fs
Change the CephFS auth caps documentation to reflect the new ceph auth
fs command.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-04 11:10:07 -04:00
Kefu Chai
5c374e7382 Merge pull request #16471 from jan--f/janf-mds-deactivate-doc
doc: reword mds deactivate docs; add optional fs_name argument

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-01 18:52:59 +08:00
John Wilkins
3b9f70d4fd doc/cephfs: Removed contractions for ESL speakers.
Signed-off-by: John Wilkins <jowilkin@redhat.com>
2017-07-27 10:01:29 -07:00
Jan Fajerski
8e82df30b5 doc: extend mds deactivate docs
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-07-21 18:48:20 +02:00
Yan, Zheng
1ef6aec7e4 doc: add some docs about 'cephfs-data-scan scan_links'
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-07-07 20:06:18 +08:00
John Spray
301d53a3c7 doc/mon: clean up mds fail/mds deactivate descriptions
Fixes: http://tracker.ceph.com/issues/20424
Signed-off-by: John Spray <john.spray@redhat.com>
2017-07-03 14:47:29 +01:00
John Spray
9e7a12b470 doc: multimds is no longer experimental
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-23 17:07:34 +01:00
Jan Fajerski
d49dd859ef doc: add allow_multimds and fs_name parameter
Add a short description and command example to set the allow_multimds
flag and add a <fs_name> place holder to all 'ceph fs set' commands.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-06-22 14:52:49 +02:00
Josh Durgin
7376e8132f Merge pull request #15550 from jcsp/wip-doc-cephfs-objsize
doc/cephfs: mention RADOS object size limit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-06-09 14:22:56 -07:00
John Spray
7b528b1044 doc/cephfs: mention RADOS object size limit
Reflect the recent change in this limit
for 12.x.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-07 11:55:57 +01:00
John Spray
f76208cbec doc: fix syntax on code snippets in cephfs/multimds
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-05 20:46:06 +01:00
Ken Dreyer
4274c91c28 doc: describe differences with "mds set" vs "fs set"
Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:14 -06:00
Ken Dreyer
02753cdb91 doc: describe CephFS max_file_size
Add a description of max_file_size to the CephFS admin docs.

Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:11 -06:00
John Spray
45caf26140 mds: improve eviction usability and update docs
The "session ls" and "session evict" are now
"client ls" and "client evict" (the old ones
are still there for backwards compatibility).

The automatic client eviction now emits
cluster logs that call the client by its
friendly name (usually the hostname).

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
048e825484 mds: make blacklisting configurable in kill_session
This makes the code a bit awkward because we now have
4x paths through this function (blocking, noblocking, blacklisting,
nonblacklisting).

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
Yan, Zheng
b67a599ebe Merge pull request #14598 from batrick/mds-balancer-pin
mds: support export pinning on directories
2017-05-11 11:56:34 +08:00
Drunkard Zhang
ab0310883e doc: typo fixes in doc/cephfs/client-config-ref.rst
fixed:
  Reference symbol, i.e. s/`/``/
  Hyperlink typo at ``client_trace``

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-04-28 09:53:17 +08:00
Sage Weil
1919297826 Merge pull request #14494 from drunkard/master
doc: two minor fixes
2017-04-25 12:11:03 -05:00
John Spray
c2fb170586 Merge pull request #14652 from jcsp/wip-18816
mds: remove "mds log" config option

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-24 22:12:46 +01:00
John Spray
ad1882350d mds: remove "mds log" config option
This was occasionally useful for establishing a journal-less
performance baseline, but it has two big problems:
* We don't test it, so it's probably broken a lot of the time
* It sounds a lot to a naive user like an option for controlling
  logging.

IMO, anyone who wants this behaviour is in sufficiently advanced
territory that then can hack it in and recompile, we don't need
to leave dangerous things like this in our releases.

Fixes: http://tracker.ceph.com/issues/18816
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 10:02:17 +01:00
Patrick Donnelly
0b420be7e9
mds: add export_pin feature
This allows the client/admin to pin a directory tree to a particular rank,
preventing its export by the dynamic balancer.

Fixes: http://tracker.ceph.com/issues/17834

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-04-19 18:21:19 -04:00
John Spray
b4c32b1b58 osdc: remove journaler_allow_split_entries option
This had been broken for some time, as since the new
JournalStream stuff, zero padding was no longer a valid
encoding.

Fixes: http://tracker.ceph.com/issues/19691
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-19 11:41:28 +01:00
John Spray
177699981e Merge pull request #13522 from singler/wip-reconnect-client
client/Client.cc: after reset session from MDS - reconnect

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-15 19:44:53 +01:00
John Spray
e1b4327d67 Merge pull request #14087 from jcsp/wip-doc-fscid
doc: how to specify filesystem for cephfs clients

 Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-13 17:42:13 +01:00
Drunkard Zhang
3c70331d6b doc: indent style fixes
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-04-13 12:51:44 +08:00
Henrik Korkuc
e0bbc70467 client/Client.cc: add feature to reconnect client after MDS reset
Client.cc marks session as stale instead of reconecting after received
reset from MDS. On MDS side session is closed so MDS is ignoring cap
renew. This adds option to reconnect stale client sessions instead of
just marking sessions stale.

Fixes: http://tracker.ceph.com/issues/18757

Signed-off-by: Henrik Korkuc <henrik@kirneh.eu>
2017-04-12 15:27:12 +03:00
Douglas Fuller
cb86740a5f cephfs: Permit recovering metadata into a new RADOS pool
Add a procedure that permits reconstructing metadata in a potentially
damaged cephfs metadata pool and writing the results into a
freshly-initialized pool that refers to the same data pool. Add option
flags to override checks that would ordinarily prevent this and add
options to the recovery tools to write output to a separate pool instead of
the one selected for recovery. See docs/cephfs/disaster-recovery.rst for
details.

Fixes: http://tracker.ceph.com/issues/15068
Fixes: http://tracker.ceph.com/issues/15069
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-04-04 12:29:01 -07:00
John Spray
c743ea7d00 mds: enable dirfrags by default in new filesystems
Signed-off-by: john Spray <john.spray@redhat.com>
2017-03-28 23:26:51 +01:00
John Spray
d4959004d1 Merge pull request #12074 from batrick/i17604
mds: warn if insufficient standbys exist

Reviewed-by: John Spray <john.spray@redhat.com>
2017-03-28 09:25:24 -04:00
John Spray
3307ecf782 doc: how to specify filesystem for cephfs clients
Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-22 11:03:06 -04:00
Kefu Chai
e423f0b597 doc: cephfs: fix the unexpected indent warning
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-21 13:47:09 +08:00
Kefu Chai
b935248197 Merge pull request #13997 from tchaikov/wip-doc-fixings
doc:  fixes to silence sphinx-build

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-21 11:46:12 +08:00