Commit Graph

208 Commits

Author SHA1 Message Date
Patrick Donnelly
61215892d4
doc: clarify type of client in config ref
The kernel configuration is different.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-14 12:37:17 -08:00
Sage Weil
6fdd8ba284
Merge pull request #19435 from smithfarm/wip-20559
doc: globally change CRUSH ruleset to CRUSH rule

Reviewed-by: Sage Weil <sage@redhat.com>
2017-12-11 18:55:13 -06:00
Nathan Cutler
aea9fa01ae doc: globally change CRUSH ruleset to CRUSH rule
Since kraken, Ceph enforces a 1:1 correspondence between CRUSH ruleset and
CRUSH rule, so effectively ruleset and rule are the same thing, although
the term "ruleset" still survives - notably in the CRUSH rule itself, where it
effectively denotes the number of the rule.

This commit updates the documentation to more faithfully reflect the current
state of the code.

Fixes: http://tracker.ceph.com/issues/20559
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-12-11 17:15:23 +01:00
Dan van der Ster
9d55d17c4e doc: correct the new fs allow opts
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2017-12-11 13:32:59 +01:00
Barbora Ančincová
4f590990b0 doc: Add section about MDS cache limits
Signed-off-by: Bara Ancincova (bara@redhat.com)
2017-11-29 12:46:49 +01:00
Patrick Donnelly
06e2cec1ea
Merge PR #17678 into master
* refs/pull/17678/head:
	mon/AuthMonitor: improve error message
	mon/OSDMonitor: disallow "all" as a key or value name
	cephfs, mon/AuthMonitor, OSD/osdcap: make 'all' a synonym for '*'
	vstart.sh: Create an admin user for each CephFS
	mon/AuthMonitor: Allow * wildcard for filesystem name
	OSD/OSDCap: Allow namespace and pool tag to be combined
	OSD/OSDCap: Namespace globbing
	mon/AuthMonitor: Use new osd auth caps for ceph fs authorize
	OSD/auth caps: Add OSD auth caps based on pool tag
	mon/FSCommands: Tag pools used for cephfs by default
	mon/OSDMonitor: Add key/value arguments for pool tagging

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-21 13:49:24 -08:00
Patrick Donnelly
df43e415c6
Merge PR #18274 into master
* refs/pull/18274/head:
	mds: fold mds_revoke_cap_timeout into mds_session_timeout
	client: add new delegation testcases
	client: add delegation support for cephfs
	common: remove data_dir_option from common_preinit and global_pre_init

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-20 21:48:19 -08:00
Douglas Fuller
9c694ffc7e cephfs, mon/AuthMonitor, OSD/osdcap: make 'all' a synonym for '*'
Define the string 'all' to be a synonym for the wildcard '*'. This
avoids confusion in the event that some auth caps (typically with
ceph fs authorize) are not quoted and thus '*' is expanded by the shell.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-11-14 10:48:23 -05:00
Jeff Layton
3321cc7b37 mds: fold mds_revoke_cap_timeout into mds_session_timeout
Right now, we have two different timeout settings -- one for when the
client is just not responding at all (mds_session_timeout), and one for
when the client is otherwise responding but isn't returning caps in a
timely fashion (mds_cap_revoke_timeout).

The default settings on them are equivalent (60s), but only the
mds_session_timeout is communicated via the mdsmap. The
mds_cap_revoke_timeout is known only to the MDS. Neither timeout results
in anything other than warnings in the current codebase.

There is also a third setting (mds_session_autoclose) that is also
communicated via the MDSmap. Exceeding that value (default of 300s)
could eventually result in the client being blacklisted from the
cluster. The code to implement that doesn't exist yet, however.

The current codebase doesn't do any real sanity checking of these
timeouts, so the potential for admins to get them wrong is rather high.
It's hard to concoct a use-case where we'd want to warn about these
events at different intervals.

Simplify this by just removing the mds_cap_revoke_timeout setting, and
replace its use in the code with the mds_session_timeout. With that, the
client can at least determine when warnings might start showing up in
the MDS' logs.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2017-11-14 07:27:01 -05:00
Ilya Dryomov
c702fdc33a doc/cephfs/experimental-features: kernel client snapshots limit
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-10-27 09:35:11 +02:00
Ilya Dryomov
37142e9c29 doc/cephfs/experimental-features: fix Mantle section header
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-10-27 09:35:11 +02:00
Douglas Fuller
160c4bfeb8 mon/AuthMonitor: Use new osd auth caps for ceph fs authorize
Change 'ceph fs authorize' to grant osd auth caps by pool tag
instead of to current data pools. This makes:

ceph fs authorize cephfs_a client.foo /bar rw

now equivalent to:

ceph auth get-or-create client.foo mon 'allow r' mds 'allow rw path=/bar' osd 'allow rw tag cephfs data=cephfs_a'

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-10-25 15:34:13 -04:00
Patrick Donnelly
c58161f25b
Merge PR #17266 into master
* refs/pull/17266/head:
	qa: update test_ceph_argparse to test fs cmds
	qa: use fs rm_data_pool
	qa: fix mdsmap lookup
	qa: remove usage of mds dump
	PendingReleaseNotes: add obsoleted mds commands
	qa: remove use of obsolete mds commands
	ceph_volume_client: remove use of obsolete mds cmd
	doc: update on obsolete mds commands
	cephfs: obsolete deprecated mds commands

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2017-10-24 16:37:14 -07:00
Patrick Donnelly
db5df3c605
Merge PR #18366 into master
* refs/pull/18366/head:
	mon: s/mds_blacklist_interval/mon_mds_blacklist_interval/
	mon: tidy up mds_blacklist_interval

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-24 12:17:19 -07:00
Patrick Donnelly
b897ef9445
qa: use fs rm_data_pool
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-24 11:51:02 -07:00
Kefu Chai
127d25ccbd doc: fix warning reported by "build-doc linkcheck"
all the HTTP 301 (moved permanently) should be killed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-24 15:58:48 +08:00
John Spray
0d68d3513e mon: tidy up mds_blacklist_interval
Remove the misleading reference to this from the client
eviction page, it was never the right option to mention
there (my mistake).

Demote the option from LEVEL_ADVANCED to LEVEL_DEV as it
is hard to imagine a good reason for the user to change it.

Set a hard minimum of one hour, to make it harder to
corrupt` a system by setting it close to zero.

Remove the legacy definition of the field while we're at it.

Fixes: http://tracker.ceph.com/issues/21821
Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-17 23:08:00 +01:00
Ken Dreyer
0fcdba5339 doc: rm stray ")" character from mds config ref
I accidentally introduced this in
4fb89a6317

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-10-10 15:11:46 -06:00
Ken Dreyer
4fb89a6317 doc: "mds blacklist interval" vs manually blacklisting
The "mds blacklist interval" setting has no effect on the time that
the "ceph osd blacklist" command will use by default. Clarify this in
the docs.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-10-09 09:28:38 -06:00
Patrick Donnelly
71e410c290
doc: update on obsolete mds commands
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-01 17:09:37 -07:00
Patrick Donnelly
1da4a5090a
Merge PR #16036 into HEAD
* refs/remotes/upstream/pull/16036/head:
	mds: improve cap min/max ratio descriptions
	mds: fix whitespace
	mds: cap client recall to min caps per client
	mds: fix conf types
	mds: fix whitespace
	doc/cephfs: add client min cache and max cache ratio describe
	mds: adding tunable features for caps_per_client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-28 17:00:39 -07:00
Patrick Donnelly
dcf97d1735
mds: improve cap min/max ratio descriptions
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-28 16:01:00 -07:00
ren.huanwen
d879ff91e7 doc/cephfs: add client min cache and max cache ratio describe
Signed-off-by: ren.huanwen <ren.huanwen@zte.com.cn>
2017-09-22 09:57:13 +08:00
John Spray
30b16ac814 Merge pull request #17372 from ceph/wip-doc-cephfs-pools
doc: add example of setting pool in cephfs layout

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-09-18 11:37:28 +01:00
Yao Zongyou
69129b73a5 doc: change boolean option default value from zero to false.
Signed-off-by: Yao Zongyou yaozongyou@vip.qq.com
2017-09-14 21:37:04 +08:00
Patrick Donnelly
d929dae49b
Merge PR #17657 into master
* refs/remotes/upstream/pull/17657/head:
	mds: optimize MDCache::rejoin_scour_survivor_replicas()
	mds: fix MDSCacheObject::clear_replica_map
	mds: support limiting cache by memory
	common: refactor of lru
	mds: resolve unsigned coercion compiler warning
	common: use safer uint64_t for list size
	common: add bytes2str pretty print function
	mds: check if waiting is allocated before use
	mds: go back to compact_map for replicas
	mds: use mempool for cache objects
	mds: cleanup replica_map access
	common: add alloc_ptr smart pointer
	common: add warning on base class use of mempool
	common: use atomic uin64_t for counter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-13 20:08:51 -07:00
Patrick Donnelly
a73ad7676a
Merge PR #17608 into master
* refs/remotes/upstream/pull/17608/head:
	doc/cephfs/posix: put posix notes in perspective

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-13 13:37:57 -07:00
Patrick Donnelly
06c94de584
mds: support limiting cache by memory
This introduces two config parameters:

    mds_cache_memory_limit: Sets the soft maximum of the cache to the given
    byte count. (Like mds_cache_size, this doesn't actually limit the maximum
    size of the cache. It just dictates the steady-state size.)

    mds_cache_reservation: This replaces mds_health_cache_threshold everywhere
    except the Beacon heartbeat sent to the mons. The idea here is to specify a
    reservation of memory (5% by default) for operations and the MDS tries to
    always maintain that reservation. So, the MDS will recall caps from clients
    when it begins dipping into its reservation of memory.

mds_cache_size still limits the cache by Inode count but is now by-default 0
(i.e. unlimited). The new preferred way of specifying cache limits is by memory
size. The default is 1GB.

Fixes: http://tracker.ceph.com/issues/20594
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1464976

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-12 20:02:41 -07:00
Yan, Zheng
f27bf0ce54 doc/cephfs/posix: remove stale information for seekdir
Current cephfs can support seekdir efficiently. The diverge was
fixed by https://github.com/ceph/ceph/pull/14317

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-12 09:49:34 +08:00
Sage Weil
8222a05096 doc/cephfs/posix: put posix notes in perspective
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-08 16:17:27 -04:00
John Spray
dee090e87a doc: add example of setting pool in cephfs layout
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-07 15:41:43 +02:00
John Spray
5dea164a01 doc/cephfs: add info on using EC pools with CephFS
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-30 14:23:27 +01:00
Sage Weil
3cf248c04d Merge pull request #15847 from jan--f/doc-fix-multimds-cmds
doc: add allow_multimds and fs_name parameter

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-08-29 22:19:59 -05:00
Zhu Shangzhong
6b75f2d840 doc/cephfs: s/rados_max_object_size/osd_max_object_size
Signed-off-by: Zhu Shangzhong <zhu.shangzhong@zte.com.cn>
2017-08-22 21:51:28 +08:00
Kefu Chai
1cb188db01 Merge pull request #17044 from baruza/wip-doc-21007
doc: Improve the ceph fs set max_mds command

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-21 22:53:46 +08:00
Barbora Ančincová
2e46cc706e doc: Improve the ceph fs set max_mds command
Fixes: http://tracker.ceph.com/issues/21007
Signed-off-by: Bara Ancincova <bara@redhat.com>
2017-08-21 16:37:40 +02:00
Alfredo Deza
d8b287011c doc/cephfs add label to health messages for use in refs linking
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-16 08:20:00 -04:00
Douglas Fuller
f249e3d2d5 doc/cephfs: Document ceph auth fs
Change the CephFS auth caps documentation to reflect the new ceph auth
fs command.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-04 11:10:07 -04:00
Kefu Chai
5c374e7382 Merge pull request #16471 from jan--f/janf-mds-deactivate-doc
doc: reword mds deactivate docs; add optional fs_name argument

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-01 18:52:59 +08:00
John Wilkins
3b9f70d4fd doc/cephfs: Removed contractions for ESL speakers.
Signed-off-by: John Wilkins <jowilkin@redhat.com>
2017-07-27 10:01:29 -07:00
Jan Fajerski
8e82df30b5 doc: extend mds deactivate docs
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-07-21 18:48:20 +02:00
Yan, Zheng
1ef6aec7e4 doc: add some docs about 'cephfs-data-scan scan_links'
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-07-07 20:06:18 +08:00
John Spray
301d53a3c7 doc/mon: clean up mds fail/mds deactivate descriptions
Fixes: http://tracker.ceph.com/issues/20424
Signed-off-by: John Spray <john.spray@redhat.com>
2017-07-03 14:47:29 +01:00
John Spray
9e7a12b470 doc: multimds is no longer experimental
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-23 17:07:34 +01:00
Jan Fajerski
d49dd859ef doc: add allow_multimds and fs_name parameter
Add a short description and command example to set the allow_multimds
flag and add a <fs_name> place holder to all 'ceph fs set' commands.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-06-22 14:52:49 +02:00
Josh Durgin
7376e8132f Merge pull request #15550 from jcsp/wip-doc-cephfs-objsize
doc/cephfs: mention RADOS object size limit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-06-09 14:22:56 -07:00
John Spray
7b528b1044 doc/cephfs: mention RADOS object size limit
Reflect the recent change in this limit
for 12.x.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-07 11:55:57 +01:00
John Spray
f76208cbec doc: fix syntax on code snippets in cephfs/multimds
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-05 20:46:06 +01:00
Ken Dreyer
4274c91c28 doc: describe differences with "mds set" vs "fs set"
Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:14 -06:00
Ken Dreyer
02753cdb91 doc: describe CephFS max_file_size
Add a description of max_file_size to the CephFS admin docs.

Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:11 -06:00