Commit Graph

342 Commits

Author SHA1 Message Date
John Spray
0d68d3513e mon: tidy up mds_blacklist_interval
Remove the misleading reference to this from the client
eviction page, it was never the right option to mention
there (my mistake).

Demote the option from LEVEL_ADVANCED to LEVEL_DEV as it
is hard to imagine a good reason for the user to change it.

Set a hard minimum of one hour, to make it harder to
corrupt` a system by setting it close to zero.

Remove the legacy definition of the field while we're at it.

Fixes: http://tracker.ceph.com/issues/21821
Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-17 23:08:00 +01:00
Ken Dreyer
0fcdba5339 doc: rm stray ")" character from mds config ref
I accidentally introduced this in
4fb89a6317

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-10-10 15:11:46 -06:00
Ken Dreyer
4fb89a6317 doc: "mds blacklist interval" vs manually blacklisting
The "mds blacklist interval" setting has no effect on the time that
the "ceph osd blacklist" command will use by default. Clarify this in
the docs.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-10-09 09:28:38 -06:00
Patrick Donnelly
71e410c290
doc: update on obsolete mds commands
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-01 17:09:37 -07:00
Patrick Donnelly
1da4a5090a
Merge PR #16036 into HEAD
* refs/remotes/upstream/pull/16036/head:
	mds: improve cap min/max ratio descriptions
	mds: fix whitespace
	mds: cap client recall to min caps per client
	mds: fix conf types
	mds: fix whitespace
	doc/cephfs: add client min cache and max cache ratio describe
	mds: adding tunable features for caps_per_client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-28 17:00:39 -07:00
Patrick Donnelly
dcf97d1735
mds: improve cap min/max ratio descriptions
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-28 16:01:00 -07:00
ren.huanwen
d879ff91e7 doc/cephfs: add client min cache and max cache ratio describe
Signed-off-by: ren.huanwen <ren.huanwen@zte.com.cn>
2017-09-22 09:57:13 +08:00
John Spray
30b16ac814 Merge pull request #17372 from ceph/wip-doc-cephfs-pools
doc: add example of setting pool in cephfs layout

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-09-18 11:37:28 +01:00
Yao Zongyou
69129b73a5 doc: change boolean option default value from zero to false.
Signed-off-by: Yao Zongyou yaozongyou@vip.qq.com
2017-09-14 21:37:04 +08:00
Patrick Donnelly
d929dae49b
Merge PR #17657 into master
* refs/remotes/upstream/pull/17657/head:
	mds: optimize MDCache::rejoin_scour_survivor_replicas()
	mds: fix MDSCacheObject::clear_replica_map
	mds: support limiting cache by memory
	common: refactor of lru
	mds: resolve unsigned coercion compiler warning
	common: use safer uint64_t for list size
	common: add bytes2str pretty print function
	mds: check if waiting is allocated before use
	mds: go back to compact_map for replicas
	mds: use mempool for cache objects
	mds: cleanup replica_map access
	common: add alloc_ptr smart pointer
	common: add warning on base class use of mempool
	common: use atomic uin64_t for counter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-13 20:08:51 -07:00
Patrick Donnelly
a73ad7676a
Merge PR #17608 into master
* refs/remotes/upstream/pull/17608/head:
	doc/cephfs/posix: put posix notes in perspective

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-13 13:37:57 -07:00
Patrick Donnelly
06c94de584
mds: support limiting cache by memory
This introduces two config parameters:

    mds_cache_memory_limit: Sets the soft maximum of the cache to the given
    byte count. (Like mds_cache_size, this doesn't actually limit the maximum
    size of the cache. It just dictates the steady-state size.)

    mds_cache_reservation: This replaces mds_health_cache_threshold everywhere
    except the Beacon heartbeat sent to the mons. The idea here is to specify a
    reservation of memory (5% by default) for operations and the MDS tries to
    always maintain that reservation. So, the MDS will recall caps from clients
    when it begins dipping into its reservation of memory.

mds_cache_size still limits the cache by Inode count but is now by-default 0
(i.e. unlimited). The new preferred way of specifying cache limits is by memory
size. The default is 1GB.

Fixes: http://tracker.ceph.com/issues/20594
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1464976

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-12 20:02:41 -07:00
Yan, Zheng
f27bf0ce54 doc/cephfs/posix: remove stale information for seekdir
Current cephfs can support seekdir efficiently. The diverge was
fixed by https://github.com/ceph/ceph/pull/14317

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-12 09:49:34 +08:00
Sage Weil
8222a05096 doc/cephfs/posix: put posix notes in perspective
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-08 16:17:27 -04:00
John Spray
dee090e87a doc: add example of setting pool in cephfs layout
Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-07 15:41:43 +02:00
John Spray
5dea164a01 doc/cephfs: add info on using EC pools with CephFS
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-30 14:23:27 +01:00
Sage Weil
3cf248c04d Merge pull request #15847 from jan--f/doc-fix-multimds-cmds
doc: add allow_multimds and fs_name parameter

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-08-29 22:19:59 -05:00
Zhu Shangzhong
6b75f2d840 doc/cephfs: s/rados_max_object_size/osd_max_object_size
Signed-off-by: Zhu Shangzhong <zhu.shangzhong@zte.com.cn>
2017-08-22 21:51:28 +08:00
Kefu Chai
1cb188db01 Merge pull request #17044 from baruza/wip-doc-21007
doc: Improve the ceph fs set max_mds command

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-21 22:53:46 +08:00
Barbora Ančincová
2e46cc706e doc: Improve the ceph fs set max_mds command
Fixes: http://tracker.ceph.com/issues/21007
Signed-off-by: Bara Ancincova <bara@redhat.com>
2017-08-21 16:37:40 +02:00
Alfredo Deza
d8b287011c doc/cephfs add label to health messages for use in refs linking
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-16 08:20:00 -04:00
Douglas Fuller
f249e3d2d5 doc/cephfs: Document ceph auth fs
Change the CephFS auth caps documentation to reflect the new ceph auth
fs command.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-04 11:10:07 -04:00
Kefu Chai
5c374e7382 Merge pull request #16471 from jan--f/janf-mds-deactivate-doc
doc: reword mds deactivate docs; add optional fs_name argument

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-01 18:52:59 +08:00
John Wilkins
3b9f70d4fd doc/cephfs: Removed contractions for ESL speakers.
Signed-off-by: John Wilkins <jowilkin@redhat.com>
2017-07-27 10:01:29 -07:00
Jan Fajerski
8e82df30b5 doc: extend mds deactivate docs
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-07-21 18:48:20 +02:00
Yan, Zheng
1ef6aec7e4 doc: add some docs about 'cephfs-data-scan scan_links'
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-07-07 20:06:18 +08:00
John Spray
301d53a3c7 doc/mon: clean up mds fail/mds deactivate descriptions
Fixes: http://tracker.ceph.com/issues/20424
Signed-off-by: John Spray <john.spray@redhat.com>
2017-07-03 14:47:29 +01:00
John Spray
9e7a12b470 doc: multimds is no longer experimental
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-23 17:07:34 +01:00
Jan Fajerski
d49dd859ef doc: add allow_multimds and fs_name parameter
Add a short description and command example to set the allow_multimds
flag and add a <fs_name> place holder to all 'ceph fs set' commands.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-06-22 14:52:49 +02:00
Josh Durgin
7376e8132f Merge pull request #15550 from jcsp/wip-doc-cephfs-objsize
doc/cephfs: mention RADOS object size limit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-06-09 14:22:56 -07:00
John Spray
7b528b1044 doc/cephfs: mention RADOS object size limit
Reflect the recent change in this limit
for 12.x.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-07 11:55:57 +01:00
John Spray
f76208cbec doc: fix syntax on code snippets in cephfs/multimds
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-05 20:46:06 +01:00
Ken Dreyer
4274c91c28 doc: describe differences with "mds set" vs "fs set"
Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:14 -06:00
Ken Dreyer
02753cdb91 doc: describe CephFS max_file_size
Add a description of max_file_size to the CephFS admin docs.

Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:11 -06:00
John Spray
45caf26140 mds: improve eviction usability and update docs
The "session ls" and "session evict" are now
"client ls" and "client evict" (the old ones
are still there for backwards compatibility).

The automatic client eviction now emits
cluster logs that call the client by its
friendly name (usually the hostname).

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:17 -04:00
John Spray
048e825484 mds: make blacklisting configurable in kill_session
This makes the code a bit awkward because we now have
4x paths through this function (blocking, noblocking, blacklisting,
nonblacklisting).

Signed-off-by: John Spray <john.spray@redhat.com>
2017-05-23 05:22:16 -04:00
Yan, Zheng
b67a599ebe Merge pull request #14598 from batrick/mds-balancer-pin
mds: support export pinning on directories
2017-05-11 11:56:34 +08:00
Drunkard Zhang
ab0310883e doc: typo fixes in doc/cephfs/client-config-ref.rst
fixed:
  Reference symbol, i.e. s/`/``/
  Hyperlink typo at ``client_trace``

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-04-28 09:53:17 +08:00
Sage Weil
1919297826 Merge pull request #14494 from drunkard/master
doc: two minor fixes
2017-04-25 12:11:03 -05:00
John Spray
c2fb170586 Merge pull request #14652 from jcsp/wip-18816
mds: remove "mds log" config option

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-24 22:12:46 +01:00
John Spray
ad1882350d mds: remove "mds log" config option
This was occasionally useful for establishing a journal-less
performance baseline, but it has two big problems:
* We don't test it, so it's probably broken a lot of the time
* It sounds a lot to a naive user like an option for controlling
  logging.

IMO, anyone who wants this behaviour is in sufficiently advanced
territory that then can hack it in and recompile, we don't need
to leave dangerous things like this in our releases.

Fixes: http://tracker.ceph.com/issues/18816
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-20 10:02:17 +01:00
Patrick Donnelly
0b420be7e9
mds: add export_pin feature
This allows the client/admin to pin a directory tree to a particular rank,
preventing its export by the dynamic balancer.

Fixes: http://tracker.ceph.com/issues/17834

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-04-19 18:21:19 -04:00
John Spray
b4c32b1b58 osdc: remove journaler_allow_split_entries option
This had been broken for some time, as since the new
JournalStream stuff, zero padding was no longer a valid
encoding.

Fixes: http://tracker.ceph.com/issues/19691
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-19 11:41:28 +01:00
John Spray
177699981e Merge pull request #13522 from singler/wip-reconnect-client
client/Client.cc: after reset session from MDS - reconnect

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-15 19:44:53 +01:00
John Spray
e1b4327d67 Merge pull request #14087 from jcsp/wip-doc-fscid
doc: how to specify filesystem for cephfs clients

 Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-13 17:42:13 +01:00
Drunkard Zhang
3c70331d6b doc: indent style fixes
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-04-13 12:51:44 +08:00
Henrik Korkuc
e0bbc70467 client/Client.cc: add feature to reconnect client after MDS reset
Client.cc marks session as stale instead of reconecting after received
reset from MDS. On MDS side session is closed so MDS is ignoring cap
renew. This adds option to reconnect stale client sessions instead of
just marking sessions stale.

Fixes: http://tracker.ceph.com/issues/18757

Signed-off-by: Henrik Korkuc <henrik@kirneh.eu>
2017-04-12 15:27:12 +03:00
Douglas Fuller
cb86740a5f cephfs: Permit recovering metadata into a new RADOS pool
Add a procedure that permits reconstructing metadata in a potentially
damaged cephfs metadata pool and writing the results into a
freshly-initialized pool that refers to the same data pool. Add option
flags to override checks that would ordinarily prevent this and add
options to the recovery tools to write output to a separate pool instead of
the one selected for recovery. See docs/cephfs/disaster-recovery.rst for
details.

Fixes: http://tracker.ceph.com/issues/15068
Fixes: http://tracker.ceph.com/issues/15069
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-04-04 12:29:01 -07:00
John Spray
c743ea7d00 mds: enable dirfrags by default in new filesystems
Signed-off-by: john Spray <john.spray@redhat.com>
2017-03-28 23:26:51 +01:00
John Spray
d4959004d1 Merge pull request #12074 from batrick/i17604
mds: warn if insufficient standbys exist

Reviewed-by: John Spray <john.spray@redhat.com>
2017-03-28 09:25:24 -04:00
John Spray
3307ecf782 doc: how to specify filesystem for cephfs clients
Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-22 11:03:06 -04:00
Kefu Chai
e423f0b597 doc: cephfs: fix the unexpected indent warning
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-21 13:47:09 +08:00
Kefu Chai
b935248197 Merge pull request #13997 from tchaikov/wip-doc-fixings
doc:  fixes to silence sphinx-build

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-03-21 11:46:12 +08:00
Kefu Chai
9d32038222 doc/cephfs: add capabilities.rst to toc
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-16 16:39:40 +08:00
Kefu Chai
d90d4f22d6 docs/cephfs: troubleshooting.rst: fix sphinx warning
silences following warning:

troubleshooting.rst:16: WARNING: unknown document:
/rados/troubleshooting

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-16 16:34:53 +08:00
John Spray
f788686d5c mds: extend 'p' auth cap to cover all vxattr stuff
Fixes: http://tracker.ceph.com/issues/19075
Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-08 14:02:57 +00:00
John Spray
76589ed9e1 doc: instructions and guidance for multimds
Inspired by http://tracker.ceph.com/issues/19135

Signed-off-by: John Spray <john.spray@redhat.com>
2017-03-07 14:08:22 +00:00
Drunkard Zhang
f763bacab3 doc: hyperlink fix
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-03-01 09:51:01 +08:00
Patrick Donnelly
7278543d74
mds: warn if insufficient standbys exist
Fixes: http://tracker.ceph.com/issues/17604

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-02-28 14:57:59 -05:00
John Spray
a4fcdb6133 Merge pull request #13346 from batrick/mds-doc-fix
doc: update to new ceph fs commands

Reviewed-by: John Spray <john.spray@redhat.com>
2017-02-20 23:58:55 +00:00
John Spray
41253bbd6c Merge pull request #13065 from ceph/wip-fuse-client-config-edits
doc: minor changes in fuse client config reference

Reviewed-by: John Spray <john.spray@redhat.com>
2017-02-20 13:34:04 +00:00
John Spray
f5ac182cbd Merge pull request #12370 from wido/docs-cephfs-disaster
doc: Update CephFS disaster recovery documentation

Reviewed-by: John Spray <john.spray@redhat.com>
2017-02-17 16:59:35 +00:00
Barbora Ančincová
b6cad3364c doc: additional edits in FUSE client config
Signed-off-by: Bara Ancincova (bara@redhat.com)
2017-02-16 10:49:24 +01:00
Patrick Donnelly
8501341886
doc: update to new ceph fs commands
These `ceph mds ...` commands are deprecated.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-02-09 21:20:04 -05:00
John Spray
f1c3eeda38 Merge pull request #12993 from jcsp/wip-cephfs-doc-authcaps
doc: clarify the path restriction mds cap example

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-02-06 12:59:22 +00:00
John Spray
c6eabe04d9 Merge pull request #11448 from ledgr/change/mount_fuse_ceph_options_in_fs_mntops_and_python
Rewrite mount.fuse.ceph (to python) and move ceph-fuse options to fs_mntops

Reviewed-by: John Spray <john.spray@redhat.com>
2017-02-03 12:30:46 +01:00
Wido den Hollander
d0c8d8cfe0
doc: Update CephFS disaster recovery documentation
Better documentation about spawning multiple workers to speed
up the recovery proces.

Signed-off-by: Wido den Hollander <wido@42on.com>
2017-01-30 10:07:35 +01:00
Edgaras Lukosevicius
35a13e86b2 Rewrite mount.fuse.ceph (to python) and move ceph-fuse options to fs_mntops
Rewrote mount.fuse.ceph to move ceph-fuse options to `fs_mntops`, where it should be.
Bash version with options in `fs_spec` is counterintuitive and cause issues in some
situations (systemd, for example)

Signed-off-by: Edgaras Lukosevicius <edgaras.lukosevicius@gmail.com>
2017-01-29 19:46:10 +02:00
Barbora Ančincová
80db40f855 doc: Dirty data are not the same as corrupted data
Signed-off-by: Bara Ancincova (bara@redhat.com)
2017-01-26 12:26:51 +01:00
Barbora Ančincová
e57605681f doc: minor changes in fuse client config reference
Signed-off-by: Bara Ancincova (bara@redhat.com)
2017-01-23 16:34:55 +01:00
John Spray
936bab6d59 doc: clarify the path restriction mds cap example
It's not obvious as written that the example was
only restricting writes to a path, not reads.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-01-19 06:23:42 +01:00
Dan Mick
c278971bb6 doc/cephfs/troubleshooting: fix broken bullet list
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-01-11 18:45:15 -08:00
John Spray
63ae8579bf Merge pull request #11542 from batrick/systemd-ceph-fuse
systemd: add ceph-fuse service file

Reviewed-by: John Spray <john.spray@redhat.com>
2016-12-14 13:55:33 +00:00
John Spray
3c7c65c669 Merge pull request #12337 from vishalkanaujia/wip_12132
tools: cleanup phase of cephfs-data-scan

Reviewed-by: John Spray <john.spray@redhat.com>
2016-12-14 13:52:35 +00:00
Wido den Hollander
82c2f840b6
doc: Fix for worker arguments to cephfs-data-scan tool
The docs were incorrect and these arguments should work.

Signed-off-by: Wido den Hollander <wido@42on.com>
2016-12-07 09:49:09 +01:00
Vishal Kanaujia
8e8f8dd260 tools: cleanup phase of cephfs-data-scan
cephfs-data-scan has a new optional phase to delete xattrs generated
during recovery.

Signed-off-by: Vishal Kanaujia <vishal.kanaujia@sandisk.com>
2016-12-06 18:43:52 +05:30
Patrick Donnelly
d32d70b783
systemd: add ceph-fuse service file
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-01 19:51:37 -05:00
John Spray
15c6147f79 doc: explain directory fragmenation settings
...and update the config ref.

Includes the new mds_bal_fragment_fast_factor setting.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-24 10:45:59 +00:00
Sage Weil
58f9387acf Merge pull request #12127 from renhwztetecs/renhw-wip-doc-mds
doc/mds: fixup "mds bal mode" Description

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-22 19:35:43 -05:00
huanwen ren
3975b28b98 doc/mds: fixup "mds bal mode" Description
mds_load code is: 
switch(g_conf->mds_bal_mode) {
  case 0:
    return
      .8 * auth.meta_load() +
      .2 * all.meta_load() +
      req_rate +
      10.0 * queue_len;

  case 1:
    return req_rate + 10.0*queue_len;

  case 2:
    return cpu_load_avg;
  }

from Brett Niver <bniver@redhat.com> 

Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2016-11-22 20:10:51 +08:00
David Disseldorp
a138178fbe doc/cephfs/standby: fix minor typos
Signed-off-by: David Disseldorp <ddiss@suse.de>
2016-11-17 20:46:17 +01:00
David Disseldorp
f00546fee0 doc/cephfs: add note about deletion from OSD restricted pool
As described in http://tracker.ceph.com/issues/17937, a client with
restricted pool access can still delete files unless a corresponding
MDS path restriction is also in place.

Signed-off-by: David Disseldorp <ddiss@suse.de>
2016-11-17 20:45:57 +01:00
Patrick Donnelly
b9a63e49ea
doc: clarify mds deactivate purpose
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:51:51 -05:00
Patrick Donnelly
e5a05739ed
doc: remove broken sentence
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-13 21:51:29 -05:00
John Spray
36905d7caf Merge pull request #11783 from jcsp/wip-17796
mds: enable rmxattr on pool_namespace attrs 

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-11-11 12:09:57 +01:00
Kefu Chai
23b591c0f9 Merge pull request #11784 from jcsp/wip-jcsp-docs
Documentation syntax cleanup

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-04 21:14:17 +08:00
John Spray
e7858ecf87 doc/cephfs: separate front page section for dev stuff
The "additional details" section was getting longer
and longer, and I don't want developer-only stuff
in there anyway.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-04 13:07:30 +00:00
John Spray
7d4c4c83d1 doc/cephfs: fix rst syntax in mantle.rst
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-04 13:07:29 +00:00
John Spray
e33355d228 cephfs/capabilities: fix rst syntax
Although we don't link this into built docs,
it generates warnings during build.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-04 13:07:29 +00:00
John Spray
8111fea1ad doc/cephfs: s/CephFS Quotas/Quotas/
This looks odd in the TOC (we're already
in the cephfs section)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-04 13:07:29 +00:00
John Spray
6c38e3adb0 doc/cephfs: fix header depths
Some files had multiple top-level headers resulting in
subsections being listed in the TOC alongside the
main page header.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-04 13:07:28 +00:00
John Spray
1e7e2a94ce doc/cephfs: link in mantle doc
...and add a warning at the very top of the document
that it is not for ordinary user use.

Considered just not linking this in at all, but it
seems a shame to have it here but not be able to
e.g. google it and link to it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-04 13:07:28 +00:00
John Spray
2c3d385c48 doc/cephfs: document the pool_namespace layout attr
...including the new ability to clear it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-04 13:00:05 +00:00
Uday Mullangi
7c7395c1cc doc: Fixing the broken hyperlinks by pointing to correct documentation.
Signed-off-by: umullangi@walmartlabs.com
2016-11-03 14:55:12 +05:30
Malte Fiala
34cd50c4c4 doc: Fixed mapping error in legacy mds command
Signed-off-by: Malte Fiala <maltefiala@produktion.io>
2016-10-27 19:27:19 +02:00
Michael Sevilla
5cc43cf0a7 mantle: re-design and fixes
- fix legacy encoding in mds map and add balancer to dumps
- fix blocking rados read and remove temporary files
- fix beacon message spamming

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:34 -07:00
Michael Sevilla
0829028d1c mantle: store balancer in RADOS, balancer version in MDSMap
- add docs and sample balancer (greedy-spill)

Signed-off-by: Michael Sevilla <mikesevilla3@gmail.com>
2016-10-25 13:27:34 -07:00
John Spray
c83cb7a11d tools/cephfs: add pg_files command
Sometimes users know that particular data pool PGs
have been damaged, and they would like to scan
their files to work out which ones might have
been affected.

Fixes: http://tracker.ceph.com/issues/17249
Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-19 23:06:41 +01:00
Patrick Donnelly
52f4e545e0
mds: remove max_mds config option
It is now required that all changes to max_mds use the run-time `ceph fs
set max_mds` command. The rationale for this change is that it is
confusing to have a configuration for max_mds which is only observed at
file system creation.

Fixes: http://tracker.ceph.com/issues/17105

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-08-31 22:17:28 -04:00
Patrick Donnelly
11bf807563
doc: add graphic for cap bit field
Thanks to Jeff for putting this doc together!

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-08-26 15:13:58 -04:00
Kefu Chai
b3d9b8d975 doc: silence sphinx warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-09 16:39:30 +08:00
John Spray
4a648d2d4a Merge pull request #10573 from renhwztetecs/renhw-wip-doc-cephfs
doc/mds: fixup mds doc

Reviewed-by: John Spray <john.spray@redhat.com>
2016-08-05 12:26:21 +01:00
huanwen ren
d1277f116c doc/mds: add generated files into the /etc/ceph/
Fixes: 16906

Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2016-08-04 20:14:18 +08:00
John Spray
48cd11fece Merge pull request #10458 from gregsfortytwo/wip-doc-troubleshooting
doc: extend the CephFS troubleshooting guide

Reviewed-by: Zack Cerza <zack@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2016-08-02 18:04:31 +01:00
Jeff Layton
d85ba5758a doc: add a new document on capabilities
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2016-08-02 07:20:05 -04:00
huanwen ren
d40e9aaead doc/mds: consistent with "../doc/rados/deployment/index.rst"
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2016-08-02 16:50:15 +08:00
huanwen ren
4f5346cc10 doc/cephfs: fix up mds_standby_replay describe
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2016-08-01 14:52:01 +08:00
Greg Farnum
3421851fce doc: add some links to CephFS troubleshooting guide
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-07-29 13:59:22 -07:00
Greg Farnum
1c5778ecf9 doc: extend the CephFS troubleshooting guide
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-07-29 13:26:39 -07:00
Ken Dreyer
ae4b1744df doc: add troubleshooting steps for ceph-fuse
Thanks to John Spray <jspray@redhat.com> on ceph-devel for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-07-29 07:08:34 -06:00
John Spray
80c0dfcbda Merge pull request #10479 from batrick/standby-notes
doc: small standby doc edits

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-29 13:49:03 +01:00
John Spray
df0720c98b Merge pull request #10434 from batrick/i16743
doc: add client config ref

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-29 13:48:00 +01:00
Patrick Donnelly
00ca666a28
doc: add historical warning for mds_standby_replay
When testing < v10.2.1 with standby replay, I was often confused why the
MDS daemons would go into replay even when this was false.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-07-28 14:17:44 -04:00
Patrick Donnelly
080028b67f
doc: fix config separator/title size.
This makes the setting consistent with the others.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-07-28 14:17:30 -04:00
Patrick Donnelly
9ad2ccf298
doc: add client config ref
Fixes: http://tracker.ceph.com/issues/16743

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-07-27 17:21:40 -04:00
Greg Farnum
9884cd25b6 doc: describe snapshots for developers, and warn about multi-fs
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-07-26 06:25:55 -07:00
John Spray
ef1405ab19 doc/cephfs: explain the various health messages
Signed-off-by: John Spray <john.spray@redhat.com>
2016-07-21 12:32:05 +01:00
Patrick Donnelly
42e02369f0
doc: fix standby replay config
I tried using these settings in tests without success. The correct config names
are prefixed with "mds".

Fixes: http://tracker.ceph.com/issues/16664

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-07-12 15:44:00 -04:00
John Spray
e222a99ab1 doc/cephfs: rename early-adopters to best-practices
...and give it a link in the TOC (in addition
to where it is referenced from the top of index.rst)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:56:39 +01:00
John Spray
f6ddfad6da doc/cephfs: remove some scary warnings
...and restructure the "early adopters" page
into a "best practices" guide.  Early adopters
are now just adopters :-)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:56:39 +01:00
John Spray
2499a568c2 doc: add _netdev to cephfs fstab lines
Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-27 10:39:02 +01:00
John Spray
c698995c2e doc/cephfs: add advice about kernel versions
Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-20 12:28:45 +01:00
Greg Farnum
5d9cc299e6 doc: include link to CephFS' experimental features
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-06-06 14:46:44 -07:00
John Spray
b6d2b6d1a5 client: report root's quota in statfs
When user is mounted a quota-restricted inode
as the root, report that inode's quota status
as the filesystem statistics in statfs.

This allows us to have a fairly convincing illusion
that someone has a filesystem to themselves, when
they're really mounting a restricted part of
the larger global filesystem.

Fixes: http://tracker.ceph.com/issues/15599
Signed-off-by: John Spray <john.spray@redhat.com>
2016-05-17 13:08:13 +01:00
John Spray
97dd6897ef doc: add cephfs daemon management docs
Principally to tell people how to configure
standby, but more generally as a place to define
our terms for GIDs etc.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-05-03 12:57:22 +01:00
wangsongbo
048469255b doc: correct wrong spell 'mnay' to 'many'
Signed-off-by: wangsongbo <wangsongbo@unitedstack.com>
2016-04-24 11:19:09 +08:00
Greg Farnum
d82c49703d doc: add a page for CephFS' experimental features describing lockout rules
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-07 16:40:24 -07:00
Greg Farnum
6974ed4254 doc: update cephfs administration page for enable_multiple safety check
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-07 16:40:24 -07:00
Sage Weil
f6f9c00b33 Merge pull request #8121 from liewegas/wip-15136
mon: remove 'mds setmap'

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-03-18 09:44:05 -04:00
Sage Weil
b0d9b0de15 mon: remove 'mds setmap' command
This command has no discernable purpose, and is difficult and
dangerous to support anyway.

Fixes: #15136
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-17 10:40:24 -04:00
Dongsheng Yang
28982cad9b mds: change the 'fs remove_data_pool' to 'fs rm_data_pool'
As 'fs remove_data_pool' is newly introduced command, let's
change it to 'fs rm_data_pool' immediately rather than introduce
another alias for it.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2016-03-14 16:42:13 +08:00
John Spray
99c175097c doc: cephfs admin command list
Creating this skeleton to include the new
"ceph fs ..." commands.  Needs filling out
with prose about purpose and result of
commands.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-10 11:18:28 +00:00
John Spray
e5641115e9 doc: add notes about upgrading cephfs
This is part of the run-up to removing all
TMAP code in the Jewel+1 cycle.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-01 10:58:43 +00:00
Sage Weil
d5cee59b02 doc/cephfs/posix: update
Signed-off-by: Sage Weil <sage@redhat.com>
2015-12-14 10:45:30 -05:00
John Spray
1b6a7e3600 doc: note that cephfs auth stuff is new in jewel
+ bonus whitespace fixes to the code blocks to
get them to render properly

Signed-off-by: John Spray <john.spray@redhat.com>
2015-12-08 14:10:18 +00:00
John Spray
534ff381ab Merge pull request #6848 from H3C/wip-zcl-layout-rst
doc:file must be empty when writing layout fields of file use "setfattr"

Reviewed-by: John Spray <john.spray@redhat.com>
2015-12-08 11:47:22 +00:00
Cilang Zhao
07c334a2ca doc:file must be empty when writing layout fields of file use "setfattr"
When the layout fields of a file are modified, this file must be empty, otherwise an error would occur.

Signed-off-by:Cilang Zhao zhao.cilang@h3c.com
2015-12-08 03:45:43 -05:00
Gregory Farnum
66de0e3215 Merge pull request #6567 from jcsp/wip-layout-restrict
mds: add 'p' flag in auth caps to control setting pool in layout

Reviewed-by: Sage Weil <sage@redhat.com>
2015-12-06 21:05:30 -08:00
Drunkard Zhang
9fba402413 doc: typo fix in cephfs/quota 2015-12-01 17:15:29 +08:00
John Spray
2829e9dc78 doc: flesh out MDS auth docs
...including updating for 'rwp'.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-11-13 14:18:44 +00:00
Jevon Qiao
b4c5620d28 doc: remove toctree items under Create CephFS
The two toctree items under Create CephFS should be changed into hyper links.

Signed-off-by: Jevon Qiao <qiaojianfeng@unitedstack.com>
2015-10-13 21:38:02 +08:00
Jashan Kamboj
10295e9f8b doc:fix path-based restriction
Signed-off-by: Jashan Kamboj <jashank42@gmail.com>
2015-10-01 09:41:32 -04:00
Jashan Kamboj
6a6c06887c doc/cephfs: path-based restriction
Signed-off-by: Jashan Kamboj <jashank42@gmail.com>
2015-10-01 09:39:34 -04:00
Sage Weil
8b1df960e2 doc/cephfs/quota: simple doc
Signed-off-by: Sage Weil <sage@redhat.com>
2015-07-23 08:35:35 -04:00
John Spray
8eaa2f263d doc: add some docs about cephfs-data-scan
These are deliberately fairly sparse, because:
 * These tools are for experts
 * These tools may well be wrapped in a higher
   level recovery tool that orchestrates parallel
   workers at some stage.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-07-13 14:05:17 +01:00
Valentin
a1e3108628 doc: Fixed the picture on page http://ceph.com/docs/master/cephfs/
Fixes: #9174

Signed-off-by Valentin Thomas <valentin.arshanes.thomas@gmail.com>
2015-06-19 13:37:56 +02:00
Fabio Alessandro Locati
d5d6468e88 doc: fix the architecture diagram in cephfs.rst
Signed-off-by: Fabio Alessandro Locati <fabio@locati.cc>
2015-03-31 18:00:45 +02:00
John Spray
a5804c45f1 doc: add a page for CephFS early adopters
This is where we should point people who are
trying out CephFS in evaluation environments.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-02-11 13:24:13 +00:00
Sage Weil
d2376497e7 doc/cephfs: Ceph FS -> CephFS
Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-11 13:24:13 +00:00
Sage Weil
65dfd5d4ea doc/cephfs: clarify the 'not production ready' warning
Continue to run into people who see this and run away (occasionally to
less robust solutions) without understanding why.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-11 13:24:13 +00:00
John Spray
a007c529e8 doc: add cephfs disaster recovery guidance
This is a place to put some useful notes about
the new offline recovery tooling.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-02-02 09:56:14 +01:00
Wido den Hollander
883e1aea96 doc: Show how new data pools can be added to CephFS for file layouts 2014-12-18 10:59:31 +01:00
John Spray
9f53eeb88d doc: add cephfs ENOSPC and eviction information
Adding this at this time to give us a sensible place
to talk about the epoch barrier stuff.  The eviction
stuff will probably get simplified once we add a mon-side
eviction command that handles blacklisting and MDS session
eviction in one go.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:55:24 +00:00
john
b016f84682 doc: add notes on using "ceph fs new"
Signed-off-by: John Spray <john.spray@redhat.com>
2014-08-18 17:47:31 +01:00
John Spray
8eef89e663 doc: fix example s/inspect/journal inspect/
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-18 18:40:51 +01:00
John Spray
6c48d076ae doc: add cephfs layout documentation
This clarifies how to deal with layouts in CephFS
using vxattrs.  We can point people here if they
ask what they should use instead of the deprecated
`cephfs set_layout`.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 14:28:32 +01:00
John Spray
49add98390 docs: Add cephfs-journal-tool
Signed-off-by: John Spray <john.spray@inktank.com>
2014-05-20 14:07:49 +01:00
Scott Devoid
9f1ad4db54 Document unstable nature of CephFS
- Add note to docs indicating that CephFS is not recommended for
  production datasets.
- Add note to docs indicating that running CephFS with multiple MDS
  servers is not currently recommended.

This fixes issue #5797 http://tracker.ceph.com/issues/5797

Signed-off-by: Scott Devoid <devoid@anl.gov>
2013-08-15 14:01:32 -05:00
Noah Watkins
d277edd24a Merge branch 'wip-hadoop-doc'
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-07-14 16:32:28 -07:00
Noah Watkins
6ef48c7ec2 doc: update Hadoop docs with plugin download
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-07-14 16:31:33 -07:00
Noah Watkins
a805958f89 doc: document new hadoop config options
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-07-14 16:31:33 -07:00
John Wilkins
f4eddd7be9 doc: Updated to reflect glossary usage.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-05-30 20:28:22 -07:00
Noah Watkins
352b7b5936 doc: start Hadoop installation docs
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-05-30 13:29:42 -07:00
Noah Watkins
743c528754 doc: Hadoop clarifications
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-05-30 13:29:42 -07:00
John Wilkins
7c497d95db doc: Added troubleshooting to Ceph FS index.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-05-23 17:01:51 -07:00
John Wilkins
3dda794a66 doc: Added separate troubleshooting for MDS and Ceph FS.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-05-23 17:01:29 -07:00
John Wilkins
decf342c26 doc: Minor improvements to Ceph FS landing page.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-05-17 15:56:59 -07:00
John Wilkins
7494e4eb6b doc: Omitted literal syntax from toc.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-05-16 23:10:54 -07:00
John Wilkins
381ad24d09 doc: Added fuse syntax to the fstab doc.
fixes: #3672

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-05-16 23:10:32 -07:00
John Wilkins
3d9bc46945 doc: Added ceph-mds to CephFS toc.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-04-28 14:57:03 -07:00
John Wilkins
ba73b8301a doc: Cleanup.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-03-29 17:32:00 -07:00
John Wilkins
1d33436043 doc: Added instructions for ensuring ceph config file and keyring prior to mounting ceph fuse.
fixes: #3796

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-03-04 10:59:18 -08:00
Noah Watkins
c036dc7c90 doc: fix command syntax
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-02-12 15:36:19 -08:00
Noah Watkins
f923c8cd77 doc: document hadoop replication config
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-02-11 17:49:35 -08:00
John Wilkins
38dd59ba7c doc: Removed unnecessary/contradictory options.
fixes: #4058

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-02-08 13:27:58 -08:00
Noah Watkins
3583684776 doc: update Hadoop documentation
Updates configuration option names, and adds object.size,
localize.reads, and root.dir control options.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2012-12-28 17:19:31 -08:00
Sage Weil
9da6d88291 doc: document mds config options
Signed-off-by: Sage Weil <sage@inktank.com>
2012-12-27 09:33:27 -08:00
Sage Weil
916d1cf607 doc: journaler config options
Signed-off-by: Sage Weil <sage@inktank.com>
2012-12-26 17:34:12 -08:00
John Wilkins
2bf4f42b6d doc: Added new journaler page to CephFS section. Needs descriptions.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-12-21 16:14:53 -08:00
John Wilkins
53afac1a21 doc: Added Journaler Configuration to toc tree.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-12-21 16:14:23 -08:00
John Wilkins
f2c7a60c90 doc: Fixed many hyperlinks, a few typos, and some minor clarifications.
fixes: #3564

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-12-03 12:22:37 -08:00
John Wilkins
9ea2609ea0 doc: Added libcephfs to the CephFS section and moved librbd to RBD section.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-11-16 14:56:46 -08:00
Noah Watkins
22cb13565c doc: add Hadoop configuration parameters
fs.ceph.block.size and fs.ceph.replication.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2012-11-15 14:03:36 -08:00
John Wilkins
0a2a0c075c doc: config-cluser move to new IA.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-11-14 14:57:51 -08:00
Noah Watkins
52bada57de doc: fix Hadoop config option typo
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2012-11-07 17:07:55 -08:00
Noah Watkins
132fb3413c doc: describe Hadoop configuration options
Start a document describing Ceph integration with Hadoop, and adds a
description of configuration options that the CephFileSystem shim will
accept.
2012-11-04 06:19:29 -08:00
Sage Weil
251649cdfa doc: remove cephfs warning
Signed-off-by: Sage Weil <sage@inktank.com>
2012-10-13 20:13:35 -07:00
John Wilkins
78439e96b8 doc: Fixed hyperlink.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-23 21:51:43 -07:00
John Wilkins
873ccdfe2c doc: Fixed hyperlink.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-23 21:51:26 -07:00
John Wilkins
d233271434 doc: Added admonishments for Ceph FS per http://tracker.newdream.net/issues/3077
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-09-04 16:17:29 -07:00
John Wilkins
07169d2e43 doc: Added mount cephfs with fstab.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-06-07 11:35:37 -07:00
John Wilkins
87327c2d5c doc: Added mount cephfs and included it in quick start.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2012-06-06 10:45:26 -07:00