Commit Graph

430 Commits

Author SHA1 Message Date
Venky Shankar
2132cf6ee0
Merge pull request #34210 from kotreshhr/cephfs-subvolume-info
mgr/volumes: Add interface to get subvolume metadata
2020-04-16 18:38:08 +05:30
Sebastian Wagner
62abead9bd
Merge pull request #32297 from varshar16/wip-mgr-nfs-ganesha-exports
Create and delete exports for nfs ganesha with mgr volume 

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-11 21:22:56 +02:00
Kefu Chai
0cb56e0f13 doc: use plantweb as fallback of sphinx-ditaa
RTD does not support installing system packages, the only ways to install
dependencies are setuptools and pip. while ditaa is a tool written in
Java. so we need to find a native python tool allowing us to render ditaa
images. plantweb is able to the web service for rendering the ditaa
diagram. so let's use it as a fallback if "ditaa" is not around.

also start a new line after the directive, otherwise planweb server will
return 500 at seeing the diagram.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-10 08:38:06 +08:00
Kotresh HR
70659ffee1 mgr/volumes: Add interface to get subvolume metadata
The following interface is added

"ceph fs subvolume info <vol_name> <sub_name> [<group_name>]"

The output is in json format with following fields

1. atime: access time of subvolume path in the format "YYYY-MM-DD HH:MM:SS"
2. mtime: modification time of subvolume path in the format "YYYY-MM-DD HH:MM:SS"
3. ctime: change time of subvolume path in the format "YYYY-MM-DD HH:MM:SS"
4. uid: uid of subvolume path
5. gid: gid of subvolume path
6. mode: mode of subvolume path
7. mon_addrs: list of monitor addresses
8. bytes_pcent: quota used in percentage if quota is set, else displays "undefined"
9. bytes_quota: quota size in bytes if quota is set, else displays "infinite"
10. bytes_used: current used size of the subvolume in bytes
11. created_at: time of creation of subvolume in the format "YYYY-MM-DD HH:MM:SS"
12. data_pool: data pool the subvolume belongs to
13. path: absolute path of a subvolume
14. type: subvolume type indicating whether it's clone or subvolume

Fixes: https://tracker.ceph.com/issues/44277
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-04-09 15:24:50 +05:30
Varsha Rao
25642bcf50 mgr/volumes: Make cluster id option mandatory in nfs create export
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-04-08 17:21:17 +05:30
Varsha Rao
a84d4b0124 mgr/volumes: Update nfs cluster and export interface
Instead of prefixing 'fs' to the commands, type is added for easy extension to
create rgw exports.

$ ceph nfs cluster create <type=cephfs> [--size=1] <clusterid>
$ ceph nfs export create <type=cephfs> <fsname> <binding> [--readonly] [--path=/path/in/cephfs] [--attach=<clusterid>]

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-04-08 17:21:17 +05:30
Varsha Rao
765cafdb61 vstart: Use "NFS" instead "GANESHA" for starting nfs ganesha clusters
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-04-08 17:21:17 +05:30
Varsha Rao
48c8e8b546 doc: Add document about fs nfs interface to create CephFS exports
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-04-08 17:21:09 +05:30
Kefu Chai
c0615a4d27
Merge pull request #33911 from tchaikov/wip-cephfs-doc
pybind/cephfs, doc: add python binding doc

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-03-24 23:01:16 +08:00
Sage Weil
6cb39e4aa8 Merge PR #34060 into master
* refs/pull/34060/head:
	Merge PR #34027 into octopus
	Merge PR #34045 into octopus
	Merge pull request #34035 from dillaman/wip-rbd-permissions
	mgr/progress: fix duration strings
	Merge PR #34014 into octopus
	Merge PR #34001 into octopus
	Merge PR #34011 into octopus
	qa/workunits/rbd: use context managers to control Rados lifespan
	Merge pull request #34032 from dillaman/wip-rbd-octopus-docs
	doc/releases/octopus: add additional RBD improvements
	qa/workunits/cephadm/test_cephadm: mark services unmanaged for test
	mgr/cephadm: do not reconfig unmanaged services
	Merge PR #33981 into octopus
	Merge pull request #34018 from ajarr/octopus-subvolume-clone-cancel
	qa/workunits/cephadm/test_cephadm: output file for pub key
	Merge PR #33866 into octopus
	Merge PR #34005 into octopus
	Merge PR #34013 into octopus
	mgr/cephadm: pytest: Enable SpecStore
	mgr/orchestrator: add test for default implementation for apply()
	python-common: validate ServiceSpec.service_type
	fixup mgr/cephadm: Fix ceph orch apply -i
	mgr/dashbaord: orchestrator service: Revert wait_api_result to a single completion
	mgr/orchestrator: `orch daemon add` accepts a yaml
	mgr/cephadm: apply_drivegroups() returns a single Completion
	mgr/cephadm: remove `trivial_result()`
	mgr/cephadm: Fix `ceph orch apply -i`
	Merge pull request #33994 from dillaman/wip-librbd-poll-event-race
	doc: document `clone cancel` command
	test: add `clone cancel` tests
	mgr/volumes: introduce "clone cancel" volume command
	mgr/volumes: allow canceling a single asynchronous job for a volume
	mgr/volumes: helper for looking up a clone entry index
	mgr/volumes: periodically check if clone operations should be canceled
	mgr/volumes: periodically check if copy operations should be canceled
	mgr/volumes: introduce 'canceled' state in clone op state machine
	qa/suites/rados/verify/validater/valgrind: tolerate SLOW_OPS
	qa/suites/rados/verify/validater/valgrind: less bluestore logging
	qa/suites/rados/verify/validater: increase heartbeat grace
	Revert "qa/suites/rados/verify: debug_ms = 1, osd_heartbeat_grace = 60"
	Revert "qa/suites/rados/verify/validator/valgrind: debug refs = 5"
	ceph_test_watch_notify: try notify 10x if ALLOW_TIMEOUTS is set
	ceph_test_rados_api_misc: ShutdownRace timeout if ALLOW_TIMEOUTS is set
	qa/suites/rados/verify: set ALLOW_TIMEOUTS for workunits
	doc/install: edits
	doc/cephadm: more edits
	doc/cephadm/install: edits
	doc/cephadm/adoption: improvements
	doc/cephadm/install: a few edits
	doc/cephadm/install: do not install ceph-common on host (by default)
	doc/cephadm: drop os recs link
	doc/cephadm/upgrade: improvements
	doc/cephadm/upgrade: document upgrade
	doc/cephadm/install: revamp install docs
	doc: reorganize cephadm docs
	doc/cephadm/administration: update docs on customizing SSH config
	doc/cephadm/administration: add a note about the 'removed' dir
	mgr/balancer: tolerate pgs outside of target weight map
	qa/workunits/cephadm/test_cephadm: --skip-monitoring-stack
	Merge PR #33974 into octopus
	Merge PR #33442 into octopus
	Merge PR #33997 into octopus
	Merge PR #34000 into octopus
	use quay octopus tip until 15.2 tag is available
	python-common: reduce output of ServiceSpec.to_json()
	python-common,mgr/cephadm: move assert_valid_host to service_spec
	mgr/cephadm: add HostAssignment.validate()
	mgr/dashboard: adapt create_osds interface change
	mon/MgrMonitor: make 'mgr fail' work with no arguments
	cephadm: add allow_ptrace option to enable SYS_PTRACE
	update default container images
	mgr/cephadm: limit number of times check host is performed in the serve loop
	Merge PR #33961 into octopus
	Merge PR #33952 into octopus
	Merge PR #33990 into octopus
	Merge PR #33955 into octopus
	Merge PR #33936 into octopus
	mgr/orch: add --all-available-devices to 'orch apply osd'
	qa/workunits/cephadm: --skip-mon-network when using 127.0.0.1
	cephadm: add tests
	qa/tasks/cephadm: pass -v to bootstrap
	mgr/cephadm: only try to place mons on hosts matching public_network
	mgr/cephadm: keep track of host networks, ips
	cephadm: automatically infer mon public_network, if we can
	cephadm: add list-networks command
	cephadm: bootstrap: deploy monitoring stack by default
	librbd: defer event socket completion until after callback issued
	cephadm: add-repo: add --version
	mgr/cephadm: respect 'unmanaged' flag in spec
	mgr/orch: orch ls: show <no spec> or <unmanaged> as appropriate
	mgr/orch: orch ls: rename SPEC -> PLACEMENT
	mgr/orch: add 'unmanaged' property to ServiceSpec
	cephadm: rename distro args in repo methods
	mgr/orch: combine 'orch daemon add <type> ...' into one command
	mgr/orch: combine 'orch apply <type> [<placement>]' into one command

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-03-19 11:07:16 -05:00
Venky Shankar
60105f6101 doc: document clone cancel command
Fixes: http://tracker.ceph.com/issues/44208
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:03:21 +05:30
Kefu Chai
7357fde070 doc/cephfs: add python binding doc
and restructure cephfs/api to move the javadoc for cephfs to this
directory

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-12 18:46:48 +08:00
Sean Fang
ab772c562a doc: Fix three link errors about mount cephfs
Some links about mount cephfs did not jump to the right place.

Signed-off-by: Sean Fang <silence.boy@live.cn>
2020-03-12 16:35:23 +08:00
Ramana Raja
8034044f94
Merge pull request #33120 from vshankar/wip-mgr-volumes-clone-sync-attrs
mgr/volumes: sync inode attributes for cloned subvolumes

Reviewed-by: Ramana Raja <rraja@redhat.com>
2020-03-03 16:13:34 +05:30
Patrick Donnelly
4e90fbbcdf
Merge PR #33491 into master
* refs/pull/33491/head:
	mount.ceph: add "fs=<fs_name>" mount options support

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-03-02 16:59:51 -08:00
Venky Shankar
33f6263e5f doc: update clone section for mgr/volumes w/ attr synchronization changes
Fixes: http://tracker.ceph.com/issues/43965
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-02-28 11:42:17 -05:00
Xiubo Li
1a58e64299 client: add client_fs mount option support
"client_fs" is one alias for "client_mds_namespace=" and it will be
cleaner and be more user-friendly to use. "client_mds_namespace="
will be kept and backwards compatibility used.

Update the documents at the same time.

Fixes: https://tracker.ceph.com/issues/44212
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-02-27 19:30:31 -05:00
Xiubo Li
7367382ef2 mount.ceph: add "fs=<fs_name>" mount options support
"fs" is one alias for "mds_namespace=" and it will be cleaner and
be more user-friendly to use. The "fs" will be translated to
"mds_namespace" before sending it to kernel space.

And the "mds_namespace" will be deprecated to use any more.
Update the documents at the same time.

Fixes: https://tracker.ceph.com/issues/44214
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-02-25 21:37:56 -05:00
Daniel-Pivonka
2fe4f88ba0 mgr/volumes: add arg to fs volume create for mds daemons placement
add placement arg for mds daemons created by fs volume create

Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
2020-02-20 14:46:17 -05:00
Sebastian Wagner
59d54f3df1 doc: rename orchestrator_cli -> orchestrator
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-17 10:24:01 +01:00
Patrick Donnelly
2e916037f4
doc: add section on new mds_join_fs behavior
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-13 07:51:10 -08:00
Sage Weil
20205e70c4 mgr/orch: 'ceph orchestrator ...' -> 'ceph orch ...'
Less typing for all!

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 15:39:57 -06:00
Patrick Donnelly
29d850fb7e
Merge PR #32570 into master
* refs/pull/32570/head:
	cephfs-shell: Add tests for setxattr, getxattr and listxattr
	cephfs-shell: Add listxattr command
	cephfs-shell: Add getxattr command
	cephfs-shell: Add setxattr command
	doc: Update about extended attributes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:56:50 -08:00
Venky Shankar
97f875bb32 doc: add mgr/volumes clone commands
Fixes: http://tracker.ceph.com/issues/24880
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Gregory Farnum
548fc13549 doc: remove the CephFS-Hadoop instructions
These have not aged gracefully, and in particular include instructions
for setting pool size 1 to let Hadoop control the replication — but I've
heard reports of users setting up multiple size-1 pools and then wondering
where their data went when an OSD dies.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2020-01-30 03:14:45 -08:00
Varsha Rao
90f79ed87f doc: Update about extended attributes
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-30 01:16:27 +05:30
Patrick Donnelly
c74a261e5b
Merge PR #32522 into master
* refs/pull/32522/head:
	doc/cephfs: improve wording in mount-prerequisites.rst
	doc: migrate best practices recommendations to relevant docs
	doc/cephfs: rename doc/cephfs/kernel.rst & doc/cephfs/fuse.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-21 15:15:12 -08:00
Ilya Dryomov
267c00012a doc/cephfs/client-auth: description and example are inconsistent
According to the path restriction example, the filesystem name
should be cephfs_a, not cephfs.  Converge on cephfs_a to avoid it
being confused with with the pool tag, which is always cephfs.

This was introduced in 160c4bfeb8 ("mon/AuthMonitor: Use new osd
auth caps for ceph fs authorize").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-21 19:57:09 +01:00
Rishabh Dave
07cd0e7d31 doc/cephfs: improve wording in mount-prerequisites.rst
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-21 14:44:02 +05:30
Rishabh Dave
7067776658 doc: migrate best practices recommendations to relevant docs
Also, move the common part from "Mount using FUSE" doc and "Mount using
kernel" doc to "Mount CephFS" page to avoid repetitions.

Fixes: https://tracker.ceph.com/issues/43154
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-21 14:42:18 +05:30
Rishabh Dave
f6ea1ca36f doc/cephfs: rename doc/cephfs/kernel.rst & doc/cephfs/fuse.rst
Rename to mount-using-kernel.rst and mount-using-fuse.rst respectively
so that it's easier to find them in doc/cephfs directory.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-20 10:32:06 +05:30
Patrick Donnelly
47d8515975
Merge PR #32498 into master
* refs/pull/32498/head:
	doc: mounting CephFS subdirectory and Persistent Mounts cleanup

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:42:05 -08:00
Patrick Donnelly
7fde99ac06
Merge PR #32015 into master
* refs/pull/32015/head:
	doc/cephfs/standby: document mds_join_fs
	mgr/cephadm: map mds daemons to a particular fs
	mon/MDSMonitor: respect mfs fscid preference
	mon/MDSMonitor: assign standbys to their preferred fscid
	mds/FSMap: track preferred fscid for standby daemons
	mds: add mds_join_fs option; pass via MMDSBeacon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:29:50 -08:00
Jos Collin
1033d5b373
doc: mounting CephFS subdirectory and Persistent Mounts cleanup
Fixes: https://tracker.ceph.com/issues/37746
Signed-off-by: Jos Collin <jcollin@redhat.com>
2020-01-06 18:33:26 +05:30
Jos Collin
9f4a20e653
doc: fix Getting Started with CephFS
Signed-off-by: Jos Collin <jcollin@redhat.com>
2020-01-02 12:04:50 +05:30
Patrick Donnelly
1949ddf0e2
Merge PR #32117 into master
* refs/pull/32117/head:
	doc: add config help/get/set section for runtime client configuration

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-19 11:59:24 -08:00
Jos Collin
f35d03a037
doc: update '--force' flag to be precise
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-12-19 12:09:34 +05:30
Sage Weil
9aa25d7df8 doc/cephfs/standby: document mds_join_fs
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-18 14:00:42 -06:00
Jos Collin
cb7614adea
doc: update 'adding an MDS'
Fixes: https://tracker.ceph.com/issues/43162
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-12-17 16:11:27 +05:30
Venky Shankar
6373f8c763 doc: add config help/get/set section for runtime client configuration
Fixes: http://tracker.ceph.com/issues/41688
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-12-17 04:52:16 -05:00
Patrick Donnelly
0efa73f029
mds: update default MDS cache size memory limit
1GB is too low as a default and usually results in cache size warnings
at that size; the MDS will struggle to maintain such a small cache size
for most workloads.

Fixes: https://tracker.ceph.com/issues/43182
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-11 15:28:57 -08:00
Patrick Donnelly
2216c63ed5
Merge PR #31729 into master
* refs/pull/31729/head:
	qa: reduce cache size further
	mds: obsoleting 'mds_cache_size'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-11 09:44:27 -08:00
Patrick Donnelly
4635f943cd
Merge PR #32124 into master
* refs/pull/32124/head:
	doc/cephfs/disaster-recovery-experts: Add link for scrub and note for scrub_path

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-09 19:52:41 -08:00
Patrick Donnelly
b8635afe10
Merge PR #32038 into master
* refs/pull/32038/head:
	doc: reorganize CephFS landing page and ToC

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2019-12-09 16:36:59 -08:00
Varsha Rao
f6241d1c07 doc/cephfs/disaster-recovery-experts: Add link for scrub and note for scrub_path
Fixes: https://tracker.ceph.com/issues/22204
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-12-09 18:17:41 +05:30
Patrick Donnelly
7141cf6db9
doc: reorganize CephFS landing page and ToC
Fixes: https://tracker.ceph.com/issues/42016
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-06 12:15:52 -08:00
Patrick Donnelly
45907ee258
Merge PR #31897 into master
* refs/pull/31897/head:
	doc: obsolete entries for allow_standby_replay
	wip-doc: entries obsoleted by allow_standby_replay

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-05 16:05:59 -08:00
Rodrigo Severo
2ee56b6a68 doc: obsolete entries for allow_standby_replay
Nautilus release presented the allow_standby_replay fs setting that obsdoleted
several MDS config entries:  mds_standby_for_*, mon_force_standby_active, and
mds_standby_replay.

Removing entries instead of just marking them as "Obsolete' as per batrick
suggestion.

Signed-off-by: Rodrigo Severo <rodrigo@fabricadeideias.com>
2019-12-05 13:41:33 -03:00
Ramana Raja
aeaef1b4c5 mds: obsoleting 'mds_cache_size'
Remove last bits of support for 'mds_cache_size'.
'mds_cache_memory_limit' is preferred.

Fixes: https://tracker.ceph.com/issues/41951
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-12-02 14:51:25 +05:30
Yan, Zheng
eb57c3b6f2 doc: add description for fuse_disable_pagecache
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/16300
2019-11-27 14:44:44 +08:00