Commit Graph

590 Commits

Author SHA1 Message Date
Rishabh Dave
a96a32bd2e doc/ceph-fuse: mention -k option in ceph-fuse man page
Fixes: https://tracker.ceph.com/issues/42044
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-25 12:21:20 +05:30
Sage Weil
7b988e9fe1 doc: remove all pg_num arguments to 'osd pool create'
Also, update the dicussion about pg_num and pool creation, with a reference
to the autoscaler.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-22 16:58:33 -05:00
Vikhyat Umrao
ae9a24eaba tools/rados: add --pgid in help
This commit 825c7b9729b2410a116e123d4b21210c646704d4 brought
the support for --pgid in rados ls but was not in help.
Fixes: https://tracker.ceph.com/issues/41876

Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>
2019-09-17 14:07:12 -07:00
Patrick Donnelly
10cb50f994
Merge PR #29817 into master
* refs/pull/29817/head:
	doc: document that the kcephfs mount helper will search keyring files for secrets
	mount.ceph: fork a child to get info from local configuration
	mount.ceph: track mon string and path inside ceph_mount_info
	mount.ceph: add name and secret to ceph_mount_info
	mount.ceph: add ceph_mount_info structure
	mount.ceph: clean up debugging output and error messages
	mount.ceph: clean up return codes
	mount.ceph: add comment explaining why we need to modprobe
	mount.ceph: use bools for flags
	common: have read_secret_from_file return negative error codes

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-16 16:49:39 -07:00
Andreas Krebs
76d3671d03 doc: Add missing ceph-volume lvm batch argument to ceph-volume.rst
The optional argument '--osds-per-device' is missing. Since this is quite helpful when creating NVMe based OSDs, it should be documented.

Signed-off-by: Andreas Krebs <wintamute@gmail.com>
2019-09-13 08:27:53 -04:00
Jeff Layton
eae0127513 mount.ceph: fork a child to get info from local configuration
When a secret and/or the mon addrs are not specified by the admin,
then mmap a MAP_SHARED buffer and spawn a child process to get that
info. For safety reasons, the child drops all capabilities other than
CAP_DAC_READ_SEARCH (to ensure that it'll be able to read the keyring,
should one be found). To achieve this, we add a new dependency on
libcap-ng.

Add a new C++ file with a single routine that will create a CephContext,
get a list of monitor addresses and scrape the keyring for a secret for
the specified cephx user.

If that info is found, then it is copied to fixed-length buffers in the
MAP_SHARED area and the child exits successfully.

The parent will then vet the returned info and copy it into the
appropriate fields if they are currently blank.

Fixes: https://tracker.ceph.com/issues/16656
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-13 08:14:48 -04:00
Patrick Donnelly
e7a7cf429e
doc: filesystem to file system
"Filesystem" is not a word (although fairly common in use).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-10 08:43:28 -07:00
Josh Durgin
70621ae1a3
doc/man/ceph-kvstore-tool: fix typo
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2019-09-03 15:47:30 -07:00
Adam Kupczyk
00a5633af8 doc/ceph-kvsore-tool: add description for 'stats' command
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-09-03 11:00:09 +02:00
Luca Castoro
046f5990c3 doc/man/8/monmaptool: document the --addv argument.
Fixes: http://tracker.ceph.com/issues/40568
Signed-off-by: Luca Castoro <luca.castoro@brightcomputing.com>
2019-08-27 17:47:13 +08:00
Casey Bodley
17fc695047
Merge pull request #28813 from smanjara/wip-user-rename-working
rgw : Bucket mv, bucket chown and user rename utilities

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-08-07 16:05:07 -04:00
Neha Ojha
c9d2833b25
Merge pull request #29425 from aclamk/wip-bluestore-monitor-allocations
[bluestore][tools] Inspect allocations in bluestore

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-07 11:37:34 -07:00
Adam Kupczyk
e7f5e53cde tools/ceph-bluestore-tool: add commands free-dump and free-score
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-08-02 13:57:06 +02:00
Ricardo Marques
029dade640 doc: Fix rbd namespace documentation
Pool and namespace should be separated by a slash.

Fixes: https://tracker.ceph.com/issues/41046

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-08-01 15:45:24 +01:00
Mark Kogan
b0f6946a85 rgw: add option to specify shard-id for "bi list" admin command
related to: https://tracker.ceph.com/issues/40700
Signed-off-by: Mark Kogan <mkogan@redhat.com>
2019-07-30 08:55:07 -04:00
Shilpa Jagannath
be2b7e6b01 This commit deals with renaming user. Under the hood, the attributes of an
existing user are moved under the new user namespace specified by "--new-uid".
It calls bucket link and bucket chown to link the buckets and objects to the new
user namespace. Access and secret keys of the user(and the subusers) are preserved.

Usage: "radosgw-admin user rename --uid=<> --new-uid=<>"

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2019-07-30 14:00:45 +05:30
Shilpa Jagannath
6dc48620a1 Documentation for 'bucket chown'
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2019-07-30 14:00:45 +05:30
Marcus Watts
ea24c7fb66 rgw: bucket link: "bucket move" documentation changes
Improve and add to documentation for "bucket move" functionality;
including use moving to multi-tenancy and further deprecating bucket-id
which is no longer necessary.

Fixes: http://tracker.ceph.com/issues/35885

Signed-off-by: Marcus Watts <mwatts@redhat.com>
2019-07-30 14:00:45 +05:30
Marcus Watts
7f4cc1d21b Add "--bucket-new-name" option to radosgw-admin.
This just adds the command line option and related bits.

Underlying functionality will be a later commit.

Fixes: http://tracker.ceph.com/issues/35885

Signed-off-by: Marcus Watts <mwatts@redhat.com>
2019-07-30 14:00:45 +05:30
Jason Dillaman
cb02fb534d doc/man: note that rbd-fuse is not intended for production workloads
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-19 09:50:55 -04:00
J. Eric Ivancich
12452c4a91 rgw: allow radosgw-admin to list bucket w --allow-unordered
Presently the `radosgw-admin bucket list --bucket=<bucket>` lists the
objects in lexical order. This can be an expensive operation since
objects are not stored in bucket index shards in order and a selection
sort process is done across all bucket index shards.

By allowing the user to add the "--allow-unordered" command-line flag,
a more efficient bucket listing is enabled. This is particularly
important for buckets with a large number of objects.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-09 09:29:05 -04:00
Yuan Zhou
ebd017e37e building: adding missing ceph-immtable-object-cache-dbg rule
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2019-03-22 00:17:07 +08:00
Yuan Zhou
9466d70985 build/ops: adding build spec for immutable object cache daemon
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2019-03-22 00:16:26 +08:00
Andrew Schoen
f7943ef600 ceph-volume: update docs and help menu for simple scan
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2019-03-08 09:58:59 -06:00
Sage Weil
d2d127d806 Merge PR #26027 into master
* refs/pull/26027/head:
	osd,mon,mds: support get|set tcmalloc release rate

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-07 06:32:30 -06:00
Patrick Donnelly
1f5892f820
Merge PR #26638 into master
* refs/pull/26638/head:
	doc: update documentation for standby-replay
	qa: update discontinous map test to use mds freezing
	mon: add freeze MDS command
	qa: update testing for standby-replay
	mon: add setting for fs to enable standby-replay
	ceph-mds: obsolete hot-standby option
	fs: obsolete standby_for config options
	messages/MMDSBeacon: use inline init
	mds: avoid unnecessary copy of entity_addrvec_t
	mds: use inline init for mds_info_t
	mds: use rank from MDSMap always
	mds: remove obsolete comment
	qa: use SIGTERM when stopping vstart service

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-02-28 20:37:13 -08:00
Patrick Donnelly
80eece89a4
ceph-mds: obsolete hot-standby option
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-27 21:38:25 -08:00
Changcheng Liu
2ef3243121 doc: use preferred commands for ceph config-key
'del' & 'list' & 'put' are deprecated. It's preferred to
using 'rm' & 'ls' & 'set' for ceph config-key

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-02-26 09:01:14 +08:00
Sage Weil
1b52c723f8 Merge PR #26487 into master
* refs/pull/26487/head:
	CLI: ability to change file ownership

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-25 08:43:57 -06:00
Jason Dillaman
65c8733b56 librados: revert librados3/libradoscc back to librados2
For backwards compatibility and upgrade reasons, the librados2
API needs to be preserved and it needs to continue to be compatible
with dependent libraries like librbd1.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-02-20 14:59:26 -05:00
Sébastien Han
0e26090960 CLI: ability to change file ownership
When creating/fetching key it's nice to have the ability to change the
ownership of the created file.

This commit adds the '--setuser' and 'setgroup' which respectively apply
the desired owner and group to a file user when '--output' is passed.

Closes: https://tracker.ceph.com/issues/38370
Signed-off-by: Sébastien Han <seb@redhat.com>
2019-02-19 11:00:49 +01:00
Mykola Golub
be2cdc0bcf rbd: online re-sparsify of images
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-02-15 11:12:00 +00:00
Zengran Zhang
7e421d78a9 osd,mon,mds: support get|set tcmalloc release rate
Signed-off-by: Zengran Zhang <zhangzengran@sangfor.com.cn>
2019-02-12 10:03:05 +08:00
Ilya Dryomov
fa32d97a9f rbd: recognize alloc_size map option
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-01 17:59:38 +01:00
Marc Schoechlin
fca5ef8aba common: fix for broken rbdmap parameter parsing
This improves the broken parameter parsing discussed in #36327

Test expression for the parsing function:

PARAMS="options='lock_on_read,queue_depth=1024',id=archiv,keyring=/etc/ceph/ceph.client.archiv.keyring"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS="id=archiv,keyring=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024'"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS=""
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS=",keyring=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024',id=archiv,"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS="'keyring'=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024',id=archiv,"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

PARAMS="--keyring=/etc/ceph/ceph.client.archiv.keyring,options='lock_on_read,queue_depth=1024',id=archiv, # a comment"
echo -e " ORIGINAL PARAM: >>>$PARAMS<<<\nCONVERTED PARAM: >>>$(create_cmd_params "$PARAMS")<<<"

Fixes: https://tracker.ceph.com/issues/36327
Signed-off-by: Marc Schoechlin <ms@256bit.org]>
2019-01-14 14:29:59 -05:00
Ilya Dryomov
fce08ffbab
Merge pull request #25662 from yangdongsheng/abort_on_full
rbd: introduce abort_on_full option for rbd map

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2019-01-12 10:29:56 +01:00
Dongsheng Yang
5639a8b187 rbd: introduce abort_on_full option for rbd map
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2019-01-12 03:42:15 -05:00
Sage Weil
251f667ef8 Merge PR #25009 into master
* refs/pull/25009/head:
	librbd: stringify locker name with get_legacy_str()
	osdc/Objecter: fix list_watchers addr rendering to match legacy
	test/crimson: disable unittest_seastar_messenger test
	msg/msg_types: encode entity_addr_t TYPE_ANY as TYPE_LEGACY for pre-nautilus
	client: make blacklist detection handle TYPE_ANY entries
	mon/OSDMonitor: maintain compat output for 'blacklist ls'
	client: maintain compat for {inst,addr}_str in status dump
	qa/tasks/ceph_manager: compare osd flush seq #'s as ints
	qa/suites/fs: make use of simple.yaml where appropriate
	qa/msgr: move msgr factet into generic re-usable dir
	crimson: fix monmap build for seastar
	doc/start/ceph.conf: trim the sample ceph.conf file
	doc/rados/operations: only describe --public-{addr,network} method for adding mons
	PendingReleaseNotes: deprecate 'mon addr'
	doc: fix some 'mon addr' references
	doc/rados/configuration: fix some 'mon addr' references
	doc/rados/configuration/network-config-ref: revise network docs somewhat
	doc/rados/configuration/network-config-ref: remove totally obsolete section
	qa/suites/rados: replace mon_seesaw.py task with a small bash script
	qa/suites/fs/upgrade: don't bind to v2 addrs
	qa/tasks/mon_thrash: avoid 'mon addr' in mon section
	mon/MonClient: disable ms_bind_msgr2 if NAUTILUS feature not set
	osd/OSDMap: maintain compat addr fields
	msg/msg_types: add get_legacy_str()
	mds/MDSMap.h: maintain compat addr field
	mon/MgrMap: maintain compat active_addr field
	mon/MonClient: reconnect to mon if it's addrvec appears to have changed
	qa/tasks/ceph.conf.template: increase mon_mgr_mkfs_grace
	msg/async/ProtocolV2: fill in IP for all peer_addrs
	msg/async: print all addrs on debug lines
	mon/MonMap: no noname- mon name prefix when for_mkfs
	ceph-monstore-tool: print initial monmap
	msg/async/ProtocolV2: advertise ourselves as a v2 addr when using v2 protocol
	msg/async: assert existing protocol matches current protocol
	msg/async: add missing modelines
	mon/MonMap: add missing modeline
	vstart.sh: put mon addrs in mon_host, not 'mon addr'
	msg/async: better debug around conn map lookups and updates
	mon/MonClient: dump initial monmap at debug level 10
	qa/standalone/osd/osd-fast-mark-down: use v1 addr w/ simplemessenger
	qa/tasks/ceph: set initial monmap features with using addrvec addrs
	monmaptool: add --enable-all-features option
	qa/tasks/ceph: only use monmaptool --addv if addr has [,:v]
	qa/tasks/ceph_manager: make get_mon_status use mon addr
	qa/tasks/ceph: keep mon addrs in ctx namespace
	mon/OSDMonitor: log all osd addrs on boot
	msg/simple: behave when v2 and v1 addrs are present at target
	mon/MonClient: warn if global_id changes
	msg/Connection: add warning/note on get_peer_global_id
	mds/MDSDaemon: clean up handle_mds_map debug output a bit
	qa/suites/rados/upgrade: debug mds
	mds/MDSRank: improve is_stale_message to handle addrvecs
	msg/async: make loopback detect when sending to one of our many addrs
	qa/suites/rados/upgrade: no aggressive pg num changes
	mon/OSDMonitor: require nautilus mons for require_osd_release=nautilus
	mon/OSDMonitor: require mimic mons for require_osd_release=mimic
	qa/suites/rados/thrash-old-clients: use legacy addr syntax in ceph.conf
	msg/async: preserve peer features when replacing a connection
	qa/tasks/ceph.py: move methods from teuthology.git into ceph.py directly; support mon bind * options
	mon/MonMap: adjust build_initial behavior for mkfs vs probe
	mon/MonMap: improve ambiguous addr behavior
	qa/suites/rados/upgrade: spread mons a bit
	qa/rados/thrash-old-clients: keep mons on separate hosts
	qa/standalone/mon/misc.sh: tweak test to be more robust
	qa/tasks/mon_seesaw: expect v1/v2 prefix in addr
	osd/OSDMap: fix is_blacklisted() check to assume type ANY
	mon/OSDMonitor: use ANY addr type for blacklisting
	mon/msg_types: TYPE_V1ORV2 -> TYPE_ANY
	qa/workunits/cephtool: fix blacklist test
	qa/suites/upgrade: install old version with only v1 addrs
	common/options: by default, bind to both msgr v1 and v2 addresses
	vstart.sh: add --msgr1, --msgr2, --msgr21 options
	msg/async/ProtocolV2: be flexible with server identity check
	msg/msg_types: fix entity_addrvec_t::parse() with null end arg
	qa/suites/rados/basic/msgr: no msgr2 addrs in initial monmaps
	qa/tasks/ceph: add 'mon_bind_addrvec' and 'mon_bind_msgr2' options
	monmaptool: add --addv argument to pass in addrvec directly
	qa/suites/rados/basic/msgr: do not use msgr2 with simplemessenger
	qa/suites/rados/basic/msgr: async is not experimental
	messages/MOSDBoot: fix compat with pre-nautilus
	mon/MonMap: allow v1 or v2 to be explicitly specified along with part
	msg/msg_types: allow parsing of IPs without assuming v1 vs v2
	msg/msg_types: default parse to v2 addrs
	msg: standarize on v1: and v2: prefixes for *all* entity_addr_t's
	vstart.sh: use msgr2 by default
	mon/MonMap: remove get_addr() methods
	ceph-mon: adjust startup/bind/join sequence to use addrs
	mon: use MonMap::get_addrs() (instead of get_addr())
	mon/MonClient: change pending_cons to addrvec-based map
	mon/MonMap: fix set_addr() caller, kill wrapper
	mon/MonMap: remove addr-based add()
	monmaptool: fix --add to do either legacy or msgr2+legacy
	monmaptool: clean up iterator use a bit
	mon/MonMap: handle ambiguous mon addrs by trying both legacy and msgr
	mon/MonMap: take addrvec for set_initial_members
	mon/MonMap: use addrvecs for test instances
	mon: pass addrvec via MMonJoin
	mon/MonmapMonitor: fix 'mon add' to populate addrvec
	mon/MonMap: addr -> addrvec
	msg/async/ProtocolV2: only update socket_addr if we learned our addr
	osd: go active even if mon only accepted our v1 addr
	test/msgr: add test for msgr2 protocol
	msg/async/ProtocolV2: share socket_addr and all addrs during handshake
	msg/async: print socket_addr for the connection
	msg/async: msgr2 protocol placeholder
	msg/async: move ProtocolV1 class to its own source file
	msg/async: keep listen addr in ServerSocket, pass to new connections
	msg/async/AsyncMessenger: fix set_addr_unknowns

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-01-04 13:42:09 -06:00
Sage Weil
8e2fcae16e doc: fix some 'mon addr' references
Signed-off-by: Sage Weil <sage@redhat.com>
2019-01-03 11:17:31 -06:00
Greg Farnum
71a8605762 doc: warn about how 'rados put' works in the manpage
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2019-01-02 15:00:25 -08:00
Alfredo Deza
1ceef08d07
Merge pull request #25429 from alfredodeza/wip-bz1644847
ceph-volume zap devices associated with an OSD ID and/or OSD FSID

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Reviewed-by: Sebastien Han <shan@redhat.com>
2018-12-10 12:27:37 -05:00
Alfredo Deza
acbf7c9b2a doc/man/ceph-volume add zapping by osd-id examples
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-12-07 12:30:27 -05:00
Kefu Chai
d80000fcf0
Merge pull request #25262 from aclamk/wip-kvstore-tool-dump
ceph-kvstore-tool: dump fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-06 00:13:00 +08:00
Adam Kupczyk
b2a8751bf3 bluestore/tools: Add option 'dump' to ceph-kvstore-tool to print both key and values.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2018-12-04 09:19:26 +01:00
Sage Weil
cdcc5b4521 Merge PR #24502 into master
* refs/pull/24502/head:
	crushtool: implement --rebuild-class-roots command
	crushtool: make --reweight re-sum choose_args weight-sets too
	crushtool: --reweight should only reweight nonshadow roots
	crush/CrushWrapper: reclassify: use default parent for created buckets
	crush/CrushWrapper: reclassify: handle to-be-created buckets that we need twice
	test/cli/crushtool/reclassify: add second gabe test case
	crushtool: add --set-subtree-class; do not set class via --reclassify-root
	test/cli/crushtool/reclassify: add reclassify test cases
	doc/rados/operations/crush*: document reclassify
	doc/rados/operations/crush: remove instructions for separate crush trees for ssd
	crushtool: add --compare command
	crushtool: implement --reclassify
	crush/CrushCompiler: fix id scan to include class ids

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-27 21:32:04 -06:00
Sage Weil
505050befd doc/rados/operations/crush*: document reclassify
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-27 20:36:43 -06:00
Sage Weil
f3c27670c0 Merge PR #24737 into master
* refs/pull/24737/head:
	doc/ceph-bluestore-tool: add help for migrate and new DB/WAL commands.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-20 09:50:04 -06:00
Jan Fajerski
dfc0e1d9a6 doc: add ceph-volume inventory sections
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-16 08:35:56 +01:00
Xiang Dai
0c2c3e0316 doc: correct rbytes description
The default was changed from on to off in 4.6 because the way rbytes behaves can be surprising and sometimes confuses tools like rsync.

Signed-off-by: Xiang Dai <764524258@qq.com>
2018-11-08 17:56:47 +08:00
Kefu Chai
8c6ec85f43 doc: s/librados2/librados3/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00