Commit Graph

391 Commits

Author SHA1 Message Date
Patrick Donnelly
0efa73f029
mds: update default MDS cache size memory limit
1GB is too low as a default and usually results in cache size warnings
at that size; the MDS will struggle to maintain such a small cache size
for most workloads.

Fixes: https://tracker.ceph.com/issues/43182
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-11 15:28:57 -08:00
Patrick Donnelly
2216c63ed5
Merge PR #31729 into master
* refs/pull/31729/head:
	qa: reduce cache size further
	mds: obsoleting 'mds_cache_size'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-11 09:44:27 -08:00
Sage Weil
e5e41c443d Merge PR #32160 into master
* refs/pull/32160/head:
	doc/releases/nautilus,PendingReleaseNotes: consolidate telemetry note

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-12-11 08:06:40 -06:00
Sage Weil
c50c17e755 doc/releases/nautilus,PendingReleaseNotes: consolidate telemetry note
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-10 14:36:06 -06:00
Sage Weil
aa760fa501 Merge PR #32148 into master
* refs/pull/32148/head:
	doc/releases/nautilus: fix release notes (crash->device)

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2019-12-10 14:33:02 -06:00
David Zafman
47b5fd9383
Merge pull request #32041 from dzafman/wip-balancer3-pending
release note: Add pending release notes for already merged code

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-10 10:56:04 -08:00
Sage Weil
c221b06bbf doc/releases/nautilus: fix release notes (crash->device)
Fix pending note for octopus too

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-10 08:32:02 -06:00
Nathan Cutler
e524bb8880 doc/releases: add release notes for nautilus v14.2.5
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-12-09 23:27:54 +01:00
David Zafman
65d03bae8b release note: Add pending release notes for already merged code
Follow on to https://github.com/ceph/ceph/pull/31774

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-12-09 11:51:32 -08:00
Casey Bodley
f6bda33bc9
Merge pull request #31926 from yuvalif/wip-yuval-fix-pubsub-record-format
rgw/pubsub: fix records/event json format to match documentation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-12-05 13:55:31 -05:00
Yuval Lifshitz
19832a0dae rgw/pubsub: support eventId in push mode
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-12-03 20:42:20 +02:00
Ramana Raja
aeaef1b4c5 mds: obsoleting 'mds_cache_size'
Remove last bits of support for 'mds_cache_size'.
'mds_cache_memory_limit' is preferred.

Fixes: https://tracker.ceph.com/issues/41951
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-12-02 14:51:25 +05:30
Sage Weil
9206b90294 PendingReleaseNotes: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-25 08:13:52 -06:00
Sage Weil
1d0fd5603e PendingReleaseNotes: note about the removal of 'nvme' class
There isn't much to say here since this really shouldn't be happening in
the wild.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-22 15:33:13 -06:00
Kefu Chai
dc1d34ba42
Merge pull request #31310 from badone/wip-tracker-42477-reinstate-o-outfile
tools/rados: Unmask '-o' to restore original behaviour

Reviewed-by: Sage Weil <sage@redhat.com>
2019-11-17 01:12:12 +08:00
Sridhar Seshasayee
8819c3c37a
Merge pull request #31416 from sseshasa/wip-41666-replicaSizeWarn
osd/OSDMap: Show health warning if a pool is configured with size 1

Reviewed-by: Sage Weil <sweil@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-11-12 12:06:46 +05:30
Brad Hubbard
d2b806070d tools/rados: Unmask '-o' to restore original behaviour
0b369e1aff masked the original behaviour of '-o' which was to indicate
'outfile' as documented in the man page. Changing object-size to capital
o will restore the original behaviour.

Fixes: https://tracker.ceph.com/issues/42477

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-11-12 09:20:03 +10:00
Sridhar Seshasayee
33c647e811 osd/OSDMap: Show health warning if a pool is configured with size 1
Introduce a config option called 'mon_warn_on_pool_no_redundancy' that is
used to show a health warning if any pool in the ceph cluster is
configured with a size of 1. The user can mute/unmute the warning using
'ceph health mute/unmute POOL_NO_REDUNDANCY'.

Add standalone test to verify warning on setting pool size=1. Set the
associated warning to 'false' in ceph.conf.template under qa/tasks so
that existing tests do not break.

Fixes: https://tracker.ceph.com/issues/41666
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2019-11-11 10:36:35 +05:30
J. Eric Ivancich
729c0ba136 rgw: reduce per-shard entry count during ordered bucket listing
Currently, if a client requests the 1000 next entries from a bucket,
each bucket index shard will receive a request for the 1000 next
entries. When there are hundreds, thousands, or tens of thousands of
bucket index shards, this results in a huge amplification of the
request, even though only 1000 entries will be returned.

These changes reduce the per-bucket index shard requests. These also
allow re-requests in edge cases where all of one shard's returned
entries are consumed. Finally these changes improve the determination
of whether the resulting list is truncated.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-11-09 00:17:43 -05:00
Patrick Donnelly
1c56632e88
mds: define stream operator for mds_info_t
This also cleans up the output to be more readable/useful in debug
output.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-11-08 10:02:09 -08:00
Sage Weil
09ef9b850f mon/ConfigMap: search nested sections
For an entity a.b.c.d, search all dot-delineated prefix sections.  This
enables you to establish a hierarchical set of options for clients, such
as radosgw daemons.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-01 16:51:54 -05:00
Sage Weil
713dbc9722 mgr/telemetry: add stats about crush map
Signed-off-by: Sage Weil <sage@redhat.com>
2019-11-01 07:59:53 -05:00
Abhishek Lekshmanan
f62c6e8cba mgr/telemetry: add rgw metadata
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-30 16:56:38 -05:00
Sage Weil
2b7ac440ab mgr/telemetry: include fs size (files, bytes, snaps)
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 14:46:53 -05:00
Sage Weil
f4c7366994 mgr/telemetry: mds cache stats
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 14:46:53 -05:00
Sage Weil
a42dc0a3d0 mgr/telemetry: add some rbd metadata
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 14:46:53 -05:00
Sage Weil
702175f493 mgr/telemetry: note whether osd cluster_network is in use
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 14:25:00 -05:00
Sage Weil
9e6fbaaaa0 mgr/telemetry: add host counts
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 14:25:00 -05:00
Sage Weil
87670fdc3c mgr/telemetry: add more pool metadata
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 14:24:59 -05:00
Sage Weil
3453930d43 mgr/telemetry: include min_mon_release and msgr v1 vs v2 addr count
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 13:38:44 -05:00
Sage Weil
7f6aad677b mgr/telemetry: add CephFS metadata
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-29 13:38:44 -05:00
Sage Weil
29c97547a9 Merge PR #30859 into master
* refs/pull/30859/head:
	auth: EACCES, not EPERM
	mon: shunt old tell commands from cli interface to asok
	mon: allow mgr to tell mon.foo smart
	mon: include quorum features in quorum_status
	qa/workunits/mon/caps.sh: fix test
	ceph_test_rados_api_cmd: fix MonDescribe test
	Merge branch 'vstart-fs-auth' of git://github.com/batrick/ceph into wip-cleanup-mon-asok
	test/pybind/test_ceph_argparse: fix tests
	vstart: add volume client keys to keyring
	vstart: use fs authorize to create master client key
	vstart: redirect some output to stderr
	vstart: output command strings to stderr
	qa/workunits/cephtool/test.sh: fix 'quorum enter' caller
	qa: change mon_status calls to quorum_status or tell commands
	mon: fix 'heap ...' command
	mon: consolidate 'sync force' commands
	mon: allow asok commands to return an error code
	mon: move 'quorum enter|exit' and 'mon_status' to asok
	mon: fix 'smart' asok command
	mon: remove old 'config set' and 'injectargs'

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-10-23 21:05:42 -05:00
Gregory Farnum
e190825f26
Merge pull request #30650 from athanatos/sjust/wip-dmclock-server-only
dmclock server side refactor

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-10-23 13:35:13 -07:00
Samuel Just
6eaf324083 PendingReleaseNotes: note mClockScheduler config changes
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-10-23 13:33:59 -07:00
Sage Weil
da533bdd4d Merge branch 'vstart-fs-auth' of git://github.com/batrick/ceph into wip-cleanup-mon-asok 2019-10-21 11:43:01 -05:00
Kefu Chai
8ae022a3ce
Merge pull request #30830 from tchaikov/wip/rpm-install-deps/python_provide
install-deps, rpm: use python_provide macro and cleanups

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-10-15 00:05:06 +08:00
Sage Weil
e3260a81d5 mon: consolidate 'sync force' commands
Replace the 'ceph [mon] sync force' commands and just use the asok
sync_force command instead.  This is a low-level command that nobody should
reasonsbly using except in an emergency, so do not bother with trying to
maintain compatibility; it's a bit rediculous that we had 3 variations of
this to being with!

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-12 12:05:36 -05:00
Kefu Chai
9ae33df4ca PendingReleaseNotes: revise the note on python3.4 to python3
as RHEL/CentOS 7.7 offers python3 (python3.6), EPEL7 removed the
duplicated python3-* (python36-*) packages, see
https://lists.fedoraproject.org/archives/list/epel-devel@lists.fedoraproject.org/message/GUSLTD5AJWFEGBFK5EYFVH3LHQVHUBAP/

and EPEL7 only supports the latest RHEL7.x release, which is now 7.7

so should not mention EPEL7 in this note,

for the reason why EPEL removed these packages, see EPEL's guideline:
https://fedoraproject.org/wiki/EPEL/GuidelinesAndPolicies#Policy

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-10 11:04:54 +08:00
Sage Weil
c9bfbb7a47 Merge PR #30724 into master
* refs/pull/30724/head:
	mgr/telemetry: bump content revision and add a release note
	telemetry/server: add device report endpoint
	mgr/telemetry: include device telemetry
	mgr/devicehealth: factor _get_device_metrics out of show_device_metrics
	mgr/devicehealth: pull out MAX_SAMPLES

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-10-09 21:30:44 -05:00
Sage Weil
47d3406fb2 mgr/telemetry: bump content revision and add a release note
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-09 21:30:13 -05:00
Sage Weil
bbc7bb5a22 Merge PR #30217 into master
* refs/pull/30217/head:
	crimson: common/admin_socket kludge so that it builds
	mon/MonClient: fix sending mon command to a specific rank
	src/.gitignore: ignore .tox
	mon/MonClient: interpret numeric mon target name as rank
	mgr,mgr/MgrClient: use fsid to signal mon-mgr vs cli MCommands
	qa/workunits/cephtool: fix errpr checks for 'ceph daemon' commands
	common/ceph_context: make 'config unset' idempotent
	qa/tasks/dump_stuck: mon.a, not mon.0
	qa/suites/rados/singleton/all/admin-socket: fix test
	common/config: EPERM setting config option after startup
	qa/workunits/cephtool/test.sh: fix tell output error check
	common/admin_socket: pass Formatter from generic infrastructure
	common/admin_socket: pass ostream to call() for error output
	os/bluestore: fix asok hook return value
	rgw: fix asok return value
	common/ceph_context: return error code from asok commands
	test/pybind/test_rados: fix accidental mon tell test
	mon: print entity_name along with caps to debug log
	PendingReleaseNotes: notes about asok changes
	mgr/MgrClient: empty target string for 'tell' means active mgr
	common/admin_socket: report error code as part of output string
	osd: change trigger_[deep_]scrub tommands to a pg tell command
	osd: remove old command workqueue, threadpool
	osd: drop MMonCommand handling
	osdc/Objecter: resend OSD tell commands on EAGAIN
	osd: route tell commands to asok; migrate commands
	osd: use unique_ptr<Formatter> for asok_command
	common/ceph_context: add generic asok 'injectargs'
	common/admin_socket: allow dup prefixes
	common/admin_socket: refactor with sync and async execute_command variants
	common/admin_socket: pass input bufferlist
	osd: transition to call_async() for asok
	common/admin_socket: support alternative call_async()
	mon/MonClient: send tell commands out of band via MCommand
	mon: accept tell commands via MCommand and send them to asok handler
	common/admin_socket: return int from hook call()
	mgr/DaemonServer: route MCommand (for octopus+) to asok commands
	do not use 'ceph tell mgr'
	pybind/ceph_argparse: disambiguate mgr tell and CLI commands
	ceph: make 'ceph tell mgr.*' send to the active mgr
	ceph: send 'ceph tell mgr.X' to the right mgr
	librados: add rados_mgr_command_target
	mgr/MgrClient: add start_command variant that takes a target
	common/admin_socket: drop unregister_command(); use per-hook variant
	common/admin_socket: drop explicit prefix arg to register_command
	common/admin_socket: simplify command routing
	common/admin_socket: add ability to process MCommand via asok queue
	common/admin_socket: pass cmdvec to execute_command
	common/admin_socket: use pipe for general wakeup
	include/compat: add flags arg to pipe_cloexec
	common/admin_socket: drop unused args

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-10-06 09:08:28 -05:00
Sage Weil
5d4fe85b74 PendingReleaseNotes: notes about asok changes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-04 09:07:02 -05:00
Kefu Chai
86b9036c6c
Merge pull request #30614 from tchaikov/wip-no-more-osdmap-full
librados,osd,mon: remove traces of CEPH_OSDMAP_FULL

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-10-04 10:27:21 +08:00
Kefu Chai
a532aaf479 PendingReleaseNotes: document full/nearfull changes
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-04 10:26:08 +08:00
Xie Xingguo
f28f35f79b
Merge pull request #30591 from xiexingguo/wip-balancer-throttler
mgr/balancer: upmap_max_iterations -> upmap_max_optimizations; behave as it is per pool

Reviewed-by: Sage Weil <sage@redhat.com>
2019-10-01 07:42:25 +08:00
xie xingguo
d7ea56f3df mgr/balancer: upmap_max_iterations -> upmap_max_optimizations
With osd_calc_pg_upmaps_aggressively on we might have to iterate
hundreds or thousands of times to figure out an optimization,
but upmap_max_optimizations will remain a hard limit for the
total optimizations that can be returned.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-28 08:31:45 +08:00
Sage Weil
dff5697464 Merge PR #30525 into master
* refs/pull/30525/head:
	qa/tasks/ceph.conf.template: disable power-of-2 warning
	qa/standalone/mon/health-mute: use power of 2 for pg_num
	osd/OSDMap: remove remaining g_conf() usage
	PendingReleaseNotes: add note for 14.2.5 so we can backport this
	osd/OSDMap: health alert for non-power-of-two pg_num

Reviewed-by: Kai Wagner <kwagner@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-27 12:08:37 -05:00
Sage Weil
f1f8e9a520 PendingReleaseNotes: add note for 14.2.5 so we can backport this
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-24 09:26:45 -05:00
Sage Weil
6e46b1c0e5 osd/OSDMap: health alert for non-power-of-two pg_num
Fixes: https://tracker.ceph.com/issues/41647
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-24 09:26:33 -05:00
Patrick Donnelly
30909f5a6a
Merge PR #29824 into master
* refs/pull/29824/head:
	qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning
	mds: add a HEALTH_WARN message when inline_data is enabled
	mds: log a warning message when mds is started on an fs with inline_data
	mon: deprecate CephFS inline_data support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2019-09-24 04:32:28 -07:00