Commit Graph

5245 Commits

Author SHA1 Message Date
Adam C. Emerson
afaf48a263 log: Mark timestamps for coarseness and print appropriately
Have each timestamp know whether it's coarse or fine. Print six figures
for fine stamps and three for coarse.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-06 20:49:53 -04:00
Adam C. Emerson
0f8606b4e0 log: Add log_coarse_timestamps option
And set up an observer in CephContext to coarsen/refine time stamps as
requested.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-06 20:49:53 -04:00
Adam C. Emerson
a0a4c483bc config: Add templated _get_val for use in observers
When notified by a config observer, the config lock is already held,
create a _get_val template to manipulate newstyle options when
notified.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-06 20:49:53 -04:00
Adam C. Emerson
31de198955 log: Use log_clock, defaulting to coarse time
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-06 17:29:06 -04:00
Adam C. Emerson
7b0168c5dd log: Create log_clock to replace use of utime_t
We create a new time type to support using coarse timestamps (for
performance) by default while still allowing the user to switch to
fine timestamps.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-10-06 17:29:06 -04:00
Sage Weil
b73346df0b Merge pull request #18049 from liewegas/wip-kv-iterator
kv/KeyValueDB: add column family

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2017-10-06 13:07:57 -05:00
Sage Weil
70916131d6 Merge pull request #18028 from liewegas/wip-pick-ifname
common/pick_address: add {public,cluster}_network_interface option

Reviewed-by: Dan Mick <dmick@redhat.com>
2017-10-05 12:02:49 -05:00
Sage Weil
15a20eb2f5 Merge pull request #18120 from liewegas/wip-bluefs-allocation
os/bluestore: make bluefs behave better near enospc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-05 09:13:46 -05:00
Sage Weil
6ea96fa939 os/bluestore: use separate CF for omap and deferred
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-04 22:01:02 -05:00
Sage Weil
65be614f2b os/bluestore: add bluestore_bluefs_min_free
We need at least ~1GB free so we can write out new SSTs (which are 256MB
each).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-04 17:34:23 -05:00
Sage Weil
cb48d6c37c Merge pull request #18072 from dragonylffly/wip-optimize-assert
assert(false)->ceph_abort()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2017-10-04 13:59:19 -05:00
Sage Weil
1d26eb38bf Merge pull request #18003 from cbodley/wip-build-options-move
common: use move instead of copy in build_options()

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-02 21:47:22 -05:00
John Spray
47bfe6cf17 Merge pull request #17735 from jcsp/wip-mgr-perf-interface
mgr: common interface for TSDB modules

Reviewed-by: My Do <mhdo@umich.edu>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-10-02 11:12:35 +01:00
Li Wang
e482d2ea70 common: assert(false)->ceph_abort()
Signed-off-by: Li Wang <laurence.liwang@gmail.com>
2017-10-02 07:19:31 +00:00
Kefu Chai
dd4e4ed3fe Merge pull request #17728 from ygtzf/cleanup-unused-parameter
mon: cleanup unused option mon_health_data_update_interval

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-02 11:34:39 +08:00
Kefu Chai
6788ea0e9a common/options: use user-defined literals for sizes
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-29 11:14:25 +08:00
Kefu Chai
d2364bde9b common/options: pass by reference
for better performance. and for better consistency, pass by
std::initializer_list.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-29 11:09:35 +08:00
Patrick Donnelly
1da4a5090a
Merge PR #16036 into HEAD
* refs/remotes/upstream/pull/16036/head:
	mds: improve cap min/max ratio descriptions
	mds: fix whitespace
	mds: cap client recall to min caps per client
	mds: fix conf types
	mds: fix whitespace
	doc/cephfs: add client min cache and max cache ratio describe
	mds: adding tunable features for caps_per_client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-28 17:00:39 -07:00
Patrick Donnelly
dcf97d1735
mds: improve cap min/max ratio descriptions
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-28 16:01:00 -07:00
Yuri Weinstein
b362626e99 Merge pull request #17984 from adamemerson/wip-lists-of-pointers-are-bad-in-options
options: Do not use linked lists of pointers!

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-28 15:50:05 -07:00
Sage Weil
95cc790acd common/pick_address: add {public,cluster}_network_interface option
Add _interfaces option to constrain the choice of IPs in the network
list to those on interfaces matching the provided list of interface names.
The _interfaces options only work in concert with the _network options,
so you must also specify a list of networks if you want to use a specific
interface, e.g., by specifying a broad network like "::" or "0.0.0.0/0".

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-28 17:47:17 -04:00
Sage Weil
c59efe0a2b Merge pull request #17839 from liewegas/wip-recovery-preemption
osd: allow PG recovery scheduling preemption

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-09-28 14:14:01 -05:00
Sage Weil
20b0055e0d Merge pull request #17769 from optimistyzy/97_new_opt
os/bluestore/NVMEDevice: Remove using dpdk thread

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-09-28 08:30:44 -05:00
Casey Bodley
9a97f5405f options: use move instead of copy in build_options()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-27 16:21:55 -04:00
Sage Weil
937379d57a buffer: add ptr::[try_]reassign_to_mempool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-27 15:49:17 -04:00
Sage Weil
dbc002eaa9 common/AsyncReserver: support preemption
If an (optional) preemption context is provided, use that to preempt
and existing reservation and grant a higher-priority one.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-27 15:40:18 -04:00
John Spray
88163749b5 mgr: respect perf counter prio_adjust in MgrClient
This awkwardly involves re-ordering some definitions
in perf_counters.h in order to refer to the prio
names defined in PerfCountersBuilder.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:22 -04:00
John Spray
66f61eeda6 common: PerfCountersBuilder helper for priorities
Let the caller set a priority as the defaul, to enable them
to create a bunch at a given priority.  This is just a
convenience.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:21 -04:00
John Spray
30a74ce343 ceph.in: use PRIO_INTERESTING as daemonperf threshold
Using PRIO_USEFUL as the threshold for what goes into
time series databases.  I'm claiming that we have
more "useful" counters than fit on the screen,
so daemonperf's "a screen's worth" threshold
should be at the "interesting" level.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:20 -04:00
John Spray
ba08fc1008 common: used fixed size int for perf counter prio
...to avoid any ambiguity in allowed range and
make clear how to encode it down the wire.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:20:20 -04:00
John Spray
e631f1a727 common: always include priority in perf counter dump
JSON output with inconsistent sets of members is
annoying to use on the receiving side.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-09-27 14:18:01 -04:00
Patrick Donnelly
bfc4902495
mds: fix conf types
This correct an assertion failure.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-27 09:29:39 -07:00
Patrick Donnelly
8a5d71bf45
mds: fix whitespace
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-27 09:29:23 -07:00
Yuri Weinstein
85f3227885 Merge pull request #17063 from bspark8/wip-dynamic-cli-info-f
osd: use dmclock library client_info_f function dynamically

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2017-09-26 16:02:19 -07:00
Adam C. Emerson
0d8c52a906 common/options.h: Do not use linked lists of pointers
Especially since we're just pushing things in from the end. The linked
list has more overhead, is slower, and adds no capability.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-09-26 18:37:31 -04:00
Sage Weil
a79c78c1a4 Merge pull request #17661 from yunfeiguan/master
librados: Fix a potential risk of buffer::list::claim_prepend(list& b…

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-25 12:33:18 -05:00
Sage Weil
fb532ad1cf Merge pull request #17827 from tchaikov/wip-mono-heartbeat
common: use mono clock for HeartbeatMap

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-22 16:07:51 -05:00
Sage Weil
bc2c363a5e Merge pull request #17844 from liewegas/wip-21259
os/bluestore: debug bluestore cache shutdown
2017-09-22 16:05:50 -05:00
Kefu Chai
38751c70a5 Merge pull request #17806 from tchaikov/wip-osdc-new-options
osdc/Journaler: use new style options

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-22 12:44:36 +08:00
Kefu Chai
ab22dd4ee4 Merge pull request #17374 from jcsp/wip-mgr-config-tidy
mgr: use new style config opts + add metadata

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-22 12:32:13 +08:00
Kefu Chai
5c8e65a2a4 osdc/Journaler: use new style options
also use uint64_t for these options, as they are casted to uint64_t when
reading from conf.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-22 12:28:21 +08:00
Sage Weil
3a6a0f4ab0 Merge pull request #17739 from liewegas/wip-filestore-configs
common/options: document filestore and filejournal options

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-21 21:25:52 -05:00
Sage Weil
787ea8aba0 Merge pull request #17740 from liewegas/wip-objecter-configs
common/options: document objecter, filer, and journal options

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-21 21:25:36 -05:00
ren.huanwen
a07b376628 mds: adding tunable features for caps_per_client
Sometimes we need to raise or lower the value of "max_caps_per_client" and
"min_caps_per_client" to improve recall_client_state efficiency

Signed-off-by: ren.huanwen <ren.huanwen@zte.com.cn>
2017-09-22 09:57:00 +08:00
Sage Weil
6169cf6442 osd: make shutdown debug conditional (and off by default)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-21 15:19:47 -04:00
Sage Weil
65bec679f2 common/options: document filestore and filejournal options
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-21 14:37:37 -04:00
Sage Weil
08d2c8875b common/AsyncReserver: get a cct
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-21 14:22:18 -04:00
Kefu Chai
344f112bb3 common: use mono clock for HeartbeatMap
to avoid problems when admin sets system clock.

see https://gcc.gnu.org/bugzilla/show_bug.cgi?id=53901 for the reason
why we cannot use atomic<time_point>.

Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Xinze Chi <xinze@xsky.com>
2017-09-22 01:12:13 +08:00
bspark
046d7390a1 osd: use dmclock library client_info_f function dynamically
to be able to apply QoS parameter changes at runtime in Ceph.

Signed-off-by: bspark <bspark8@sk.com>
2017-09-21 13:23:26 +09:00
Patrick Donnelly
8242210def
Merge PR #17791 into master
* refs/remotes/upstream/pull/17791/head:
	client: set client_try_dentry_invalidate to false by default

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-20 12:38:25 -07:00