Commit Graph

89015 Commits

Author SHA1 Message Date
Patrick Nawracay
7340e70d7f mgr/dashboard/backend: API to manage dashboard settings
Enables to change (set/unset) values of settings of the dashboard using
the REST API.

Fixes: https://tracker.ceph.com/issues/24273

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-08-10 11:32:25 +02:00
Kefu Chai
50f7f7e32e
Merge pull request #23496 from bstillwell/crush_doc_fixes
doc: Fix a couple typos and improve diagram formatting

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-10 12:45:29 +08:00
Kefu Chai
c91006141b
Merge pull request #23477 from liewegas/wip-kv-merge-name
kv/KeyValueDB: return const char* from MergeOperator::name()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-10 10:54:13 +08:00
Kefu Chai
7acb991728
Merge pull request #23474 from tchaikov/wip-config-expand-meta
common: expand meta in parse_argv()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 10:52:53 +08:00
yanjun
e4c35bfa8f
Merge pull request #23481 from Yan-waller/wip-walle-180808-smooth-intervals
mgr,mon: fix to apply changed mon_stat_smooth_intervals

Reviewed-by: John Spray <john.spray@redhat.com>
2018-08-10 10:51:52 +08:00
yanjun
d50bef3861
Merge pull request #23482 from Yan-waller/wip-walle-180808-mgr-deadlock
mgr: fix beacon interruption caused by deadlock

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-10 10:49:19 +08:00
yanjun
8d50ca449c
Merge pull request #23487 from xiexingguo/wip-hb-peers-v2
osd/OSD: choose heartbeat peers more carefully

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
2018-08-10 10:47:19 +08:00
Alfredo Deza
f563510c58
Merge pull request #23514 from bstillwell/operations_doc_fixes
doc: Multiple spelling fixes

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-08-09 17:41:58 -04:00
Bryan Stillwell
791b00daa1 doc: Multiple spelling fixes
I ran a lot of the docs through aspell and found a number of spelling problems.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-09 14:51:25 -06:00
Sage Weil
ebaa80690d Merge PR #23471 into master
* refs/pull/23471/head:
	mon/PGMap: fix spacing around pretty-printed SI units
	include/types: render SI units adjacent to number

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
2018-08-09 14:35:56 -05:00
Sage Weil
6fe0ad0897 Merge PR #23473 into master
* refs/pull/23473/head:
	OSD: translate the error result

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-09 14:35:50 -05:00
Bryan Stillwell
e6abe89ec6 doc: Fix a couple typos and improve diagram formatting
I found a couple misspelled words in the crush-map documentation, and also
tweaked the formatting of the CRUSH hierarchy diagram to center some of the
entries.

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2018-08-09 11:00:40 -06:00
Sage Weil
4c513eabdb Merge PR #23422 into master
* refs/pull/23422/head:
	log/Log: fix buffer overflow

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-09 08:06:25 -05:00
Kefu Chai
42b1cff8cb
Merge pull request #23466 from tspmelo/wip-update-packages
mgr/dashboard: Update frontend packages

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2018-08-09 20:35:17 +08:00
John Wilkins
309a3fdb73
Merge pull request #23431 from falcon78921/wip-doc-rados-pool
doc: fixed links in Pools section

Reviewed-by: John Wilkins <jowilkin@redhat.com>
2018-08-08 21:23:28 -07:00
xie xingguo
64362ac21d osd/OSD.cc: force updating heartbeat peers periodically
Because the cluster topology may change (e.g., because we add some
new racks, hosts and disks) and we want the existing osds are then
aware of new incoming osds, guaranteeing osds are always trying to
do heartbeat as wide as possible(e.g., across all racks, hosts etc.).

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-09 08:44:59 +08:00
xie xingguo
8a77e1f4dc crush/CrushWrapper: check against dead crush rule
We currently remove a rule without adjusting the **rules** array
because we don't recycle the rule_no and hence there can be
holes in the "rules" array.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-09 08:44:58 +08:00
xie xingguo
bcc11541b8 osd/OSD.cc: choose heartbeat peers by failure domain
By default, monitor requires at least two valid failure votes/reports from
different hosts to mark an OSD down, which turns out to be impossible sometimes
for a replicated-pool of size of 2 in those clusters made up of hosts
with contiguous labeled OSDs.

This patch instead does a breadth-first search based on the highest level of
failure domain at cluster-wide, to try to make heartbeat peers can cover all failure domains
whenever possible, which can hopefully help accelerating osd failure detection
in the above case..

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-09 08:44:58 +08:00
Kefu Chai
72cc4cedd4
Merge pull request #23441 from tchaikov/wip-cmake-rocksdb-cleanup
cmake: rocksdb related cleanup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-09 00:46:53 +08:00
Patrick Donnelly
059d21a370
Merge PR #23462 into master
* refs/pull/23462/head:
	doc: cleanup in cephfs/capabilities

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-08 09:40:21 -07:00
Sage Weil
aa485c9b41 mon/PGMap: fix spacing around pretty-printed SI units
"1k foo" not "1kfoo"

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-08 10:55:18 -05:00
Andrew Schoen
33ca998a6a
Merge pull request #23489 from alfredodeza/wip-cv-mgr
ceph-volume tests/functional add mgrs daemons to lvm tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-08-08 15:43:49 +00:00
Sage Weil
138b8b41db Merge PR #23475 into master
* refs/pull/23475/head:
	qa/standalone/crush/crush-choose-args: run mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-08 08:31:31 -05:00
Sage Weil
5659edae08 Merge PR #23478 into master
* refs/pull/23478/head:
	mgr/localpool: pg_num is an int arg to 'osd pool create'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-08 08:31:26 -05:00
Igor Fedotov
e0a577c278
Merge pull request #23267 from ifed01/wip-ifed-rm-fio-dir
test/fio:  pass config params to object store in a different manner

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-08 16:20:16 +03:00
Alfredo Deza
2b7a22ef10 ceph-volume tests/functional add mgrs daemons to lvm tests
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-08-08 08:29:03 -04:00
xie xingguo
108583c6be crush/CrushWrapper: get_children_of_type - switch outcome to vector
Because we don't really care about the order.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-08-08 16:46:16 +08:00
Yan Jun
70e56269b1 mgr: fix beacon interruption caused by deadlock
There is potential deadlock between this code and DaemonServer::send_report()

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2018-08-08 15:24:37 +08:00
Yan Jun
c9e4396c63 mgr: fix to apply changed mon_stat_smooth_intervals
While using config set or injectargs command to decrease
mon_stat_smooth_intervals, it didn't apply the new value.
this change fix it.

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2018-08-08 14:35:38 +08:00
Sage Weil
e02a5d5547 mgr/localpool: pg_num is an int arg to 'osd pool create'
In bd565bca3f we start returning EINVAL if
the pg_num argument is not valid, whereas before it was silently ignored.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-07 20:43:49 -05:00
Sage Weil
e9be5dabf2 kv/KeyValueDB: return const char* from MergeOperator::name()
This avoids a c_str() on a temporary string later down the line, which
avoids a use-after-free.

Fixes: http://tracker.ceph.com/issues/26875
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-07 17:03:06 -05:00
Alfredo Deza
bfd0cde8ff
Merge pull request #23472 from jcsp/wip-orchestrator-rook-doc
doc: Rook/orchestrator doc fixes

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-08-07 13:12:36 -04:00
Sage Weil
662e883683 qa/standalone/crush/crush-choose-args: run mgr
The osd purge command needs a running mgr.

Fixes: d2b41d4095
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-07 11:57:05 -05:00
Kefu Chai
2a565ee35d common: expand meta in parse_argv()
it fixes the issue where the conf->foo fails to expand if it is set
as "$bar" in a .conf file, and "bar" is another config var, and bar
is set using config_proxy.parse_argv().

because before 773ef117, apply_changes() calls update_legacy_vals(),
which expand meta vars for legacy config vals, but after 773ef117,
we cannot change config_values in apply_changes() anymore. so
update_legacy_vals() calls is moved to apply_changes()'s callers
accordingly. but the apply_changes() is also called by global_init()
directly instead of by the routines in config.cc. so in 773ef117,
i missed it.

in this change, it's put back into parse_argv() instead of into
global_init(), as update_legacy_vals() is a low level function, and
parse_argv() could change the config_values, it's better to call
update_legacy_vals() out there, just like set_mon_vals() and
parse_config_files().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-08 00:33:29 +08:00
Willem Jan Withagen
14c6f0de9b OSD: translate the error result
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-08-07 16:57:00 +02:00
Igor Fedotov
376c7fed9e test/fio: pass config params to object store in a different manner
This avoids an existing bug with config params substituion.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-08-07 17:19:15 +03:00
John Spray
7ad61cc032 doc: Rook/orchestrator doc fixes
Signed-off-by: John Spray <john.spray@redhat.com>
2018-08-07 10:13:31 -04:00
Sage Weil
3988351227 Merge PR #23432 into master
* refs/pull/23432/head:
	Revert "rocksdb: pickup change to link against libsnappy.a"
	cmake,make-dist: revert "build gperftools if WITH_STATIC_LIBSTDCXX"
	cmake: cleanup snappy related script
	debian: strip "-Wl,-Bsymbolic-functions" from LDFLAGS
2018-08-07 08:59:39 -05:00
Sage Weil
61615e037f Merge PR #23243 into master
* refs/pull/23243/head:
	mon/OSDMonitor: remove ambiguous type case for 'osd pool set' value
	mon: use throwing variant of cmd_getval
	common/cmdparse: add cmd_getval_throws variants that throw bad_cmd_get
	mon: catch bad_cmd_exception and reply EINVAL
	common/cmdparse: add bad_cmd_get exception

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-07 08:54:00 -05:00
Sage Weil
864d93f829 Merge PR #23338 into master
* refs/pull/23338/head:
	msg/Messenger: send_message -> send_to
	msg/msg_types: add entity_addr_t::legacy_or_front_addr()
	mon/MonMap: kill get_inst()
	mon: kill MonMap::get_inst() users
	mon/MonClient: replace get_mon_{addr,inst} with get_mon_addrs
	mon/MonClient: get_connection -> connect_to_mon
	src/test: get_connection -> connect_to_*
	mon/MonMap: add get_addrs() (temp wrappers)
	msg/Messenger: make connect_to() key method, get_connection() becomes wrapper
2018-08-07 08:53:55 -05:00
Sage Weil
cedeeadf30 Merge PR #23412 into master
* refs/pull/23412/head:
	mgr: add Orchestrator.available method + CLI
	doc: add general documentation on orchestrator
	doc: add page for Rook module
	doc: add development guide for Ceph+Rook in k8s
	script: add kubejacker script
	mgr/rook: Rook orchestrator module
	mgr/orchestrator_cli: module for calling into orchestators
	mgr: introduce `orchestrator` python interface

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-07 08:53:51 -05:00
Sage Weil
36920de171 include/types: render SI units adjacent to number
Make

 out << si_u_t(foo) << " objects"

result in strings like

 "0 objects"
 "123k objects"
 "3M objects"

instead of

 "0  objects"
 "0 k objects"
 "3 M objects"

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-07 08:49:56 -05:00
Kefu Chai
19f2525fc7
Merge pull request #23430 from tchaikov/wip-silence-clang-warnings
tools, mgr: silence clang warnings

Reviewed-by: John Spray <john.spray@redhat.com>
2018-08-07 18:18:01 +08:00
Sebastian Wagner
94198c01c2
Merge pull request #23420 from tspmelo/fix-24902
mgr/dashboard: Escape regex pattern in DeletionModalComponent

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2018-08-07 11:43:48 +02:00
Sebastian Wagner
7c4bbfa225
Merge pull request #23414 from tspmelo/wip-breadcrumbs
mgr/dashboard: Add breadcrumbs component

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-08-07 11:38:56 +02:00
Yan, Zheng
eb46b598f4
Merge pull request #23465 from ukernel/wip-revert-22850
Revert "cephfs-journal-tool: enable purge_queue journal's event comma…
2018-08-07 17:05:37 +08:00
Tiago Melo
c12f113318 mgr/dashboard: Update prettier package
Prettier updated the following rule, that implied we update our code:
"Never inline decorators unless they’re lone parameter decorators"

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-08-07 10:05:17 +01:00
Yan, Zheng
65ae72a1e6 Revert "cephfs-journal-tool: enable purge_queue journal's event commands"
This reverts commit 8ebfa93982. That
commit changes PurgeItem's encode/decode function, breaks backward
compatibility

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-08-07 17:02:18 +08:00
Tiago Melo
3faf09c96f mgr/dashboard: Update Codelyzer package
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-08-07 09:57:32 +01:00
Tiago Melo
2b59d757c1 mgr/dashboard: Update all @angular packages
no-unused-variable is deprecated because typescript now covers most of its
functionality.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-08-07 09:57:32 +01:00