Commit Graph

86316 Commits

Author SHA1 Message Date
Jan Fajerski
7e7ae7a0fe add monitoring subdir and Grafana cluster dashboard
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-05-07 14:25:29 +02:00
Kefu Chai
9b8a74f037
Merge pull request #21748 from b-ranto/wip-fix-prom-shutdown
prometheus: Fix prometheus shutdown/restart

Reveiwed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-05-07 10:34:29 +08:00
Kefu Chai
a8150b1205
Merge pull request #21793 from b-ranto/wip-expose-objects
prometheus: Expose number of degraded/misplaced/unfound objects

Reveiwed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-05-07 10:33:03 +08:00
Kefu Chai
9df56dc509
Merge pull request #21837 from tchaikov/wip-gcc-8
cmake,common,filestore: silence gcc-8 warnings/errors

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-05-07 10:31:31 +08:00
Yuri Weinstein
5658547581
Merge pull request #21827 from yuriw/wip-yuriw-crontab
qa/tests: Added mimic runs, removed large suites (rados, rbd, etc) ru…

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-06 13:36:34 -07:00
Kefu Chai
3f3f378d38 os/filestore: silence -Wformat-truncation= warning
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-06 15:26:14 +08:00
Kefu Chai
68caa9da7e os/filestore: silence error from libstdc++ in gcc-8
this change silences following error

stl_tree.h:452:21: error: static assertion failed: comparison object
must be invocable with two arguments of key type
static_assert(__is_invocable<_Compare&, const _Key&, const _Key&>{},
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-06 15:26:14 +08:00
Kefu Chai
557cb06145 messages,mon,osd: silence gcc-8 warnings related to memset()
this silences warnings like:

warning: ‘void* memset(void*, int, size_t)’ writing to an object of
non-trivial type ‘struct uuid_d’; use assignment instead [-Wcl\
ass-memaccess]

uuid_d only contains boost::uuids::uuid, which is "nil" initialized in
uuid_d's ctor. so we don't need to bother with memset() it with 0.
the same applies to entity_inst_t.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-06 15:26:14 +08:00
Kefu Chai
62382040ee common,filestore: silence GCC-8 warnings
should catch polymorphic exceptions by reference. this silences warnings
like:

error: catching polymorphic type ‘class std::RetryException’ by value
[-Werror=catch-value=]
     } catch (std::RetryException) {

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-06 15:26:14 +08:00
Kefu Chai
19230378c8 cmake: specify missing settings for dpdk
* after upgrading to gcc-8, seems dpdk requires more settings to compile.
  in which, CONFIG_RTE_MAX_VFIO_GROUPS=64 is copied from config/common_base.
* librte_bus_pci.a depends on librte_pci.a, so reorder the libraries
  in DPDK_LIBRARIES.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-06 15:26:14 +08:00
Kefu Chai
c17e3d8346
Merge pull request #21637 from ceph/wip-da-SCA-20180423
misc: mark constructors as explicit

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-06 11:34:52 +08:00
Kefu Chai
1a87441de1
Merge pull request #19041 from dragonylffly/wip-list-objects-in-a-pg
tools/rados: allow list objects in a specific pg in a pool

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-06 11:33:47 +08:00
Kefu Chai
4ad013c536
Merge pull request #21765 from yunfeiguan/wip-23962
pybind/ceph_daemon: expand the order of magnitude of daemonperf statistics to ZB

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-06 11:29:26 +08:00
Kefu Chai
3d6429753e
Merge pull request #21815 from xiexingguo/wip-23921
crush, osd: handle multiple parents properly when applying pg upmaps

Reviewed-by: huangjun <hjwsm1989@gmail.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-06 11:25:36 +08:00
Kefu Chai
7bd7559ece
Merge pull request #21811 from tchaikov/wip-23627
librados: block MgrClient::start_command until mgrmap

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-05 19:02:25 +08:00
Kefu Chai
489519edc5
Merge pull request #21790 from dalgaaf/SCA-override-specifier
misc: mark functions with 'override' specifier

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-05 18:59:25 +08:00
Kefu Chai
4134a25ebc
Merge pull request #21829 from tchaikov/wip-qa-cephfs-snap
qa: fix test on "ceph fs set cephfs allow_new_snaps"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-05 18:39:59 +08:00
Kefu Chai
5910c2902e qa: fix test on "ceph fs set cephfs allow_new_snaps"
snapshot is now enabled for new fs in 81d0554e, so this test should be
updated accordingly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-05 09:40:41 +08:00
Yuri Weinstein
b6d85cad7c qa/tests: Added mimic runs, removed large suites (rados, rbd, etc) runs on luminous
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-05-04 13:45:29 -07:00
Sage Weil
6ac59390d2
Merge pull request #21816 from xiexingguo/wip-wrong-unregister-pg
osd/OSD: drop extra/wrong *unregister_pg*

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-04 15:25:38 -05:00
Kefu Chai
4afd5ece9c
Merge pull request #21822 from tchaikov/wip-24012
cmake: use javac -h for creating JNI native headers

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-05 00:08:23 +08:00
Kefu Chai
df27ed3a38 cmake: bump up JDK version to 1.8
as JDK 7 is EOL. see
http://www.oracle.com/technetwork/java/eol-135779.html and
https://www.java.com/en/download/faq/java_7.xml

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-04 22:55:44 +08:00
Kefu Chai
edc504b9d4 cmake: use javac -h for creating JNI native headers
JDK 1.10 does not offer javah anymore, so we need to use "javac -h" or
add_jar(... GENERATE_NATIVE_HEADERS) instead.

Fixes: http://tracker.ceph.com/issues/24012
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-04 22:34:57 +08:00
Sage Weil
02f882dd03 Merge remote-tracking branch 'gh/mimic' 2018-05-04 08:44:36 -05:00
xiexingguo
6ee6fa79b5 osd/OSD: drop extra/wrong *unregister_pg*
Signed-off-by: xiexingguo <xie.xingguo@gmail.com>
2018-05-04 21:43:51 +08:00
Brad Hubbard
303e71fe07 mgr: Include daemon details in SLOW_OPS output
Currently there is no way to see which daemons were involved in a slow
op after the op has cleared. This change allows us to record which
daemons were implicated in the logs.

Partially fixes: http://tracker.ceph.com/issues/23205

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit b5263176de)
2018-05-04 08:43:08 -05:00
xiexingguo
482ec97c98 crush, osd: handle multiple parents properly when applying pg upmaps
Fixes: http://tracker.ceph.com/issues/23921
Signed-off-by: xiexingguo <xie.xingguo@gmail.com>
2018-05-04 21:40:07 +08:00
Sage Weil
6e64a4e4d9
Merge pull request #21750 from badone/wip-summarise-osds-when-issuing-slow-request-warning-post-luminous
mgr: Include daemon details in SLOW_OPS output

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-04 08:36:02 -05:00
Kefu Chai
eaa1179965 librados: timeout on mgr_command()
because the mgrclient will be waiting for the mgrmap if the mgrmap
is not available, when the client is about to send a mgr command.
and monitor will drop the subscription requests if the client does not
have enough cap for reading mon, so unlike mon commands, the client
won't get an EACCES return code in this case.

in this change, a timeout machinary is introduced. and the client
will wait for "rados-mon-op-timeout" before it gives up. if this
setting is 0, it will wait forever.

Fixes: https://tracker.ceph.com/issues/23627
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-04 19:23:02 +08:00
John Spray
5865b0cbec
Merge pull request #21520 from jan--f/doc-fix-pg-state-names
doc/rados/operations/pg-states: fix PG state names

Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-04 10:57:47 +01:00
John Spray
4f98ff5e06
Merge pull request #21557 from jan--f/mgr-prometheus-fix-metadata-labels
mgr: prometheus fix metadata labels

Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-04 10:56:24 +01:00
Kefu Chai
dc9df4d93a
Merge pull request #21797 from tomkukral/remove-cz-mirror
doc: remove CZ mirror

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-04 16:54:32 +08:00
Tomáš Kukrál
71bd43babf
doc: remove CZ mirror
CZ mirror is no longer running because company sponsoring this mirror
isn't able to provide it anymore.

I'm removing this mirror from list of official mirrors.

Signed-off-by: Tomáš Kukrál <tom@6shore.net>
2018-05-04 10:46:14 +02:00
John Spray
ef517d0ea0 librados: fix locking on get_required_monitor_features
This wasn't taking the MonClient lock: should use
with_monmap to protect access to MonClient::monmap.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-05-04 16:39:30 +08:00
John Spray
8fd500d736 librados: config mgrclient for pre-luminous cluster
Signed-off-by: John Spray <john.spray@redhat.com>
2018-05-04 16:39:21 +08:00
John Spray
bae47183c2 mgr/MgrClient: add mgr_optional mode
This is for use when talking to pre-luminous
clusters, where we should not block waiting
for MgrMap because it might never come.

Fixes: https://tracker.ceph.com/issues/23627
Signed-off-by: John Spray <john.spray@redhat.com>
2018-05-04 16:39:17 +08:00
Jan Fajerski
7f8b40fc46 doc/rados/operations/pg-states: fix PG state names
Change pg state names according to osd/osd_types.cc as this is what
ceph -s and the prometheus exporter will present to users.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-05-04 08:47:12 +02:00
Kefu Chai
7eb94d4909
Merge pull request #21461 from yaozongyou/calculate-stddev-on-the-fly
common: calculate stddev on the fly

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-04 12:06:10 +08:00
Patrick Donnelly
5eb2a2b10a
Merge PR #21805 into master
* refs/pull/21805/head:
	qa: move snap-hierarchy out of snaps workunits
	qa: try snap format upgrade with multimds cluster
	qa: add mds deactivation procedure for upgrades

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 19:05:50 -07:00
Kefu Chai
46fc58a120
Merge pull request #21807 from smithfarm/wip-python-encoding
script: build-integration-branch: avoid Unicode error

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-04 09:33:45 +08:00
Kefu Chai
50a052d79e
Merge pull request #19714 from qwren/qatzip-compressor
compressor: add QAT support

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-04 09:17:17 +08:00
Kefu Chai
d2441ea27c
Merge pull request #21242 from majianpeng/objecter-calc-budget
osdc: Change 'bool budgeted' to 'int budget' to avoid recalculating.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-04 09:16:14 +08:00
Kefu Chai
d59c7d942b
Merge pull request #21487 from yanghonggang/kstore-statistic
os/kstore: support db statistic

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-04 09:14:24 +08:00
Kefu Chai
de6b7ac5f6
Merge pull request #21299 from yanghonggang/pool-create
librados: Reject the invalid pool create request at client side, rath…

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-05-04 09:13:17 +08:00
Patrick Donnelly
5dc626cec7
Merge PR #21759 into master
* refs/pull/21759/head:
	script: Fix ceph-debug-docker.sh script create --tag in correct format

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 17:54:39 -07:00
Patrick Donnelly
4d37b0ee8d
qa: move snap-hierarchy out of snaps workunits
The snapshot hierarchy it leaves behind can't be cleaned up by `rm -rf` which
breaks workunit cleanup. So, don't run this as part of normal snaps test.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 16:52:34 -07:00
Patrick Donnelly
0b466cb2e6
qa: try snap format upgrade with multimds cluster
Fixes: http://tracker.ceph.com/issues/24002

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 16:52:13 -07:00
Patrick Donnelly
6a788bf203
qa: add mds deactivation procedure for upgrades
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 16:51:43 -07:00
Sage Weil
fb6b4ec76b
Merge pull request #21553 from dragonylffly/wip-improve-rados-ls
tools/rados: improve the ls command usage

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-03 17:34:13 -05:00
Sage Weil
489c60915d
Merge pull request #21795 from wido/influx-string-split
mgr/influx: Only split string on first occurence of dot (.)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-03 17:32:29 -05:00