Commit Graph

92885 Commits

Author SHA1 Message Date
Lenz Grimmer
339ff6abf1
Merge pull request #25325 from Devp00l/wip-issue-37469
mgr/dashboard: Notification queue

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-12-12 17:59:29 +01:00
Lenz Grimmer
e94318887d
Merge pull request #25494 from callithea/wip-e2e-script-rgw-conf
mgr/dashboard: Object Gateway user configuration

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-12-12 17:41:30 +01:00
Alfredo Deza
d178a5c278
Merge pull request #25238 from jan--f/c-v-refactor-strategies-into-hierachy
ceph-volume: introduce class hierachy for strategies

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-12-12 10:26:43 -05:00
Sebastian Wagner
b9663ba5a7
Merge pull request #25452 from jtlayton/wip-orchestrator
mgr/rook: fix API version and object types for recent rook changes

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-12 15:55:56 +01:00
Jan Fajerski
34df12ea6a ceph-volume: filestore strategy use strategy class hierarchy
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-12-12 15:02:59 +01:00
Jan Fajerski
302334ac6a ceph-volume: bluestore strategy use strategy class hierarchy
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-12-12 15:02:59 +01:00
Jan Fajerski
b38987ee96 ceph-volume: add strategies.py to for shared code
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-12-12 15:02:59 +01:00
Stephan Müller
0d3f312f57 mgr/dashboard: Notification queue
It's now possible to send an array of notification configs to the notification
service. These array is cached for, by default 500ms, before this array
is unified and than converted to full notifications that are seen by the
user.

Useful if different service can come to the same conclusions regarding
the notification. This is the case for the prometheus notification service
and the prometheus alert service.

Fixes: https://tracker.ceph.com/issues/37469
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-12-12 14:53:09 +01:00
Stephan Müller
174dd6ed4d mgr/dashboard: CdNotificationConfig
This model will now be taken as single argument in the 'show' method
of the notification service. Through using this model it's easy to
define notifications before sending them out. Which can be helpful
if you have to process an array of possible notification and the
possibility that those notifications would look a like.

This scenario doesn't exist in the current code base, but it's the
case for new feature to show alerts from Prometheus.

Fixes: https://tracker.ceph.com/issues/37469
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-12-12 14:53:09 +01:00
Alfredo Deza
1dcbf2f801
Merge pull request #25390 from jan--f/c-v-revert-partition-as-disk
ceph-volume: revert partition as disk

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-12-12 08:11:52 -05:00
Lenz Grimmer
e43de0b74f
Merge pull request #25276 from rhcs-dashboard/37401-chart-slice-hiding
mgr/dashboard: permanent pie chart slice hiding

Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2018-12-12 12:34:52 +01:00
Lenz Grimmer
4437f18e78
Merge pull request #25143 from nathan-weinberg/breadcrumb-block
mgr/dashboard: Added breadcrumb tests to Block menu items

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-12-12 11:58:49 +01:00
Jason Dillaman
71574a64a2
Merge pull request #25358 from trociny/wip-prometheus-rbd-stats
mgr/prometheus: provide RBD stats via osd dynamic perf counters

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-11 15:18:38 -05:00
Casey Bodley
1ef61370e6
Merge pull request #25495 from ivancich/wip-rgw-add-missing-editor-directives
rgw: clean-up -- insure C++ source code files contain editor directives

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-12-11 14:24:04 -05:00
J. Eric Ivancich
cac57e647e rgw: clean-up -- insure C++ source code files contain editor directives
Most, although not all, source code files have a comment on the first
two lines describing the C++ formatting conventions used. This commit
adds that directive to the files lacking it. Also, vertical whitespace
was made more consistent. Note: this only touches files specifically
for RGW.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2018-12-11 12:30:35 -05:00
Kefu Chai
3a1cf89e49
Merge pull request #25491 from smithfarm/wip-libradospp-devel
rpm: fix libradospp-devel runtime dependency

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-12 00:59:07 +08:00
Jason Dillaman
d135e8739c
Merge pull request #25436 from Songweibin/wip-rbd-silence-log
cls/rbd: silence the log of get metadata error
2018-12-11 11:44:08 -05:00
Jason Dillaman
e0549b3b69
Merge pull request #25372 from iridescent-rsy/add-throttle-name
common: fix access and add name for the token bucket throttle

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2018-12-11 11:42:20 -05:00
Jason Dillaman
0118603e30
Merge pull request #25445 from trociny/wip-python-rbd_list2
pybind/rbd: optimize rbd_list2

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-11 11:39:30 -05:00
Laura Paduano
7f7b1fe894 mgr/dashboard: Object Gateway user configuration
In order to be able to access and test the Object Gateway
within our end-to-end tests it needs to be configured properly.
This script will now take care of creating and configuring
a user and will set the corresponding credentials for the user.

Signed-off-by: Laura Paduano <lpaduano@suse.com>
2018-12-11 17:24:52 +01:00
Lenz Grimmer
07baabd024
Merge pull request #25327 from Devp00l/wip-issue-37471
mgr/dashboard: Settings service

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-12-11 16:23:01 +01:00
Kefu Chai
86646df14b
Merge pull request #25467 from rrmichel/patch-3
doc: Fixed syntax in iscsi initiator windows doc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-11 23:00:31 +08:00
Casey Bodley
50d1d489dc
Merge pull request #25487 from theanalyst/vstart-lc-level
vstart: rgw: disable the lc debug interval option

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-12-11 09:35:34 -05:00
Jan Fajerski
a183a28c5e ceph-volume: add inventory call to functional tests
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-12-11 15:31:05 +01:00
Jan Fajerski
05ac680cb3 ceph-volume: add partition support to Device
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-12-11 15:31:05 +01:00
Jan Fajerski
3c1c32cbc2 Revert "ceph-volume tests.util ensure partitions are listed as top-level keys"
This reverts commit 6dc0177224.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-12-11 15:31:05 +01:00
Jan Fajerski
50bc44f1c2 Revert "ceph-volume util.disk include partitions as top level devices in get_devices"
This reverts commit 7f3c359849.
Fixes: http://tracker.ceph.com/issues/37506

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-12-11 15:31:05 +01:00
Jos Collin
972abbecc8
Merge pull request #25394 from LenzGr/master-documentation
doc: Added some hints on how to further accelerate builds with ccache

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Erwan Velu <erwan@redhat.com>
Reviewed-by: Kai Wagner <kwagner@suse.com>
2018-12-11 19:41:23 +05:30
Nathan Cutler
506ba0ea0d build/ops: rpm: fix libradospp-devel runtime dependency
The devel packages don't get the major version in their name.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-12-11 15:06:08 +01:00
Alfredo Deza
ade69123dc
Merge pull request #25469 from sebastian-philipp/ceph-volume-fix-join
ceph-volume: Fix TypeError: join() takes exactly one argument (2 given)

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-12-11 08:19:44 -05:00
Sebastian Wagner
8263e4c2a6
Merge pull request #25401 from jmolmo/improve_wait_code
mgr/orchestrator: Simplify Orchestrator wait implementation 

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
2018-12-11 13:57:45 +01:00
Lenz Grimmer
0bf7fb1dad doc: Added some hints on how to further accelerate builds with ccache
Fixed incorrect note directives and added a section about how to speed
up development/scratch builds with ccache.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-12-11 12:54:54 +01:00
Kefu Chai
522f12d013
Merge pull request #25432 from rzarzynski/wip-bl-drop-pipesize
common: drop unused get_max_pipe_size() in buffer.cc.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-12-11 19:44:00 +08:00
Kefu Chai
68f52c486a
Merge pull request #25457 from trociny/wip-37581
pybind/mgr: drop unnecessary iterkeys usage to make py-3 compatible

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-11 19:42:13 +08:00
Kefu Chai
329f72dfb8
Merge pull request #25471 from majianpeng/bluestore-open-blufs
os/bluestore: check return value of _open_bluefs.

Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>
2018-12-11 19:41:11 +08:00
Sebastian Wagner
38f289b691 ceph-volume: Fix TypeError: join() takes exactly one argument (2 given)
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-11 12:23:02 +01:00
Abhishek Lekshmanan
722823a786 vstart: rgw: disable the lc debug interval option
Since it can be very verbose in logs as the start and end time are logged every
10s currently, comment these out. If needed, they can be enabled by those
needing to run the lc time based tests which are still unreliable and disabled
in qa suites.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-12-11 10:49:52 +01:00
Kefu Chai
b88de88059
Merge pull request #25404 from ptozys/master
async/dpdk: when enable dpdk, multiple message queue defect

Reviewed-by: Haomai Wang <haomai@xsky.com>
2018-12-11 14:21:22 +08:00
Kefu Chai
7582f0b5fe
Merge pull request #25460 from tchaikov/wip-krb5-off
auth: do not use GSS/KRB5 if ! HAVE_GSSAPI

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-11 11:48:35 +08:00
Kefu Chai
3a83bb2ed5
Merge pull request #25298 from smanjara/wip-rgw-import
qa/rgw: add missing import line

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-11 09:35:22 +08:00
Alfredo Deza
1ceef08d07
Merge pull request #25429 from alfredodeza/wip-bz1644847
ceph-volume zap devices associated with an OSD ID and/or OSD FSID

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Reviewed-by: Sebastien Han <shan@redhat.com>
2018-12-10 12:27:37 -05:00
Alfredo Deza
5f72143d3f
Merge pull request #25354 from ceph/wip-rm37409
ceph-volume: test with multiple NVME drives

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-12-10 11:56:16 -05:00
Radoslaw Zarzynski
58240bdb26 common: drop unused get_max_pipe_size() in buffer.cc.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-12-10 17:48:19 +01:00
Lenz Grimmer
2dd184346a
Merge pull request #25120 from Devp00l/wip-ecp-api-test-failure
mgr/dashboard/qa: Fix ECP creation test

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-12-10 17:25:10 +01:00
Jeff Layton
3deb8b10a1 mgr/rook: fix API version and object types for recent rook changes
The rook project recently renamed these objects and promoted the version
to v1. Make the corresponding changes in the ceph rook module.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2018-12-10 11:08:52 -05:00
Lenz Grimmer
a8d23bc970
Merge pull request #25363 from zmc/wip-fix-dash-ecp-test
mgr/dashboard: Fix a broken ECP controller test

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-12-10 16:19:05 +01:00
Sebastian Wagner
8d459de570
Merge pull request #25391 from SUSE/wip-orchestrator-deepsea-cleanup
mgr/deepsea: check for inflight completions when starting event reader, cleanup logging and comments

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-12-10 16:04:56 +01:00
Mykola Golub
7d1c7ec331 pybind/mgr: drop unnecessary iterkeys usage to make py-3 compatible
Fixes: http://tracker.ceph.com/issues/37581
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-10 13:50:46 +00:00
Jianpeng Ma
4d0001fd6f os/bluestore: check return value of _open_bluefs.
With an non-existing device as db, it met the following error messages:

sceph7: 2018-12-11 04:52:28.117 7efe74b1f600 -1 bluestore(/var/lib/ceph/mnt/osd-device-0-data) _read_fsid unparsable uuid
sceph7: 2018-12-11 04:52:28.121 7efe74b1f600 -1 bluestore(/var/lib/ceph/mnt/osd-device-0-data) _open_bluefs /var/lib/ceph/mnt/osd-device-0-data/block.db symlink exists but target unusable: (2) No such file or directory
sceph7: *** Caught signal (Segmentation fault) **
sceph7:  in thread 7efe74b1f600 thread_name:ceph-osd
sceph7:  ceph version 14.0.1-1121-gfbea0e658a (fbea0e658a) nautilus (dev)
sceph7:  1: (()+0x29e7ebc) [0x564a473f8ebc]
sceph7:  2: (()+0x12890) [0x7efe7235f890]
sceph7:  3: (__pthread_mutex_trylock()+0x14) [0x7efe72357244]
sceph7:  4: (ceph::mutex_debug_detail::mutex_debug_impl<false>::try_lock_impl()+0x1f) [0x564a46ae5091]
sceph7:  5: (ceph::mutex_debug_detail::mutex_debug_impl<false>::try_lock(bool)+0x1d) [0x564a46abd3bf]
sceph7:  6: (ceph::mutex_debug_detail::mutex_debug_impl<false>::lock(bool)+0x49) [0x564a46a9b20b]
sceph7:  7: (std::lock_guard<ceph::mutex_debug_detail::mutex_debug_impl<false> >::lock_guard(ceph::mutex_debug_detail::mutex_debug_impl<false>&)+0x2f) [0x564a46a98515]
sceph7:  8: (BlueFS::mkdir(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x45) [0x564a4739a7cb]
sceph7:  9: (BlueRocksEnv::CreateDir(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x3a) [0x564a473b691a]
sceph7:  10: (BlueStore::_open_db(bool, bool)+0x11b3) [0x564a471ec2b7]
sceph7:  11: (BlueStore::mkfs()+0x149a) [0x564a471f4e00]
sceph7:  12: (OSD::mkfs(CephContext*, ObjectStore*, uuid_d, int)+0xc9) [0x564a46a07c2b]
sceph7:  13: (main()+0x1bf0) [0x564a469d4850]
sceph7:  14: (__libc_start_main()+0xe7) [0x7efe70ff4b97]
sceph7:  15: (_start()+0x2a) [0x564a469d1c5a]
sceph7: 2018-12-11 04:52:28.137 7efe74b1f600 -1 *** Caught signal (Segmentation fault) **

To avoid this occur, it should check return value of _open_bluefs.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-12-10 21:12:10 +08:00
Mykola Golub
ad174de080 mgr/prometheus: provide RBD stats via osd dynamic perf counters
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-10 11:56:22 +00:00