Commit Graph

83832 Commits

Author SHA1 Message Date
Kefu Chai
23eb14de52
Merge pull request #20103 from openattic/wip-mgr-dashboard_v2
mgr/dashboard_v2: Initial submission of a web-based management UI (replacement for the existing dashboard)

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-06 19:08:57 +08:00
Kefu Chai
2e4f06ea54
Merge pull request #20659 from tchaikov/wip-msg/async/dpdk/launch-on-coreid
msg/async: execute on core specified by core_id not its index

Reviewed-by: shangfufei <shangfufei@inspur.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
2018-03-06 17:10:52 +08:00
Nathan Cutler
bebcdbeb76 tests: workunits: drop rest/test.py workunit
This workunit is only used by the two rest-api test cases that are also being removed.

Fixes: http://tracker.ceph.com/issues/21264
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-06 09:34:43 +01:00
Nathan Cutler
b69530e647 tests: rados suite: drop rest-api test cases
Fixes: http://tracker.ceph.com/issues/21264
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-06 06:58:59 +01:00
Gregory Farnum
017c846449
Merge pull request #20519 from gregsfortytwo/wip-22882-linger-locking
osdc/Objecter: take budgets across a LingerOp instead of on child Ops

Reviewed-by:  Jason Dillaman <dillaman@redhat.com>
2018-03-05 21:49:27 -08:00
Greg Farnum
aba55b5fb6 osdc: create and use take_linger_budget for prefetching watch/notify budgets
We don't actually take any budget, as we don't want to hit the
total op limits (especially on eg rbd-mirror), but this prevents
our per-message budgeting from causing a deadlock.

Fixes: http://tracker.ceph.com/issues/22882

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2018-03-05 21:45:42 -08:00
Gregory Farnum
7b9a715189
Merge pull request #20517 from gregsfortytwo/wip-22114-beacon-blocking-2
mon: mark OSD beacons and pg_create messages as no_reply

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2018-03-05 21:29:10 -08:00
Jos Collin
3d6a61efff
Merge pull request #20720 from ctrlaltdel/typo
doc: Fix typo s/applicatoin/application/

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-03-06 09:22:19 +05:30
Kefu Chai
c454b1d1d6
Merge pull request #20535 from ifed01/wip-ifed-bring-fio
test/fio: enable objectstore FIO plugin building without the need to install and build FIO source code

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-06 08:36:39 +08:00
Kefu Chai
ade7193be8
Merge pull request #20708 from majianpeng/bluefs-bug-fix
os/bluestore: fix wrong usage for BlueFS::_allocate.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-03-06 08:31:07 +08:00
Jianpeng Ma
3e56ecb7b1 os/bluestore: fix wrong usage for BlueFS::_allocate.
In fact, function _allocate is atomic function which don't
allocate less than want space.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-03-06 16:11:17 +08:00
Jianpeng Ma
d1af5b060c os/bluestore/BlueFS: cleanup code for more readable.
And remove the useless judgement.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-03-06 16:11:17 +08:00
Kefu Chai
41ae53385b
Merge pull request #20699 from yaozongyou/fix-potential-memory-leak
common: fix potential memory leak in HTMLFormatter

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-06 08:29:06 +08:00
Kefu Chai
a1c4846fbc
Merge pull request #20701 from tchaikov/wip-23212
os/bluestore: recalc_allocated() when decoding bluefs_fnode_t

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-03-06 08:28:12 +08:00
Kefu Chai
f9a934a211
Merge pull request #20544 from liewegas/wip-min-kv
os/bluestore: kv_max -> kv_min

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-03-06 08:27:20 +08:00
Kefu Chai
a1fdc5e280
Merge pull request #20713 from smithfarm/wip-spdk-python3
spdk: advance to upstream dc82989d

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-06 08:22:05 +08:00
John Spray
86d7f3f72c
Merge pull request #20131 from jcsp/wip-doc-encoding
doc/dev: add a brief guide to serialization

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-05 22:33:34 +00:00
Boris Ranto
93cd098103 build-doc: Upgrade ceph python libraries
If you have python ceph bindings installed on your system, the doc-build
script will fail since pip detects them and fails to install the updated
bindings in the virtualenv. This fixes the issue by adding --upgrade
flag to pip so that it overrides the system-installed libraries.

Signed-off-by: Boris Ranto <branto@redhat.com>
2018-03-05 22:46:39 +01:00
Boris Ranto
ae36980ce4
Merge pull request #20717 from b-ranto/wip-restful-doc
doc: Improve mgr/restful module documentation

Reviewed-by: John Spray <john.spray@redhat.com>
2018-03-05 22:37:49 +01:00
Nathan Cutler
b7e638f7e4 build/ops: deb: move python-jinja2 dependency to mgr
87399bea8321a7a9ab554085be3a3d5e0563f27f introduced an explicit dependency on
python-jinja2, but mistakenly as an overall build dependency instead of as a
runtime dependency of ceph-mgr as intended.

Fixes: http://tracker.ceph.com/issues/22457
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-05 22:04:34 +01:00
Nathan Cutler
0dd34c81f2 doc: PendingReleaseNotes: deprecate/drop ceph-rest-api
References: http://tracker.ceph.com/issues/21264
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-05 22:01:51 +01:00
Nathan Cutler
495742f7dd tools: cleanup: rip out ceph-rest-api
Obsoleted by the mgr REST API.

Fixes: http://tracker.ceph.com/issues/21264
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-05 22:01:51 +01:00
Yuri Weinstein
8eb3c1f88e
Merge pull request #20542 from liewegas/wip-bluefs-buffered-io
common/options: bluefs_buffered_io=true by default

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2018-03-05 09:43:36 -08:00
Ilya Dryomov
c13d196256
Merge pull request #20721 from idryomov/wip-krbd-parent-overlap-test
qa: krbd parent-overlap test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-03-05 18:39:35 +01:00
Igor Fedotov
939805165e test/fio: enable objectstore FIO plugin building without the need to install and build FIO source code
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-03-05 20:35:08 +03:00
Jason Dillaman
3ff15beb97
Merge pull request #20695 from mikechristie/wip-doc-mnc-update-iscsi-kernel
doc: update iSCSI upstream kernel to 4.16

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-03-05 12:27:09 -05:00
John Spray
d9a289849a
Merge pull request #20663 from tchaikov/wip-ceph.in-py3
ceph.in: use a different variable for holding thrown exception

Reviewed-by: John Spray <john.spray@redhat.com>
2018-03-05 15:36:27 +00:00
Francois Deppierraz
25edd6115a Doc: Fix typo s/applicatoin/application/
Signed-off-by: Francois Deppierraz <francois@ctrlaltdel.ch>
2018-03-05 15:44:19 +01:00
Ilya Dryomov
bd05dbd694
Merge pull request #20714 from idryomov/wip-krbd-msgr-segments-test
qa: krbd msgr-segments test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-03-05 15:25:56 +01:00
Kefu Chai
25514e0bbd os/bluestore: recalc_allocated() when decoding bluefs_fnode_t
Fixes: http://tracker.ceph.com/issues/23212
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-03-05 21:47:19 +08:00
Boris Ranto
a83583e7fa doc: Improve mgr/restful module documentation
Fixes: https://tracker.ceph.com/issues/23219

Signed-off-by: Boris Ranto <branto@redhat.com>
2018-03-05 14:45:51 +01:00
Ilya Dryomov
5224a218bb qa: krbd parent-overlap test
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2018-03-05 14:26:42 +01:00
Ricardo Dias
5449857380
mgr/dashboard_v2: added script to run backend API tests locally
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-05 13:07:18 +00:00
Ricardo Dias
7eba3187a5
qa/suites/mgr/dashboard_v2: added suite yaml for testing dashboard_v2
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-05 13:07:18 +00:00
Ricardo Dias
966fe3672e
qa/tasks/mgr/dashboard_v2: implementation of backend API tests
We moved the dashboard_v2 test cases that required a real ceph cluster
to run into qa/tasks/mgr with the necessary adaptations.
These tests can now be run in teuthology using the cephfs_test_runner
task.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-05 13:07:18 +00:00
Ricardo Dias
86264d4b02
qa/tasks/mgr: move test initialization to setUpClass method
With this change, we avoid the disabling/enabling of the ceph-mgr module
being tested for each test function declared in each test case. Now
the ceph-mgr module being tested is disabled/enabled only once for each
test case.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-05 13:07:18 +00:00
Sebastian Wagner
19bb5db9f7
mgr/dashboard_v2: Added smoke test.
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-05 13:07:18 +00:00
Sebastian Wagner
97606b4660
mgr/dashboard_v2: Add mgr-dashboard_v2 frontend unittests to ctest
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-05 13:07:17 +00:00
Sebastian Wagner
24e216b519
mgr/dashboard_v2: Add CMake target to build the frontend.
* Added new CMake flag `WITH_MGR_DASHBOARD_V2_FRONTEND`:
  Build the mgr/dashboard_v2 frontend using `npm install && npm run build`

* Set this flag to `OFF` when building packages.

* Removed creation of the frontend from `vstart.sh`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-05 13:07:17 +00:00
Sebastian Wagner
d7ead639dc
mgr/dashboard_v2: Integrate dashboard_v2 into make check
Also:

* Disabled API tests in tox.
* No longer start a vstart.sh cluster in tox.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-05 13:07:17 +00:00
Patrick Nawracay
12f3c7a6b8
mgr/dashboard_v2: Remove Service and ServiceMeta class
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-03-05 13:07:17 +00:00
Patrick Nawracay
a9fd022c32
mgr/dashboard_v2: Remove BaseControllerMeta meta class
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-03-05 13:07:17 +00:00
Ricardo Dias
5fa2d07690
mgr/dashboard_v2: use global manager instance instead of injection
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-05 13:07:17 +00:00
Stephan Müller
c6fcf5e1db
mgr/dashboard_v2: Fix OSD menu entry position
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-03-05 13:07:17 +00:00
Stephan Müller
772609ffd4
mgr/dashboard_v2: Auto reload cd-table
Now every used cd-table with a valid "fetch" function will auto reload
itself by default every 10 seconds. You can also identify the unique
property of the row now, by default the unique identifier is "id".

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-03-05 13:07:17 +00:00
Sebastian Wagner
1f5051ab8a
mgr/dashboard_v2: Fixed exception in rbd_mirroring
Fixed issue when rbd-mirroring is enabled without any Pools.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-05 13:07:16 +00:00
Lenz Grimmer
f71e683a38
mgr/dashboard_v2: Enable table header and footer on perfcounters
Enable the ability to filter and paginate the performance counter tables
to make it easier to find specific information quickly.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-03-05 13:07:16 +00:00
Ricardo Marques
5a40394f92
mgr/dashboard_v2: Add support for $PREFIX config
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-03-05 13:07:16 +00:00
Ricardo Marques
4f9f38746e
mgr/dashboard_v2: Add links on dashboard
User will be able to navigate from dashboard to "Monitor" and "OSDs" pages

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-03-05 13:07:16 +00:00
Tiago Melo
53c65ea292
mgr/dashboard_v2: enable rbd-mirror perf counters
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-03-05 13:07:16 +00:00