Commit Graph

91136 Commits

Author SHA1 Message Date
Stephan Müller
8e56421bcd mgr/dashboard: Update PG update test
It is now commented out like it was before,
but I've added a comment what happened during this test with the QA
system. The problem was that even with only a increase of 1 PG the QA
cluster went into a cluster warning state and did not recover in time.
The QA coverage timeout is 2 minutes.

I could not reproduce this behavior with a local cluster, but I've
added a loop to wait until pgp and pg number are equal and the cluster
is in a healthy state again. This can take locally about 5 seconds.
The internal loop has a timeout of 3 minutes.

Fixes: https://tracker.ceph.com/issues/36362
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 15:56:54 +02:00
Stephan Müller
c98c8055c2 mgr/dashboard: Unset compression arguments for pools
The dashboard backend can now unset all set compression arguments if the
compression mode is switched to 'unset'. In the case of 'unset' Ceph
itself will only delete the 'compression_mode' argument, not all other
set arguments. The other arguments that should be removed, too, are
added to the update arguments in order to delete all set arguments.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 15:56:47 +02:00
Stephan Müller
039a01d824 mgr/dashboard: Readd pool notifications
As of the merge of cleaner notifications, the notification component was
refactored and move this caused a loss of previously added
notifications.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 15:56:35 +02:00
Stephan Müller
e5a04a3d48 mgr/dashboard: Use task list service in pool list
Now the pool list uses the task list service to monitor all tasks, in
order to extend each pool item with corresponding tasks if any. If there
is a running task for a pool you will see what action runs on it in the
listing.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 15:56:28 +02:00
Stephan Müller
2d74c97c7c mgr/dashboard: Handle pool permissions
Handles pool action permissions in pool listing.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 15:56:21 +02:00
Stephan Müller
6b86243c3a mgr/dashboard: Pool delete
You can delete pools through the UI, this will generate a task that
deletes the pool in the background.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 15:56:18 +02:00
Stephan Müller
1e75db573b mgr/dashboard: Pool create / edit
You can create/edit pools through the UI if you have the right
permissions.

You can specify the following:
* Name - can't be duplicated
* Type - replicated or erasure
* Crush rule set
  * Validates if you can use it
  * A popover tells which crush steps are used
* Replica size - depends on your selected rule and the amount of OSDs
* Erasure code profile
* PGs - will be recalculated on form changes (type, replica size,
    erasure profile, crush rule) only if not set before
* EC overwrites flag
* Compression - Algorithm / Min/max blob size / mode / ratio
* Application metadata - Predefined and custom applications as badges

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 15:56:15 +02:00
Kefu Chai
cdbba106aa
Merge pull request #24471 from tchaikov/wip-doc-serve-doc
doc: add instructions about using "serve-doc" to preview built document

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-10-09 21:22:20 +08:00
Kefu Chai
71d0c98c8b PendingReleaseNotes: note newly added CLAY code
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-09 21:20:27 +08:00
Kefu Chai
438876eb0f
Merge pull request #24477 from tchaikov/wip-live-with-slow-list-size
cmake: remove checking for GCC 5.1

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-10-09 21:05:25 +08:00
Stephan Müller
769abcb399 mgr/dashboard: Return errors to subscriber of task-wrapper
Fixes: https://tracker.ceph.com/issues/36360
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:55:14 +02:00
Stephan Müller
525de6674d mgr/dashboard: Fixes user roles
Due to changes in the badges component, user roles had to be amended.

Fixes: https://tracker.ceph.com/issues/36357
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:55:02 +02:00
Stephan Müller
3d06484be5 mgr/dashboard: Add badge filtering
It's now possible to filter badges and create badges via a create badges
label.

Fixes: https://tracker.ceph.com/issues/36357
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:54:51 +02:00
Tatjana Dehler
960c17aa1b mgr/dashboard: add create functionality to the frontend
Add the missing functionality to create config options and related
tests to the frontend.

Fixes: http://tracker.ceph.com/issues/24455

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:51:34 +02:00
Stephan Müller
bc7ead0bc6 mgr/dashboard: Enable custom badges
Enables custom badges within badges component.

It's possible to use custom validations and custom error messages.

Fixes: https://tracker.ceph.com/issues/36357
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:51:31 +02:00
Stephan Müller
bc9f34eacc mgr/dashboard: Amend pool backend tasks
Amends pool tasks in order to get the right results back into the UI
and also to have tasks with the same attributes.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:51:27 +02:00
Stephan Müller
177e2df47e mgr/dashboard: Add pool type definition
Adds pool type definition which is used in pool listing.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:51:23 +02:00
Stephan Müller
2f041a0f0b mgr/dashboard: Add crush rule type definitions
There are two type definitions one for the crush rule itself and one
for the crush step definition which is used inside the crush rule
definition.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:51:19 +02:00
Stephan Müller
1ef6c7a382 mgr/dashboard: Erasure code profile interface
Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:51:13 +02:00
Tatjana Dehler
724e3cb709 mgr/dashboard: add missing parameter type and related test
Added missing parameter type and a test for this service method.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:50:53 +02:00
Tatjana Dehler
b952a0df11 mgr/dashboard: add config options form
Fixes: http://tracker.ceph.com/issues/24455

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:50:47 +02:00
Tatjana Dehler
a4dacee4b6 mgr/dashboard: add pattern validators
Add some pattern validators (ip, uuid, number, decimalNumber) that
are needed to validate the config option input values.

Fixes: http://tracker.ceph.com/issues/24455

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:50:42 +02:00
Stephan Müller
47d7399cd6 mgr/dashboard: Erasure code service
Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-10-09 14:50:32 +02:00
Tatjana Dehler
a874548121 mgr/dashboard: add placeholder for filters to datatable
As (e.g.) the configuration option documentation has dropdown menus
with pre-defined filters we need a placeholder for them in the
datatable.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:50:27 +02:00
Tatjana Dehler
bbd69caf17 mgr/dashboard: move config table details to their own component
Fixes: http://tracker.ceph.com/issues/24455

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:50:10 +02:00
Tatjana Dehler
18d91e2419 mgr/dashboard: add backend method to create config options
Fixes: http://tracker.ceph.com/issues/24455

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:50:00 +02:00
Tatjana Dehler
d13cab8631 mgr/dashboard: fix typo
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:49:54 +02:00
Tatjana Dehler
80d304181d mgr/dashboard: fix missing import
Added the missing import otherwise the 'should create' test will fail
because the received component is undefined.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:49:38 +02:00
Tatjana Dehler
2a630be872 mgr/dashboard: refactor '_get_mon_allow_pool_delete_config'
Refactor '_get_mon_allow_pool_delete_config' method to be a little bit
more general. The method can now be used to get the value of every
config option known to the cluster.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-10-09 14:47:24 +02:00
Sage Weil
c1a9d02c9b mgr/devicehealth: warn on failing devices at 6 weeks
This gives us an interval where we warn before automatically marking an
OSD out.  That way the operator has an opportunity to preemptively replace
the device and incurring only a single rebalance/recovery event (vs two,
one to evacutate the failing the device, another to refill the
replacement).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-09 07:21:27 -05:00
Jos Collin
4878508dcc
Merge pull request #24392 from joscollin/wip-fix-fs-status
pybind/mgr: identify invalid fs

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-09 16:36:02 +05:30
Kefu Chai
eb4070e458
Merge pull request #24422 from mynaramana/claydoc
docs: add Clay code plugin documentation

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-09 17:50:14 +08:00
Sebastian Wagner
92e2a57078 mgr/orchestrator: Fix Python 3 issues
* `Exception.message` is deprecated.
* Use relative imports.
* `filter` returns an iterator in Py3
* `urlparse` moved.
* `s/log.warn/log.warning`
* Dockerfile: install Py3 versions.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-10-09 11:16:44 +02:00
Ricardo Marques
f55ce302b6
Merge pull request #23666 from rhcs-dashboard/grafana-integration
mgr/dashboard: Grafana graphs integration with dashboard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-10-09 09:29:08 +01:00
Volker Theile
9164e810b4 mgr/dashboard: The RGW backend doesn't handle IPv6 properly
Fixes: https://tracker.ceph.com/issues/36109

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-10-09 09:42:32 +02:00
Volker Theile
eaf366aac0 mgr/dashboard: Performance counter progress bar keeps infinitely looping
Fixes: https://tracker.ceph.com/issues/36325

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-10-09 08:26:09 +02:00
Kefu Chai
5e0dd8c19e README.md: bump up required cmake to 3.5.1
we started to use cmake 3.5.1 back in 34f1ee78

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-09 13:52:11 +08:00
Jos Collin
52fb7a9f6a
pybind/mgr: identify invalid fs
Identify invalid fs in 'fs status' output.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-10-09 09:47:38 +05:30
hsiang41
401d729787 Replace local predictor model file
Replace local predictor model file for Debian package.
It is compatible with below library:
python-sklearn	0.19.1-3
python-joblib   0.11-1

Signed-off-by: Rick Chen <rick.chen@prophetstor.com>
2018-10-09 12:07:43 +08:00
Myna V
c5a46dde94 doc: clay code plugin
Signed-off-by: Myna <mynaramana@gmail.com>
2018-10-09 07:48:07 +05:30
Myna V
da6f5a44e0 ersaure-code: Cleanup of clay code source files.
* fixes the copyright on clay code source files

Signed-off-by: Myna <mynaramana@gmail.com>
2018-10-09 07:47:24 +05:30
Jason Dillaman
82a98163af
Merge pull request #24457 from trociny/wip-qa-cli-namespace
qa/workunits/rbd: fix cli generic namespace test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-10-08 15:15:30 -04:00
Jason Dillaman
03faf68d8f rbd-mirror: re-use pool config override helper method
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-08 14:08:30 -04:00
Jason Dillaman
7845252e35 librbd: use pool config overrides for create state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-08 14:03:28 -04:00
Jason Dillaman
7abfe59ec3 librbd: use pool config overrides for clone state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-08 13:56:58 -04:00
Jason Dillaman
66f4ebbb90 librbd: helper method to apply pool-level config overrides
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-08 13:56:58 -04:00
Jason Dillaman
df886fbcfc librbd: avoid explicitly naming all RBD config options
Instead, only list the few that are excluded and use the config
schema to populate the remainder.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-08 13:56:57 -04:00
Kefu Chai
d6072b9571 cmake: remove checking for GCC 5.1
this reverts bcc0511d3b,

because

* we already check for C++17 support in the same cmake list
* it's non trivial to check the O(1) std::list::size().
* we always build using the GCC 7.3 from SCLs on CentOS and RHEL. so the
  error message is always printed if we could have detected the O(1)
  std::list::size(). and we cannot fail the build if we are using an
  standard library with O(1) std::list::size().

so, this check is pointless.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-08 23:35:57 +08:00
Kefu Chai
f443aaed23
Merge pull request #24460 from falcon78921/wip-doc-36336
doc: updated cluster map reference link

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-08 23:13:55 +08:00
Ricardo Marques
ac7a77149f
Merge pull request #24369 from p-na/fix-osd-error
mgr/dashboard: Fix error when clicking on newly created OSD

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-10-08 16:00:16 +01:00