Commit Graph

88009 Commits

Author SHA1 Message Date
Ricardo Dias
1d9ec3b9e4
mgr/dashboard: pylint: updated list of files to verify
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
dccd7d84be
mgr/dashboard: tests: local role-based authorization
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
2823013b45
mgr/dashboard: load and cofigure authorization system
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
d53272cc65
mgr/dashboard: authmanager: authorization handling cherrypy tool
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
603f715b73
mgr/dashboard: local role-based authorization system implementation
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
70b567f78d
mgr/dashboard: security: static scopes and permissions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:50 +01:00
Jos Collin
675fc8ac38 doc: updated get-involved.rst for ceph-dashboard
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-26 16:49:25 +05:30
Lenz Grimmer
ea870c249f
Merge pull request #22706 from joscollin/wip-doc-dashboardgrafana
doc/dashboard: fix formatting on Grafana instructions-2
2018-06-26 12:18:39 +02:00
Tiago Melo
d9b29fa6a8 mgr/dashboard: fix the version of all frontend dependencies
This will reduce unexpected errors when building dashboard frontend. 

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-26 10:55:16 +01:00
Kefu Chai
da5d156b6b include/memory.h: remove memory.h
memory.h was introduced back when the shared_ptrs were still in TR1, but
we've moved to C++17 now. and the C++ clients should be compiled with
a C++11 compatible compiler. so there is no need to have this file anymore.

also replace all references of ceph::shared_ptr and ceph::weak_ptr with
std::shared_ptr and std::weak_ptr accordingly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-26 17:52:04 +08:00
Mykola Golub
d9fe8246c1
Merge pull request #22694 from dillaman/wip-test-rbd-mirror
test/rbd-mirror: disable use of gtest-parallel

Reviewed-by: Erwan Velu <erwan@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-06-26 10:24:25 +03:00
Kefu Chai
c9fb0484d6
Merge pull request #22591 from tchaikov/wip-gcc-8.1
cmake: disable -Werror-stringop-truncation for rocksdb

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-26 12:41:57 +08:00
Jos Collin
72f14881ae doc/dashboard: fix formatting on Grafana instructions
The whole list was in a code block, instead of just the snippets.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-26 09:10:15 +05:30
Sage Weil
cade2f96cb Merge PR #22691 into master
* refs/pull/22691/head:
	os/bluestore: fix minor issues in bitmap logging output
	os/bluestore: fix overlappedd allocation returned by bitmap allocator

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-25 21:21:17 -05:00
Kefu Chai
3117fde93a
Merge pull request #22682 from wwformat/fix-centos-install-deps
install-deps: check the exit status for the $builddepcmd

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-26 09:26:49 +08:00
David Zafman
f0964beac5 qa: For teuthology copy logs to teuthology expected location
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-25 18:06:01 -07:00
James McClune
90bbc8d933 doc: updated documentation for installing google-perftools on Debian systems
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-06-25 19:53:04 -04:00
Patrick Donnelly
9829f56c07
Merge PR #22532 into master
* refs/pull/22532/head:
	qa/suites: Add supported-random-distro$ links.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-25 15:48:34 -07:00
Sage Weil
97ef5a8510 mgr/DaemonServer: avoid dereferencing end() iterator
Fixes: http://tracker.ceph.com/issues/23249
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-25 16:00:02 -05:00
Erwan Velu
57df91380b qa/standalone/ceph-helpers.sh: Setup ulimit in setup()
If ulimit is set to a 1024 value, ceph-osd will segfault with the
following error :
    filestore(td/smoke/0)  error (24) Too many open files not handled on operation 0x55565d1fd004 (2182.1.0, or op 0, counting from 0)

This patch is about to insure that before setting up ceph daemons in tests, a valid ulimit value is setup.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-06-25 22:09:14 +02:00
Erwan Velu
7b0d1c8b8a qa/standalone/ceph-helpers.sh: Thinner resolution in get_timeout_delays()
get_timeout_delays() is a generic function to compute delays for a long
period of time without saturating the CPU is busy loops.

It works pretty fine when the delay is short like having the following
series when requesting a 20seconds timeout : "0.1 0.2 0.4 0.8 1.6 3.2 6.4 7.3 ".
Here the maximum between two loops is 7.3 which is perfectly fine.

When the timeout reaches 300sec, the same code produces the following
series : "0.1 0.2 0.4 0.8 1.6 3.2 6.4 12.8 25.6 51.2 102.4 95.3 "
In such example there is delays which are nearly 2 minutes !

That is not efficient as the expected event, between two loops, could
arrive just after this long sleep occurs making a minute+ sleep for
nothing. On a local system that could be ok while on a CI, if all jobs
run like CI the overall is pretty unefficient by generating useless CPU
waits.

This patch is about adding a maximum acceptable delay time between two
loops while keeping the same rampup behavior.

On the same 300 seconds delay example, with MAX_TIMEOUT set to 10, we
now have the following series: "0.1 0.2 0.4 0.8 1.6 3.2 6.4 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 7.3"
We can see that the long 12/25/51/102/95 values vanished and being
replaced by a series of 10 seconds. It's up to every test defining the
probability of having a soonish event to complete.

The MAX_TIMEOUT is set to 15seconds.
Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-06-25 22:09:14 +02:00
Patrick Donnelly
d038e1da7a
Merge PR #22626 into master
* refs/pull/22626/head:
	scripts: add ceph-common-dbg to debug packages

Reviewed-by: David Zafman <dzafman@redhat.com>
2018-06-25 13:07:39 -07:00
Patrick Donnelly
fc41b98822
scripts: add ceph-common-dbg to debug packages
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-25 13:06:02 -07:00
Casey Bodley
36d3a8f984 common: add an async SharedMutex
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-25 15:32:48 -04:00
Jason Dillaman
814a4a2388 test/rbd-mirror: disable use of gtest-parallel
This test repeatedly deadlocks when run under in parallel.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-06-25 15:32:15 -04:00
Kefu Chai
e7d98d73e5
Merge pull request #22693 from tspmelo/fix-lint-codelyzer
mgr/dashboard: fix lint error caused by codelyzer update

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-26 01:42:07 +08:00
Tiago Melo
4e7f4cbd3f mgr/dashboard: fix lint error caused by codelyzer update
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-25 17:23:00 +01:00
Igor Fedotov
4fe976db22
Merge pull request #22544 from ifed01/wip-ifed-alloc-bench-fix
test/objectstore: fix random generator in allocator_bench.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2018-06-25 19:17:28 +03:00
Igor Fedotov
dc4b5fc5af os/bluestore: fix minor issues in bitmap logging output
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-06-25 18:06:27 +03:00
Igor Fedotov
539af4f27e os/bluestore: fix overlappedd allocation returned by bitmap allocator
Fixes: https://tracker.ceph.com/issues/24598
Signed-off-by: Igor Fedotov <ifedotov@suse.som>
2018-06-25 18:06:24 +03:00
Lenz Grimmer
ccd59a4678 mgr/dashboard: Replaced "Pool" with "Pools" in navigation bar
Replaced the string "Pool" with "Pools" in the navigation component.

Fixes: https://tracker.ceph.com/issues/24623
Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-06-25 13:38:55 +02:00
Yunchuan Wen
46e33d15a4 install-deps: check the exit status for the $builddepcmd
in some case, the $builddepcmd will failed without any "error:" output.
so we should check the exit status to handle it.

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2018-06-24 09:48:50 +08:00
Sage Weil
eb3bbb8462 Merge PR #22479 into master
* refs/pull/22479/head:
	mgr/devicehealth: add self-test
	mgr/devicehealth: make config options instance attributes
	mgr/devicehealth: active -> enable_monitoring
	mgr/mgr_module: update docstring for get()
	mgr/devicehealth: fix 'device get-health-metrics' when no metrics are stored
	mgr/devicehealth: add some scraping infrastructure
	osd: optionally query smart for a single devid
	mgr/ActivePyModules: add get for 'device <devid>'
	osd: key smart results by unique device id
	mgr: enable devicehealth by default
	mgr/devicehealth: rename old smart module to devicehealth
2018-06-23 17:05:51 -05:00
Sage Weil
cd24ccefc5 Merge PR #22572 into master
* refs/pull/22572/head:
	osd: update clone_overlap even the clone have been evicted

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-23 17:05:45 -05:00
Sage Weil
23915a4baf Merge PR #22576 into master
* refs/pull/22576/head:
	common/obj_bencher.cc: faster object name generation

Reviewed-by: Erwan Velu <erwan@redhat.com>
2018-06-23 17:05:40 -05:00
Sage Weil
2f7595131b Merge PR #22588 into master
* refs/pull/22588/head:
	mgr/iostat: column_width should be int not float

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Mohamad Gebai <mgebai@suse.com>
2018-06-23 17:05:35 -05:00
Sage Weil
6ad9f13a18 githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:05:34 -05:00
Sage Weil
dc4e35b523 Merge PR #22615 into master
* refs/pull/22615/head:
	common: fix enum redeclaration

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-23 17:04:46 -05:00
Sage Weil
de0206cb80 Merge PR #22620 into master
* refs/pull/22620/head:
	common/WorkQueue: Before set_ioprio it must do create/try_create.

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2018-06-23 17:04:41 -05:00
Sage Weil
9f44ab3308 Merge PR #22634 into master
* refs/pull/22634/head:
	mgr, pybind/mgr: pass inbuf (ceph -i <file>) to modules

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-23 17:04:36 -05:00
Sage Weil
dd6ad72b90 mgr/devicehealth: add self-test
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:55 -05:00
Sage Weil
6b9c0689a4 mgr/devicehealth: make config options instance attributes
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:55 -05:00
Sage Weil
1af2f26d4f mgr/devicehealth: active -> enable_monitoring
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:55 -05:00
Sage Weil
f78d3ac6e5 mgr/mgr_module: update docstring for get()
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:55 -05:00
Sage Weil
378230c669 mgr/devicehealth: fix 'device get-health-metrics' when no metrics are stored
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:55 -05:00
Sage Weil
aa01002478 mgr/devicehealth: add some scraping infrastructure
- command to fetch smart info
- command to scrape a device and store the metrics
- command to scrape all devices (and store)
- command to dump stored metrics
- purging of old metrics

This is based on code originally written by Yaarit.

Signed-off-by: Yaarit Hatuka yaarithatuka@gmail.com
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:53 -05:00
Sage Weil
18abfb2486 osd: optionally query smart for a single devid
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:31 -05:00
Sage Weil
9662fa061c mgr/ActivePyModules: add get for 'device <devid>'
This is slightly different than the usual pattern because it is
parameterized.  I want to avoid fetching *all* devices if we don't need
it.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:31 -05:00
Sage Weil
a5957a9d13 osd: key smart results by unique device id
This is more useful than the current local device name.

Clean up some formatting.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:31 -05:00
Sage Weil
9f51a1e537 mgr: enable devicehealth by default
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-23 17:01:31 -05:00