Commit Graph

100549 Commits

Author SHA1 Message Date
Tatjana Dehler
ce613b955a mgr/dashboard: fix RBD snapshot protected label
Fixes: https://tracker.ceph.com/issues/41153
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-08-07 17:45:10 +02:00
Kefu Chai
d9a385da8c
Merge pull request #29525 from tchaikov/wip-mgr/dashboard/run-backend-api-tests.sh
mgr/dashboard: add python-common to $PYTHONPATH

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2019-08-07 17:29:22 +08:00
Lenz Grimmer
e83a7a623c
Merge pull request #29451 from rhcs-dashboard/wip-41047-master
github: Add CODEOWNERs for designated code-owner reviews

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-08-07 11:14:08 +02:00
Lenz Grimmer
62c495b8e0
mgr/dashboard: fix HACKING.rst is not rendered on github (#29521)
mgr/dashboard: fix HACKING.rst is not rendered on github

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-08-07 10:53:06 +02:00
Kefu Chai
8bfd3cb1e1
Merge pull request #29461 from tchaikov/wip-mgr/dashboard/test_mgr_module
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-07 16:34:08 +08:00
Kefu Chai
3303116f56 qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
* use primitive types instead of `JLeaf(the_type)` as they are
  equivalent in this context
* remove fields which are added only if certain channels are
  activated.
* allow unknown fields, as we are including various stuff
  in the report, for instance, osdmap, usage, crash info, etc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-07 15:25:18 +08:00
Kefu Chai
e36332595e mgr/dashboard: add python-common to $PYTHONPATH
fix the regression introduced by 8c50be5df6, so ceph-mgr's python
modules are able to import python-common.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-07 15:00:13 +08:00
Jan Fajerski
47fecd80d8
Merge pull request #29382 from MI-OSiRIS/prometheus_scrape_interval
mgr/prometheus: Cast collect_timeout (scrape_interval) to float
2019-08-07 08:05:43 +02:00
Kiefer Chang
a1a3817659
mgr/dashboard: fix HACKING.rst is not rendered on github
The file is not rendered because of inconsistent section markers.

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-08-07 11:40:09 +08:00
Sage Weil
4ac4768e23 Merge PR #29116 into master
* refs/pull/29116/head:
	osd: move heartbeat connection cleanup to helper
	osd: break con<->session cycle when removing heartbeat peers
	osd: mark down heartbeat connections on shutdown
	crimson/: move get_mnow() to ShardServices, pass to heartbeat
	crimson/osd: stubs for get_mnow, get_hbstamps
	crimson/osd/heartbeat: adapt to new MOSDPing fields
	crimson/osdmap_service: add get_mnow(), get_up_epoch()
	osd/PeeringState: take HeartbeatStamps refs for current interval
	osd: track clock delta between peer OSDs
	osd: add get_mnow() interface to OSDService, PG, PeeringState
	osd: record startup_time
	osd: some minor refactoring/cleanup in handle_osd_ping

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-08-06 16:22:14 -05:00
Sage Weil
f35b5e5fa4 Merge PR #29498 into master
* refs/pull/29498/head:
	qa/tasks/ceph_manager: remove race from all_active_or_peered()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-06 16:21:58 -05:00
Patrick Donnelly
bbd63e0a7c
Merge PR #29509 into master
* refs/pull/29509/head:
	doc: indicate imperative mood for commit titles

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-06 13:23:23 -07:00
Patrick Donnelly
e72f590477
doc: indicate imperative mood for commit titles
This is convention in the kernel and Ceph but is not clearly documented.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-06 11:18:21 -07:00
Kefu Chai
b6b3724f04
Merge pull request #29501 from tchaikov/wip-journal/test_JournalRecorder.cc
journal: always shutdown JournalRecoreder before destructing it

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-06 23:57:45 +08:00
Jan Fajerski
f0746bbbec
Merge pull request #27859 from jan--f/update-bluestore-cache-doc
doc: update bluestore cache settings and clarify data fraction
2019-08-06 13:32:58 +02:00
Kefu Chai
f646704081 journal: always shutdown JournalRecoreder before destructing it
otherwise when we destruct `journal::JournalRecorder::m_object_locks`,
it/they would be still being waited by some condition variable.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-06 14:12:29 +08:00
Kefu Chai
7265b55d09
Merge pull request #29475 from tchaikov/wip-cmake3-for-xenial
install-deps.sh: use chacra for cmake repo

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-06 08:15:19 +08:00
Sage Weil
41e4056174 qa/tasks/ceph_manager: remove race from all_active_or_peered()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 14:01:02 -05:00
Sage Weil
8d155d0f67 osd: move heartbeat connection cleanup to helper
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
dcaba832e4 osd: break con<->session cycle when removing heartbeat peers
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
c6351315fb osd: mark down heartbeat connections on shutdown
This ensures that heartbeat_reset() gets call and we clean up the
ref loop between the Connections and Sessions.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Samuel Just
8f906e3cd7 crimson/: move get_mnow() to ShardServices, pass to heartbeat
get_mnow isn't clearly at home in OSDMapService, and the other methods
are needed from PeeringState, so let's consolidate on ShardServices
for now.  We probably ought OSDMapService state out of OSD into its
own module at some point.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
49478dd3d2 crimson/osd: stubs for get_mnow, get_hbstamps
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
9923c3fe76 crimson/osd/heartbeat: adapt to new MOSDPing fields
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
91c0df8121 crimson/osdmap_service: add get_mnow(), get_up_epoch()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
94b39c1c69 osd/PeeringState: take HeartbeatStamps refs for current interval
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
541e208cdf osd: track clock delta between peer OSDs
We need to keep track of the monotonic clock deltas between peer OSDs in
order to be able to exchange timestamps across messages.  We need an
upper and lower bound on this delta, depending on the context where it is
used.

We can use the existing ping messages to get this by assuming that a ping
message is sent instantly to get a bound, and to share our delta in a
follow-up reply to share the other bound.  The ping sender will get both
bounds with a single ping + ping_reply exchange.  The ping receiver will
get the delta value from the next round's ping.

Include up_from in the ping messages to ensure we don't mix up different
instances of the same OSD.

Signed-off-by: Sage Weil <sage@inktank.com>
2019-08-05 13:53:25 -05:00
Sage Weil
c5a7cb0a7d osd: add get_mnow() interface to OSDService, PG, PeeringState
Single helper to provide a monotonic time offset from startup_time.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:34:14 -05:00
Sage Weil
37a79dd209 osd: record startup_time
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:34:14 -05:00
Sage Weil
753a2ce164 osd: some minor refactoring/cleanup in handle_osd_ping
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:34:14 -05:00
Sage Weil
c6eafb7343 Merge PR #29337 into master
* refs/pull/29337/head:
	mon: enable telemetry module by default
	mgr/telemetry: force re-opt-in if the report contents change
	mgr/telemetry: less noise in the log
	mgr/telemetry: wake up serve on config change
	mgr/telemetry: track telemetry report revisions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-05 13:08:53 -05:00
Kefu Chai
f4e911ac1e
Merge pull request #29457 from tchaikov/wip-consolidate-run-tox
cmake: one run_tox.sh to rule them all

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-06 01:52:31 +08:00
Kefu Chai
4a7df22cff script/run_tox.sh: add --help option
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-06 00:45:51 +08:00
Patrick Donnelly
c1659e536a
Merge PR #29492 into master
* refs/pull/29492/head:
	doc: Fix for new ceph-devel mailing list

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-05 09:10:28 -07:00
Kefu Chai
793308f82d cmake: pass tox envs to run_tox.sh explicitly
* add two optional keyword parameters to `add_tox_test()`
* use the default `TOX_PATH` parameter instead passing it explicitly,
  as it is always `${CMAKE_CURRENT_SOURCE_DIR}`
* drop the code to guess the tox envs in `run_tox.sh`, and always pass
  them explicitly in CMake script using the `--tox-envs` argument.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-06 00:06:29 +08:00
Kefu Chai
3553f8d891
Merge pull request #29471 from tchaikov/wip-googletest
googletest: pick up change to suppress CMP0048 warning

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-05 23:59:08 +08:00
David Zafman
45bc410037 doc: Fix for new ceph-devel mailing list
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-05 07:36:04 -07:00
Casey Bodley
018429cf50
Merge pull request #29458 from mikulely/rgw-drop-flush
rgw: drop dead flush_read_list declaration

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-05 10:25:43 -04:00
Alfredo Deza
d7f481d749
Merge pull request #27675 from jan--f/c-v-console-logging-to-stderr
ceph-volume: print most logging messages to stderr

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-08-05 08:12:29 -04:00
Ernesto Puerta
0d8908a82f
github: Add CODEOWNERs for component/team reviews
Adds [CODEOWNERS](https://help.github.com/en/articles/about-code-owners)
file and assigns ownership of /src/pybind/mgr/dashboard to
@ceph/dashboard alias. That will also automatically add @ceph/dashboard
team to all reviews modifying any file in the above location.

Besides, if "Require review from Code Owners" is marked in the Branch
Protection Rules of any branch, where this CODEOWNERS file is propagated
to, at least one review from a designated CODEOWNER will be mandatory.

If Ceph teams' visibility is changed to public, teams can also be
@mentioned (both from Ceph and other projects), so it's easier to reach
to component-team members.

Fixes: https://tracker.ceph.com/issues/41047
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-05 14:04:34 +02:00
Kefu Chai
6cd4c2c967 cmake: move tests to where they are implemented
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-05 19:11:51 +08:00
Kefu Chai
d68a84b0fd cmake: do not add gtest-parallel_ext if already added
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-05 19:11:51 +08:00
Kefu Chai
f0079a1030 cmake: use script/run_tox.sh for running tox for dashboard
* adapt script/run_tox.sh to use different envs for dashboard's tox
  test.
* use script/run_tox.sh for running dashboard's tox test
* remove pybind/mgr/dashboard/run-tox.sh

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-05 19:11:51 +08:00
Kefu Chai
d359227ec0 cmake/modules/AddCephTest.cmake: make ${name}-venv a target
so we can prepare the venv for tox with `make tests`. and it's optional,
as run_tox.sh will check for it and setup a venv if it's not around.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-05 18:47:08 +08:00
Kefu Chai
a19761b8e8 src: remove unused run-tox.sh
they are not used anymore after b9c9f74f

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-05 18:47:08 +08:00
Igor Fedotov
383a9c948a
Merge pull request #29393 from ifed01/wip-ifed-bluestore-header-cleanup
os/bluestore: remove unused _tune_cache_size() method declaration

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-08-05 13:42:15 +03:00
Lenz Grimmer
7a6f741cbe
mgr/dashboard: update npm packages (#28343)
mgr/dashboard: update npm packages

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-05 12:20:20 +02:00
Kefu Chai
9f4b2be015
Merge pull request #29403 from rhcs-dashboard/wip-41013-master
install-deps.sh: remove failing error catching

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-05 18:07:39 +08:00
Kefu Chai
815f52831f
Merge pull request #29476 from tchaikov/wip-test/journal-close-object
test/journal: always close object

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-05 17:37:33 +08:00
Kefu Chai
29397ca589 test/journal: always close object
otherwise when we destruct `TestObjectRecorder::Handler::lock` or
`journal::JournalRecorder::m_object_locks`, it/they would be still
being waited by some condition variable.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-05 09:07:22 +08:00