Commit Graph

100599 Commits

Author SHA1 Message Date
Sage Weil
0527d9c8cd Merge PR #29546 into master
* refs/pull/29546/head:
	mgr/telemetry: clear the event after being awaken by it

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-08 08:12:53 -05:00
Lenz Grimmer
6d5939f8d1
mgr/dashboard: Prevent clone when layering not enabled on pare… (#29317)
mgr/dashboard: Prevent clone when layering not enabled on parent image

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-08-08 14:38:58 +02:00
Lenz Grimmer
ee66b6be91
mgr/dashboard: fix RBD snapshot protected label (#29534)
mgr/dashboard: fix RBD snapshot protected label

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 14:34:17 +02:00
Lenz Grimmer
95ec11a080
mgr/dashboard: Verify fields on Crush map page (#29452)
mgr/dashboard: Verify fields on Crush map page

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 14:01:49 +02:00
Lenz Grimmer
f22fc76453
mgr/dashboard: Verify fields on Monitors page (#29450)
mgr/dashboard: Verify fields on Monitors page

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 14:00:52 +02:00
Lenz Grimmer
e56e3d78fb
mgr/dashboard: E2E Dashboard Page Test Suite (#29432)
mgr/dashboard: E2E Dashboard Page Test Suite

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 13:59:42 +02:00
Lenz Grimmer
c2caec2ebe
mgr/dashboard: Verify manager modules have editing functionali… (#29407)
mgr/dashboard: Verify manager modules have editing functionality

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 13:58:51 +02:00
Kefu Chai
0dddb20685 mgr/telemetry: clear the event after being awaken by it
otherwise telemetry will have a busy-loop once it's signaled.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-08 12:24:56 +08:00
David Zafman
b1c14b7f6e
Merge pull request #29494 from dzafman/wip-scrub-test
test: Bump sleep time for slower machines

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-07 18:30:31 -07:00
Casey Bodley
17fc695047
Merge pull request #28813 from smanjara/wip-user-rename-working
rgw : Bucket mv, bucket chown and user rename utilities

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-08-07 16:05:07 -04:00
Neha Ojha
c9d2833b25
Merge pull request #29425 from aclamk/wip-bluestore-monitor-allocations
[bluestore][tools] Inspect allocations in bluestore

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-07 11:37:34 -07:00
Adam Kupczyk
713f9b4d09 doc/rados/operations/health-checks: document BlueStore fragmentation and BlueFS space available features
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-08-07 19:18:21 +02:00
Tatjana Dehler
ce613b955a mgr/dashboard: fix RBD snapshot protected label
Fixes: https://tracker.ceph.com/issues/41153
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-08-07 17:45:10 +02:00
Nathan Cutler
e6514a0567
Merge pull request #29438 from wjwithagen/wjw-fix-ceph-backport.sh-https-tracker
script/ceph-backport.sh: Use secure access for tracker.ceph.com

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-08-07 17:04:13 +02:00
Rafael Quintero
c3a2bdeebe mgr/dashboard: E2E Dashboard Page Test Suite
Fixes: https://tracker.ceph.com/issues/40549
Fixes: https://tracker.ceph.com/issues/40550
Fixes: https://tracker.ceph.com/issues/40561

Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>
2019-08-07 07:29:21 -04:00
Kefu Chai
d9a385da8c
Merge pull request #29525 from tchaikov/wip-mgr/dashboard/run-backend-api-tests.sh
mgr/dashboard: add python-common to $PYTHONPATH

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2019-08-07 17:29:22 +08:00
Lenz Grimmer
e83a7a623c
Merge pull request #29451 from rhcs-dashboard/wip-41047-master
github: Add CODEOWNERs for designated code-owner reviews

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-08-07 11:14:08 +02:00
Lenz Grimmer
62c495b8e0
mgr/dashboard: fix HACKING.rst is not rendered on github (#29521)
mgr/dashboard: fix HACKING.rst is not rendered on github

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-08-07 10:53:06 +02:00
Kefu Chai
8bfd3cb1e1
Merge pull request #29461 from tchaikov/wip-mgr/dashboard/test_mgr_module
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-07 16:34:08 +08:00
Kefu Chai
3303116f56 qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
* use primitive types instead of `JLeaf(the_type)` as they are
  equivalent in this context
* remove fields which are added only if certain channels are
  activated.
* allow unknown fields, as we are including various stuff
  in the report, for instance, osdmap, usage, crash info, etc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-07 15:25:18 +08:00
Kefu Chai
e36332595e mgr/dashboard: add python-common to $PYTHONPATH
fix the regression introduced by 8c50be5df6, so ceph-mgr's python
modules are able to import python-common.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-07 15:00:13 +08:00
Jan Fajerski
47fecd80d8
Merge pull request #29382 from MI-OSiRIS/prometheus_scrape_interval
mgr/prometheus: Cast collect_timeout (scrape_interval) to float
2019-08-07 08:05:43 +02:00
Kiefer Chang
a1a3817659
mgr/dashboard: fix HACKING.rst is not rendered on github
The file is not rendered because of inconsistent section markers.

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-08-07 11:40:09 +08:00
Sage Weil
4ac4768e23 Merge PR #29116 into master
* refs/pull/29116/head:
	osd: move heartbeat connection cleanup to helper
	osd: break con<->session cycle when removing heartbeat peers
	osd: mark down heartbeat connections on shutdown
	crimson/: move get_mnow() to ShardServices, pass to heartbeat
	crimson/osd: stubs for get_mnow, get_hbstamps
	crimson/osd/heartbeat: adapt to new MOSDPing fields
	crimson/osdmap_service: add get_mnow(), get_up_epoch()
	osd/PeeringState: take HeartbeatStamps refs for current interval
	osd: track clock delta between peer OSDs
	osd: add get_mnow() interface to OSDService, PG, PeeringState
	osd: record startup_time
	osd: some minor refactoring/cleanup in handle_osd_ping

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-08-06 16:22:14 -05:00
Sage Weil
f35b5e5fa4 Merge PR #29498 into master
* refs/pull/29498/head:
	qa/tasks/ceph_manager: remove race from all_active_or_peered()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-06 16:21:58 -05:00
Willem Jan Withagen
32732b4b7e script/ceph-backport.sh: Use secure access for tracker.ceph.com
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-08-06 22:54:41 +02:00
Patrick Donnelly
bbd63e0a7c
Merge PR #29509 into master
* refs/pull/29509/head:
	doc: indicate imperative mood for commit titles

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-06 13:23:23 -07:00
Patrick Donnelly
e72f590477
doc: indicate imperative mood for commit titles
This is convention in the kernel and Ceph but is not clearly documented.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-06 11:18:21 -07:00
Rafael Quintero
7e408632b2 mgr/dashboard: Write E2E test to verify that Manager modules have editing functionality
Fixes: https://tracker.ceph.com/issues/40823

Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>
2019-08-06 14:05:35 -04:00
Kefu Chai
b6b3724f04
Merge pull request #29501 from tchaikov/wip-journal/test_JournalRecorder.cc
journal: always shutdown JournalRecoreder before destructing it

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-06 23:57:45 +08:00
Jan Fajerski
f0746bbbec
Merge pull request #27859 from jan--f/update-bluestore-cache-doc
doc: update bluestore cache settings and clarify data fraction
2019-08-06 13:32:58 +02:00
Adam Kupczyk
355dc85372 test/objectstore: Allocator_test. Add test for dumping free regions and fragmentation_score.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-08-06 12:19:29 +02:00
Adam Kupczyk
16a9dac167 BlueStore/allocator: Add command to inspect how much BlueStore's block can go to BlueFS.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-08-06 12:19:29 +02:00
Kefu Chai
f646704081 journal: always shutdown JournalRecoreder before destructing it
otherwise when we destruct `journal::JournalRecorder::m_object_locks`,
it/they would be still being waited by some condition variable.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-06 14:12:29 +08:00
Kefu Chai
7265b55d09
Merge pull request #29475 from tchaikov/wip-cmake3-for-xenial
install-deps.sh: use chacra for cmake repo

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-06 08:15:19 +08:00
Sage Weil
41e4056174 qa/tasks/ceph_manager: remove race from all_active_or_peered()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 14:01:02 -05:00
Sage Weil
8d155d0f67 osd: move heartbeat connection cleanup to helper
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
dcaba832e4 osd: break con<->session cycle when removing heartbeat peers
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
c6351315fb osd: mark down heartbeat connections on shutdown
This ensures that heartbeat_reset() gets call and we clean up the
ref loop between the Connections and Sessions.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Samuel Just
8f906e3cd7 crimson/: move get_mnow() to ShardServices, pass to heartbeat
get_mnow isn't clearly at home in OSDMapService, and the other methods
are needed from PeeringState, so let's consolidate on ShardServices
for now.  We probably ought OSDMapService state out of OSD into its
own module at some point.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
49478dd3d2 crimson/osd: stubs for get_mnow, get_hbstamps
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
9923c3fe76 crimson/osd/heartbeat: adapt to new MOSDPing fields
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
91c0df8121 crimson/osdmap_service: add get_mnow(), get_up_epoch()
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
94b39c1c69 osd/PeeringState: take HeartbeatStamps refs for current interval
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:53:25 -05:00
Sage Weil
541e208cdf osd: track clock delta between peer OSDs
We need to keep track of the monotonic clock deltas between peer OSDs in
order to be able to exchange timestamps across messages.  We need an
upper and lower bound on this delta, depending on the context where it is
used.

We can use the existing ping messages to get this by assuming that a ping
message is sent instantly to get a bound, and to share our delta in a
follow-up reply to share the other bound.  The ping sender will get both
bounds with a single ping + ping_reply exchange.  The ping receiver will
get the delta value from the next round's ping.

Include up_from in the ping messages to ensure we don't mix up different
instances of the same OSD.

Signed-off-by: Sage Weil <sage@inktank.com>
2019-08-05 13:53:25 -05:00
Sage Weil
c5a7cb0a7d osd: add get_mnow() interface to OSDService, PG, PeeringState
Single helper to provide a monotonic time offset from startup_time.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:34:14 -05:00
Sage Weil
37a79dd209 osd: record startup_time
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:34:14 -05:00
Sage Weil
753a2ce164 osd: some minor refactoring/cleanup in handle_osd_ping
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-05 13:34:14 -05:00
Sage Weil
c6eafb7343 Merge PR #29337 into master
* refs/pull/29337/head:
	mon: enable telemetry module by default
	mgr/telemetry: force re-opt-in if the report contents change
	mgr/telemetry: less noise in the log
	mgr/telemetry: wake up serve on config change
	mgr/telemetry: track telemetry report revisions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-05 13:08:53 -05:00
Kefu Chai
f4e911ac1e
Merge pull request #29457 from tchaikov/wip-consolidate-run-tox
cmake: one run_tox.sh to rule them all

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-08-06 01:52:31 +08:00