Commit Graph

100625 Commits

Author SHA1 Message Date
Sage Weil
8827bc1022 Merge PR #29493 into master
* refs/pull/29493/head:
	qa/tasks/mgr/mgr_test_case: get mgrmap from 'mgr dump', not status
	qa/tasks/ceph_manager: no newlines in 'ceph -s' output
	mon: make mon summary more concise in 'ceph -s'
	mon/MgrStatMonitor: set initial service_map 'modified' to cluster mkfs
	mon: remove double-nesting of "osdmap" for ceph status
	mon/MgrMap: make print_summary (used by 'ceph -s') more concise

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-08 15:52:45 -05:00
Sage Weil
a0fca4eaf6 Merge PR #29511 into master
* refs/pull/29511/head:
	common/config: respect POD_MEMORY_REQUEST *and* POD_MEMORY_LIMIT env vars
	common/config: let diff show non-build defaults
	common/config: do no include multiple 'default' values

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-08 15:49:29 -05:00
Sage Weil
01fcf0e401 Merge PR #29517 into master
* refs/pull/29517/head:
	osd: include PastInterals in pg_notify_t

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-08-08 15:49:17 -05:00
Adam C. Emerson
ad88d4dced Merge pull request #29559 from adamemerson/wip-putobj-crash
rgw: Move upload_info declaration out of conditional

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2019-08-08 15:14:03 -04:00
Adam C. Emerson
a63881eaf7 rgw: Move upload_info declaration out of conditional
That way we don't deconstruct it right after assigning a reference to
part of it.

Fixes: https://tracker.ceph.com/issues/41172
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-08-08 13:12:46 -04:00
Casey Bodley
24a3056171
Merge pull request #29449 from cbodley/wip-vstart-client-rgw
vstart: move common rgw config to [client.rgw]

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2019-08-08 11:33:52 -04:00
Sage Weil
72d6426025 osd: include PastInterals in pg_notify_t
We use a pair<pg_notify_t,PastIntervals> everywhere a pg_notify_t is used.
This is silly; just make it a member instead.

Include some minor compat cruft so we can speak to pre-octopus OSDs.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-08 09:14:03 -05:00
Casey Bodley
6e976c5aa7
Merge pull request #29538 from cbodley/wip-rgw-data-changes-shared-unlock
rgw: fix unlock of shared lock in RGWDataChangesLog

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-08 10:11:29 -04:00
Mykola Golub
82a45573d5
Merge pull request #29468 from dillaman/wip-41032
pybind/mgr/rbd_support: use image ids to detect duplicate tasks

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-08-08 16:32:33 +03:00
Sage Weil
0b719c4382 Merge PR #29514 into master
* refs/pull/29514/head:
	mgr/hello: typos
	mgr/hello: a better command example
	mgr/hello: boilerplate for handling config options
	mgr/hello: fully document our options

Reviewed-by: Tim Serong <tserong@suse.com>
2019-08-08 08:24:33 -05:00
Sage Weil
390f76d525 qa/tasks/mgr/mgr_test_case: get mgrmap from 'mgr dump', not status
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-08 08:17:04 -05:00
Sage Weil
0527d9c8cd Merge PR #29546 into master
* refs/pull/29546/head:
	mgr/telemetry: clear the event after being awaken by it

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-08 08:12:53 -05:00
Lenz Grimmer
6d5939f8d1
mgr/dashboard: Prevent clone when layering not enabled on pare… (#29317)
mgr/dashboard: Prevent clone when layering not enabled on parent image

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-08-08 14:38:58 +02:00
Lenz Grimmer
ee66b6be91
mgr/dashboard: fix RBD snapshot protected label (#29534)
mgr/dashboard: fix RBD snapshot protected label

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 14:34:17 +02:00
Lenz Grimmer
95ec11a080
mgr/dashboard: Verify fields on Crush map page (#29452)
mgr/dashboard: Verify fields on Crush map page

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 14:01:49 +02:00
Lenz Grimmer
f22fc76453
mgr/dashboard: Verify fields on Monitors page (#29450)
mgr/dashboard: Verify fields on Monitors page

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 14:00:52 +02:00
Lenz Grimmer
e56e3d78fb
mgr/dashboard: E2E Dashboard Page Test Suite (#29432)
mgr/dashboard: E2E Dashboard Page Test Suite

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 13:59:42 +02:00
Lenz Grimmer
c2caec2ebe
mgr/dashboard: Verify manager modules have editing functionali… (#29407)
mgr/dashboard: Verify manager modules have editing functionality

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-08 13:58:51 +02:00
Kefu Chai
0dddb20685 mgr/telemetry: clear the event after being awaken by it
otherwise telemetry will have a busy-loop once it's signaled.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-08 12:24:56 +08:00
David Zafman
b1c14b7f6e
Merge pull request #29494 from dzafman/wip-scrub-test
test: Bump sleep time for slower machines

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-07 18:30:31 -07:00
Casey Bodley
17fc695047
Merge pull request #28813 from smanjara/wip-user-rename-working
rgw : Bucket mv, bucket chown and user rename utilities

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-08-07 16:05:07 -04:00
Neha Ojha
c9d2833b25
Merge pull request #29425 from aclamk/wip-bluestore-monitor-allocations
[bluestore][tools] Inspect allocations in bluestore

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-07 11:37:34 -07:00
Casey Bodley
553d97ca95 rgw: fix unlock of shared lock in RGWDataChangesLog
std::shared_mutex expects a call to unlock_shared() after lock_shared().
use the std::shared_lock guard to make it more obviously correct

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-08-07 14:02:49 -04:00
Adam Kupczyk
713f9b4d09 doc/rados/operations/health-checks: document BlueStore fragmentation and BlueFS space available features
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-08-07 19:18:21 +02:00
Tatjana Dehler
ce613b955a mgr/dashboard: fix RBD snapshot protected label
Fixes: https://tracker.ceph.com/issues/41153
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-08-07 17:45:10 +02:00
Nathan Cutler
e6514a0567
Merge pull request #29438 from wjwithagen/wjw-fix-ceph-backport.sh-https-tracker
script/ceph-backport.sh: Use secure access for tracker.ceph.com

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-08-07 17:04:13 +02:00
Sage Weil
7e10b70615 mgr/hello: typos
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-07 09:27:21 -05:00
Sage Weil
6a744f65a0 mgr/hello: a better command example
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-07 09:27:21 -05:00
Sage Weil
9318fb0d66 mgr/hello: boilerplate for handling config options
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-07 09:27:19 -05:00
Rafael Quintero
c3a2bdeebe mgr/dashboard: E2E Dashboard Page Test Suite
Fixes: https://tracker.ceph.com/issues/40549
Fixes: https://tracker.ceph.com/issues/40550
Fixes: https://tracker.ceph.com/issues/40561

Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>
2019-08-07 07:29:21 -04:00
Kefu Chai
d9a385da8c
Merge pull request #29525 from tchaikov/wip-mgr/dashboard/run-backend-api-tests.sh
mgr/dashboard: add python-common to $PYTHONPATH

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2019-08-07 17:29:22 +08:00
Lenz Grimmer
e83a7a623c
Merge pull request #29451 from rhcs-dashboard/wip-41047-master
github: Add CODEOWNERs for designated code-owner reviews

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-08-07 11:14:08 +02:00
Lenz Grimmer
62c495b8e0
mgr/dashboard: fix HACKING.rst is not rendered on github (#29521)
mgr/dashboard: fix HACKING.rst is not rendered on github

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-08-07 10:53:06 +02:00
Kefu Chai
8bfd3cb1e1
Merge pull request #29461 from tchaikov/wip-mgr/dashboard/test_mgr_module
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-07 16:34:08 +08:00
Kefu Chai
3303116f56 qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
* use primitive types instead of `JLeaf(the_type)` as they are
  equivalent in this context
* remove fields which are added only if certain channels are
  activated.
* allow unknown fields, as we are including various stuff
  in the report, for instance, osdmap, usage, crash info, etc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-07 15:25:18 +08:00
Kefu Chai
e36332595e mgr/dashboard: add python-common to $PYTHONPATH
fix the regression introduced by 8c50be5df6, so ceph-mgr's python
modules are able to import python-common.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-07 15:00:13 +08:00
Jan Fajerski
47fecd80d8
Merge pull request #29382 from MI-OSiRIS/prometheus_scrape_interval
mgr/prometheus: Cast collect_timeout (scrape_interval) to float
2019-08-07 08:05:43 +02:00
Kiefer Chang
a1a3817659
mgr/dashboard: fix HACKING.rst is not rendered on github
The file is not rendered because of inconsistent section markers.

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-08-07 11:40:09 +08:00
Sage Weil
4ac4768e23 Merge PR #29116 into master
* refs/pull/29116/head:
	osd: move heartbeat connection cleanup to helper
	osd: break con<->session cycle when removing heartbeat peers
	osd: mark down heartbeat connections on shutdown
	crimson/: move get_mnow() to ShardServices, pass to heartbeat
	crimson/osd: stubs for get_mnow, get_hbstamps
	crimson/osd/heartbeat: adapt to new MOSDPing fields
	crimson/osdmap_service: add get_mnow(), get_up_epoch()
	osd/PeeringState: take HeartbeatStamps refs for current interval
	osd: track clock delta between peer OSDs
	osd: add get_mnow() interface to OSDService, PG, PeeringState
	osd: record startup_time
	osd: some minor refactoring/cleanup in handle_osd_ping

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-08-06 16:22:14 -05:00
Sage Weil
f35b5e5fa4 Merge PR #29498 into master
* refs/pull/29498/head:
	qa/tasks/ceph_manager: remove race from all_active_or_peered()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-06 16:21:58 -05:00
Willem Jan Withagen
32732b4b7e script/ceph-backport.sh: Use secure access for tracker.ceph.com
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-08-06 22:54:41 +02:00
Patrick Donnelly
bbd63e0a7c
Merge PR #29509 into master
* refs/pull/29509/head:
	doc: indicate imperative mood for commit titles

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-06 13:23:23 -07:00
Patrick Donnelly
e72f590477
doc: indicate imperative mood for commit titles
This is convention in the kernel and Ceph but is not clearly documented.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-06 11:18:21 -07:00
Rafael Quintero
7e408632b2 mgr/dashboard: Write E2E test to verify that Manager modules have editing functionality
Fixes: https://tracker.ceph.com/issues/40823

Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>
2019-08-06 14:05:35 -04:00
Sage Weil
25f28e610f common/config: respect POD_MEMORY_REQUEST *and* POD_MEMORY_LIMIT env vars
If a kubernetes pod spec specifies a limit of X, then the pod gets both
the limits.memory and requests.memory resource fields set, and rook passes
those as POD_MEMORY_LIMIT and POD_MEMORY_REQUEST environment variables.

This is a problem if only the limit is set, because we will end up
setting our osd_memory_target (and, in the future, other *_memory_targets)
to the hard limit, and the daemon will inevitably reach that threshold
and get killed.

Fix this by also looking at the POD_MEMORY_LIMIT value, and applying the
ratio (default: .8) to it, and setting our actual target to the min of
that and the POD_MEMORY_REQUEST.

Also, set the "default" target to ratio*limit, so that it will apply in
general when no request is specified.

When both request and limit are 10M, we then see

        "osd_memory_target": {
            "default": "800000000000",
            "env": "800000000000",
            "final": "800000000000"
        },

In a more "normal" situation where limit is 10M and request is 5M, we get

        "osd_memory_target": {
            "default": "800000000000",
            "env": "500000000000",
            "final": "500000000000"
        },

If only limit is specified (to 10M), we get

        "osd_memory_target": {
            "default": "800000000000",
            "final": "800000000000"
        },

Fixes: https://tracker.ceph.com/issues/41037
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-06 12:50:36 -05:00
Sage Weil
77b634ad08 common/config: let diff show non-build defaults
Notably, this includes things from set_val_default(), which may be set
at runtime.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-06 12:50:36 -05:00
Jason Dillaman
7adb17f831 pybind/mgr/rbd_support: use image ids to detect duplicate tasks
This helps to to avoid the case where new tasks were not being scheduled
when an image name was re-used after having a task created under the
same name.

Fixes: https://tracker.ceph.com/issues/41032
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-08-06 12:17:46 -04:00
Kefu Chai
b6b3724f04
Merge pull request #29501 from tchaikov/wip-journal/test_JournalRecorder.cc
journal: always shutdown JournalRecoreder before destructing it

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-06 23:57:45 +08:00
Sage Weil
712409cac4 common/config: do no include multiple 'default' values
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-06 10:47:04 -05:00
Jan Fajerski
f0746bbbec
Merge pull request #27859 from jan--f/update-bluestore-cache-doc
doc: update bluestore cache settings and clarify data fraction
2019-08-06 13:32:58 +02:00