Commit Graph

95827 Commits

Author SHA1 Message Date
Sage Weil
1e2b0c7252 qa/standalone/ceph-helpers.sh: fix test_run_mon
- Only create each osd once
- forget the first osdmap dump test; it's pointless

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-08 17:43:00 -06:00
Sage Weil
bf74c1adc4 qa/standalone/osd/osd-rep-recov-eio: fix better
- no need for the default pool size
- no initial osds or it will collide with setup_osds later
- no need for rbd pool at all

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-08 17:41:11 -06:00
Patrick Nawracay
f51fcad52e
Merge pull request #26815 from tchaikov/wip-38584
doc/releases/nautilus: dashboard package notes

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-03-08 16:24:18 +01:00
Sage Weil
3e83a6e960 Merge PR #26823 into master
* refs/pull/26823/head:
	qa/suites: disable valgrind leak checks on ceph-mgr
	mgr: skip shutdown and exit

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-08 09:04:21 -06:00
Sage Weil
b88a10aef2 Merge PR #26796 into master
* refs/pull/26796/head:
	common/options: osd_memory_target et al are TYPE_SIZE

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-08 08:11:47 -06:00
Casey Bodley
139becb6c1
Merge pull request #26827 from adamemerson/wip-doc-s3-op-acl
Document mappings of S3 Operations to ACL grants

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-08 08:54:57 -05:00
Sage Weil
b0496c44ed Merge PR #26832 into master
* refs/pull/26832/head:
	msg/async/ProtocolV2: end scope of std::hex properly

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-08 07:04:35 -06:00
Sage Weil
62136d381a Merge PR #26794 into master
* refs/pull/26794/head:
	mon/MgrMonitor: only try to update always_on_modules if >= NAUTILUS
	qa/standalone/mon/msgr-v2-transition: add some tests for enabling msgr v2
	mon/MonmapMonitor: add 'ceph mon set-addrs <name> <addrvec>' command
	Revert "mon/MonClient: disable ms_bind_msgr2 if NAUTILUS feature not set"
	mon/OSDMonitor: use legacy_equals to compare osd addrs
	msg/msg_types: make legacy_equals() symmetrical
	mon/MDSMonitor: stop using get_orig_source_inst()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-07 22:12:52 -06:00
Sage Weil
4d33b6d56a Merge PR #26770 into master
* refs/pull/26770/head:
	qa/standalone/osd/osd-force-create-pg: create more pgs
	qa/standalone: make sure an osd is running before create_rbd_pool

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-03-07 22:10:12 -06:00
Sage Weil
99207b2c35 Merge PR #26504 into master
* refs/pull/26504/head:
	osd: fixup OpTracker destruct assert, waiting_for_osdmap take ref

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-07 21:58:01 -06:00
Sage Weil
cb59866c46 Merge PR #26803 into master
* refs/pull/26803/head:
	msg/async/ProtocolV1: fix locking around authorizer_buf

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-03-07 16:59:24 -06:00
Patrick Donnelly
a1539b118e
Merge PR #26781 into master
* refs/pull/26781/head:
	mds: avoid calling clientreplay_done() prematurely

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-07 14:40:16 -08:00
Patrick Donnelly
9c0495fb58
Merge PR #26773 into master
* refs/pull/26773/head:
	mds: refactor subtree accessors

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-03-07 14:38:48 -08:00
Sage Weil
a2debbc26b mon/MgrMonitor: only try to update always_on_modules if >= NAUTILUS
Pre-nautilus mgrmap doesn't encode have this field, so we'll just loop.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 16:35:35 -06:00
Sage Weil
c939eefa16 qa/standalone/mon/msgr-v2-transition: add some tests for enabling msgr v2
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 16:35:35 -06:00
Sage Weil
a790740357 mon/MonmapMonitor: add 'ceph mon set-addrs <name> <addrvec>' command
This lets us explicitly adjust the IPs/ports a monitor binds to.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 16:35:35 -06:00
Sage Weil
b21dc7f2b5 Revert "mon/MonClient: disable ms_bind_msgr2 if NAUTILUS feature not set"
This reverts commit f3ddb1c9b8.

That behavior complicated the process of moving to v1 -> v2+v1 (extra
daemon restart, for example).  Also, it wasn't sufficient: there are lots
of other reasons besides the mon version that could lead to a mismatch
between what we bind to locally and what is published in the cluster
maps.  Better to embrace that reality and address those other issues.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 16:35:35 -06:00
Sage Weil
301c2e79e3 mon/OSDMonitor: use legacy_equals to compare osd addrs
The OSDs may bind to v2+v1 due to ms_bind_msgr2, but we may only use the
v1 address in the OSDMap due to

 - the osd->mon connection being v1 (mon isn't using v2 yet)
 - the osd require_osd_release < nautilus
 - ???

Conversely, the OSD may end up with a v2+v1 address in the osdmap, but
may connect to the current monitor via v1 only, due to the mon only being
bound to a v1 address.

If/when this happens, make sure we are doing a loose comparison of the
osdmap addrs vs the osd's addr they are connecting from.

Fixes: http://tracker.ceph.com/issues/38598
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 16:35:34 -06:00
Sage Weil
9b379de572 msg/msg_types: make legacy_equals() symmetrical
The prior version would return true for

 [v2,v1] vs [v2,v1]
 [v2,v1] vs [v1]

but not

 [v1] vs [v2,v1]

Now that final case is also true, which means a.legacy_equals(b) ==
b.legacy_equals(a) for any combination.  This is what you would expect
for an equality operator... even a fuzzy one.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 16:35:34 -06:00
Sage Weil
391c1cd232 mon/MDSMonitor: stop using get_orig_source_inst()
Use get_orig_source() + get_orig_source_addrs()

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 16:35:34 -06:00
Adam C. Emerson
bd94c93fad doc/radosgw: Document mappings of S3 Operations to ACL grants
Since the ACL documentation is a bit sparse, let people know exactly
what operations they can expect to enable with a given ACL grant.

Fixes: https://tracker.ceph.com/issues/38523
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2019-03-07 16:42:51 -05:00
Sage Weil
ec7c9976d7 Merge PR #26802 into master
* refs/pull/26802/head:
	qa/suites/upgrade/mimic-x/parallel: run master rados/test.sh

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-07 13:49:58 -06:00
Sage Weil
e79dc454db qa/suites: disable valgrind leak checks on ceph-mgr
We've disabled the "clean" shutdown in ceph-mgr due to
https://tracker.ceph.com/issues/38621

Until then, no valgrind leak checks!

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 13:03:28 -06:00
Sage Weil
6146c85bb2 mgr: skip shutdown and exit
The python subinterpreter teardown is broken; see
https://tracker.ceph.com/issues/38621

Instead, just exit with the appropriate error code.  That way we don't
crash and leave a core and ugly stack trace behind.

Users won't care, although our leak checking will.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 11:23:31 -06:00
Patrick Donnelly
0a13f4a90c
Merge PR #26821 into master
* refs/pull/26821/head:
	mds,mgr,mon: warn future respawn() copy-pasters to set thread name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-07 08:48:05 -08:00
Sage Weil
4c5ed29925 Merge PR #26764 into master
* refs/pull/26764/head:
	mgr: 'osd df' by specified class or (crush) name
	mon/OSDMonitor: add 'osd crush get-device-class' command
2019-03-07 08:52:56 -06:00
Sage Weil
8e07029454 mds,mgr,mon: warn future respawn() copy-pasters to set thread name
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 08:50:53 -06:00
Sage Weil
25bf65e9c3 common/options: osd_memory_target et al are TYPE_SIZE
This makes us interpret "2G" and 2 GiB, not 2 billion bytes.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-07 08:43:11 -06:00
Kefu Chai
fcf027dc7a doc/mgr/dashboard: note dashboard as a separate package
Fixes: https://tracker.ceph.com/issues/38584
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-07 22:32:11 +08:00
Kefu Chai
b43ce06710 doc/releases/nautilus: dashboard package notes
Fixes: https://tracker.ceph.com/issues/38584
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-07 22:21:40 +08:00
Sebastian Wagner
b954e3d8b1
Merge pull request #26743 from votdev/cleanup
mgr/dashboard: Cleanup Python code

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-03-07 14:14:51 +01:00
Sage Weil
b28cc915f4 Merge PR #26797 into master
* refs/pull/26797/head:
	ceph-mon: reset process name to 'ceph-mon' on startup

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
2019-03-07 06:36:04 -06:00
Sage Weil
730d9cf63b Merge PR #26795 into master
* refs/pull/26795/head:
	mon/MgrStatMonitor: fix typo

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-07 06:35:49 -06:00
Sage Weil
d2d127d806 Merge PR #26027 into master
* refs/pull/26027/head:
	osd,mon,mds: support get|set tcmalloc release rate

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-07 06:32:30 -06:00
Sage Weil
251538cc46 Merge PR #26674 into master
* refs/pull/26674/head:
	os/bluestore: log long aio operations in KernelDevice
	os/bluestore: treat bdev_debug_aio_suicide_timeout==0 as no suicide
	os/bluestore: track omap iterator latencies.
	os/bluestore: log slow operations/long lasting states

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-07 06:31:03 -06:00
Sage Weil
6c723b927d Merge PR #26718 into master
* refs/pull/26718/head:
	rpm: put numpy and scipy deps in distro conditionals

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-07 06:30:46 -06:00
Sage Weil
3dda18b399 Merge PR #26725 into master
* refs/pull/26725/head:
	doc/releases/nautilus: ask users to opt in to telemetry
	doc/mgr/telemtry: update docs
	mgr/telemetry: drop config-set and config-show; add just show
	mgr/telemetry: make 'telemetry show' readable by a human
	mgr/telemetry: add 'telemetry on' and 'telemetry off' commands
	mgr/telemetry: off by default

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-by: Dan Mick <dmick@redhat.com>
2019-03-07 06:30:29 -06:00
Ricardo Dias
07a5615003
Merge pull request #26716 from rjfd/wip-dashboard-ganesha-docs
mgr/dashboard: nfs-ganesha: controller API documentation

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2019-03-07 12:10:37 +00:00
xie xingguo
2ad0ffdd52 msg/async/ProtocolV2: end scope of std::hex properly
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-03-07 19:49:29 +08:00
Ilya Dryomov
e50aa559f6 Merge PR #26775 into master
* refs/pull/26775/head:
	qa/suites/krbd/wac: bluestore snippet is placed incorrectly

Reviewed-by: Mike Christie <mchristi@redhat.com>
2019-03-07 12:19:36 +01:00
Xie Xingguo
476d88ae6b
Merge pull request #26778 from xiexingguo/wip-fix-wrong-lpr
osd/PrimaryLogPG: fix last_peering_reset checking on manifest flushing

Reviewed-by: Myoungwon Oh <ommw@sk.com>
2019-03-07 16:40:59 +08:00
Sage Weil
f82f888609 msg/async/ProtocolV1: fix locking around authorizer_buf
Fix two problems:

- we are accessing authorizer_buf without the connection lock, and
  under the lock we are modifying it (in connect()).
- if we receive two connect_msg's with a different length, we won't
  have a buffer that's large enough.

Fixes: http://tracker.ceph.com/issues/38524
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-06 17:40:54 -06:00
Sage Weil
a376a151ea qa/suites/upgrade/mimic-x/parallel: run master rados/test.sh
We rename ceph_test_rados_api_tier to add _pp, so the mimic version doesn't
work.  And in any case, at this stage the client host has master installed.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-06 16:50:12 -06:00
Sage Weil
b59ff3860f qa/standalone/osd/osd-force-create-pg: create more pgs
Avoid warnings about too few pgs.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-06 16:27:56 -06:00
Sage Weil
cba0483b09 qa/standalone: make sure an osd is running before create_rbd_pool
'rbd pool init' now does IO.  Drop the pool, or change the pool size to 1.

Fixes: http://tracker.ceph.com/issues/38585
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-06 16:27:56 -06:00
Sage Weil
5d30e87c0a ceph-mon: reset process name to 'ceph-mon' on startup
After a respawn the process name ends up as 'exe' (because we do execve
on /proc/$pid/exe).  Reset to 'ceph-mon' so that killall works.

Fixes: http://tracker.ceph.com/issues/38604
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-06 13:49:50 -06:00
Sage Weil
c55cbed72e mon/MgrStatMonitor: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-06 13:27:41 -06:00
Sebastian Wagner
7ba6bece41
Merge pull request #26633 from jtlayton/wip-nfs-scale
mgr/orchestrator: Allow the orchestrator to scale the NFS server count

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-03-06 19:08:48 +01:00
Sage Weil
b6410d00f9 Merge PR #26748 into master
* refs/pull/26748/head:
	ceph_test_rados_[a]io_pp: add test verifying read-into-bufferlist behavior

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-06 09:22:42 -06:00
Nathan Cutler
5a0846631c rpm: put numpy and scipy deps in distro conditionals
Without this patch, attempts to install the ceph-mgr-diskprediction-local RPM
fail on SUSE platforms with the following error:

can't install ceph-mgr-diskprediction-local-14.1.0.402+ga396e8bf3b-3742.1.noarch:
  nothing provides numpy needed by ceph-mgr-diskprediction-local-14.1.0.402+ga396e8bf3b-3742.1.noarch
  nothing provides scipy needed by ceph-mgr-diskprediction-local-14.1.0.402+ga396e8bf3b-3742.1.noarch

Also take into account package naming differences between Fedora and
RHEL/CentOS.

Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-03-06 15:13:23 +01:00