Commit Graph

96063 Commits

Author SHA1 Message Date
Sage Weil
106de8caf4 Merge PR #26994 into nautilus
* refs/pull/26994/head:
	doc: add scrub link for nautilus release notes

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-15 16:48:27 -05:00
Sage Weil
9df050f5d6 Merge PR #26822 into nautilus
* refs/pull/26822/head:
	osd/PG: adjust pg history on fabricated merge target if necessary

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-15 16:45:53 -05:00
Sage Weil
8daf2885bb Merge PR #26986 into nautilus
* refs/pull/26986/head:
	mgr: Make 3rd parameter optional in ceph_get_module_option

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-15 16:43:33 -05:00
Sage Weil
8dbbb3a673 Merge PR #26949 into nautilus
* refs/pull/26949/head:
	mgr/dashboard: add test_module_selftest to API tests

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-03-15 16:43:17 -05:00
Casey Bodley
3a6bab7f2f
Merge pull request #26997 from cbodley/wip-38008
doc/rgw: document placement targets and storage classes

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2019-03-15 17:06:34 -04:00
Sage Weil
c2d3322628 Merge PR #26995 into nautilus
* refs/pull/26995/head:
	osd/PG: fix pg merge check for rc clusters

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-15 15:29:04 -05:00
Casey Bodley
8079db6a6d doc/rgw: document storage class configuration
Fixes: http://tracker.ceph.com/issues/38008

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-03-15 15:50:32 -04:00
Casey Bodley
c95585b198 doc/rgw: document placement target configuration
Fixes: http://tracker.ceph.com/issues/24508

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-03-15 15:50:32 -04:00
Sage Weil
f9d419d0c3 osd/PG: fix pg merge check for rc clusters
If a cluster had a pg merge pending before last_pg_merge_meta was
introduced then the source_pgid will be pg_t().  If that's the case,
skip these new checks.

Likewise, if we decode a legacy pg_pool_t, put the old merge les/lec
values into the correct location.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-15 12:32:48 -05:00
Patrick Donnelly
4e36305be5
doc: add scrub link for nautilus release notes
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-15 10:15:58 -07:00
Sage Weil
faf19b81c1 Merge PR #26958 into nautilus
* refs/pull/26958/head:
	mon: avoid using naked pointer
	msg/async: do not "return std::move(local_var)"
	mon: do not assert on bad auth payload

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-03-15 12:09:35 -05:00
Sage Weil
570fcd7861 Merge PR #26959 into nautilus
* refs/pull/26959/head:
	mgr/crash: include entity (instead of daemon) in 'crash ls'

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-03-15 12:09:18 -05:00
Sage Weil
3ee78a9d64 Merge PR #26965 into nautilus
* refs/pull/26965/head:
	ms/async/ProtocolV2: add ms_die_on_bug and assert rxbuf/txbuf don't get big
	msg/async/ProtocolV2: do not reenable pre_auth buffering on from reset_recv_state

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-03-15 12:08:34 -05:00
Patrick Donnelly
5ea8c7346c
Merge PR #26974 into nautilus
* refs/pull/26974/head:
	doc: add cephfs scrub related admin document

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-15 09:36:57 -07:00
Lenz Grimmer
7e4125d25b
Merge pull request #26984 from ricardoasmarques/remove-iscsi-gateway-param-nautilus
mgr/dashboard: Drop iSCSI gateway name parameter

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-03-15 16:40:40 +01:00
Volker Theile
b261e8ca9b mgr: Make 3rd parameter optional in ceph_get_module_option
Fixes: https://tracker.ceph.com/issues/38766

File "/usr/share/ceph/mgr/mgr_module.py", line 863, in _handle_command
2019-03-15T11:28:31.324 INFO:tasks.ceph.mgr.x.mira117.stderr:    return self.handle_command(inbuf, cmd)
2019-03-15T11:28:31.324 INFO:tasks.ceph.mgr.x.mira117.stderr:  File "/usr/share/ceph/mgr/selftest/module.py", line 114, in handle_command
2019-03-15T11:28:31.324 INFO:tasks.ceph.mgr.x.mira117.stderr:    self._self_test()
2019-03-15T11:28:31.325 INFO:tasks.ceph.mgr.x.mira117.stderr:  File "/usr/share/ceph/mgr/selftest/module.py", line 213, in _self_test
2019-03-15T11:28:31.325 INFO:tasks.ceph.mgr.x.mira117.stderr:    self._self_test_config()
2019-03-15T11:28:31.325 INFO:tasks.ceph.mgr.x.mira117.stderr:  File "/usr/share/ceph/mgr/selftest/module.py", line 313, in _self_test_config
2019-03-15T11:28:31.325 INFO:tasks.ceph.mgr.x.mira117.stderr:    assert self.get_module_option_ex("foo", "bar") is None
2019-03-15T11:28:31.325 INFO:tasks.ceph.mgr.x.mira117.stderr:  File "/usr/share/ceph/mgr/mgr_module.py", line 942, in get_module_option_ex
2019-03-15T11:28:31.325 INFO:tasks.ceph.mgr.x.mira117.stderr:    r = self._ceph_get_module_option(module, key)
2019-03-15T11:28:31.325 INFO:tasks.ceph.mgr.x.mira117.stderr:TypeError: ceph_get_module_option() takes exactly 3 arguments (2 given)

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-03-15 15:45:39 +01:00
Ricardo Marques
65a93cb8f7 mgr/dashboard: Drop iSCSI gateway name parameter
iSCSI gateway name will now be obtained from the
ceph-iscsi `/api/sysinfo/hostname` endpoint

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-03-15 14:05:49 +00:00
Casey Bodley
1e3c7a7897
Merge pull request #26971 from theanalyst/nautilus-rgw-enoent-mdlog
rgw_sync: drop ENOENT error logs from mdlog

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-15 09:31:34 -04:00
Kefu Chai
0500fff76b mon: avoid using naked pointer
to save our trouble to delete auth_handler in the error handling paths

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-15 07:07:07 -05:00
Kefu Chai
26b848d7c9 msg/async: do not "return std::move(local_var)"
it prevents copy elision. and both GCC and Clang warn like

warning: moving a local object in a return statement prevents copy
elision [-Wpessimizing-move]

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-15 07:07:07 -05:00
Sage Weil
7a2bb0f01e mon: do not assert on bad auth payload
If we get garbage, fail to authenticate--do not assert out and crash.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-15 07:07:07 -05:00
Sage Weil
4f41800386 ms/async/ProtocolV2: add ms_die_on_bug and assert rxbuf/txbuf don't get big
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-15 06:42:29 -05:00
Sage Weil
8449b4c191 msg/async/ProtocolV2: do not reenable pre_auth buffering on from reset_recv_state
This is specifically bad because we call reset_recv_state from
reuse_connection, which turns buffering back on on an already-authenticated
session.

Instead, reenable it only when we set the state to START_CONNECT.  (On
the accepting side, it is a fresh connection, so it starts out true.)
Also, we want to *disable* it on the connection we are reusing, which
might be in a pre-auth state, while we are in a post-auth state.

Fixes: http://tracker.ceph.com/issues/38746
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-15 06:08:51 -05:00
Lenz Grimmer
98653b3db9
Merge pull request #26738 from votdev/fix_docs
mgr/dashboard: Fix issues in controllers/docs

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tina Kallio <tina.kallio@gmail.com>
2019-03-15 10:38:00 +01:00
Venky Shankar
a83c0f8953 doc: add cephfs scrub related admin document
Fixes: http://tracker.ceph.com/issues/38728
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-03-15 15:05:27 +05:30
Abhishek Lekshmanan
ea5093566e rgw_sync: drop ENOENT error logs from mdlog
Since this commonly occurs and isn't an error of concern at level 1.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit c246abb393)
2019-03-15 09:18:37 +01:00
Sage Weil
13d7c4f4ec Merge PR #26898 into nautilus
* refs/pull/26898/head:
	osd/PG: invalidate PG if merging with unexpected version
	osd,mon: include more pg merge metadata in pg_pool_t
	qa/standalone/osd/pg-split-merge.sh: reproduce pg merge problem with empty pgs
	osd: add osd_debug_no_{acting_change,purge_strays}

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-14 22:37:18 -05:00
Sage Weil
9b10b45f3f mgr/crash: include entity (instead of daemon) in 'crash ls'
The daemon name is implied by the entity, and the entity is more useful.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-14 17:56:15 -05:00
Sage Weil
f1ab4ee685 Merge PR #26905 into nautilus
* refs/pull/26905/head:
	mgr: Cleanup get_localized_module_option function

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-03-14 17:17:25 -05:00
Sage Weil
d216aed387 Merge PR #26875 into nautilus
* refs/pull/26875/head:
	common: implement HMACs on top of OpenSSL.
	msg/async, v2: switch the pre-auth mechanism to HMAC-SHA256.
	include/types: beef sha_digest_t up with encode and compare.
	auth: add hmac_sha256() to CryptoKey.
	msg/async, v2: introduce pre_auth exchanges with CRC32.
	msg/async, v2: introduce pre_auth buffers.
	msg/async, v2: rectify the encapsulation of rx_segments_{desc,data}.
	msg/async, v2: rework decoding of MessageFrame.
	msg/async, v2: limit the num_segments to non-empty segments.
	msg/async, v2: drop the bl onwire space optimization in ControlFrames.
	msg/async, v2: clean up ret handling in ProtocolV2::write().
	msg/async, v2: drop next_payload_len as we don't need anymore.
	msg/async, v2: drop temp_buffer and limitations driven by it.
	msg/async, v2: switch to rx_buffer_t entirely.
	msg/async, v2: rx continuations use buffer::ptr_node.
	msg/async, v2: use bptr continuation for segment reading.
	msg/async: introduce bptr-carrying continuations.
	msg/async: replace CONTINUATION_PARAM() with specialized types.
	msg/async, v2: ::_banner_exchange() takes CtRef instead of CtPtr.
	msg/async: avoid extra pointers in continuation definitions.
	msg/async, v2: dissect setting stream handlers into ::finish_auth().
	msg/async, v2: drop ceph_msg_header2 handling from ControlFrames.
	msg/async, v2: drop the SignedEncryptedFrame entirely.
	msg/async, v2: reintroduce segment aligment. It's compile-time now.
	msg/async, v2: generalize Frame about number of segments.
	msg/async, v2: rework and generalize Frame encryption.
	msg/async, v2: rework the class hierarchy - introduce MessageFrame.
	msg/async, v2: rework the class hierarchy - introduce ControlFrame.
	msg/async/ProtocolV2: remove obsolete AuthFlags

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-14 10:04:14 -05:00
Jason Dillaman
bf53d69b7e
Merge pull request #26918 from trociny/wip-rbd-bench-wait-on-interrupted
rbd: wait for all io complete when bench is interrupted

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-14 10:27:03 -04:00
Volker Theile
9dc6de446d mgr: Cleanup get_localized_module_option function
Address comments from https://github.com/ceph/ceph/pull/26736.

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-03-14 13:43:29 +01:00
Sage Weil
7831b989e8 Merge PR #26948 into nautilus
* refs/pull/26948/head:
	rbd-nbd: fix segfault for list-mapped command

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-14 07:22:30 -05:00
Sage Weil
e3085f4262 Merge PR #26864 into nautilus
* refs/pull/26864/head:
	rados: update to latest ver. of dmclock lib w performance enhancements

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: yanjun <yan.jun8@zte.com.cn>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-14 07:07:26 -05:00
Sage Weil
dc8a49697f Merge PR #26921 into nautilus
* refs/pull/26921/head:
	mgr/telemetry: fix 'telemetry {on,off}'

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-14 07:01:46 -05:00
Sage Weil
8fde68152d Merge PR #26924 into nautilus
* refs/pull/26924/head:
	auth/cephx: fix decode_encrypt error handling
	auth/cephx: fix encode_encrypt error handling

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-14 06:59:05 -05:00
Lenz Grimmer
d8b10c3417
Merge pull request #26951 from ricardoasmarques/validate-ceph-iscsi-config-version-nautilus
nautilus: mgr/dashboard: Validate `ceph-iscsi` config version

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-03-14 12:42:32 +01:00
Ricardo Marques
1db73ca778 mgr/dashboard: Validate ceph-iscsi config version
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit b9b2b562cc)
2019-03-14 09:42:55 +00:00
alfonsomthd
5b59c87fd8 mgr/dashboard: add test_module_selftest to API tests
* This test suite helps to catch mgr module regressions introduced by
dashboard feature/bugfix.
* Fixed: 'ceph -w' now behaves properly for Python 3.

Fixes: https://tracker.ceph.com/issues/38394

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-03-14 09:28:49 +01:00
Mykola Golub
a5a49f3871 rbd-nbd: fix segfault for list-mapped command
The global ceph context is not initialized when list-mapped command
is issued.

The regression was introduced by a92628f285.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-03-14 07:47:34 +00:00
Patrick Donnelly
7de8cb405c
Merge PR #26935 into nautilus
* refs/pull/26935/head:
	qa: extend MDS heartbeat grace for valgrind

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-13 20:37:03 -07:00
Patrick Donnelly
505a05f351
Merge PR #26916 into nautilus
* refs/pull/26916/head:
	qa: ignore MON_DOWN for volume-client testing

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-13 20:31:01 -07:00
Sage Weil
4bb4f7a891 Merge PR #26894 into nautilus
* refs/pull/26894/head:
	qa/standalone/erasure-code/test-erasure-code: adjust test to avoid m=0
	erasure-code: ensure m >= 1
	mon/OSDMonitor: set ec min_size to k + min(1, m - 1)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-13 22:07:45 -05:00
Patrick Donnelly
beea915c01
Merge PR #26919 into nautilus
* refs/pull/26919/head:
	doc: add CephFS notes for nautilus

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-13 13:23:52 -07:00
Patrick Donnelly
145c37c048
doc: add CephFS notes for nautilus
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-13 11:51:06 -07:00
Sage Weil
decb964626 Merge remote-tracking branch 'gh/nautilus' 2019-03-13 13:31:03 -05:00
Sage Weil
52d5797c3d qa/standalone/erasure-code/test-erasure-code: adjust test to avoid m=0
_DD is k=2 m=0, which we don't allow.  Switch it to cDD.

I confess I don't fully understand why this was _DD to begin with, but
I'm pretty sure mapping is there to control the order of results so that
it can be mapped to the CRUSH rule output sanely, and the coding portion
is not relevant to the test.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-13 12:46:50 -05:00
Patrick Donnelly
7b520755ce
qa: extend MDS heartbeat grace for valgrind
Valgrind makes the MDS slowwwww. The newish mds_heartbeat_grace config allows
us to keep sending beacons to the mons even if the internal heartbeat is slow.
This avoids the laggy messages which are useful to grep for unrelated messaging
issues.

Fixes: http://tracker.ceph.com/issues/38723
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-13 09:18:32 -07:00
Lenz Grimmer
bb3b2471ac
Merge pull request #26790 from ricardoasmarques/iscsi-passwords-with-slash
mgr/dashboard: iSCSI - Support iSCSI passwords with '/'

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
2019-03-13 17:07:18 +01:00
Sage Weil
497e00c4da mgr/telemetry: fix 'telemetry {on,off}'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-13 10:32:18 -05:00