Commit Graph

91206 Commits

Author SHA1 Message Date
Sage Weil
7f5d42fef1 Merge PR #24151 into master
* refs/pull/24151/head:
	mgr/devicehealth: use is_valid_daemon_name helper
	mgr/devicehealth: generalize to mon and osd daemons
	mon: implement 'smart [devid]' tell command
	mgr: parse mon metadata properly
	mon: report device id used by mon
	common/blkdev: add get_device_by_path
	common/blkdev: migrate block_device_run_smartctl from OSD.cc

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-16 17:43:02 -05:00
Sage Weil
8e2ed7796c Merge PR #24566 into master
* refs/pull/24566/head:
	osd,mon: keep last_epoch_started along with last_epoch_clean premerge

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-16 14:34:19 -05:00
Sage Weil
f9cf93584f Merge PR #24598 into master
* refs/pull/24598/head:
	.github/stale.yml: configure probot/stale to automatically close stale issues

Reviewed-by: Erwan Velu <erwan@redhat.com>
Reviewed-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2018-10-16 13:41:28 -05:00
Kefu Chai
6c00b11ba9
Merge pull request #24619 from tchaikov/wip-crimson-mon-client-better-encapsulation
crimson/mon: move mon::Connection into .cc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-17 00:45:19 +08:00
Kefu Chai
311c6371f8 crimson/mon: move mon::Connection into .cc
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-10-17 00:07:41 +08:00
Neha Ojha
bc13cfd035
Merge pull request #23849 from tchaikov/wip-crimson-monc
crimson: add MonClient

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-16 08:10:36 -07:00
Patrick Donnelly
299fc82ded
Merge PR #24505 into master
* refs/pull/24505/head:
	mds: wait shorter intervals if beacon not sent

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-10-16 07:52:54 -07:00
Kefu Chai
dd460032dd
Merge pull request #24373 from mogeb/build-cls-rbd
osd: add required cls_* libraries as dependencies of osd

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-10-16 22:12:53 +08:00
Patrick Donnelly
4014441b8d
mds: wait shorter intervals if beacon not sent
MDS beacon upkeep always waits mds_beacon_interval seconds even when laggy.
Check more frequently for when we stop being laggy to reduce likelihood that
the MDS is removed.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-16 06:29:35 -07:00
Sage Weil
747c9dcf0a Merge PR #24095 into master
* refs/pull/24095/head:
	osd: do not authenticate heartbeat connections until nautilus
	msg,osd: enable unauthenticated Dispatcher for pre-nautilus OSD compat
	osd: add missing space in heartbeat debug output
	mgr/DaemonServer: add missing return
	msg/async: drop verify_authorizer wrapper
	osd: authenticate ping sessions
	msg/simple: remove verify_authorizer wrapper
	msg: remove unused ms_verify_authorizer
	msg/async: remove get_authorizer wrapper
	msg/simple: remove get_authorizer wrapper
	msg/Messenger: pull authenticator validation into Messenger
	msg/Messenger: uninline ms_deliver_verify_authorizer
	mgr/DaemonServer: expose keyring for authenticator verification
	mon: expose keyring for msgr1 authentication
	mds: expose keyring for authenticater verification
	osd: expose keyring for authenticater verification
	msg/Dispatcher: add ms_get_auth1_authorizer_keystore
	mon: fix ref cycle breakage in handle_forward
	mon: use MonOpRequest get_session() instead of PaxosServiceMessage's
	mon: get session from MonOpRequest in handle_command
	messages/MForward: drop unused ctor
	mon: use ms_handle_authentication to parse caps
	mon: kill Session::global_id and use Connection member instead
	mgr/DaemonServer: move session setup into ms_handle_authentication
	mds: move session setup into ms_handle_authentication
	osd: move session setup into ms_handle_authentication
	msg: new ms_handle_authentication, add fields to Connection

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-10-16 07:20:17 -05:00
Sage Weil
05faeb4d12 Merge PR #24579 into master
* refs/pull/24579/head:
	qa/osd: fixup osd-rep-recov-eio.sh fails to parse pg dump

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-16 07:17:59 -05:00
John Spray
e6a26aeff7
Merge pull request #24597 from batrick/i36450
qa: fix run call args

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-10-16 13:09:08 +01:00
Kefu Chai
67777bbe7a
Merge pull request #23983 from theanalyst/vstart-rgw-asok
vstart: set admin socket for RGW in conf

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-16 19:15:35 +08:00
Kefu Chai
52706830d6
Merge pull request #24576 from cyx1231st/wip-seastar-msgr-refactor
crimson/net: seastar-msgr refactoring

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-16 16:44:16 +08:00
Kefu Chai
e1fd799b75
Merge pull request #24255 from gregsfortytwo/wip-crush-doc
doc: explain 'firstn v indep' in the CRUSH docs

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-10-16 13:49:19 +08:00
Patrick Donnelly
2760ddde89
Merge PR #24286 into master
* refs/pull/24286/head:
	client: fix fuse client can't read or write data due its caps is invalid

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-15 21:34:31 -07:00
Patrick Donnelly
6a4cc58a9d
Merge PR #24292 into master
* refs/pull/24292/head:
	qa: add test for rctime on root inode
	mds: set rctime on new system inode
	mds: small refactor

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-10-15 21:31:04 -07:00
Patrick Donnelly
35843a31c8
Merge PR #24486 into master
* refs/pull/24486/head:
	client: explicitly show blacklisted state via asok status command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-15 21:23:19 -07:00
Patrick Donnelly
14f23d602b
Merge PR #24508 into master
* refs/pull/24508/head:
	cephfs-shell: fixup 'str' object has no attribute 'decode'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-15 21:12:56 -07:00
Sage Weil
585d21df65 Merge PR #24596 into master
* refs/pull/24596/head:
	ptl-tool.py: move githubmap update into merge commit

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-10-15 18:41:53 -05:00
Sage Weil
46f32747bd .github/stale.yml: configure probot/stale to automatically close stale issues
Initially only warn about closing issues, but do not close them.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 17:37:03 -05:00
Patrick Donnelly
d491227956
qa: fix run call args
Fixes: http://tracker.ceph.com/issues/36450
Introduced-by: 95746ecce9
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-15 14:45:18 -07:00
Patrick Donnelly
28b9b4ea2b
Merge PR #24562 into master
* refs/pull/24562/head:
	removed warning for resolved errata

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-15 14:34:22 -07:00
Gregory Farnum
929a9201c8
Merge pull request #24186 from libingyang-zte/master
doc: fix typos in doc/releases
2018-10-15 14:17:36 -07:00
Gregory Farnum
9b099583ca
Merge pull request #24238 from LenzGr/doc-leads-update
doc/dev: Updated component leads table
2018-10-15 14:15:43 -07:00
Yingxin
265fcdd2ed crimson/net: clean seastar-msgr class dependencies
Remove protocol-specific interfaces from Messenger/Connection classes,
and let SocketMessenger manage SocketConnection instead of Connection.

Signed-off-by: Yingxin <yingxin.cheng@intel.com>
2018-10-16 04:43:35 +08:00
Sage Weil
2152d8ffb7 osd: do not authenticate heartbeat connections until nautilus
Some (currently) pre-nautilus OSDs will crash if you try to authenticate
a heartbeat connection but they are not expecting it:

src/auth/Crypto.h: 109: FAILED assert(ckh)
 ceph version 12.2.8-457-gccd69ef (ccd69ef36a) luminous (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x5618b04aaea0]
 2: (()+0x41cbec) [0x5618afe2cbec]
 3: (CephxSessionHandler::_calc_signature(Message*, unsigned long*)+0x8c5) [0x5618b0777ba5]
 4: (CephxSessionHandler::check_message_signature(Message*)+0x7d) [0x5618b077800d]
 5: (AsyncConnection::process()+0x1b44) [0x5618b0761a04]
 6: (EventCenter::process_events(int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0x359) [0x5618b0546079]
 7: (()+0xb38c3e) [0x5618b0548c3e]
 8: (()+0xb5070) [0x7ff04faf5070]
 9: (()+0x7dd5) [0x7ff050168dd5]
 10: (clone()+0x6d) [0x7ff04f259b3d]

See http://tracker.ceph.com/issues/36443

It won't be fixed in all clusters before upgrade to nautilus, though, so
we also need to work around it here.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
b8d1c80370 msg,osd: enable unauthenticated Dispatcher for pre-nautilus OSD compat
Before nautilus, osd heartbeats are sent over an unauthenticated channel.
We need support here to allow these connections when they are necessary
for upgrade compatibility.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
4b2f82ca5e osd: add missing space in heartbeat debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
28debec0f3 mgr/DaemonServer: add missing return
Fixes: http://tracker.ceph.com/issues/36110
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
a5f9295537 msg/async: drop verify_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
a3c40b345f osd: authenticate ping sessions
Do not set up a Session object, though--nobody cares (currently!).

This avoids having to special-case the generic authorizer validation
code in msg/* to have to handle non-authenticated sessions.  Also, it
seems like a good idea to authenticate these sessions!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
e91fd88b92 msg/simple: remove verify_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
1e3517a31e msg: remove unused ms_verify_authorizer
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
31f82c95d6 msg/async: remove get_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
955017ea4d msg/simple: remove get_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
b362ee2120 msg/Messenger: pull authenticator validation into Messenger
This code is essentially identical across the OSD and MDS.  The
monitor is annoyingly different, but in a msgr1 specific way that
we can handle carrying here until msgr1 gets ripped out in a
couple years.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
huanwen ren
f1219d716d qa/osd: fixup osd-rep-recov-eio.sh fails to parse pg dump
Fixes: http://tracker.ceph.com/issues/36418
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-10-16 02:18:22 +08:00
Lenz Grimmer
4decc6b3a4
Merge pull request #24577 from p-na/fix-saves-invalid-config
dashboard/mgr: Save button doesn't prevent saving an invalid form

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-10-15 18:01:41 +02:00
Scoots Hamilton
9352899618 removed warning for resolved errata
Signed-off-by: Scoots Hamilton <scoots@redhat.com>
2018-10-15 11:23:31 -04:00
Sage Weil
aa78792d91 mgr/devicehealth: use is_valid_daemon_name helper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 09:44:05 -05:00
Sage Weil
8d786003a4 mgr/devicehealth: generalize to mon and osd daemons
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 09:44:05 -05:00
Sage Weil
f37254a669 mon: implement 'smart [devid]' tell command
Just like the OSD!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 09:44:05 -05:00
Sage Weil
80cee1d988 mgr: parse mon metadata properly
Identify the "device_ids" like we do with OSD metadata by using the
helper.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 09:44:05 -05:00
Sage Weil
119fc0e552 mon: report device id used by mon
This will feed into the same device tracking that OSDs currently use.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 09:44:05 -05:00
Sage Weil
f9aea504eb common/blkdev: add get_device_by_path
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 09:44:05 -05:00
Sage Weil
2fb6315db1 common/blkdev: migrate block_device_run_smartctl from OSD.cc
Slight change in behavior here in that we return the error message in
the result.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 09:44:05 -05:00
Sage Weil
f22e55ad7a Merge PR #24473 into master
* refs/pull/24473/head:
	common: drop get_contiguous() from ceph::bufferlist.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-15 08:42:50 -05:00
Sage Weil
36c3bce219 Merge PR #24493 into master
* refs/pull/24493/head:
	mgr/DaemonState: clean up device life_expectancy values
	mgr/devicehealth: warn based on life_expectancy_max
	mgr/devicehealth: warn on failing devices at 6 weeks

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-15 08:36:18 -05:00
Lenz Grimmer
66db97eb6b
Merge pull request #24523 from s0nea/wip-dashboard-configs-table-cleanup
mgr/dashboard: config options table cleanup

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-15 15:14:52 +02:00