Commit Graph

91129 Commits

Author SHA1 Message Date
Sage Weil
28debec0f3 mgr/DaemonServer: add missing return
Fixes: http://tracker.ceph.com/issues/36110
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
a5f9295537 msg/async: drop verify_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
a3c40b345f osd: authenticate ping sessions
Do not set up a Session object, though--nobody cares (currently!).

This avoids having to special-case the generic authorizer validation
code in msg/* to have to handle non-authenticated sessions.  Also, it
seems like a good idea to authenticate these sessions!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
e91fd88b92 msg/simple: remove verify_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
1e3517a31e msg: remove unused ms_verify_authorizer
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
31f82c95d6 msg/async: remove get_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
955017ea4d msg/simple: remove get_authorizer wrapper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
b362ee2120 msg/Messenger: pull authenticator validation into Messenger
This code is essentially identical across the OSD and MDS.  The
monitor is annoyingly different, but in a msgr1 specific way that
we can handle carrying here until msgr1 gets ripped out in a
couple years.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-15 15:01:40 -05:00
Sage Weil
b462cf2b22 msg/Messenger: uninline ms_deliver_verify_authorizer
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:10 -05:00
Sage Weil
f2f4493b26 mgr/DaemonServer: expose keyring for authenticator verification
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:10 -05:00
Sage Weil
cdb5b9da3f mon: expose keyring for msgr1 authentication
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:10 -05:00
Sage Weil
6296573ef1 mds: expose keyring for authenticater verification
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:10 -05:00
Sage Weil
14e3cb1555 osd: expose keyring for authenticater verification
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:09 -05:00
Sage Weil
68d2b03bf4 msg/Dispatcher: add ms_get_auth1_authorizer_keystore
This is there to provide the keyring used for authenticating msgr1
authorizers.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:09 -05:00
Sage Weil
9ddb9bfd8b mon: fix ref cycle breakage in handle_forward
We now rely on the session -> connection ref for printing
remote addr, peer_global_id, and so on.  Change this code to
break the ref cycle instead by removing the con->session link,
which is only needed by the MonOpRequest ctor called at the top
of _ms_dispatch.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:09 -05:00
Sage Weil
ec282c45a7 mon: use MonOpRequest get_session() instead of PaxosServiceMessage's
The PaxosServiceMessage method relies on the msg -> con -> session linkage,
and the con -> session link is not present for forwarded messages.  Also,
the message path is redundant and unnecessary.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:09 -05:00
Sage Weil
60dcb7c432 mon: get session from MonOpRequest in handle_command
We should have made this switchover a long time ago.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:09 -05:00
Sage Weil
830760903e messages/MForward: drop unused ctor
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:09 -05:00
Sage Weil
6c7b34adc9 mon: use ms_handle_authentication to parse caps
The situation is a bit different here than the MDS and OSD because the
authentication happens from MAuth instead of ms_verify_authorizer, but
we are moving toward being more consistent.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 12:01:09 -05:00
Sage Weil
e7d1ab2688 mon: kill Session::global_id and use Connection member instead
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
873c6a69bb mgr/DaemonServer: move session setup into ms_handle_authentication
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
ecbd4a8aa8 mds: move session setup into ms_handle_authentication
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
67d2f3b901 osd: move session setup into ms_handle_authentication
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
eec65bada4 msg: new ms_handle_authentication, add fields to Connection
Lay some groundwork to eliminate ms_verify_authorizer.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
59ab2aa6ab Merge PR #24146 into master
* refs/pull/24146/head:
	mgr/orchestrator: Fix Python 3 issues

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-14 11:42:17 -05:00
Sage Weil
b5ba057240 Merge PR #24247 into master
* refs/pull/24247/head:
	PendingReleaseNotes: add note about increased mon memory footprint
	doc/start/hardware-recommendations: refresh recommendations for RAM
	rocksdb: increase default cache size to 512 MB
	mon: mon_osd_cache_size = 500 (from 10)

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-10-14 11:40:15 -05:00
Sage Weil
b43dd18fc0 Merge PR #24495 into master
* refs/pull/24495/head:
	kv: apply the move semantics in KeyValueDB::get().

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-14 08:06:18 -05:00
Sage Weil
bc52bc2f6d Merge PR #24535 into master
* refs/pull/24535/head:
	mon: consider AUTH_NONE clients which "authenticate" to be finished

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-14 08:05:10 -05:00
Mykola Golub
1d92788f71
Merge pull request #24563 from dillaman/wip-36410
test: move OpenStack devstack test to rocky release

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-10-14 10:40:05 +03:00
Neha Ojha
05fea962f1
Merge pull request #24564 from neha-ojha/wip-21931
osd: do not overestimate the size of the object for reads with trimtrunc

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>
2018-10-12 19:15:39 -07:00
Sage Weil
9db328f2ab Merge PR #24204 into master
* refs/pull/24204/head:
	qa/suites/rgw/tempest: valgrind on centos only

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-10-12 16:29:44 -05:00
Sage Weil
b29e4470ac Merge PR #24249 into master
* refs/pull/24249/head:
	doc/rados/troubleshooting-mon: update mondb recovery script

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-12 16:29:28 -05:00
Sage Weil
b624cea60a Merge PR #24296 into master
* refs/pull/24296/head:
	osd: Handle is_stopping() by discarding item so it doesn't loop
	osd: Simplify _process() logic recently added

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-12 16:16:39 -05:00
Sage Weil
ec3a825db2 Merge PR #24131 into master
* refs/pull/24131/head:
	tests, common: introduce bufferlist::apennd benchmark.
	test, common: add BufferListIterator.BenchDeref benchmark.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-12 16:14:55 -05:00
Sage Weil
4aba9cc02f Merge PR #24270 into master
* refs/pull/24270/head:
	osd: make 'cache drop' command require 'executable' permission
	osd: rename 'drop cache' and 'get cache stats' to group them by component
	doc: add documentation for 'drop cache' and 'get cache stats'
	osd: don't print osdmap cache stats in 'get cache stats' command
	osd: do not clear osdmap cache on 'drop cache' command
	osd: offload dumping cache stats to the object store
	osd: pass a stream to flush_cache commands for more verbosity
	osd: implement flush_cache() method for Filestore
	osd: add clear_cache and get_cache_object_count commands

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-12 16:14:37 -05:00
Sage Weil
07e74f803f Merge PR #24312 into master
* refs/pull/24312/head:
	osd: kill the std::stringstream in ReplicatedBackend::do_repop_reply.
	osd: bump-up the dout level in PGLog::write_log_and_missing.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-12 16:14:19 -05:00
Sage Weil
4ae369119d Merge PR #24520 into master
* refs/pull/24520/head:
	install-deps.sh: dashboard frontend needs git

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-10-12 16:13:57 -05:00
Sage Weil
90c342b521 Merge PR #24521 into master
* refs/pull/24521/head:
	ceph.in: reinstate interactive mode output

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-10-12 16:13:37 -05:00
Neha Ojha
76c57810ee osd/PrimaryLogPG.cc: reassign size only when object size > truncate_size
Before setting size equal to op.extent.truncate_size, we need to check
if the size of the object is greater than the truncate_size. We do not
need to set size to op.extent.truncate_size, in the case where the size of
the object is less than op.extent.truncate_size.

Without this change, we were always setting size =
op.extent.truncate_size, when (seq < op.extent.truncate_seq) and
(op.extent.offset + op.extent.length > op.extent.truncate_size), were both
true. This ended up in:

1. overestimating the size of the object
2. not considering the correct size of the object, for
   the later checks, which calculate op.extent.length for the read ops
3. causing crashes when trying to read more data than what was present

Fixes: http://tracker.ceph.com/issues/21931
Fixes: http://tracker.ceph.com/issues/22330

Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-10-12 12:49:07 -07:00
Neha Ojha
07f7bd6942 osd: print offset and length to track trimtrunc
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-10-12 12:47:39 -07:00
Matt Benjamin
9e58faf4a5
Merge pull request #24341 from joke-lee/WIP_FIX_RGWPOSTOBJ_VERSIONING
rgw: list bucket can not show the object uploaded by RGWPostObj when enable bucket versioning
2018-10-12 13:02:33 -04:00
Jason Dillaman
1e3dc02604 qa/tasks/workunit: use suite branch/SHA1 when cloning workunits
Right now it's using the Ceph branch/SHA1 but it's using the suite
Git URL.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-12 12:41:58 -04:00
Jason Dillaman
2a1dca3fca qa/workunits/rbd: switch devstack to rocky branch and tempest to 19.0.0 tag
Fixes: http://tracker.ceph.com/issues/36410
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-12 08:40:44 -04:00
Jason Dillaman
ba32395165
Merge pull request #24550 from dillaman/wip-36409
qa/workunits: replace 'realpath' with 'readlink -f' in fsstress.sh

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-12 08:39:37 -04:00
John Spray
27ea9ca821
Merge pull request #24517 from jcsp/wip-23970-test
mgr/selftest: fix disabled module selection

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-12 13:05:40 +01:00
Jan Fajerski
54499147ba
Merge pull request #24426 from Miouge1/grafana-fix1
monitoring/grafana: Fix OSD Capacity Utlization Grafana graph
2018-10-12 12:44:39 +02:00
Ricardo Marques
639c19e5fd
Merge pull request #24511 from a2batic/grafana-doc
mgr/dashboard: Improves documentation for Grafana Setting

Reviewed-by: Kai Wagner <kwagner@suse.com> 
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-12 10:19:48 +01:00
Ricardo Marques
cef650aa3d
Merge pull request #24513 from rhcs-dashboard/27047-landing-page-info-visibility
mgr/dashboard: Landing Page: info visibility

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-12 10:04:02 +01:00
Ricardo Marques
57b28c7fc5
Merge pull request #24222 from votdev/bug_36109
mgr/dashboard: The RGW backend doesn't handle IPv6 properly

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-12 10:01:39 +01:00
Jason Dillaman
c1f950236b qa/tasks: qemu task now uses a relative path in suite repo for test
This makes it easier to re-run tests against a suite branch without
requiring a full ceph-ci build and repo.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-11 20:23:39 -04:00