Commit Graph

91108 Commits

Author SHA1 Message Date
Sage Weil
ecbd4a8aa8 mds: move session setup into ms_handle_authentication
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
67d2f3b901 osd: move session setup into ms_handle_authentication
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
eec65bada4 msg: new ms_handle_authentication, add fields to Connection
Lay some groundwork to eliminate ms_verify_authorizer.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-14 11:59:20 -05:00
Sage Weil
59ab2aa6ab Merge PR #24146 into master
* refs/pull/24146/head:
	mgr/orchestrator: Fix Python 3 issues

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-14 11:42:17 -05:00
Sage Weil
b5ba057240 Merge PR #24247 into master
* refs/pull/24247/head:
	PendingReleaseNotes: add note about increased mon memory footprint
	doc/start/hardware-recommendations: refresh recommendations for RAM
	rocksdb: increase default cache size to 512 MB
	mon: mon_osd_cache_size = 500 (from 10)

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-10-14 11:40:15 -05:00
Sage Weil
b43dd18fc0 Merge PR #24495 into master
* refs/pull/24495/head:
	kv: apply the move semantics in KeyValueDB::get().

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-14 08:06:18 -05:00
Sage Weil
bc52bc2f6d Merge PR #24535 into master
* refs/pull/24535/head:
	mon: consider AUTH_NONE clients which "authenticate" to be finished

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-14 08:05:10 -05:00
Mykola Golub
1d92788f71
Merge pull request #24563 from dillaman/wip-36410
test: move OpenStack devstack test to rocky release

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-10-14 10:40:05 +03:00
Neha Ojha
05fea962f1
Merge pull request #24564 from neha-ojha/wip-21931
osd: do not overestimate the size of the object for reads with trimtrunc

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>
2018-10-12 19:15:39 -07:00
Sage Weil
9db328f2ab Merge PR #24204 into master
* refs/pull/24204/head:
	qa/suites/rgw/tempest: valgrind on centos only

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-10-12 16:29:44 -05:00
Sage Weil
b29e4470ac Merge PR #24249 into master
* refs/pull/24249/head:
	doc/rados/troubleshooting-mon: update mondb recovery script

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-12 16:29:28 -05:00
Sage Weil
b624cea60a Merge PR #24296 into master
* refs/pull/24296/head:
	osd: Handle is_stopping() by discarding item so it doesn't loop
	osd: Simplify _process() logic recently added

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-12 16:16:39 -05:00
Sage Weil
ec3a825db2 Merge PR #24131 into master
* refs/pull/24131/head:
	tests, common: introduce bufferlist::apennd benchmark.
	test, common: add BufferListIterator.BenchDeref benchmark.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-12 16:14:55 -05:00
Sage Weil
4aba9cc02f Merge PR #24270 into master
* refs/pull/24270/head:
	osd: make 'cache drop' command require 'executable' permission
	osd: rename 'drop cache' and 'get cache stats' to group them by component
	doc: add documentation for 'drop cache' and 'get cache stats'
	osd: don't print osdmap cache stats in 'get cache stats' command
	osd: do not clear osdmap cache on 'drop cache' command
	osd: offload dumping cache stats to the object store
	osd: pass a stream to flush_cache commands for more verbosity
	osd: implement flush_cache() method for Filestore
	osd: add clear_cache and get_cache_object_count commands

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-12 16:14:37 -05:00
Sage Weil
07e74f803f Merge PR #24312 into master
* refs/pull/24312/head:
	osd: kill the std::stringstream in ReplicatedBackend::do_repop_reply.
	osd: bump-up the dout level in PGLog::write_log_and_missing.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-12 16:14:19 -05:00
Sage Weil
4ae369119d Merge PR #24520 into master
* refs/pull/24520/head:
	install-deps.sh: dashboard frontend needs git

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-10-12 16:13:57 -05:00
Sage Weil
90c342b521 Merge PR #24521 into master
* refs/pull/24521/head:
	ceph.in: reinstate interactive mode output

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-10-12 16:13:37 -05:00
Neha Ojha
76c57810ee osd/PrimaryLogPG.cc: reassign size only when object size > truncate_size
Before setting size equal to op.extent.truncate_size, we need to check
if the size of the object is greater than the truncate_size. We do not
need to set size to op.extent.truncate_size, in the case where the size of
the object is less than op.extent.truncate_size.

Without this change, we were always setting size =
op.extent.truncate_size, when (seq < op.extent.truncate_seq) and
(op.extent.offset + op.extent.length > op.extent.truncate_size), were both
true. This ended up in:

1. overestimating the size of the object
2. not considering the correct size of the object, for
   the later checks, which calculate op.extent.length for the read ops
3. causing crashes when trying to read more data than what was present

Fixes: http://tracker.ceph.com/issues/21931
Fixes: http://tracker.ceph.com/issues/22330

Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-10-12 12:49:07 -07:00
Neha Ojha
07f7bd6942 osd: print offset and length to track trimtrunc
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-10-12 12:47:39 -07:00
Matt Benjamin
9e58faf4a5
Merge pull request #24341 from joke-lee/WIP_FIX_RGWPOSTOBJ_VERSIONING
rgw: list bucket can not show the object uploaded by RGWPostObj when enable bucket versioning
2018-10-12 13:02:33 -04:00
Jason Dillaman
1e3dc02604 qa/tasks/workunit: use suite branch/SHA1 when cloning workunits
Right now it's using the Ceph branch/SHA1 but it's using the suite
Git URL.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-12 12:41:58 -04:00
Jason Dillaman
2a1dca3fca qa/workunits/rbd: switch devstack to rocky branch and tempest to 19.0.0 tag
Fixes: http://tracker.ceph.com/issues/36410
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-12 08:40:44 -04:00
Jason Dillaman
ba32395165
Merge pull request #24550 from dillaman/wip-36409
qa/workunits: replace 'realpath' with 'readlink -f' in fsstress.sh

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-12 08:39:37 -04:00
John Spray
27ea9ca821
Merge pull request #24517 from jcsp/wip-23970-test
mgr/selftest: fix disabled module selection

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-12 13:05:40 +01:00
Jan Fajerski
54499147ba
Merge pull request #24426 from Miouge1/grafana-fix1
monitoring/grafana: Fix OSD Capacity Utlization Grafana graph
2018-10-12 12:44:39 +02:00
Ricardo Marques
639c19e5fd
Merge pull request #24511 from a2batic/grafana-doc
mgr/dashboard: Improves documentation for Grafana Setting

Reviewed-by: Kai Wagner <kwagner@suse.com> 
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-12 10:19:48 +01:00
Ricardo Marques
cef650aa3d
Merge pull request #24513 from rhcs-dashboard/27047-landing-page-info-visibility
mgr/dashboard: Landing Page: info visibility

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-12 10:04:02 +01:00
Ricardo Marques
57b28c7fc5
Merge pull request #24222 from votdev/bug_36109
mgr/dashboard: The RGW backend doesn't handle IPv6 properly

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-10-12 10:01:39 +01:00
Jason Dillaman
c1f950236b qa/tasks: qemu task now uses a relative path in suite repo for test
This makes it easier to re-run tests against a suite branch without
requiring a full ceph-ci build and repo.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-11 20:23:39 -04:00
Matt Benjamin
9809e95308
Merge pull request #24402 from cbodley/wip-36302
librgw: initialize curl and http client for multisite
2018-10-11 15:51:49 -04:00
Sage Weil
f1dd265a36 Merge PR #24514 into master
* refs/pull/24514/head:
	mgr/restful: do not print warning message at seeing unknown request

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-10-11 14:35:45 -05:00
Jason Dillaman
ddb7e5eb80 qa/workunits: replace 'realpath' with 'readlink -f' in fsstress.sh
Fixes: http://tracker.ceph.com/issues/36409
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-10-11 15:25:20 -04:00
Sage Weil
29c9fbe534 Merge PR #24264 into master
* refs/pull/24264/head:
	tools/rados/rados.cc: fix rados rm --force-full blocking problem

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-10-11 14:24:12 -05:00
Sage Weil
28cca7bb5f Merge PR #24287 into master
* refs/pull/24287/head:
	osd/OSD: drop osd_lock only if pg osdmaps are truly laggy

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-11 14:22:44 -05:00
Sage Weil
65ea56d15b Merge PR #24331 into master
* refs/pull/24331/head:
	common: fix memory leaks in WeightedPriorityQueue.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-11 14:22:28 -05:00
Sage Weil
5ea5dc2b0e Merge PR #24365 into master
* refs/pull/24365/head:
	erasure-code: var-sized array init is done separatly.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-11 14:22:13 -05:00
Sage Weil
f5ffe4db69 Merge PR #24506 into master
* refs/pull/24506/head:
	doc/rados/troubleshooting: update notes on rebuilding mon db
	ceph-objectstore-tool: update-mon-db: remove pgmap references
	ceph-monstore-tool: remove remaining pgmap references, inflate-pgmap command
	ceph-monstore-tool: rebuild creating_pgs
	ceph-monstore-tool: rebuild: remove obsolete pgmap_meta fields

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-11 13:53:20 -05:00
Greg Farnum
f155851e5f mon: consider AUTH_NONE clients which "authenticate" to be finished
We check for AUTH_NONE success by examining the side effect of the caps being
filled in with allow_all, and we need that to be "finished" for purposes of
replying with a monmap as well.

Fixes: http://tracker.ceph.com/issues/36300

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2018-10-11 11:08:51 -07:00
Casey Bodley
4d8e2c0df6
Merge pull request #24409 from alimaredia/wip-rgw-dpp-auth
rgw: thread DoutPrefixProvider into RGW::Auth_S3::authorize

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-11 13:21:40 -04:00
Sage Weil
b371771383 doc/rados/troubleshooting-mon: update mondb recovery script
- some cleanup (e.g., use $ms throughput)
- behave if the local host is in the $hosts list (use $ms.remote)
- be clear about updating all mons
- mon.0 -> mon.foo

Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-11 11:35:31 -05:00
Jason Dillaman
c60ffac61e
Merge pull request #24428 from trociny/wip-rbd-config-global
rbd: add 'config global' command to get/store overrides in mon config db

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-10-11 10:50:33 -04:00
Sage Weil
bc4a306790 Merge PR #24541 into master
* refs/pull/24541/head:
	common/config.h: fix spelling error in this file

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-11 09:09:07 -05:00
John Spray
796a4efc80 mgr/selftest: fix disabled module selection
This was broken by always on modules -- it was also
unnecessary complication, let's just pick some
hardcoded module to use.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-10-11 08:50:49 -04:00
Sage Weil
9d7473f78b Merge PR #24305 into master
* refs/pull/24305/head:
	msg/async: ProtocolV1: use continuations instead of direct function calls
	msg/async: ProtocolV1 state machine ascii diagram

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2018-10-11 07:27:11 -05:00
Sebastian Wagner
d8de543b7e install-deps.sh: dashboard frontend needs git
Running `npm install` for the dashboard pulls dependenies with git.
Under some setups, git was not installed when building the frontend.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-10-11 14:20:52 +02:00
Alfredo Deza
4e312b8751
Merge pull request #24404 from ceph/wip-batch-report-idempotent
ceph-volume: make `lvm batch` idempotent

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-10-11 07:51:22 -04:00
xiaomanh
692abe1844 common/config.h: fix spelling error in this file
Signed-off-by: xiaomanh <huangxiaoman@cmss.chinamobile.com>
2018-10-11 18:00:51 +08:00
Boris Ranto
072bb4e178
Merge pull request #24425 from b-ranto/wip-ld-hardening
rpm: Use hardened LDFLAGS

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-10-11 04:55:37 -05:00
Kanika Murarka
c8f2e5af35 mgr/dashboard: Improves documentation for Grafana Setting
Fixes: http://tracker.ceph.com/issues/36371
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>
2018-10-11 15:19:44 +05:30
Patrick Donnelly
d03a8302b5
Merge PR #23069 into master
* refs/pull/23069/head:
	tests/libcephfs: add simple reclaim test
	mds: check auth name before reclaiming session
	mds: reclaim session before allowing mds to become active
	mds: allow client to specify its session timeout
	mds: initial code for client states reclaim

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-10-10 15:29:41 -07:00