Commit Graph

94582 Commits

Author SHA1 Message Date
Kefu Chai
8805a28b0f
Merge pull request #26245 from liewegas/wip-38150
os/bluestore/KernelDevice: use flock(2) for block device lock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-02-04 01:20:55 +08:00
Sage Weil
51067350ad msg/async/ProtocolV2: respect policy.resetcheck on cookie==0
It's possible the accepting end knows the cookie but the connecting end
does not if the fault happens before it receives server_ident.  If the
next connection attempt is in the other direction, we need to avoid a
reset or the queued messages at the first site will get lost.

Fixes: http://tracker.ceph.com/issues/38118
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-03 10:43:40 -06:00
Ilya Dryomov
04f5b343f9 qa: update krbd tests for zeroout
Discard no longer guarantees zeroing, use BLKZEROOUT and "fallocate -z"
instead (blkdiscard(8) in xenial doesn't support -z).

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-03 10:57:07 +01:00
Ilya Dryomov
031bbea739 qa: krbd discard with alloc_size vs zeroout tests
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-02 18:33:32 +01:00
Xie Xingguo
a4b1dc5a09
Merge pull request #26179 from xiexingguo/wip-37968
crush: fix upmap overkill

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-02 17:24:42 +08:00
Kefu Chai
434dc9e95e
Merge pull request #26222 from tchaikov/wip-crimson-heartbeat
crimson/osd: add heartbeat support

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-02 15:45:44 +08:00
Kefu Chai
4eff55d0f1 cmake: disable GCC-9 warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
e9506e79ea crimson/osd: add heartbeat support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
a88e89e777 crimson/osd: move "_preboot" log to where it belongs to
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
3ee0167266 crimson/osd: bind and listen
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
66826c86f4 crimson/net: add Messenger::try_bind()
in case the server is just fine with any unused local port number, and it
will report it to monitor.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
2d70d9e990 crimson/osd: s/client_msgr/public_msgr/
because this messenger also serves requests from librados clients.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
7a5469dd2e crimson/common: add pick_address.cc to crimson-common
crimson-osd needs pick_address() for initializing the listening
addresses.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
41da38f21a common/pick_address: add necessary includes
* add needed forward declaration
* add necessary #includes
* move `#include "common/config.h"` to .cc, as it's not part of
interface.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
77a1eb73a0 common/pick_address: conditional compile for crimson
crimson can only update configuration async, so we cannot let
pick_addreses() call set_val_or_die() without chaning its function
signature.

for implementing crimson-osd, what we need is only a single
pick_addresses() variant, which returns entity_addrvec_t. so we just
enable it if WITH_SEASTAR is defined instead of adding a wrapper or
reimplement all pick_addresses() variants for crimson-osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
ef9403b1e5 crimson/mon: add get_fsid() to mon::Client
we need it for creating some messages. `MOSDPing`, for instance.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
a0307f5d1f crimson/osd: define OSDMapService interface
* define OSDMapService interface to decouple the consumers of
  this interface from its implementation -- the `OSD` class
* implement its methods in `OSD`

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
459fea558e crimson/osd: add editor variable settings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:13:37 +08:00
Kefu Chai
0feaf360c5 crimson/osd: remove unused method
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:13:37 +08:00
Patrick Donnelly
ff3411d56f
mds: refactor MDSContext inheritance
This commit greatly simplifies things.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-01 16:38:57 -08:00
Xie Xingguo
6f6e080f4d
Merge pull request #26250 from falcon78921/wip-doc-rados-typo
doc: fixed typo in add-or-rm-mons.rst

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-02-02 08:26:50 +08:00
James McClune
4b077dd2e5 doc: fixed typo in add-or-rm-mons.rst
Redundant use of the word "monitor"

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-02-01 17:12:24 -05:00
Radoslaw Zarzynski
995d6b0cc9 common: drop decltype(_buffers) from include/buffers.h.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:51 +01:00
Radoslaw Zarzynski
e20837a15f tests: introduce BufferList.ContiguousAppender.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:51 +01:00
Radoslaw Zarzynski
f780d8ede1 common: optimize bufferlist::contiguous_appender.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:51 +01:00
Radoslaw Zarzynski
5b905b8364 common: introduce obtain_contiguous_space() to bufferlist.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:51 +01:00
Radoslaw Zarzynski
e0994229a1 tests: introduce BufferList.InternalCarriage.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:51 +01:00
Radoslaw Zarzynski
ded528e66f common: introduce bl::_carriage to track writeable area.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:51 +01:00
Radoslaw Zarzynski
7362e5b585 common: kill remainings of bufferlist's append_buffer.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:50 +01:00
Radoslaw Zarzynski
93e1a712dc common: simplify the C-string-taking variant of bl::append().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:50 +01:00
Radoslaw Zarzynski
66b7cc8806 tests: introduce BufferListIterator.iterate_with_empties.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:50 +01:00
Radoslaw Zarzynski
c7a53ecfbc common: bufferlist can contain 0-length bptrs.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:50 +01:00
Radoslaw Zarzynski
0326cf33da common: contiguous_appender doesn't use append_buffer anymore.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:50 +01:00
Radoslaw Zarzynski
a94e54af68 common: bl::appends don't use the append_buffer anymore.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-01 22:54:50 +01:00
Sage Weil
54fd6dce26 Merge PR #25703 into master
* refs/pull/25703/head:
	os/bluestore: option to disable bluestore warns on spillover.
	mon: expose object store health warnings
	osd: expose object store alerts
	os/bluestore: indicate BlueFS spillover and lacking compressor alerts
	os:enable ObjectStore::statfs() api to return OS alert list.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-01 12:43:03 -06:00
Sage Weil
c4ad6044c1 Merge PR #25773 into master
* refs/pull/25773/head:
	common: Use OpenSSL for cryptographic hashing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-02-01 12:42:38 -06:00
Sage Weil
2129cfc431 Merge PR #26067 into master
* refs/pull/26067/head:
	pybind/rados: fix application metadata list

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-01 12:41:25 -06:00
Sage Weil
3b5b96b90a Merge PR #26112 into master
* refs/pull/26112/head:
	mgr: load modules in finisher to avoid potential lock cycles

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-01 12:40:56 -06:00
Sage Weil
5481532554 Merge PR #26164 into master
* refs/pull/26164/head:
	mon/LogMonitor: lower logging level for check_sub

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-01 12:40:12 -06:00
Sage Weil
632a1033aa os/bluestore/KernelDevice: use flock(2) for block device lock
The fcntl locks fail due to the classic posix lock gotcha: if you close
*any* fd to the same inode from the process, the lock(s) go away.

Use flock(2) instead.  We have to be careful because we open the main
bluestore device via two KernelDevice instances: one for bluestore and
one for bluefs.  Add a no-lock flag so that the bluefs instance does not
try to lock and does not conflict with bluestore's.

Fixes: http://tracker.ceph.com/issues/38150
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-01 11:39:41 -06:00
Ilya Dryomov
fa32d97a9f rbd: recognize alloc_size map option
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-01 17:59:38 +01:00
Kefu Chai
e124ad72cf
Merge pull request #26224 from tchaikov/radek-lru-cleanup
common: drop the unused methods from SharedLRU.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-02 00:01:58 +08:00
Sebastian Wagner
d361f77a78
Merge pull request #26171 from sebastian-philipp/orchestrator-merge-create-add
mgr/orchestrator: Unify `osd create` and `osd add`

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-02-01 16:42:36 +01:00
Patrick Nawracay
c870477461
Merge pull request #26151 from nathan-weinberg/cluster-tests
mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-02-01 16:09:11 +01:00
J. Eric Ivancich
fdae3a71d7
Merge pull request #26231 from ivancich/wip-infinite-bucket-rm
rgw: `radosgw-admin bucket rm ... --purge-objects` can hang...

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-02-01 09:08:06 -05:00
Nathan Weinberg
2b8ed2cf18 mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu
Fixes: https://tracker.ceph.com/issues/38050
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
2019-02-01 08:55:37 -05:00
Lenz Grimmer
eba6be512b
Merge pull request #26203 from rhcs-dashboard/updated-pg-status-chart-colors
mgr/dashboard: Updated colors in PG Status chart

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-01 12:29:21 +01:00
Volker Theile
8210be29ad mgr: Use Py_BuildValue to create the argument tuple
Reduce the complexity of the code by using the generic function, Py_BuildValue(), that can create most common objects from C values, directed by a format string.

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-02-01 11:48:29 +01:00
Kefu Chai
5f030b0aa8
Merge pull request #25929 from falcon78921/wip-doc-37880
doc: updated rgw multitenancy link

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-01 17:21:54 +08:00
Sebastian Wagner
9e926e9927 mgr/orchestrator: Unify osd create and osd add
Also:

* Added some more tests
* Better validation of drive Groups
* Simplified `TestWriteCompletion`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-01 10:10:59 +01:00