Commit Graph

94466 Commits

Author SHA1 Message Date
Kefu Chai
8805a28b0f
Merge pull request #26245 from liewegas/wip-38150
os/bluestore/KernelDevice: use flock(2) for block device lock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-02-04 01:20:55 +08:00
Xie Xingguo
a4b1dc5a09
Merge pull request #26179 from xiexingguo/wip-37968
crush: fix upmap overkill

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-02 17:24:42 +08:00
Kefu Chai
434dc9e95e
Merge pull request #26222 from tchaikov/wip-crimson-heartbeat
crimson/osd: add heartbeat support

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-02 15:45:44 +08:00
Kefu Chai
4eff55d0f1 cmake: disable GCC-9 warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
e9506e79ea crimson/osd: add heartbeat support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
a88e89e777 crimson/osd: move "_preboot" log to where it belongs to
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
3ee0167266 crimson/osd: bind and listen
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
66826c86f4 crimson/net: add Messenger::try_bind()
in case the server is just fine with any unused local port number, and it
will report it to monitor.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
2d70d9e990 crimson/osd: s/client_msgr/public_msgr/
because this messenger also serves requests from librados clients.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
7a5469dd2e crimson/common: add pick_address.cc to crimson-common
crimson-osd needs pick_address() for initializing the listening
addresses.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
41da38f21a common/pick_address: add necessary includes
* add needed forward declaration
* add necessary #includes
* move `#include "common/config.h"` to .cc, as it's not part of
interface.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
77a1eb73a0 common/pick_address: conditional compile for crimson
crimson can only update configuration async, so we cannot let
pick_addreses() call set_val_or_die() without chaning its function
signature.

for implementing crimson-osd, what we need is only a single
pick_addresses() variant, which returns entity_addrvec_t. so we just
enable it if WITH_SEASTAR is defined instead of adding a wrapper or
reimplement all pick_addresses() variants for crimson-osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
ef9403b1e5 crimson/mon: add get_fsid() to mon::Client
we need it for creating some messages. `MOSDPing`, for instance.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
a0307f5d1f crimson/osd: define OSDMapService interface
* define OSDMapService interface to decouple the consumers of
  this interface from its implementation -- the `OSD` class
* implement its methods in `OSD`

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
459fea558e crimson/osd: add editor variable settings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:13:37 +08:00
Kefu Chai
0feaf360c5 crimson/osd: remove unused method
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:13:37 +08:00
Xie Xingguo
6f6e080f4d
Merge pull request #26250 from falcon78921/wip-doc-rados-typo
doc: fixed typo in add-or-rm-mons.rst

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-02-02 08:26:50 +08:00
James McClune
4b077dd2e5 doc: fixed typo in add-or-rm-mons.rst
Redundant use of the word "monitor"

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-02-01 17:12:24 -05:00
Sage Weil
54fd6dce26 Merge PR #25703 into master
* refs/pull/25703/head:
	os/bluestore: option to disable bluestore warns on spillover.
	mon: expose object store health warnings
	osd: expose object store alerts
	os/bluestore: indicate BlueFS spillover and lacking compressor alerts
	os:enable ObjectStore::statfs() api to return OS alert list.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-01 12:43:03 -06:00
Sage Weil
c4ad6044c1 Merge PR #25773 into master
* refs/pull/25773/head:
	common: Use OpenSSL for cryptographic hashing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-02-01 12:42:38 -06:00
Sage Weil
2129cfc431 Merge PR #26067 into master
* refs/pull/26067/head:
	pybind/rados: fix application metadata list

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-01 12:41:25 -06:00
Sage Weil
3b5b96b90a Merge PR #26112 into master
* refs/pull/26112/head:
	mgr: load modules in finisher to avoid potential lock cycles

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-01 12:40:56 -06:00
Sage Weil
5481532554 Merge PR #26164 into master
* refs/pull/26164/head:
	mon/LogMonitor: lower logging level for check_sub

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-01 12:40:12 -06:00
Sage Weil
632a1033aa os/bluestore/KernelDevice: use flock(2) for block device lock
The fcntl locks fail due to the classic posix lock gotcha: if you close
*any* fd to the same inode from the process, the lock(s) go away.

Use flock(2) instead.  We have to be careful because we open the main
bluestore device via two KernelDevice instances: one for bluestore and
one for bluefs.  Add a no-lock flag so that the bluefs instance does not
try to lock and does not conflict with bluestore's.

Fixes: http://tracker.ceph.com/issues/38150
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-01 11:39:41 -06:00
Kefu Chai
e124ad72cf
Merge pull request #26224 from tchaikov/radek-lru-cleanup
common: drop the unused methods from SharedLRU.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-02 00:01:58 +08:00
Sebastian Wagner
d361f77a78
Merge pull request #26171 from sebastian-philipp/orchestrator-merge-create-add
mgr/orchestrator: Unify `osd create` and `osd add`

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-02-01 16:42:36 +01:00
Patrick Nawracay
c870477461
Merge pull request #26151 from nathan-weinberg/cluster-tests
mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-02-01 16:09:11 +01:00
J. Eric Ivancich
fdae3a71d7
Merge pull request #26231 from ivancich/wip-infinite-bucket-rm
rgw: `radosgw-admin bucket rm ... --purge-objects` can hang...

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-02-01 09:08:06 -05:00
Nathan Weinberg
2b8ed2cf18 mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu
Fixes: https://tracker.ceph.com/issues/38050
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
2019-02-01 08:55:37 -05:00
Lenz Grimmer
eba6be512b
Merge pull request #26203 from rhcs-dashboard/updated-pg-status-chart-colors
mgr/dashboard: Updated colors in PG Status chart

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-01 12:29:21 +01:00
Kefu Chai
5f030b0aa8
Merge pull request #25929 from falcon78921/wip-doc-37880
doc: updated rgw multitenancy link

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-01 17:21:54 +08:00
Sebastian Wagner
9e926e9927 mgr/orchestrator: Unify osd create and osd add
Also:

* Added some more tests
* Better validation of drive Groups
* Simplified `TestWriteCompletion`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-01 10:10:59 +01:00
Abhishek L
d28ace9bef
Merge pull request #26228 from theanalyst/doc/releases/12.2.11
doc: add release notes for 12.2.11 luminous

Reviewed-By: Sage Weil <sage@redhat.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-By: Eric Ivanvich <ivanvich@redhat.com>
2019-02-01 08:46:53 +01:00
J. Eric Ivancich
5b3dc38c62 rgw: radosgw-admin bucket rm ... --purge-objects can hang...
This command can hang (i.e., enter an infinite loop) due to
problematic bucket index entries left as a result of bug
https://tracker.ceph.com/issues/38007 .

The fix is to ignore the false bucket index entries -- since they do
not represent actual objects -- and remove all actual objects in the
bucket, so that bucket itself can be removed.

This fixes the both code paths whether `--bypass-gc` is specified or
not.

Furthermore, to made these operations more efficient, the internal
listing of the bucket is done unordered. This would improve behavior
when removing buckets with a large number of objects.

Fixes: http://tracker.ceph.com/issues/38134
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-01-31 17:43:25 -05:00
Abhishek Lekshmanan
7c677047a6 doc: add release notes for 12.2.11 luminous
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-31 23:32:24 +01:00
Patrick Donnelly
359e091c80
Merge PR #26193 into master
* refs/pull/26193/head:
	mds: move session setup to ms_handle_accept
	common: add method to get StackStringStream ptr

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-31 12:35:36 -08:00
Patrick Donnelly
0d26266ccb
Merge PR #26038 into master
* refs/pull/26038/head:
	mds: simplify recall warnings
	mds: add extra details for cache drop output
	qa: test mds_max_caps_per_client conf
	mds: limit maximum number of caps held by session
	mds: adapt drop cache for incremental recall
	mds: recall caps incrementally
	mds: adapt drop cache for incremental trim
	mds: add throttle for trimming MDCache
	mds: cleanup SessionMap init
	mds: cleanup Session init

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-01-31 12:08:26 -08:00
Patrick Donnelly
c0b3a11484
mds: simplify recall warnings
Instead of a timeout and complicated decisions about whether the client is
releasing caps in an expeditious fashion, just use a DecayCounter that tracks
the number of caps we've recalled. This counter is decremented whenever the
client releases caps. If the counter passes a threshold, then we raise the
warning.

Similar reworking is done for the steady-state recall of client caps. Another
release DecayCounter is added so we can tell when the client is not releasing
any more caps.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-31 12:07:54 -08:00
Patrick Donnelly
c2405957ed
mds: move session setup to ms_handle_accept
Session setup in ms_handle_authentication is (historically) racy where multiple
connections from the same client can come in before one is finally accepted.  A
session should only be created after ms_handle_accept. The MDS did some
backflips before this commit to ensure this.

Moreover, with the msgr2 changes, it is even more necessary since the address
nonce is not set until before ms_handle_accept is called.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-31 11:29:34 -08:00
Casey Bodley
e6c2da1e96
Merge pull request #26190 from cbodley/wip-rgw-datalog-last-trim
rgw multisite: only update last_trim marker on ENODATA

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-01-31 12:37:09 -05:00
Radoslaw Zarzynski
4234101a15 common: drop the unused reset_comparator() from SharedLRU.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-01-31 20:46:07 +08:00
Radoslaw Zarzynski
b701f8f3e9 common: drop the unused get_comparator() from SharedLRU.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-01-31 20:46:07 +08:00
Lenz Grimmer
99e45cd8d9
Merge pull request #26188 from Exotelis/tracker-37916
mgr/dashboard: Cleanup of the cluster and audit log

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-01-31 10:59:06 +01:00
Patrick Donnelly
727c5aff99
common: add method to get StackStringStream ptr
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-01-30 14:24:08 -08:00
Andrew Schoen
93094a5230
Merge pull request #25542 from jan--f/c-v-extend-batch
Extend batch to accept explicit device lists

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-01-30 13:29:40 -06:00
Casey Bodley
aacd111e39
Merge pull request #26205 from cbodley/wip-38115
qa/mon: fix cluster support for monmap bootstrap

Reviewed-by: Sage Weil <sage@redhat.com>
2019-01-30 13:55:52 -05:00
Casey Bodley
82cd04b9d7
Merge pull request #26204 from pritha-srivastava/wip-rgw-signature-mismatch
rgw: Fix for SignatureMismatchError in s3 commands.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-01-30 12:39:39 -05:00
David Zafman
553d83dd24
Merge pull request #25403 from liyichao/rdigest
tools: Add clear-data-digest command to objectstore tool.

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-01-30 09:30:23 -08:00
David Zafman
894bdf080e
Merge pull request #26158 from dzafman/wip-38053
Add hashinfo testing for dump command of ceph-objectstore-tool

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-01-30 09:29:01 -08:00
Casey Bodley
0aebb55af5 qa/mon: fix cluster support for monmap bootstrap
-filter out mons from other clusters
-fix parsing of mon name from role

Fixes: http://tracker.ceph.com/issues/38115

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-01-30 12:24:36 -05:00