RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-04 02:02:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
89,322 Commits 212 Branches 394 Tags 1.6 GiB
9b240c040d
Commit Graph

89322 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Gregory Farnum
2b0ceced42
Merge pull request #23519 from falcon78921/wip-doc-troubleshoot-osds 
doc: cleaned up troubleshooting OSDs documentation

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2018-08-13 13:57:58 -07:00
Dan Mick
298a1d92d2 qa/suites/rados, qa/workunits/rados: Add suite/workunit for ceph-crash 
Signed-off-by: Dan Mick <dan.mick@redhat.com>
 2018-08-13 13:53:26 -07:00
Casey Bodley
909f74d6c5
Merge pull request #23401 from cbodley/wip-rgw-getomapkeys2-more 
rgw: RGWRadosGetOmapKeysCR uses 'more' flag from omap_get_keys2()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2018-08-13 15:44:45 -04:00
Sage Weil
a3d64ea9db Merge PR #23406 into master 
* refs/pull/23406/head:
	TestOSDMap: Test with negative upmap values
	osd/OSDMap: Disallow negative values in _apply_upmap

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2018-08-13 13:00:51 -05:00
Sage Weil
211cd6388b Merge PR #23512 into master 
* refs/pull/23512/head:
	osd: vary tick interval +/- 5% to avoid scrub livelocks
	osd: tick at OSD_TICK_INTERVAL, not heartbeat interval

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2018-08-13 13:00:46 -05:00
Sage Weil
88ec550112 Merge PR #23515 into master 
* refs/pull/23515/head:
	os/bluestore_tool: print actual usage in BlueFS::dump_block_extents.

Reviewed-by: Sage Weil <sage@redhat.com>
 2018-08-13 13:00:41 -05:00
Sage Weil
4c2591b5d3 Merge PR #23516 into master 
* refs/pull/23516/head:
	os/bluestore: check bluefs_extents consistency (DB vs. BlueFS)

Reviewed-by: Sage Weil <sage@redhat.com>
 2018-08-13 13:00:36 -05:00
Sage Weil
58a45f13a4 Merge PR #23517 into master 
* refs/pull/23517/head:
	os/bluestore: uniform loging format for bluefs_extent_t.
	os/bluestore_tool: handle fsck's returned  status properly.
	os/bluestore_tool: fix multiple extents handling in BlueFS::log_dump

Reviewed-by: Sage Weil <sage@redhat.com>
 2018-08-13 13:00:32 -05:00
Patrick Donnelly
9ce675d0ca
Merge PR #23536 into master 
* refs/pull/23536/head:
	mds: report lagginess at lower debug
	MDSMonitor: note beacons and cluster changes at low dbg level

Reviewed-by: Sage Weil <sage@redhat.com>
 2018-08-13 10:16:32 -07:00
Sage Weil
f21f1f14f2 os/bluestore: fix split vs finish_write race 
In _tcx_finish(), we were looking at the right Cache for the collection,
and then calling finish_write with that Cache and taking the lock.  This
could race with a split_cache() such that after we got the lock the
collection was not on a different cache.  This would in turn lead to a
failed assertion later on in _rm_buffer when the sharedblob was trimmed.

Fixes: http://tracker.ceph.com/issues/24439
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-13 12:10:59 -05:00
Sage Weil
3d774d6a91 Merge PR #23291 into master 
* refs/pull/23291/head:
	tests: add Cephx-resembling scenarios to crypto tests.
	tests: differentiate AES testing regarding text size.

Reviewed-by: Sage Weil <sage@redhat.com>
 2018-08-13 10:49:41 -05:00
Sage Weil
8f3560d4ed Merge PR #22879 into master 
* refs/pull/22879/head:
	doc/rados/operations/user-management: document 'network' clause of moncap and osdcap
	mds/SessionMap: make Session::connection private
	mds/MDSAuthCaps: parse and enforce network restriction
	mds/MDSAuthCaps: pass addr to is_capable
	mds/SessionMap: track socket_addr for each Session
	osd/OSDCap: enforce network restriction
	osd/OSDCap: take addr arg to is_capable
	osd/OSDCap: parse 'network' clause in grant
	mon: adapt MonCap network checks to addrvecs
	mon/MonCap: enforce network constraint (if present)
	mon/MonCap: take addr for MonCap::is_capable
	mon/MonCap: parse 'network ...' suffix
	osd: add peer_socket_addr to Session
	mon: use addrvec for RoutedRequest and MForward
	msg/Connection: add get_peer_socket_addr()
	common/ipaddr: add network_contains() helper
	common/ipaddr: add parse_network helper
	common/ipaddr: expose netmask_ipv[46]

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2018-08-13 08:48:14 -05:00
Kefu Chai
e2e6a77b38
Merge pull request #23510 from tchaikov/wip-cmake-boost-build 
cmake: fix build WITH_SYSTEM_BOOST=ON

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2018-08-13 21:42:10 +08:00
Alfredo Deza
ac00e72255 ceph-volume tests.functional batch add filestore sceanrios to tox.ini 
Signed-off-by: Alfredo Deza <adeza@redhat.com>
 2018-08-13 08:38:08 -04:00
Willem Jan Withagen
57f7a9f005 osd: make random shuffle comply with C++17 
random_shuffle is depriacted in C++14 and removed in C++17 on FreeBSD
(As per the standard)

So this code does not compile on FreeBSD with Clang 6

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2018-08-13 11:57:33 +02:00
Yao Zongyou
a4ff39a588 mon/MonMap: remove duplicate code in get_rank 
Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
 2018-08-13 17:35:34 +08:00
Patrick Donnelly
418db4617b
Merge PR #23542 into master 
* refs/pull/23542/head:
	qa: fix mon config section

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 19:15:20 -07:00
Patrick Donnelly
47e60908a3
qa: fix mon config section 
Fixes: fc6e683832

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 19:13:06 -07:00
Patrick Donnelly
0b879f4401
Merge PR #23444 into master 
* refs/pull/23444/head:
	cephfs-shell: avoid sys.argv modification
	tools/cephfs-shell: added support for batch file processing and to execute commands from arguments.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 18:29:34 -07:00
Sage Weil
d7596a74e1 doc/rados/operations/user-management: document 'network' clause of moncap and osdcap 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:03:20 -05:00
Sage Weil
d3af166d6e mds/SessionMap: make Session::connection private 
Ensure all setters go through set_connection()

Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:03:20 -05:00
Patrick Donnelly
e6c33aa09b
cephfs-shell: avoid sys.argv modification 
In multiple locations in the code.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 15:01:34 -07:00
Sage Weil
6651b49863 mds/MDSAuthCaps: parse and enforce network restriction 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
09bf0cd9a4 mds/MDSAuthCaps: pass addr to is_capable 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
37568982e3 mds/SessionMap: track socket_addr for each Session 
Make sure socket_addr is populated when connection is set.

Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
43f812d15d osd/OSDCap: enforce network restriction 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
7ae14b5688 osd/OSDCap: take addr arg to is_capable 
Not enforced yet; just plumbing!

Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
b1418387df osd/OSDCap: parse 'network' clause in grant 
This mirrors what we do in the MonCap (but, naturally, is a slightly
different since we're using a the spirit parse in a totally different way).

Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
759a902ace mon: adapt MonCap network checks to addrvecs 
Breaking this out in a separate commit to make the backport a bit easier.

Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
556426e66a mon/MonCap: enforce network constraint (if present) 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
1081e5f691 mon/MonCap: take addr for MonCap::is_capable 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
5038627c9a mon/MonCap: parse 'network ...' suffix 
Allow an optional network constraint to any grant.

Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
7ebdbb7672 osd: add peer_socket_addr to Session 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
388b82f461 mon: use addrvec for RoutedRequest and MForward 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
4985d068aa msg/Connection: add get_peer_socket_addr() 
Return the addr that is actually being used for this socket (among the
potentially many in the addrvec).

Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
be0d1c027a common/ipaddr: add network_contains() helper 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
e961633428 common/ipaddr: add parse_network helper 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Sage Weil
52bed1e72b common/ipaddr: expose netmask_ipv[46] 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 17:01:05 -05:00
Patrick Donnelly
0ef08e1ba9
Merge PR #23066 into master 
* refs/pull/23066/head:
	include/utime.h: remove improper comments

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2018-08-12 14:51:26 -07:00
Patrick Donnelly
aab25e41d9
Merge PR #23513 into master 
* refs/pull/23513/head:
	doc: updated contact email for Ceph pull requests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 14:49:05 -07:00
Patrick Donnelly
8a5adec8d5
Merge PR #23280 into master 
* refs/pull/23280/head:
	cephfs: LeaseStat versioning
	cephfs: DirStat versioning
	mds: make has_feature const function
	cephfs: InodeStat versioning
	mds: add new feature bit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
 2018-08-12 14:25:01 -07:00
Patrick Donnelly
45e96a2f46
Merge PR #23538 into master 
* refs/pull/23538/head:
	mds: mark beacons as high priority

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
 2018-08-12 14:12:02 -07:00
Patrick Donnelly
fe9a1b5c58
Merge PR #23527 into master 
* refs/pull/23527/head:
	mds: use fast dispatch to handle MDSBeacon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 14:11:58 -07:00
Patrick Donnelly
358432308d
Merge PR #23457 into master 
* refs/pull/23457/head:
	qa: ignore normal slow IO warnings for cephfs

Reviewed-by: Zheng Yan <zyan@redhat.com>
 2018-08-12 14:10:09 -07:00
Patrick Donnelly
c8aff620c2
mds: report lagginess at lower debug 
To help diagnose laggy daemons with performance tuned debug settings.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 14:09:00 -07:00
Patrick Donnelly
d6f6b4f72a
MDSMonitor: note beacons and cluster changes at low dbg level 
These messages are essential for diagnosing the reason why the MDSMonitor is
kicking MDSs out of the MDSMap. They should also be rare enough that the extra
verbosity is not noticable.

Fixes: http://tracker.ceph.com/issues/26898

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 14:07:42 -07:00
Patrick Donnelly
fc6e683832
qa: ignore normal slow IO warnings for cephfs 
Generally the slow warnings we get are just over the threshold. These warnings
are related to deploying multiple Ceph daemons side-by-side. Let's see how we
do with two minutes.

Ignoring the warnings entirely is unsatisfactory as they serve as a useful
canary in the coal mine when you see warnings for ops > some unreasonably large
amount of time.

Fixes: http://tracker.ceph.com/issues/26900

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2018-08-12 13:59:59 -07:00
Sage Weil
2011377c37 osd: vary tick interval +/- 5% to avoid scrub livelocks 
If you have two pgs that need to scrub on two OSDs, each the primary
for one pg and the replica for the other, you can end up in a livelock:

- both osds locally reserve a scrub slot
- both osds send a scrub schedule request
- both scrub requests are rejected
- both osds wait exactly 1 second
- repeat

Seems a bit unlikely, but I've seen test cases where it goes on more an
hour.

Fixes: http://tracker.ceph.com/issues/26890
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-08-12 15:43:40 -05:00
Casey Bodley
c954417ec3
Merge pull request #23416 from ZVampirEM77/wip-mfa-cmd-and-options 
radosgw-admin: add mfa related command and options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2018-08-12 14:10:33 -04:00
Pavani Rajula
ab70dffdb2 tools/cephfs-shell: added support for batch file processing and to execute commands from arguments. 
Fixes:http://tracker.ceph.com/issues/26853
Fixes:http://tracker.ceph.com/issues/26855

Signed-off-by: Pavani Rajula <rpavani1998@gmail.com>
 2018-08-12 22:08:38 +05:30