Commit Graph

86284 Commits

Author SHA1 Message Date
Patrick Donnelly
fb83f24a33
qa: ignore version in auth metadata comp
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 3838674f65)
2018-05-08 15:42:42 -07:00
Ramana Raja
3335b7aa1c
ceph_volume_client: allow volumes without namespace isolation
Fixes: https://tracker.ceph.com/issues/23695

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 3a7fdb8b05)
2018-05-08 15:42:42 -07:00
Patrick Donnelly
a9b136dc77
Merge PR #21888 into mimic
* refs/pull/21888/head:
	MDSMonitor: promote standby after fs creation
	MDSMonitor: always prints standbys even if no fs
2018-05-08 09:07:40 -07:00
Patrick Donnelly
79e7fe4ab1
MDSMonitor: promote standby after fs creation
This avoids unnecessary health warnings. However, the original issue in i23885
still exists because the standbys are not available at fs creation time. If you
create a new file system after these standbys are available, then you will
observe that the promotion works to silence the warnings.

Fixes: http://tracker.ceph.com/issues/23885

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 93bc8c53ef)
2018-05-08 09:05:59 -07:00
Patrick Donnelly
11e2479146
MDSMonitor: always prints standbys even if no fs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit ad75128c8e)
2018-05-08 09:05:59 -07:00
Patrick Donnelly
5e16dd6cf5
Merge PR #21867 into mimic
* refs/pull/21867/head:
	qa/tasks/cephfs: add test for renewing stale session
	client: invalidate caps and leases when session becomes stale
	client: fix race in concurrent readdir
2018-05-07 16:00:07 -07:00
Yan, Zheng
7ea83df10e
qa/tasks/cephfs: add test for renewing stale session
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit 5688476513)
2018-05-07 15:55:05 -07:00
Yan, Zheng
cf7eb8be34
client: invalidate caps and leases when session becomes stale
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: https://tracker.ceph.com/issues/23894
(cherry picked from commit 8b2e7d834c)
2018-05-07 15:55:05 -07:00
Yan, Zheng
9ab6703920
client: fix race in concurrent readdir
For a large directory, program needs to issue multiple readdir
syscalls to get all dentries. When there are multiple programs
read the directory concurrently. Following sequence of events
can happen.

 - program calls readdir with pos = 2. ceph sends readdir request
   to mds. The reply contains N1 entries. ceph adds these N1 entries
   to readdir cache.
 - program calls readdir with pos = N1+2. The readdir is satisfied
   by the readdir cache, N2 entries are returned. (Other program
   calls readdir in the middle, which fills the cache)
 - program calls readdir with pos = N1+N2+2. ceph sends readdir
   request to mds. The reply contains N3 entries and it reaches
   directory end. ceph adds these N3 entries to the readdir cache
   and marks directory complete.

The second readdir call does not update dirp->cache_index. ceph adds
the last N3 entries to wrong places.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: http://tracker.ceph.com/issues/23894
(cherry picked from commit 01e23c178d)
2018-05-07 15:55:05 -07:00
Patrick Donnelly
6383ecab93
Merge PR #21866 into mimic
* refs/pull/21866/head:
	mds: include nfiles/nsubdirs of directory inode in MClientCaps
2018-05-07 15:47:50 -07:00
Yan, Zheng
bbafea42d1
mds: include nfiles/nsubdirs of directory inode in MClientCaps
Directory inode's dirstat gets updated by request reply, but not by
cap message. This causes problem for following case.

1. MDS modifies a directory
2. MDS issues CEPH_CAP_ANY_SHARED to client
3. The client satifies stat(2) by its cached metadata.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: http://tracker.ceph.com/issues/23855
(cherry picked from commit ee2c628f67)
2018-05-07 15:45:26 -07:00
Patrick Donnelly
574906d323
Merge PR #21857 into mimic
* refs/pull/21857/head:
	qa: move snap-hierarchy out of snaps workunits
	qa: try snap format upgrade with multimds cluster
	qa: add mds deactivation procedure for upgrades
2018-05-07 07:40:24 -07:00
Patrick Donnelly
c345968673
qa: move snap-hierarchy out of snaps workunits
The snapshot hierarchy it leaves behind can't be cleaned up by `rm -rf` which
breaks workunit cleanup. So, don't run this as part of normal snaps test.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 4d37b0ee8d)
2018-05-07 07:38:18 -07:00
Patrick Donnelly
4b03901218
qa: try snap format upgrade with multimds cluster
Fixes: http://tracker.ceph.com/issues/24002

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 0b466cb2e6)
2018-05-07 07:38:18 -07:00
Patrick Donnelly
34f395512a
qa: add mds deactivation procedure for upgrades
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 6a788bf203)
2018-05-07 07:38:18 -07:00
Kefu Chai
87c000bf49
Merge pull request #21832 from tchaikov/mimic-23627
librados: block MgrClient::start_command until mgrmap

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-06 11:23:47 +08:00
Kefu Chai
0ab9b101c6 librados: timeout on mgr_command()
because the mgrclient will be waiting for the mgrmap if the mgrmap
is not available, when the client is about to send a mgr command.
and monitor will drop the subscription requests if the client does not
have enough cap for reading mon, so unlike mon commands, the client
won't get an EACCES return code in this case.

in this change, a timeout machinary is introduced. and the client
will wait for "rados-mon-op-timeout" before it gives up. if this
setting is 0, it will wait forever.

Fixes: https://tracker.ceph.com/issues/23627
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit eaa1179965)
2018-05-05 19:04:20 +08:00
John Spray
c8156b9117 librados: fix locking on get_required_monitor_features
This wasn't taking the MonClient lock: should use
with_monmap to protect access to MonClient::monmap.

Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit ef517d0ea0)
2018-05-05 19:04:20 +08:00
John Spray
be23767b34 librados: config mgrclient for pre-luminous cluster
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 8fd500d736)
2018-05-05 19:04:20 +08:00
John Spray
5a45110785 mgr/MgrClient: add mgr_optional mode
This is for use when talking to pre-luminous
clusters, where we should not block waiting
for MgrMap because it might never come.

Fixes: https://tracker.ceph.com/issues/23627
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit bae47183c2)
2018-05-05 19:04:20 +08:00
Kefu Chai
eb7845a0ba
Merge pull request #21786 from dillaman/wip-23966
osdc: invoke notify finish context on linger commit failure

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-05 18:52:44 +08:00
xiexingguo
a8ed81ff05 osd/OSD: drop extra/wrong *unregister_pg*
Signed-off-by: xiexingguo <xie.xingguo@gmail.com>
(cherry picked from commit 6ee6fa79b5)
2018-05-04 15:25:55 -05:00
Sage Weil
bc42e17ce5
Merge pull request #21753 from liewegas/wip-upgrade-enospc
qa/suites/upgrade/luminous-x/stress-split: avoid enospc
2018-05-04 15:25:10 -05:00
Alfredo Deza
9432c620bb
Merge pull request #21824 from tchaikov/mimic-cmake-jni
mimic: cmake: use javac -h for creating JNI native headers

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-05-04 13:50:45 -04:00
Alfredo Deza
190b7d6a1d Merge branch 'mimic' of github.com:ceph/ceph into mimic 2018-05-04 13:46:20 -04:00
Kefu Chai
0449dca6f5 cmake: bump up JDK version to 1.8
as JDK 7 is EOL. see
http://www.oracle.com/technetwork/java/eol-135779.html and
https://www.java.com/en/download/faq/java_7.xml

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit df27ed3a38)
2018-05-05 00:15:29 +08:00
Kefu Chai
3731560bda cmake: use javac -h for creating JNI native headers
JDK 1.10 does not offer javah anymore, so we need to use "javac -h" or
add_jar(... GENERATE_NATIVE_HEADERS) instead.

Fixes: http://tracker.ceph.com/issues/24012
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit edc504b9d4)
2018-05-05 00:15:29 +08:00
Brad Hubbard
303e71fe07 mgr: Include daemon details in SLOW_OPS output
Currently there is no way to see which daemons were involved in a slow
op after the op has cleared. This change allows us to record which
daemons were implicated in the logs.

Partially fixes: http://tracker.ceph.com/issues/23205

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit b5263176de)
2018-05-04 08:43:08 -05:00
Sage Weil
dd702b9fad qa/suites/upgarde/luminous-x/stress-split: 8 osds (not 6)
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-04 08:42:29 -05:00
Jason Dillaman
fcd414f632 osdc: invoke notify finish context on linger commit failure
Fixes: http://tracker.ceph.com/issues/23966
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-05-04 08:19:35 -04:00
John Spray
4f98ff5e06
Merge pull request #21557 from jan--f/mgr-prometheus-fix-metadata-labels
mgr: prometheus fix metadata labels

Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-04 10:56:24 +01:00
Sage Weil
fb6b4ec76b
Merge pull request #21553 from dragonylffly/wip-improve-rados-ls
tools/rados: improve the ls command usage

Reviewed-by: Sage Weil <sage@redhat.com>
2018-05-03 17:34:13 -05:00
Sage Weil
489c60915d
Merge pull request #21795 from wido/influx-string-split
mgr/influx: Only split string on first occurence of dot (.)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-03 17:32:29 -05:00
Sage Weil
44355fae4e
Merge pull request #21798 from liewegas/wip-23980
osd/PG: fix uninit read in Incomplete::react(AdvMap&)

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-03 17:29:53 -05:00
Yuri Weinstein
64448b6f8e
Merge pull request #21771 from majianpeng/osd-remove-pgslot
osd: fix bug which cause can't erase OSDShardPGSlot.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-05-03 13:28:40 -07:00
Jenkins Build Slave User
1f43eda5fd 13.1.0 2018-05-03 17:57:34 +00:00
Josh Durgin
f3bdc242f3
Merge pull request #21546 from dzafman/wip-22881
osd: process _scan_snaps() with all snapshots with head

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-03 10:07:57 -07:00
Patrick Donnelly
c44adca121
Merge PR #21374 into master
* refs/pull/21374/head:
	qa: add test for snap format upgrade
	mds: initialize SnapServer::snaprealm_v2_since after journal replay
	mds: properly distinguish cap update from snap flush
	mds: update dev document of cephfs snapshot
	doc: add release notes for cephfs snapshot
	mds: allow snapshot by default for new filesystem
	mds: close past parents after snaprealm format gets converted
	mds: automaticly allow multi-active MDS after scrubbing all inodes
	mds: don't mark primary dentry damaged if inode has been repaired
	mds: upgrade snaprealm format during scrub
	mds: allow scrubbing mdsdir
	mds: cleanup scrub code
	mds: show health warning if multimds with old format snapshots
	mds: automaticly allow multi-active MDS after removing all old snapshots
	mds: disallow multi-active MDS if snapshot was ever created by pre-mimic mds
	mds: validate SnapInfo::long_name before using it
	mds: don't bump snaptable last_snap when renaming snapshot
	mds: properly save snaptable after upgrading version

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 09:45:04 -07:00
Patrick Donnelly
91942df5a6
qa: add test for snap format upgrade
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-03 09:09:03 -07:00
Lenz Grimmer
fc3f8942f4
Merge pull request #21677 from Devp00l/wip-convert-floating-values
mgr/dashboard: Convert floating values to bytes

Reviewed-by: Volker Theile <vtheile@suse.com>
2018-05-03 16:18:51 +02:00
Lenz Grimmer
fe39775832
Merge pull request #21780 from votdev/use_bootstrap_css
mgr/dashboard: Use Bootstrap CSS

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-05-03 16:01:37 +02:00
Wido den Hollander
bd7d0fc16a
mgr/influx: Only split string on first occurence of dot (.)
Service names are not always osd.X or mon.X, they might be
rgw.radosgw.rgw1

This would lead to:

  Unhandled exception from module 'influx' while running on mgr.mon01: too many values to unpack

Only split on the first dot as the rest is the service name

Fixes: http://tracker.ceph.com/issues/23996

Signed-off-by: Wido den Hollander <wido@42on.com>
2018-05-03 15:53:46 +02:00
Sage Weil
3187b036d8 osd/PG: fix uninit read in Incomplete::react(AdvMap&)
If a PG is incomplete when the pool is deleted we'll dereference invalid
iterators here.

Fixes: http://tracker.ceph.com/issues/23980
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-03 08:45:09 -05:00
Sage Weil
db5ec08f5a
Merge pull request #21684 from liewegas/wip-23769
mon: fix slow op warning on mon, improve slow op warnings

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-03 08:40:25 -05:00
Lenz Grimmer
1a385a390e
Merge pull request #21694 from sebastian-philipp/dashboard-review-pylint
mgr/dashboard: Clean up Pylint warnings

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-05-03 12:50:05 +02:00
Lenz Grimmer
8b447a75a4
Merge pull request #21774 from sebastian-philipp/dashboard-mypy-fixes
mgr/dashboard: fix two type errors found by mypy

Reviewed-by: Volker Theile <vtheile@suse.com>
2018-05-03 12:04:15 +02:00
Lenz Grimmer
d4165ce170
Merge pull request #21787 from tspmelo/fix-checkbox-fork-awesome
mgr/dashboard: Change font-family of checkbox

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-05-03 12:02:30 +02:00
Patrick Donnelly
135fe40dee
Merge PR #21789 into master
* refs/pull/21789/head:
	qa: fix blacklisted check for test_lifecycle

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-02 15:56:54 -07:00
Patrick Donnelly
36b51db0e6
qa: fix blacklisted check for test_lifecycle
Caused by: 36f89c5acf

Fixes: http://tracker.ceph.com/issues/23975

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-05-02 15:13:39 -07:00
Matt Benjamin
21b99b6d52
Merge pull request #21791 from cbodley/wip-23974
rgw: raise log level on coroutine shutdown errors
2018-05-02 16:40:49 -04:00