Commit Graph

91052 Commits

Author SHA1 Message Date
Ricardo Marques
731dcefbeb mgr/dashboard: Check content-type before decode json response
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-10-01 11:47:38 +01:00
Ricardo Marques
d7916e6458 mgr/dashboard: Exception.message doesn't exist on Python 3
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-10-01 10:20:59 +01:00
Jos Collin
d7ff7cbb5f
doc: misc fixes cephfs-shell
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-10-01 09:20:06 +05:30
Patrick Donnelly
3a10d74f3a
qa: add timeout to cleaning up workunit sandbox
If there is a bug preventing rm from completing, the workunit will get stuck.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-30 18:12:19 -07:00
Patrick Donnelly
7a64eb9dfb
qa: add timeout to kclient umount
Otherwise QA sits forever waiting for the kclient to umount when there is a
problem.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-30 18:12:15 -07:00
Patrick Donnelly
d4b8f94cf8
qa: do not cleanup sandbox on error
Otherwise the command will hang if the mount is broken.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-30 18:12:11 -07:00
Patrick Donnelly
bdd2ddcfd8
qa: use default timeout in fs workunits
Six hours is unnecessarily long.

Fixes: http://tracker.ceph.com/issues/36184
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-30 18:10:05 -07:00
Joao Eduardo Luis
d723ef4100 mgr/dashboard: fix reference to oA
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-10-01 01:11:09 +01:00
Mykola Golub
3b49b57d56 rbd-mirror: use pool level config overrides
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-30 20:16:00 +03:00
Mykola Golub
586bb7cff9 librbd: add rbd mirror tunables to pool level config overrides
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-30 20:16:00 +03:00
Kefu Chai
b35f6a533a qa/workunits/mon/test_mon_config_key.py: bump up the size limit
in b38b8e980c, we changed the upper
limit of size of `config key` 's value to 64k, so we need to update
the test accordingly.

Fixes: http://tracker.ceph.com/issues/36260
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-30 16:04:04 +08:00
Jason Dillaman
49f4614cc7
Merge pull request #24302 from hydro-b/fix-rbd-nbd-docu
doc: add "--timeout" option to rbd-nbd

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: songweibin <song.weibin@zte.com.cn>
2018-09-29 15:57:38 -04:00
Kefu Chai
27aaed88cf
Merge pull request #24289 from ukernel/wip-msg-clear-payload
msg: clear message middle when clearing encoded message buffer

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-30 00:10:18 +08:00
Kefu Chai
816f7aff2a
Merge pull request #24301 from tchaikov/wip-async-connect-timeout
msg/async: keep connection alive only actually sending

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-09-30 00:09:33 +08:00
Kefu Chai
2932b1b5ea
Merge pull request #24278 from wjwithagen/wjw-fix-inline_variant
common: fix missing include boost/noncopyable.hpp

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-30 00:09:04 +08:00
Kefu Chai
1b686aab44
Merge pull request #24263 from tchaikov/wip-drop-lock-policy
auth,common: use ceph::mutex instead of LockMutex

Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-30 00:08:33 +08:00
Alfredo Deza
9ec683b2bd
Merge pull request #24336 from alfredodeza/wip-rm36251
ceph-volume add new ceph-handlers role from ceph-ansible

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-09-28 14:16:54 -04:00
Stefan Kooman
183caeced7 doc: add "--timeout" option to rbd-nbd
Fixes: https://tracker.ceph.com/issues/22333
Signed-off-by: Stefan Kooman <stefan@bit.nl>
2018-09-28 19:39:10 +02:00
Alfredo Deza
956dc5e65c ceph-volume tests.functional add new ceph-handlers role from ceph-ansible
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-28 12:56:17 -04:00
Andrew Schoen
ccd4114dc0
Merge pull request #24330 from alfredodeza/wip-rm36098
ceph-volume:  lsblk can fail to find PARTLABEL, must fallback to blkid

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-09-28 09:54:55 -05:00
Kefu Chai
8a4a8cf9f5
Merge pull request #24315 from tchaikov/wip-jenkins-does-not-read-package-desc
install-deps: do not specify unknown options

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-09-28 21:53:22 +08:00
Radoslaw Zarzynski
61395d4401 common: fix memory leaks in WeightedPriorityQueue.
Fixes: http://tracker.ceph.com/issues/36248
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-09-28 15:13:39 +02:00
Venky Shankar
43d1b8e174 test: add test for mds drop cache command
Fixes: http://tracker.ceph.com/issues/23362
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Venky Shankar
da70dde8aa mds: command to trim mds cache and client caps
With this command, the MDS would request clients to release
caps followed by trimming its own cache and a journal flush.
The command accepts a timeout to wait for clients to respond
to session recall and flush messages.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Venky Shankar
75f42340db mds: implement journal flush as asynchronous context execution
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Venky Shankar
4c03cfd99e mds: cleanup some asok commands
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Kefu Chai
3911a7c7d0 install-deps: do not specify unknown options
per apt.conf(5), and
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=550564,
"Acquire::Translation" is not documented and will be deprecated. it
would be better to use "Acquire::Languages" solely. and it's consistent
with https://github.com/ceph/ceph-build/pull/1137 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-28 11:52:39 +08:00
Alfredo Deza
c502e5f64a ceph-volume simple.scan better detection for ceph-disk data devices
Uses the new ``CephDiskDevice`` to look into PARTLABEL from both lsblk
(the default) falling back to blkid, which in some cases has the right
value when lsblk fails.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:17:29 -04:00
Alfredo Deza
8f072eb3f9 ceph-volume tests.util verify CephDiskDevice behavior
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:15:26 -04:00
Alfredo Deza
5bfc8c26e6 ceph-volume tests.conftest add blkid patching to device_info fixture
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:15:00 -04:00
Alfredo Deza
200e6bfd93 ceph-volume util.device add a ceph-disk device object to detect types
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:14:28 -04:00
Jason Dillaman
b08b031acb
Merge pull request #24300 from trociny/wip-36236
test/rbd_mirror: race in WaitingOnLeaderReleaseLeader

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-27 15:56:58 -04:00
Casey Bodley
8bc4ddb88b
Merge pull request #23950 from ceph/wip-rgw-dpp-metasync
rgw: log refactoring for meta sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-09-27 15:33:44 -04:00
Ricardo Dias
4470842ebf
msg/async: ProtocolV1: use continuations instead of direct function calls
When using direct function calls to implement the V1 state machine,
we might fill up the stack due to state machine cycles.
With continuations we fix this problem by limiting the depth of
the call stack.

Fixes: http://tracker.ceph.com/issues/36167

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-09-27 16:58:37 +01:00
huanwen ren
c2a541cb82 librados: Add compatible code to PG new pg_state_ready field
Fixes: http://tracker.ceph.com/issues/25103
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-09-27 23:22:50 +08:00
huanwen ren
e5096b41ca common: adapt to the new pg dump format.
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-09-27 23:22:50 +08:00
huanwen ren
ed442447c0 qa: modify the format for add pgmap_ready.
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-09-27 23:22:50 +08:00
huanwen ren
95b7d2340c mgr: add pg_state_ready for pgs show in unknown state
Pgs show the unknown state, when the mgr has just started, use the command ceph pg dump pgs_brief\pgs\...,
because the pgs state has not been reported from the Osd to the Mgr service,
we need to add this state for pgs show. in this way,our management system can judge whether to filter
the unknown pg state based on this flag.

Fixes: http://tracker.ceph.com/issues/25103
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2018-09-27 23:22:40 +08:00
Ricardo Dias
2025602df2
msg/async: ProtocolV1 state machine ascii diagram
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-09-27 16:13:03 +01:00
Kefu Chai
cff82e06d5 mon/MonClient: use scoped_guard instead of goto
also silences the unused label warning. as "out_shutdown" is not used
anymore after f35e10f484 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 22:02:14 +08:00
Kefu Chai
83fbd116e2 auth: switch from Mutex to ceph::mutex
to be aligned with our direction to use std::mutex or its wrapper. see
https://trello.com/c/aUSezBRH/365-cephmutex-etc-for-release-builds

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 21:34:05 +08:00
Kefu Chai
272afb9bbe auth,common: switch to ceph::mutex, etc
in this change, along with LockPolicy, src/common/lock_* are completely
removed.

instead of using LockPolicy based template specialization of LockMutex,
etc, it would be simpler if we can just rely on WITH_SEASTAR
preprocessor macro to tell if we are compiling code for crimson or not.
but please bear in mind, we cannot link against the plain libceph-common
in crimson anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 21:34:05 +08:00
Kefu Chai
c45113ba3c common/ceph_mutex: add shared_mutex to ceph namespace
for the sake of completeness, also pave the road to ditch
SharedMutex<LockPolicy>. please note, in code used by crimson, we are
not using shared_mutex or SharedMutex yet. so we are not adding
the dummy shared_mutex for WITH_SEASTAR.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 21:34:05 +08:00
Kefu Chai
c316f82180 msg/async: keep connection alive only actually sending
When connection stuck into odd state, we need to let connection timeout.
If send_message could update last_active, it won't play the role as
expected.
So we move last_active updated to the place actually should.

Signed-off-by: Haomai Wang <haomai@xsky.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 20:40:30 +08:00
Mykola Golub
14f07dbd39 test/rbd_mirror: race in WaitingOnLeaderReleaseLeader
Fixes: http://tracker.ceph.com/issues/36236
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-27 14:32:30 +03:00
Sage Weil
bc86b06a67 qa/suites/rados/thrash-erasure-code: add clay 4+2
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-27 18:56:21 +08:00
Myna V
2a3e56b22c erasure-code: add clay codes
Introducing Clay codes to ceph. These codes are optimal
in terms of network, disk traffic utilized during repair of a lost chunk.
This feature also provides gradual increase in network, disk traffic with
respect to the number of lost chunks.

Authors: Myna, Elita.
Fixes: http://tracker.ceph.com/issues/19278
Signed-off-by: Myna V <mynaramana@gmail.com>
2018-09-27 18:56:21 +08:00
Lenz Grimmer
15165f4de2
Merge pull request #24193 from rhcs-dashboard/coverage-disabled-in-api-tests
mgr/dashboard: disable backend tests coverage

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-09-27 12:24:01 +02:00
Kefu Chai
09cc126704
Merge pull request #24250 from jecluis/wip-mon-increase-ck-default
mon/config-key: increase max key entry size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-27 18:14:17 +08:00
Lenz Grimmer
59772fe91a
Merge pull request #24200 from jecluis/wip-dashboard-fix-ac
mgr/dashboard: no side-effects on failed user creation

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-27 11:19:37 +02:00