Commit Graph

90880 Commits

Author SHA1 Message Date
Mykola Golub
586bb7cff9 librbd: add rbd mirror tunables to pool level config overrides
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-30 20:16:00 +03:00
Kefu Chai
b35f6a533a qa/workunits/mon/test_mon_config_key.py: bump up the size limit
in b38b8e980c, we changed the upper
limit of size of `config key` 's value to 64k, so we need to update
the test accordingly.

Fixes: http://tracker.ceph.com/issues/36260
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-30 16:04:04 +08:00
Jason Dillaman
49f4614cc7
Merge pull request #24302 from hydro-b/fix-rbd-nbd-docu
doc: add "--timeout" option to rbd-nbd

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: songweibin <song.weibin@zte.com.cn>
2018-09-29 15:57:38 -04:00
Kefu Chai
27aaed88cf
Merge pull request #24289 from ukernel/wip-msg-clear-payload
msg: clear message middle when clearing encoded message buffer

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-30 00:10:18 +08:00
Kefu Chai
816f7aff2a
Merge pull request #24301 from tchaikov/wip-async-connect-timeout
msg/async: keep connection alive only actually sending

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-09-30 00:09:33 +08:00
Kefu Chai
2932b1b5ea
Merge pull request #24278 from wjwithagen/wjw-fix-inline_variant
common: fix missing include boost/noncopyable.hpp

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-30 00:09:04 +08:00
Kefu Chai
1b686aab44
Merge pull request #24263 from tchaikov/wip-drop-lock-policy
auth,common: use ceph::mutex instead of LockMutex

Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-30 00:08:33 +08:00
Alfredo Deza
9ec683b2bd
Merge pull request #24336 from alfredodeza/wip-rm36251
ceph-volume add new ceph-handlers role from ceph-ansible

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-09-28 14:16:54 -04:00
Stefan Kooman
183caeced7 doc: add "--timeout" option to rbd-nbd
Fixes: https://tracker.ceph.com/issues/22333
Signed-off-by: Stefan Kooman <stefan@bit.nl>
2018-09-28 19:39:10 +02:00
Alfredo Deza
956dc5e65c ceph-volume tests.functional add new ceph-handlers role from ceph-ansible
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-28 12:56:17 -04:00
Andrew Schoen
ccd4114dc0
Merge pull request #24330 from alfredodeza/wip-rm36098
ceph-volume:  lsblk can fail to find PARTLABEL, must fallback to blkid

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-09-28 09:54:55 -05:00
Kefu Chai
8a4a8cf9f5
Merge pull request #24315 from tchaikov/wip-jenkins-does-not-read-package-desc
install-deps: do not specify unknown options

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-09-28 21:53:22 +08:00
Venky Shankar
43d1b8e174 test: add test for mds drop cache command
Fixes: http://tracker.ceph.com/issues/23362
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Venky Shankar
da70dde8aa mds: command to trim mds cache and client caps
With this command, the MDS would request clients to release
caps followed by trimming its own cache and a journal flush.
The command accepts a timeout to wait for clients to respond
to session recall and flush messages.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Venky Shankar
75f42340db mds: implement journal flush as asynchronous context execution
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Venky Shankar
4c03cfd99e mds: cleanup some asok commands
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2018-09-28 00:07:59 -04:00
Kefu Chai
3911a7c7d0 install-deps: do not specify unknown options
per apt.conf(5), and
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=550564,
"Acquire::Translation" is not documented and will be deprecated. it
would be better to use "Acquire::Languages" solely. and it's consistent
with https://github.com/ceph/ceph-build/pull/1137 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-28 11:52:39 +08:00
Alfredo Deza
c502e5f64a ceph-volume simple.scan better detection for ceph-disk data devices
Uses the new ``CephDiskDevice`` to look into PARTLABEL from both lsblk
(the default) falling back to blkid, which in some cases has the right
value when lsblk fails.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:17:29 -04:00
Alfredo Deza
8f072eb3f9 ceph-volume tests.util verify CephDiskDevice behavior
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:15:26 -04:00
Alfredo Deza
5bfc8c26e6 ceph-volume tests.conftest add blkid patching to device_info fixture
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:15:00 -04:00
Alfredo Deza
200e6bfd93 ceph-volume util.device add a ceph-disk device object to detect types
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-27 16:14:28 -04:00
Jason Dillaman
b08b031acb
Merge pull request #24300 from trociny/wip-36236
test/rbd_mirror: race in WaitingOnLeaderReleaseLeader

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-27 15:56:58 -04:00
Casey Bodley
8bc4ddb88b
Merge pull request #23950 from ceph/wip-rgw-dpp-metasync
rgw: log refactoring for meta sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-09-27 15:33:44 -04:00
Kefu Chai
cff82e06d5 mon/MonClient: use scoped_guard instead of goto
also silences the unused label warning. as "out_shutdown" is not used
anymore after f35e10f484 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 22:02:14 +08:00
Kefu Chai
83fbd116e2 auth: switch from Mutex to ceph::mutex
to be aligned with our direction to use std::mutex or its wrapper. see
https://trello.com/c/aUSezBRH/365-cephmutex-etc-for-release-builds

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 21:34:05 +08:00
Kefu Chai
272afb9bbe auth,common: switch to ceph::mutex, etc
in this change, along with LockPolicy, src/common/lock_* are completely
removed.

instead of using LockPolicy based template specialization of LockMutex,
etc, it would be simpler if we can just rely on WITH_SEASTAR
preprocessor macro to tell if we are compiling code for crimson or not.
but please bear in mind, we cannot link against the plain libceph-common
in crimson anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 21:34:05 +08:00
Kefu Chai
c45113ba3c common/ceph_mutex: add shared_mutex to ceph namespace
for the sake of completeness, also pave the road to ditch
SharedMutex<LockPolicy>. please note, in code used by crimson, we are
not using shared_mutex or SharedMutex yet. so we are not adding
the dummy shared_mutex for WITH_SEASTAR.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 21:34:05 +08:00
Kefu Chai
c316f82180 msg/async: keep connection alive only actually sending
When connection stuck into odd state, we need to let connection timeout.
If send_message could update last_active, it won't play the role as
expected.
So we move last_active updated to the place actually should.

Signed-off-by: Haomai Wang <haomai@xsky.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-27 20:40:30 +08:00
Mykola Golub
14f07dbd39 test/rbd_mirror: race in WaitingOnLeaderReleaseLeader
Fixes: http://tracker.ceph.com/issues/36236
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-09-27 14:32:30 +03:00
Sage Weil
bc86b06a67 qa/suites/rados/thrash-erasure-code: add clay 4+2
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-27 18:56:21 +08:00
Myna V
2a3e56b22c erasure-code: add clay codes
Introducing Clay codes to ceph. These codes are optimal
in terms of network, disk traffic utilized during repair of a lost chunk.
This feature also provides gradual increase in network, disk traffic with
respect to the number of lost chunks.

Authors: Myna, Elita.
Fixes: http://tracker.ceph.com/issues/19278
Signed-off-by: Myna V <mynaramana@gmail.com>
2018-09-27 18:56:21 +08:00
Lenz Grimmer
15165f4de2
Merge pull request #24193 from rhcs-dashboard/coverage-disabled-in-api-tests
mgr/dashboard: disable backend tests coverage

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-09-27 12:24:01 +02:00
Kefu Chai
09cc126704
Merge pull request #24250 from jecluis/wip-mon-increase-ck-default
mon/config-key: increase max key entry size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-27 18:14:17 +08:00
Lenz Grimmer
59772fe91a
Merge pull request #24200 from jecluis/wip-dashboard-fix-ac
mgr/dashboard: no side-effects on failed user creation

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-27 11:19:37 +02:00
Lenz Grimmer
75c1d8eacd
Merge pull request #23351 from tspmelo/wip-rbd-trash
mgr/dashboard: Add support for RBD Trash

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-27 11:04:46 +02:00
Mykola Golub
925273d270
Merge pull request #24293 from dillaman/wip-36220
librbd: object copy state machine might dereference a deleted object

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-27 09:02:00 +03:00
Kefu Chai
fb1a75c6c1
Merge pull request #22659 from theanalyst/cmake-pybind-ssl
build: mgr: check for python's ssl version linkage

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-27 10:55:16 +08:00
Nathan Cutler
0e4c765a00
Merge pull request #24243 from smithfarm/wip-bci-rate-limit
tools: backport-create-issue: rate-limit to avoid seeming like a spammer

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-09-27 00:18:49 +02:00
Nathan Cutler
a38af571c2
Merge pull request #23131 from smithfarm/wip-15100
qa: add test that builds example librados programs

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
2018-09-27 00:17:48 +02:00
Ali Maredia
a296b56bcc rgw: no DoutPrefixProvider as arg for RGWRemoteDataLog::init
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-09-26 16:36:56 -04:00
Ali Maredia
9619e05288 rgw: pass DoutPrefixProvider into the entrypoints for trim
Also add a DoutPrefixProvider to all of the
cascading classes that need one as a result

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-09-26 16:36:56 -04:00
Casey Bodley
0e4ba992b7 rgw: add global prefix provider for radosgw-admin
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a5dbc81b774d0be4b51f39e37bcfa15f3b36db8)
2018-09-26 16:36:55 -04:00
Ali Maredia
fc178b2b5d rgw: remove unused variable RGWRados *store
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-09-26 16:36:55 -04:00
Ali Maredia
92eb106a75 rgw: replace ldout with ldpp_dout in coroutine classes
The only classes in rgw_sync.cc that remain
with ldouts are:
- RGWBackoffControlCR
- RGWShardCollectCR
- RGWAsyncMetaStoreEntry
- RGWAsyncMetaRemoveEntry
- PurgePeriodLogsCR
- take_min_status
- MetaMasterTrimShardCollectCR
- MetaMasterStatusCollectCR
- MetaMasterTrimCR
- MetaPeerTrimCR
- MetaTrimPollCR

These classes do not have RGWMetaSyncEnv members.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-09-26 16:36:55 -04:00
Ali Maredia
6eb18c2a6f rgw: replace ldouts with ldpp_dout in RGWRemoteMetaLog
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-09-26 16:36:55 -04:00
Ali Maredia
ba6b01cd1b rgw: MetaSyncStatusManager implements DoutPrefixProvider
There are no member functions of RGWMetaSyncStatusManager
with ldouts to replace with ldpp_dout.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-09-26 16:36:55 -04:00
Jason Dillaman
1a9c3be2ce librbd: object copy state machine might dereference a deleted object
Fixes: http://tracker.ceph.com/issues/36220
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-26 15:58:23 -04:00
Mykola Golub
78881934c0
Merge pull request #22043 from dillaman/wip-24139
rbd-mirror: bootstrap needs to handle local image id collision

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-26 22:49:02 +03:00
Mykola Golub
9ff70326da
Merge pull request #24253 from dillaman/wip-24516
librbd: potential object map race with copyup state machine

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-09-26 22:48:29 +03:00
Yuri Weinstein
3c89ae73c8
Merge pull request #23625 from XiangxiangMeng/fix-rgw-bucket-policy-not
rgw: policy: fix NotAction, NotPricipal, NotResource does not take effect

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-09-26 09:02:36 -07:00