Commit Graph

117125 Commits

Author SHA1 Message Date
Kefu Chai
3c0ab38aba github/labeler: label src/test/** with "tests"
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-25 18:14:42 +08:00
Kefu Chai
daee16839a github/labeler: add "rgw" label to rgw related changes
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-25 18:14:42 +08:00
Jason Dillaman
4f4e94c5be
Merge pull request #38213 from petrutlucian94/rbd_exit
rbd: minor rbd-wnbd improvements

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-11-24 20:52:02 -05:00
Yuri Weinstein
a01f710a90
Merge pull request #38254 from neha-ojha/wip-48299
doc/releases/nautilus.rst: add release notes for 14.2.15

Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2020-11-24 10:51:40 -08:00
zdover23
11311241c7
Merge pull request #38144 from anthonyeleven/anthonyeleven/docs-46365
doc/dev/developer_guide: prefer Latinate verbs to English phrasal verbs

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-11-25 04:51:13 +10:00
Ernesto Puerta
4ddace0bcd
Merge pull request #38260 from bk201/wip-48338
mgr/dashboard: fix tox py3 environment error

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-24 19:35:36 +01:00
Casey Bodley
3fa037fc6d
Merge pull request #38253 from cbodley/wip-rgw-gc-disable-defer
rgw: temporarily disable calls to defer_gc() in RGWGetObj

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-11-24 12:14:22 -05:00
Neha Ojha
2d63f47878 doc/releases/nautilus.rst: add release notes for 14.2.15
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-11-24 16:40:45 +00:00
Ilya Dryomov
b4129a3e2f
Merge pull request #38142 from theanalyst/doc/releases/v14.2.14
doc: release notes for octopus & nautilus backports

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2020-11-24 17:23:00 +01:00
Mykola Golub
acf3b72b4d
Merge pull request #38247 from dillaman/wip-librbd-test-rename
test/librbd: rename tests to match proper namespaces

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-11-24 17:15:29 +02:00
Abhishek Lekshmanan
b04b1ba566 doc: releases: v15.2.6 Octopus release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
2020-11-24 15:43:37 +01:00
Abhishek Lekshmanan
cf1a3d7a39 doc: releases: v14.2.14 Nautilus release notes
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
2020-11-24 15:43:33 +01:00
Kefu Chai
30a3261f1a
Merge pull request #38261 from tchaikov/wip-45919
pybind/mgr/dashboard/run-backend-api-tests: print more log from mgr

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2020-11-24 18:14:37 +08:00
Kefu Chai
c1ae6fa3fd
Merge pull request #38217 from ideepika/wip-fix-lua-failure
cmake: require Lua 5.3 and up

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-24 18:00:15 +08:00
Kefu Chai
58c708ba49
Merge pull request #38204 from lnsyyj/wip-iouring
blk/kernel/io_uring: do not guard liburing backend with __x86_64__ anymore

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-24 17:55:17 +08:00
Kefu Chai
2e690bba7e
Merge pull request #38256 from badone/wip-dont-build-io_uring.c-every-time
cmake: Stop 'configure' running every time

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-24 16:04:51 +08:00
Kefu Chai
6e431c09c6 pybind/mgr/dashboard/run-backend-api-tests: print more log from mgr
in hope to more context when debugging https://tracker.ceph.com/issues/45919

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-24 15:47:47 +08:00
Kiefer Chang
dc974fa953
mgr/dashboard: fix tox py3 environment error
Add `ceph_argparse` module to the base environment.

Fixes: https://tracker.ceph.com/issues/48338
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-11-24 15:44:43 +08:00
Brad Hubbard
e0240b9af4 cmake: Stop 'configure' running every time
Currently the configure script is run on 'liburing_ext' not only for the
initial build but for subsequent incremental builds.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-11-24 13:38:37 +10:00
Ilya Dryomov
4ee600b354
Merge pull request #38243 from idryomov/wip-relax-preauth-asserts-again
msg/async/ProtocolV2: allow rxbuf/txbuf get bigger in testing, again

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-11-24 02:48:48 +01:00
Kefu Chai
a0230e1e6f
Merge pull request #38252 from idryomov/wip-resurrect-log-compression
qa/tasks/ceph: resurrect log compression

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-24 09:46:40 +08:00
Ilya Dryomov
0e4bc27722 qa/tasks/ceph: resurrect log compression
Commit 9536625558 ("qa/tasks/ceph: use Cluster.sh() and Remote.sh()
when appropriate") dropped run.wait(), which waits for all given
processes to exit.  This resulted in errors like

  INFO:teuthology.orchestra.run.smithi107.stderr:tar: ./objectstore_tool..log: file changed as we read it
  INFO:teuthology.orchestra.run.smithi107.stderr:tar: ./ceph-client.admin.175125.log: File removed before we read it

as the task moved on to archiving semi-corrupted and uncompressed logs,
filling up the lab cluster.

Revert that hunk, as Cluster.sh() is useless here -- we don't need
stdout or stderr, but very much need parallel execution and wait for
the compression to finish.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-11-24 00:51:54 +01:00
Casey Bodley
94df9cd37a rgw: temporarily disable calls to defer_gc() in RGWGetObj
cls_rgw_gc_queue_update_entry() is known to cause data loss when called
on objects that have not actually been scheduled for garbage collection

RGWGetObj is the only caller, and uses defer_gc() when reads are taking
a long time compared to rgw_gc_obj_min_wait. if an object has since been
deleted and submitted for garbage collection, this allows RGWGetObj to
defer that gc until the entire read completes

by disabling these calls to defer_gc(), very long reads (longer than 1hr,
with default configuration) may fail if the object gets deleted, and a
retry will result in a 404 Not Found error as expected

Fixes: https://tracker.ceph.com/issues/47866

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-11-23 18:06:31 -05:00
Anthony D'Atri
d4b0215a84 doc/dev/developer_guide: prefer Latinate verbs to English phrasal verbs
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
Fixes: https://tracker.ceph.com/issues/46365
2020-11-23 13:07:19 -08:00
Jason Dillaman
07d2ded966 test/librbd: rename tests to match proper namespaces
Some of the new crypto tests use a generic test name that
doesn't include the full namespace of the class under test.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-11-23 12:08:18 -05:00
Jason Dillaman
c569a302be
Merge pull request #37875 from orozery/librbd-luks-format
librbd: add LUKS support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-11-23 12:06:32 -05:00
Jason Dillaman
c21d4cbc83
Merge pull request #38201 from lixiaoy1/minor_fix_parent_cache
librbd/plugin: delete field m_image_ctx in ParentCache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-11-23 11:12:44 -05:00
Or Ozeri
ea3c1bfb9e librbd: add LUKS support
This commit introduces internal (not yet part of the api) librbd functions for:
1. formating an RBD image in LUKS format
2. parsing an RBD image in LUKS format

 The actual implementation of the LUKS format is done via libcryptsetup, which is added as a new dependency.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2020-11-23 10:32:14 -05:00
zdover23
8c6b533ee8
Merge pull request #38089 from anthonyeleven/anthonyeleven/docs-47976
doc/mgr: Fix msgr2 TCP port in a couple of examples

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-11-24 00:32:22 +10:00
zdover23
f6c3592916
Merge pull request #38180 from anthonyeleven/anthonyeleven/docs-23442
doc/rados/operations: Add description of new auth profiles

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-11-24 00:05:00 +10:00
Jason Dillaman
d340b03612
Merge pull request #38229 from wjwithagen/wjw-fix-librbd-HttpStream.cc
librbd: Fix variable declaration in capture list in lambda

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-11-23 08:35:10 -05:00
Ilya Dryomov
422f922c4a msg/async/ProtocolV2: allow rxbuf/txbuf get bigger in testing, again
With CEPHX_V2 authorizer challenges brought back in commit
4a82c72e3b, these need to be bumped again, as two authorizers
(without and then with the challenge) are transmitted and signed
instead of one (without the challenge).  See commit 94953dd939
("msg/async/ProtocolV2: allow rxbuf/txbuf get bigger in testing")
for details.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-11-23 14:09:13 +01:00
Jan Fajerski
b19e5ff699 Merge PR #38207 into master
* refs/pull/38207/head:
	ceph-volume: fix test_setup_device_device_name_is_none

Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2020-11-23 13:59:16 +01:00
zdover23
de870cac81
Merge pull request #38092 from anthonyeleven/anthonyeleven/docs-mixed-device-trick
doc/rados/operations: enhance primary affinity section

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-11-23 22:20:13 +10:00
Deepika Upadhyay
1974c1a979 cmake: require Lua 5.3 and up
fixes: https://tracker.ceph.com/issues/48312
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-11-23 15:15:21 +05:30
zdover23
2f0fe914be
Merge pull request #38181 from anthonyeleven/anthonyeleven/docs-23443
doc: object -> file -> disk is wrong for bluestore

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-11-23 16:13:24 +10:00
zdover23
acf80f111c
Merge pull request #34506 from ktdreyer/doc-rm-sysv-init
doc: remove SysV init reference in manual deployment walkthrough

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-11-23 16:10:30 +10:00
Lucian Petrut
ae2bb42806 rbd: add "help" command to rbd-wnbd
At the moment, "rbd-wnbd" says that "help" is an unsupported command,
only "rbd-wnbd -h" works. This isn't very user friendly.

Although "rbd-wnbd" isn't supposed to be used directly in most cases,
users might want to retrieve device specific arguments that can be
passed using "rbd device -o".

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2020-11-22 17:37:13 +00:00
J. Eric Ivancich
cf18f7e9cd
Merge pull request #38228 from ivancich/wip-rgw-gc-defer-should-not-enqueue
rgw: during GC defer, prevent new GC enqueue

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2020-11-22 10:36:48 -05:00
Kefu Chai
b7e8d11d09
Merge pull request #38231 from anthonyeleven/anthonyeleven/docs-40579
doc/rados/operations: POOL_NEAR_FULL on OSD_NEAR_FULL

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 21:24:56 +08:00
JiangYu
125674b662 blk/kernel/io_uring: do not guard liburing backend with __x86_64__ anymore
Signed-off-by: JiangYu <lnsyyj@hotmail.com>

Let the liburing library to ensure the support of the iouring system call back-end CPU instruction set.
2020-11-22 11:39:40 +00:00
Anthony D'Atri
7fde53bbb1 doc/rados/operations: POOL_NEAR_FULL on OSD_NEAR_FULL
Fixes: https://tracker.ceph.com/issues/40579
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-11-22 00:02:54 -08:00
Anthony D'Atri
61a7eb8647 doc/rados/operations: enhance primary affinity section
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-11-21 23:57:31 -08:00
Kefu Chai
d3cf17da15
Merge pull request #38090 from anthonyeleven/anthonyeleven/docs-47339
doc/releases: correct spelling

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 14:03:09 +08:00
Kefu Chai
46ad0835c1
Merge pull request #37900 from jhonxue/master
os/bluestore/StupidAllocator: choose the right bin when bdev_block_size changed

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-11-22 13:42:46 +08:00
Kefu Chai
ed77641a53
Merge pull request #38161 from petrutlucian94/msg_timeout
msg: use timeout when initiating connection

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 13:41:33 +08:00
Kefu Chai
6a52585e61
Merge pull request #38070 from dvanders/dvanders_trimto
mon/OSDMonitor, mon/PaxosService: additional debug outputs when trimming

Reviewed-by: Joao Eduardo Luis <joao@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 13:39:44 +08:00
Kefu Chai
57f385f6b8
Merge pull request #38148 from jhonxue/wip-fix-bluestore-avl-allocator
os/bluestore: do not call _block_picker() again if already searched from start()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-22 13:39:09 +08:00
Kefu Chai
b6c92fd80c
Merge pull request #38128 from tchaikov/wip-mon-add-space-in-log
mon/OSDMonitor: add a space after function name in logging message

Reviewed-by: Joao Eduardo Luis <joao@suse.com>
2020-11-22 13:36:25 +08:00
Anthony D'Atri
b3cede6dbc doc/releases: correct spelling
Fixes: https://tracker.ceph.com/issues/47339
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-11-21 18:32:40 -08:00