Commit Graph

115976 Commits

Author SHA1 Message Date
J. Eric Ivancich
ff342f2f02
Merge pull request #37684 from ivancich/rgw-yummy-orphan-testing
rgw: use yum rather than dnf for teuthology testing of rgw-orphan-list

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-15 16:14:07 -04:00
J. Eric Ivancich
11a08a5bb8 rgw: use yum rather than dnf for testing rgw-orphan-list
The teuthology testing for rgw-orphan-list needs to install
`s3cmd`. Switch from using dnf to yum to work on a wider variety of
platforms.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-10-15 15:08:45 -04:00
Adam C. Emerson
46661cae98
Merge pull request #37660 from adamemerson/wip-datalog-fix
cls/fifo: Switch use CLS_ERR for errors
rgw/fifo: Fix a few missed return value assignments
rgw/fifo: Add some error logging
rgw/fifo: Catch two instances journaling a new part
rgw/fifo: Use unique_ptr and explicit release for callbacks

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-10-15 12:03:13 -04:00
Joshua Schmid
eb94d2b325
Merge pull request #37575 from bk201/wip-47742
qa/suites/rados/cephadm/dashboard: fix creating OSD failure
2020-10-15 15:02:50 +02:00
Jason Dillaman
93eccc15f4
Merge pull request #37669 from lixiaoy1/fix_cache_state_ut_1015
rbd/cache: fix UTs related to image cache state

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2020-10-15 08:47:57 -04:00
lixiaoy1
367c1bb122 rbd/cache: fix UTs related to image cache state
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-10-15 07:00:07 -04:00
Kefu Chai
72ddbd3e2b
Merge pull request #37633 from tchaikov/wip-pybind-rados-cleanup
pybind/rados: add more type hintings and cleanup

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-10-15 18:54:38 +08:00
Kefu Chai
1d15e8c2d1
Merge pull request #37624 from lxbsz/cram
qa/tasks: add a 'parallel' option support for the cram task

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-15 18:53:38 +08:00
Kefu Chai
28133d7322
Merge pull request #37621 from dsavineau/cephadm_ntpsec
cephadm: allow ntpsec service

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-10-15 18:16:19 +08:00
Kefu Chai
2724a73743
Merge pull request #37601 from tspmelo/wip-rm-wait-for-expected-get-result
qa/mgr: Remove _wait_for_expected_get_result

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-10-15 18:12:54 +08:00
Jason Dillaman
715e83aa9b
Merge pull request #37609 from lixiaoy1/remove_writelog
rbd/cache: remove unnecessary WriteLogCache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2020-10-14 20:31:17 -04:00
Jason Dillaman
74332259ce
Merge pull request #37625 from lixiaoy1/rwl_path
rbd/cache: store full cache path to image metadata

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2020-10-14 20:29:41 -04:00
Adam C. Emerson
f035b7e3d3 rgw/fifo: Use unique_ptr and explicit release for callbacks
To simplify and clarify memory allocation in AIO cases.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-14 16:18:38 -04:00
Adam C. Emerson
9a323cf8b1 rgw/fifo: Catch two instances journaling a new part
If we see another part journaled, just run the journal ourselves.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-14 16:18:38 -04:00
Adam C. Emerson
6900d0e9dc rgw/fifo: Add some error logging
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-14 16:18:38 -04:00
Adam C. Emerson
d8f0ac2fa4 rgw/fifo: Fix a few missed return value assignments
Slipped in when I converted from call-back based to sequential.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-14 16:18:38 -04:00
Adam C. Emerson
4008f1e57f cls/fifo: Switch use CLS_ERR for errors
So things going wrong show up in the log by default. Also use
__PRETTY_FUNCTION__ instead of __func__ and print some more context.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-14 16:18:38 -04:00
Patrick Donnelly
cbcdb8eeeb
Merge PR #34702 into master
* refs/pull/34702/head:
	doc: Make time-related osd default values in documentation big-endian.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-14 11:11:15 -07:00
zdover23
8624f6f93d
Merge pull request #37587 from anthonyeleven/yet-more-doc-polishing
doc: clarity, detail, modernization, capitalization

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-10-15 02:48:25 +10:00
Kefu Chai
b43f26f9af
Merge pull request #37168 from ifed01/wip-ifed-fix-compress-csum
os/bluestore: attach csum for compressed blobs

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-10-14 22:19:03 +08:00
Kefu Chai
afd232a110
Merge pull request #37611 from tchaikov/wip-cmake-tox
cmake: do not always add py3 to TOX_ENVS

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2020-10-14 22:02:36 +08:00
Jason Dillaman
6e2e8d57ae
Merge pull request #37594 from trociny/wip-rbd-quiesce-cancel
librbd: fix race on watcher unregister

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-10-14 09:59:58 -04:00
Joshua Schmid
3bac7dd987
Merge pull request #37650 from jschmid1/gs
mgr/cephadm: adapt <placement> usage string
2020-10-14 14:45:27 +02:00
Kefu Chai
1b8393f85d mgr/dashboard: add an empty line to appease flake8
silence the warnings like

./controllers/mgr_modules.py:38:5: E301 expected 1 blank line, found 0'
./controllers/user.py:69:5: E301 expected 1 blank line, found 0

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-14 16:24:57 +08:00
Kefu Chai
585f6467ca
Merge pull request #37394 from rosinL/cleanup-queue-option
common/options: remove unavailable values of osd_op_queue

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-14 16:08:04 +08:00
Kefu Chai
c3e699483c
Merge pull request #37627 from changchengx/msg
msg: remove stale comment and unnecessary code

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-10-14 16:05:51 +08:00
Kefu Chai
b0b3e32d04
Merge pull request #37626 from tchaikov/wip-drop-std-iterator
include/interval_set: do not inherit from std::iterator

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2020-10-14 16:04:14 +08:00
Kefu Chai
ade1a6e394
Merge pull request #37455 from smithfarm/wip-spec-file-cleanup
rpm: three spec file cleanups

Reviewed-by: Tim Serong <tserong@suse.com>
2020-10-14 15:43:30 +08:00
Kefu Chai
31db9ce5dc pybind/rados: correct the declarations of C APIs
so they are consistent with the ones declared in include/rados/librados.h

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-14 15:41:03 +08:00
Kefu Chai
e7e375fdb8 pybind/rados: add more type hintings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-14 15:41:03 +08:00
Kefu Chai
7c1544c04c cmake: do not always add py3 to TOX_ENVS
before this change add_tox_test() always add "py3" to testenv, even the
caller specifies TOX_ENVS explicitly.

after this change, py3 is added only if the caller does not specify any
TOX_ENVS.

this change helps with the readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-10-14 15:30:37 +08:00
Patrick Donnelly
493f216c1e
Merge PR #37583 into master
* refs/pull/37583/head:
	mgr/volumes/nfs: Fix wrong error message for pseudo path

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:27:02 -07:00
Patrick Donnelly
bd7a847734
Merge PR #37585 into master
* refs/pull/37585/head:
	doc/cephfs/nfs: Remove outdated doc related to rook

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 10:26:02 -07:00
zdover23
9822fb49a7
Merge pull request #37610 from anthonyeleven/doc-rados-troubleshooting
doc/rados/troubleshooting: clarity and modernization

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-10-14 02:32:24 +10:00
Patrick Donnelly
c2be93c981
Merge PR #36537 into master
* refs/pull/36537/head:
	qa/cephfs: update ephemeral pin tests
	mds: distribute dirfrags for ephemeral distributed directory

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-13 09:29:04 -07:00
Yan, Zheng
e76abf517b qa/cephfs: update ephemeral pin tests
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-10-13 20:52:40 +08:00
Yan, Zheng
bb5ebd395f mds: distribute dirfrags for ephemeral distributed directory
Instead of distribute individual dir inodes inside the ephemeral
distributed dir. Distributing dirfrags can limit number of subtrees
created by the ephemeral dist pin.

This patch also unifies codes that handle export pin and ephemeral pin.

Fixes: https://tracker.ceph.com/issues/46696
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-10-13 20:51:42 +08:00
Joshua Schmid
86d2264711 mgr/cephadm: adapt <placement> usage string
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-10-13 12:48:32 +02:00
Yuval Lifshitz
2dd7d113f2
Merge pull request #35477 from yuvalif/add_lua_to_rgw
rgw/lua: embedding lua in rgw in s3 request context
2020-10-13 12:42:48 +03:00
Mykola Golub
c9d5c492df
Merge pull request #37581 from dillaman/wip-librbd-exclusive-lock-shutdown
librbd: avoid failing IO with -ESHUTDOWN when disabling exclusive-lock

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-10-13 10:44:58 +03:00
Kefu Chai
8ae611e584
Merge pull request #37613 from tchaikov/wip-cls-osd-cleanup
cls, osd: cleanups

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2020-10-13 14:23:29 +08:00
Yuval Lifshitz
9e5f319169
Merge pull request #37537 from yuvalif/missing_brackets_in_rgw_file
rgw/file: missing brackets around if statement
2020-10-13 08:06:31 +03:00
Yuval Lifshitz
2b034f2eb2
Merge pull request #37538 from yuvalif/potential_crash_in_kafka
fix potential crash in rgw_kafka
2020-10-13 08:04:18 +03:00
Yuval Lifshitz
426e6f526c
Merge pull request #37599 from yuvalif/remove_doxyfile
cmake: remove Doxyfile as doxygen run via make
2020-10-13 08:03:39 +03:00
Yuval Lifshitz
c6e8fa39cd
Merge pull request #37534 from yuvalif/fix_ownership_in_role_applier
rgw/auth: fix copy&paste bug in RoleApplier::is_owner_of
2020-10-13 08:02:40 +03:00
Patrick Donnelly
daa2f85156
Merge PR #29951 into master
* refs/pull/29951/head:
	test: add tests for validating MDS metrics via `perf stats` module
	test: Filesystem class helpers to grow and shrink MDS cluster
	mgr/stats: mds performance stats module
	mds: support sending empty perf metrics to ceph-manager

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-12 18:50:33 -07:00
Anthony D'Atri
32375cb789 doc: misc clarity and capitalization
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-10-12 13:41:46 -07:00
zdover23
0f3bce753a
Merge pull request #37541 from anthonyeleven/osd-internals-tweaks
doc/dev: doc/dev/osd_internals capitalization, formatting, clarity

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-10-13 06:01:05 +10:00
Yuval Lifshitz
270d1117bb rgw/lua: run lua scripts in s3 requests context
for more details on design and
remaining work see:
https://gist.github.com/yuvalif/60d5984c28af89ba17443ce947540c1f

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-10-12 22:23:37 +03:00
Anthony D'Atri
8a4c4cb393 doc/rados/troubleshooting: clarity and modernization
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2020-10-12 10:22:16 -07:00