Commit Graph

119906 Commits

Author SHA1 Message Date
Sage Weil
471e270674 Merge PR #39630 into master
* refs/pull/39630/head:
	mgr/cephadm/upgrade: fix typo

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-02-22 22:28:23 -05:00
Sage Weil
8e05d9759b mgr/cephadm/upgrade: fix typo
Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-22 18:07:26 -05:00
Patrick Donnelly
a3591378a5
Merge PR #39138 into master
* refs/pull/39138/head:
	qa: valgrind test for cephfs-mirror daemon
	cephfs-mirror: use preforker for daemonizing
	test: adjust sleep time to account for valgrind runs
	cephfs-mirror: gracefully shutdown threads, timers, etc..
	cephfs-mirror: call ceph_release() to cleanup mount alloc
	cephfs-mirror: shutdown filesystem/cluster connections on shutdown
	cephfs-mirror: set init failed flag on FSMirror::init() failure

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-02-22 10:35:32 -08:00
Patrick Donnelly
42803ecd8e
Merge PR #39618 into master
* refs/pull/39618/head:
	doc: fix broken links multimds and kcephfs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-02-22 09:33:47 -08:00
Kefu Chai
efcf35fd4d
Merge pull request #39620 from rzarzynski/wip-crimson-monc-failure-handling
crimson: multiple fixes for connection failure handling in MonClient

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-23 00:32:17 +08:00
Alfonso Martínez
44fbd04296
Merge pull request #39405 from rhcs-dashboard/cherrypy-security
mgr/dashboard: set security headers

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-02-22 17:01:39 +01:00
Radoslaw Zarzynski
aa53bc8897 crimson/monc: drop the pending connection on ms_handle_reset().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-02-22 15:50:58 +00:00
Radoslaw Zarzynski
dc2d4f1c39 crimson/monc: don't assume reopen_session() shall establish active_con.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-02-22 15:50:58 +00:00
Jos Collin
efb23dd034
doc: fix broken links multimds and kcephfs
Fixes: https://tracker.ceph.com/issues/49372
Signed-off-by: Jos Collin <jcollin@redhat.com>
2021-02-22 20:38:22 +05:30
Mykola Golub
d8b02aef52
Merge pull request #39432 from dillaman/wip-49238
rbd-mirror: delay update snapshot mirror image state

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-02-22 15:16:31 +02:00
Sage Weil
2a9d726fbb Merge PR #39328 into master
* refs/pull/39328/head:
	tools/rados: replace omap_key_valid with std::optional.
	tools/rados: replace omap_key_pretty with prettify().
	tools/rados: add support for binary object names.

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-02-21 11:51:54 -05:00
Sage Weil
1303bf252c Merge PR #39394 into master
* refs/pull/39394/head:
	tools/kvstore-tool: implement 'dissect' command
	kv/KeyValueHistogram: make Bluestore's DBHistogram class reusable.

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2021-02-21 11:51:32 -05:00
Sage Weil
f0795be246 Merge PR #39460 into master
* refs/pull/39460/head:
	msg/async/dpdk: be compatible with DPDK 19.11
	common/Tub: remove Tub.h
	cmake: use NUMA for package name in FindNUMA.cmake
	msg/async/dpdk: define MARKER in .hh
	msg/async/dpdk: use optional<> instead of Tub<>
	compressor/lz4: use optional<> instead of Tub<>
	compressor/lz4: use range-based loop

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-21 11:50:59 -05:00
Sage Weil
51f5981529 Merge PR #39495 into master
* refs/pull/39495/head:
	mgr/cephadm: remove spec from CephadmDaemonDeploySpec

Reviewed-by: Adam King <adking@redhat.com>
2021-02-21 11:50:36 -05:00
Sage Weil
df3818e77c Merge PR #39535 into master
* refs/pull/39535/head:
	osd: Don't clear m_planned_scrub until scrub finishes successfully

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2021-02-21 11:48:25 -05:00
Jason Dillaman
0dc74ee027
Merge pull request #39478 from orozery/rbd-encryption-doc
doc/rbd: rbd encryption

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-21 09:15:00 -05:00
Sage Weil
458ea4c30c Merge PR #39504 into master
* refs/pull/39504/head:
	mgr/cephadm/upgrade: restart mgr after mons upgrade to pacific
	mgr: rename config_prefix -> mgr_store_prefix
	mgr: fix config option prefix
	mgr/MgrStandby: simplify weird code
	mgr/cephadm: use get_foreign_ceph_option() instead of 'config get' mon command
	mgr_module: get_foreign_ceph_option(entity, name)
	mgr: maintain a ConfigMap copy
	mon/ConfigMap: factor out parse_key helper
	mon/ConfigMap: fix stray option leak
	mgr: use new kv subscription for mgr/, device/, config/
	mon: allow subscription to kv/config-key data
	mon: convert ConfigKeyService -> KVMonitor

Reviewed-by: João Eduardo Luís <joao@suse.de>
2021-02-21 08:51:49 -05:00
Kefu Chai
7349cf909b
Merge pull request #39348 from xxhdx1985126/wip-crimson-client-request-sequencer
crimson/osd: client request sequencer

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-21 19:53:07 +08:00
Kefu Chai
e08fcf8900
Merge pull request #39552 from smithfarm/wip-49356
rpm: openSUSE Tumbleweed has lua54 now

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-21 19:50:20 +08:00
Kefu Chai
0eefc80618 crimson/osd: log when obc lock is acquired
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-02-21 19:15:14 +08:00
Xuehan Xu
4ae2099628 crimson/osd: add I/O sequencer to preserve client_requests' order across PG interval change
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-02-21 19:15:14 +08:00
Xuehan Xu
574372409f crimson/osd: interrupt all client_requests that are waiting for acquiring obc locks
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-02-21 19:15:14 +08:00
Or Ozeri
e45cd83af1 doc/rbd: rbd encryption
This commit adds documentation of the new rbd encryption feature

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2021-02-21 07:31:24 +02:00
Kefu Chai
fe2a9d6651
Merge pull request #39586 from liewegas/bug-45441
qa/suites/rados/singletone: ignorelist MON_DOWN when injecting msgr errors

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2021-02-21 11:32:09 +08:00
Kefu Chai
e811b0fb21
Merge pull request #39587 from dillaman/wip-test-neorados
cmake: libneoradostest-support should be static

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-21 11:31:10 +08:00
Kefu Chai
ebdaa67c26
Merge pull request #39591 from tchaikov/wip-mgr-diskpred-ann
mgr/diskprediction_local: add typing annotations and cleanups

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-02-21 11:30:10 +08:00
Sage Weil
4d7dd00129 mgr/cephadm/upgrade: restart mgr after mons upgrade to pacific
If we are upgrading to pacific, we need to restart the mgr *after* the
mons have a pacific quorum so that they can get the kv subscriptions.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-20 19:05:29 -05:00
Jason Dillaman
963d854aba
Merge pull request #39539 from lixiaoy1/enable_pwl
cmake: enable write-back cache in spec

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-20 12:59:04 -05:00
Jason Dillaman
7285ea4a03
Merge pull request #39567 from lixiaoy1/fix_read_ios
librbd/cache/pwl: wait for the completion of reads

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-20 11:45:35 -05:00
Jason Dillaman
1a6db9edab
Merge pull request #39522 from trociny/wip-49284
mgr/rbd_support: mirror snapshot schedule should skip non-primary images

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-20 11:44:08 -05:00
Jason Dillaman
5e1718cf37
Merge pull request #39451 from trociny/wip-49282
librbd: allow disabling journaling for snapshot based mirroring image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-20 11:42:29 -05:00
Jason Dillaman
ea56b92c2f
Merge pull request #39481 from trociny/wip-luks-encryption-test-sudo
qa/workunits/rbd: make luks-encryption test work on vstart cluster

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-20 10:54:24 -05:00
Sage Weil
df0b0b6969 Merge PR #39582 into master
* refs/pull/39582/head:
	mon: fix INCOMPAT_QUINCY ondisk compatset feature bit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-20 09:40:40 -05:00
Kefu Chai
0d46a08408
Merge pull request #39590 from tchaikov/wip-49395
ceph.spec.in: s/%cmake/cmake/

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-20 20:32:45 +08:00
Kefu Chai
fb9a658828
Merge pull request #39592 from tchaikov/wip-crimson-read-exactly
crimson/net: throw read_eof if short read

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-02-20 17:31:21 +08:00
Kefu Chai
907aea748a crimson/net: throw read_eof if short read
as per the implementation and the document of input_stream::read_exactly():

/// stream and returns them. If the end of stream is reached before n
/// bytes were read, fewer than n bytes will be returned - so despite
/// the method's name, the caller must not assume the returned buffer
/// will always contain exactly n bytes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 17:03:54 +08:00
Kefu Chai
4e3a8210a5 mgr/diskprediction_local: add typing annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 15:36:20 +08:00
Kefu Chai
a6ee76cb12 mgr/diskprediction_local: raise if Predictor cannot be initialized
simpler this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 14:51:26 +08:00
Kefu Chai
2bb6821f50 mgr/diskprediction_local: add Predictor abstract class
to make the interface more explicit, also pave the road to mypy.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 14:51:26 +08:00
Kefu Chai
4cf186f5bb mgr/diskprediction_local: drop unused COMMANDS
the base class of `MgrModule` already has it

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 14:36:53 +08:00
Kefu Chai
a72d452d59 mgr/diskprediction_local: use "int" for interval options
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 14:36:53 +08:00
Kefu Chai
6f3fcde9ea mgr/diskprediction_local: define options using Option
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 14:36:53 +08:00
Kefu Chai
43a79aff9c mgr/diskprediction_local: add to flake8
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 14:36:53 +08:00
Kefu Chai
4ced8d9243
Merge pull request #39588 from athanatos/sjust/wip-fix-store-nbd
crimson/tools/store-nbd: fix invalid buffer access on connection termination

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-20 12:17:51 +08:00
Kefu Chai
71aea12bac ceph.spec.in: s/%cmake/cmake/
this change partially reverts da7030db79
which use %cmake rpm macro in the place of "cmake". but

%cmake sets BUILD_SHARED_LIBS=ON. so quite a few internal libraries
defined using add_library() are now compiled into shared libraries which
are not installed or packagesd. when we are installing the rpm packages
compiled with this option, rpm compiles because the linked libraries are
missing, for instance, `libgmock.so.1.10.0` was compiled as a static
library before da7030db79, and was
included by the test executables. but after that change it's compiled
as a shared library.

so we need to either package the linked shared libraries or just link
against them statically. at this moment, the latter approach is simpler,
albeit larger size of exectuable and dbg symbols.

Fixes: https://tracker.ceph.com/issues/49395
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-20 11:43:30 +08:00
Samuel Just
315fbba3e1 crimson/tools/store-nbd: actually check magic
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-20 03:28:21 +00:00
Jason Dillaman
ea373c1fa1
Merge pull request #39573 from weixinwei/master
librbd: memory is not preallocated in rbd c++ read api

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-19 22:28:18 -05:00
Samuel Just
a232a75b3b crimson/tools/store-nbd: check length of buffer
read_exactly does not return an error if the stream
has ended.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-20 03:28:12 +00:00
Ali Maredia
cedebc0c8c
Merge pull request #39585 from ivancich/wip-clean-rgw-warnings-1
rgw: clean up some compiler warnings

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2021-02-19 21:44:15 -05:00
Jason Dillaman
c3cc73e327 cmake: libneoradostest-support should be static
Some builds seem to be creating a libneoradostest-support.so dynamic
library instead, which results in unresolved dependencies when installing
ceph-test.

See: https://tracker.ceph.com/issues/38611
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-19 21:38:49 -05:00