Commit Graph

125528 Commits

Author SHA1 Message Date
Kefu Chai
a485fdf161
Merge pull request #42571 from tchaikov/wip-disable-kvs
cmake: disable kvs rados cls by default

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-08-04 18:31:40 +08:00
Kefu Chai
fa9df906f9
Merge pull request #42614 from soumyakoduri/wip-skoduri-sqlite3
cmake: Remove duplicate SQLITE module

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-08-04 17:56:18 +08:00
Kefu Chai
065ff536a1 cmake: disable kvs rados cls by default
libcls_kvs was introduced back in
73d016fdb3, but we don't have an internal
user so far. to reduce the build time. let's disable the build of it by
default.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-04 10:21:10 +08:00
Kefu Chai
ccccbff70b
Merge pull request #42567 from dsavineau/issue_51973
cephadm: set global default container for ingress

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-04 08:56:37 +08:00
Kefu Chai
305f0153c6
Merge pull request #42559 from tchaikov/wip-rpm-dwz
rpm: enable dwz

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2021-08-04 08:33:38 +08:00
Soumya Koduri
fa65fded5b cmake: Remove duplicate SQLite module
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-08-03 23:22:47 +05:30
Ernesto Puerta
437deaeec6
Merge pull request #42605 from aaryanporwal/visual-tests
mgr/dashboard: Jenkins Applitools plugin: add batchId variable

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-08-03 17:41:51 +02:00
Sage Weil
c92cd2c553 Merge PR #42463 into master
* refs/pull/42463/head:
	src/pybind/mgr/test_orchestrator: remove nfs pool and namespace
	src/vstart: update nfs-ganesha pool name

Reviewed-by: Sage Weil <sage@redhat.com>
2021-08-03 10:46:42 -04:00
Sage Weil
f4dff25bed Merge PR #42518 into master
* refs/pull/42518/head:
	doc/cephadm: update about disabling logging to journald for quincy
	doc/cephadm: remove repeated section on disabling logging to stderr

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2021-08-03 10:45:01 -04:00
Sage Weil
138d0355cb
Merge pull request #42588 from liewegas/doc-foundation-didi
doc/foundation: drop didi
2021-08-03 09:40:53 -05:00
Varsha Rao
bdb2241ca5 doc/cephadm: update about disabling logging to journald for quincy
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-08-03 17:50:57 +05:30
Aaryan Porwal
bb73617a8e mgr/dashboard: Jenkins Applitools plugin: add batchId variable
batchId variable is mandatory for the applitools test runner to show up in jenkins build reports, for more details, check out: https://plugins.jenkins.io/applitools-eyes/

Signed-off-by: Aaryan Porwal <aaryanporwal2233@gmail.com>
2021-08-03 17:29:39 +05:30
Ilya Dryomov
cac2433429
Merge pull request #42601 from idryomov/wip-rbd-qemu-iotests-8stream
qa/workunits/rbd: use xenial version of qemu-iotests for centos stream 8

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-08-03 13:58:57 +02:00
zdover23
4bbb716701
Merge pull request #42446 from zdover23/wip-doc-cephadm-troubleshooting-logs-2021-07-20
doc/cephadm: linking to log material

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-08-03 21:19:22 +10:00
Varsha Rao
9691f76d46 doc/cephadm: remove repeated section on disabling logging to stderr
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-08-03 16:42:14 +05:30
Ernesto Puerta
77871e27e6
Merge pull request #42328 from aaryanporwal/visual-tests
mgr/dashboard: Visual regression tests for ceph dashboard

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: aaryanporwal <NOT@FOUND>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-08-03 12:55:45 +02:00
Yingxin
03692ba7f1
Merge pull request #42514 from liu-chunmei/seastore-onode-interruptible-future
crimson/onode-staged-tree: integrate interruptible future

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-08-03 16:55:04 +08:00
Ilya Dryomov
df96b85b58 qa/workunits/rbd: use xenial version of qemu-iotests for centos stream 8
It is already used for centos 8(.3) and rhel 8(.4).

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-08-03 09:44:18 +02:00
Yingxin Cheng
03cd4d1518 crimson/onode-staged-tree: misc fixes to integrate interruptive-future
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-08-03 11:53:53 +08:00
Zac Dover
d0a6903274 doc/cephadm: linking to log material
This PR rewrites a section in the Troubleshooting
chapter of the Cephadm Guide. The material that this
section discusses has been covered already in the
Cephadm Guide in the Cephadm Operations chapter.
There's no reason to repeat this information twice,
unless adding technical debt to the documentation
is our goal (which of course it is not, and the
opposite of adding technical debt to the documentation
has been the aim that has guided my work these past
six months).

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-08-03 11:21:17 +10:00
Ilya Dryomov
76294e57f9
Merge pull request #42471 from Dorthu/fix-pybind-rbd-mirror-image-get-status
pybind/rbd: fix mirror_image_get_status

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-08-02 22:04:04 +02:00
Ilya Dryomov
8248fbe2e4
Merge pull request #42570 from tchaikov/wip-libcryptsetup
librbd/crypto/luks: require libcryptsetup v2.0.5

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-08-02 21:35:16 +02:00
Sebastian Wagner
d6960d0e09
Merge pull request #42551 from adk3798/maint-message
mgr/cephadm: make return message for entering maintenance mode more explicit

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-08-02 18:00:48 +02:00
Sage Weil
67d8bcfe66 doc/foundation: drop didi
Signed-off-by: Sage Weil <sage@newdream.net>
2021-08-02 10:45:32 -05:00
Harish Munjulur
a62e0dd755
Merge pull request #42382 from xrmeng8756/master
rgw: avoid occuring radosgw daemon crash when access a conditionally …
2021-08-02 08:28:02 -07:00
Harish Munjulur
71ed958936
Merge pull request #42387 from wzbxqt327/master
rgw:add lock to copy object
2021-08-02 08:27:53 -07:00
Harish Munjulur
00dc0b91b3
Merge pull request #42404 from ivancich/wip-broken-list-plain-entries
rgw: bucket index list can produce I/O errors
2021-08-02 08:27:37 -07:00
Kefu Chai
4231bfda04
Merge pull request #42582 from tchaikov/wip-doc-health-report
doc/dev: add health-reports.rst

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-08-02 21:40:48 +08:00
Kefu Chai
c50d8ebdef
Merge pull request #42577 from tchaikov/wip-rtd
.readthedocs.yml: use python3.8 and native ditaa

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-08-02 20:15:04 +08:00
Kefu Chai
ab3c95d5ed doc/dev: add health-reports.rst
to explain the data flow of health metrics.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-02 20:06:07 +08:00
Ernesto Puerta
edf694eebc
Merge pull request #42263 from rhcs-dashboard/51612-cephadm-e2e-improvements
mgr/dashboard: cephadm-e2e job script: improvements
2021-08-02 13:09:32 +02:00
Kefu Chai
48a91b92e1
Merge pull request #42562 from tchaikov/wip-bluestore-cleanups
os/bluestore: use scope_guard do to cleanups

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-08-02 19:04:23 +08:00
Ernesto Puerta
cc6b18a92c
Merge pull request #41880 from david-caro/fix_cluster_grafana_dashboard
monitoring/grafana/cluster: use per-unit max and limit values

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
2021-08-02 13:03:46 +02:00
Kefu Chai
1a36bf82fc admin, doc: introduce sphinxcontrib.seqdiag
for rendering sequence-diagram. unlike ditaa, seqdiag allows us to
create sequence-diagram without worrying about the layout. and the
syntax is quite like that of dot.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-02 19:02:56 +08:00
Kefu Chai
bc4aacbbbd
Merge pull request #42572 from tchaikov/wip-cmake-mgr-cleanup
cmake: initialize dpdk_LIBRARIES with empty list

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-08-02 11:09:47 +08:00
Kefu Chai
02e7acc376 doc/conf.py: run ditaa with java
just in case, otherwise we could have

  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/42577/lib/python3.8/site-packages/sphinxcontrib/ditaa.py", line 200, in html_visit_ditaa
    render_ditaa_html(self, node, node['code'], node['options'])
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/42577/lib/python3.8/site-packages/sphinxcontrib/ditaa.py", line 177, in render_ditaa_html
    fname, outfn = render_ditaa(self, code, options, prefix)
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/42577/lib/python3.8/site-packages/sphinxcontrib/ditaa.py", line 141, in render_ditaa
    p = Popen(ditaa_args, stdout=PIPE, stdin=PIPE, stderr=PIPE)
  File "/home/docs/.pyenv/versions/3.8.6/lib/python3.8/subprocess.py", line 854, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/home/docs/.pyenv/versions/3.8.6/lib/python3.8/subprocess.py", line 1702, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
OSError: [Errno 8] Exec format error: '/usr/bin/ditaa'

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-02 01:42:08 +08:00
Kefu Chai
57f57c9419 .readthedocs.yml: use ditaa instead of plantweb
use ditaa to reader ditaa images instead of relying plantweb service.
more stable this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-02 01:00:35 +08:00
Kefu Chai
0bde0f3a38 .readthedocs.yml: use python3.8
to prepare the python3.8 migration

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-08-02 00:41:34 +08:00
Kefu Chai
a35aeeb53a
Merge pull request #42129 from tchaikov/wip-cmake-build-type
cmake: set CMAKE_BUILD_TYPE only if .git exists

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-08-01 12:24:07 +08:00
Kefu Chai
ff459c0f6f
Merge pull request #42573 from tchaikov/wip-crimson-header
cmake: let crimson-admin depend on legacy-option-headers

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-08-01 09:58:56 +08:00
Kefu Chai
8f1629e788
Merge pull request #42445 from LiumxNL/ups-eliminate-rollfwd
osd/PGLog: set acceptable rollback_info_trimmed_to for pg of replicated pool

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-08-01 09:58:15 +08:00
Patrick Donnelly
775f92dd6e Merge PR #40511 into master
* refs/pull/40511/head:
	qa: update mds_pre_upgrade to no longer stop standbys
	qa: update mds_pre_upgrade to disable standby-replay
	qa: add tests for compat manipulation and upgrade
	doc: remove deprecated compat commands
	doc: update MDS upgrade procedure
	mon,mds: use per-MDS compat to inform replacement
	mon: do not update inline incompat except via mds
	mds: add MDSMap method for creating null MDSMap
	mds: only update beacon epoch if newer
	mds: harden standby_mds lookup
	mon/FSCommands: accept generic ostream rather than stringstream
	include: add less verbose CompatSet dump
	include: add dump operator for Feature
	include: add const qualifier to appropriate CompatSet methods

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-07-31 13:34:56 -07:00
Kefu Chai
d93880880d cmake: let crimson-admin depend on legacy-option-headers
legacy-option-headers provides global_legacy_options.h, which is in turn
required for building crimson-admin.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-31 17:03:00 +08:00
Kefu Chai
84425c8de6
Merge pull request #42400 from adk3798/offline-daemon-removal
mgr/cephadm: don't remove daemons from offline hosts

Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
2021-07-31 16:35:37 +08:00
Kefu Chai
edacb6eab4 cmake: prefer static library when finding DPDK
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-31 16:29:28 +08:00
Kefu Chai
ee378a3405 cmake: initialize dpdk_LIBRARIES with empty list
set(dpdk_LIBRARIES) does not reset this variable, it leaves it
unchanged.

if pkg-config manages to find DPDK libraries, dpdk_LIBRARIES would be
set with a string like "rte_node;rte_graph;..." by
pkg_check_modules(dpdk QUIET libdpdk).

but we would want to set this variable to the import paths of the
required libraries. so reset it before appending them to this variable.

this change helps to address the build failure when building Ceph with
DPDK installed into system along with its .pc file.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-31 15:53:03 +08:00
Kefu Chai
3adad9309a mgr/ServiceMap: do not include unused headers
<experimental/iterator> was included for std::experimental::make_ostream_joiner
in a968f65d78. but the code using
std::experimental::make_ostream_joiner was later rewritten in
ab0d8f2ae9, in which
std::experimental::make_ostream_joiner is not used anymore.

so let's drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-31 15:48:18 +08:00
Kefu Chai
4e207a0419
Merge pull request #42553 from cfsnyder/wip_51961
mgr/cephadm: fix exceptions causing stuck progress indicators

Reviewed-by: Adam King <adking@redhat.com>
2021-07-31 13:10:06 +08:00
Kefu Chai
3301ef623b
Merge pull request #42506 from p-se/mgr-prom-counter-type
mgr/prometheus: Fix metric types from gauge to counter

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-07-31 13:08:01 +08:00
Kefu Chai
8de47b212b librbd/crypto/luks: require libcryptsetup v2.0.5
- ubuntu focal ships libcryptsetup-dev (2:2.2.2),
- centos 8 app stream comes with cryptsetup-devel-2.3.3.
- openSUSE Leap 15.3 packages libcryptsetup-devel-2.3.4
- openSUSE Leap 15.2 packages libcryptsetup-devel-2.0.5

so we can drop the support for libcryptsetup < 2.0.5

see also ea3c1bfb9e

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-31 11:24:58 +08:00