Commit Graph

128695 Commits

Author SHA1 Message Date
Chunsong Feng
8015cb8bb4 msg/async: refactory rename_thread for DPDKStack
The thread_name of the DPDK thread has been set during DPDK initialization.

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe  <hanfengzhe@hisilicon.com>
2021-12-27 13:04:56 +00:00
Kefu Chai
85e30b4dfd
Merge pull request #44333 from rzarzynski/wip-crimson-fix-recovery-discarding
crimson/osd: implement op discarding for pglog-based recovery. 

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-12-26 21:46:41 +08:00
Kefu Chai
9690ad85a7
Merge pull request #44275 from fengchunsong/dpdk-nic
msg/async/dpdk: add NIC whitelist configuration

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-12-26 20:41:33 +08:00
Kefu Chai
e8e49d3c82
Merge pull request #44285 from fengchunsong/dpdk-rte-init
msg/async/dpdk: handle DPDK initialization failure properly

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-12-26 20:04:40 +08:00
Chunsong Feng
a5df6794e1 msg/async/dpdk:add the handling of DPDK initialization failure
If rte_eal_init returns with failure,the waiting msgr-worker thread is
woken up for exception handling.

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe  <hanfengzhe@hisilicon.com>
2021-12-26 05:54:36 +00:00
Chunsong Feng
95743d510e msg/async/dpdk: add NIC whitelist configuration
Each DPDK process uses some exclusive network adapters.The network adapters to
be used are specified in the whitelist to prevent data sharing between multiple
DPDK process.The following is an example:
1)Configure a single NIC.
-a 0000:7d:010 or --allow=0000:7d:010
2)Configure the Bond Network Adapter
ms_dpdk_port_options=--allow=0000:7d:01.0 --allow=0000:7d:02.6
--vdev=net_bonding0,mode=2,slave=0000:7d:01.0,slave=0000:7d:02.6

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe  <hanfengzhe@hisilicon.com>
2021-12-25 13:10:01 +00:00
Kefu Chai
31afabe6f2
Merge pull request #44404 from inspur-wyq/wip-doc-mgr-zabbix
doc/mgr/zabbix.rst: fix typos

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-12-25 16:44:07 +08:00
wangyunqing
f838e2e207 doc/mgr/zabbix.rst: fix typos
Signed-off-by: wangyunqing <wangyunqing@inspur.com>
2021-12-24 17:10:11 +08:00
Yingxin
2ec4a586a8
Merge pull request #44378 from cyx1231st/wip-seastore-onode-cleanup
crimson/os/seastore: fix potential leak for onodes to live across transactions

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-12-24 11:41:02 +08:00
Yuri Weinstein
7659877b16
Merge pull request #44311 from ifed01/wip-ifed-cleanup-onode-pin
os/bluestore: get rid of fake onode nref increment for pinned entry

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-12-23 16:44:43 -08:00
Yuri Weinstein
9a8cdd0f50
Merge pull request #44303 from 5cs/fix-new-state-weight
mon/OSDMonitor: fix incorrect op between osd state and weight

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2021-12-23 16:44:06 -08:00
Neha Ojha
ee3fd519cf
Merge pull request #44391 from anthonyeleven/anthonyeleven/correct-quay-url
doc/install: Update quay.io URL for ceph-ci builds

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-12-23 15:34:22 -08:00
Anthony D'Atri
ff96092cf0 doc/install: Update quay.io URL for ceph-ci builds
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2021-12-23 15:04:52 -08:00
Yuri Weinstein
ac6564538b
Merge pull request #44352 from SMIL-Infra/journald
common: fix fmt::format_to deprecated warning

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-12-23 14:02:39 -08:00
Yuri Weinstein
1e2f0c6222
Merge pull request #42896 from ifed01/wip-ifed-bluefs-improve-log
os/bluestore: dump alloc unit size on bluefs allocation failure.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-12-23 14:02:16 -08:00
Yuri Weinstein
8339b5846e
Merge pull request #44353 from tchaikov/wip-str-map
common/str_map: reimplement get_str_list() using for_each_pair

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-12-23 14:00:25 -08:00
Yuri Weinstein
9deb56cdac
Merge pull request #44330 from rzarzynski/wip-osd-drop-includes
osd: drop unnecessary recovery / scrub includes from OSD.cc.

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-12-23 13:59:36 -08:00
Ernesto Puerta
fdd6b79855
Merge pull request #44364 from rhcs-dashboard/e2e-fixups
mgr/dashboard: fix timeout error in dashboard cephadm e2e job

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-12-23 17:23:18 +01:00
Patrick Donnelly
91a1d81eff
Merge PR #44322 into master
* refs/pull/44322/head:
	mds: skip directory size checks for reintegration
	qa: test reintegration with directory limits

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-12-23 08:52:10 -05:00
Kefu Chai
714bb3aa64
Merge pull request #44375 from wjwithagen/wjw-fix-missing-utility
common: add missing #include <utility>

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-12-23 21:22:37 +08:00
Nizamudeen A
fed358d7c5 mgr/dashboard: fix timeout error in dashboard cephadm e2e job
1. Fix the timeout error happening in the dashboard e2e job
2. Take care of the flaky force maintenance check

Most of the time our test is getting timed out while searching for an item
in the table. Its because `.clear().type()` is not clearing the content
in the search field sometimes and that creates a wrong data to be
entered into the search field and it starts searching based on this
wrong name. To avoid this I am explicitly clearing the search area
before typing.

Fixes: https://tracker.ceph.com/issues/53672
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-12-23 18:05:58 +05:30
Kefu Chai
b07ba034d4
Merge pull request #44365 from tchaikov/wip-seastar
seastar: pick up upstream change which includes cryptopp fix

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2021-12-23 10:31:32 +08:00
Patrick Donnelly
08194cb2a5
Merge PR #44324 into master
* refs/pull/44324/head:
	qa: set quincy require-osd-release to avoid health warning

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-12-22 14:08:26 -05:00
Patrick Donnelly
06b4a98f63
Merge PR #44313 into master
* refs/pull/44313/head:
	mds: support '~mds{rank number}' for dump tree

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-22 14:05:03 -05:00
Patrick Donnelly
ae186b8655
Merge PR #43881 into master
* refs/pull/43881/head:
	osdc: add set_error in BufferHead, when split set_error to right

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-22 14:03:37 -05:00
Neha Ojha
0096c479e8
Merge pull request #44372 from DimitriPapadopoulos/codespell_examples
examples: typos found by codespell

Reviewed-by: Laura Flores <lflores@redhat.com>
2021-12-22 10:48:00 -08:00
Neha Ojha
9d09a8191c
Merge pull request #44241 from kamoltat/wip-ksirivad-pool-bulk-flag
mon: osd pool create <pool-name> with --bulk flag

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-12-22 10:06:28 -08:00
Neha Ojha
be82f81503
Merge pull request #44385 from trociny/wip-53677
qa/tasks: improve backfill_toofull test

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-12-22 09:23:22 -08:00
Ernesto Puerta
25f7e86c93
Merge pull request #44360 from SMIL-Infra/fix-ios-frontend
mgr/dashboard: fix white screen on Safari 

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: huww98 <NOT@FOUND>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-12-22 17:09:42 +01:00
Josh Durgin
facf0d35b1
Merge pull request #43598 from ideepika/wip-opentelemetry
migrate from using opentracing-cpp to opentelemetry-cpp static as distributed tracing API

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-12-22 07:25:13 -08:00
Ernesto Puerta
d53261a5b0
Merge pull request #44334 from aclamk/wip-aclamk-better-bluestore-perf
os/bluestore: Better readability of perf output

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2021-12-22 13:04:14 +01:00
Dimitri Papadopoulos
8bb36215e0
examples: typos found by codespell
Signed-off-by: Dimitri Papadopoulos <dpo.ceph@mail.com>
2021-12-22 00:08:42 +01:00
Neha Ojha
eb5290f690
Merge pull request #44317 from aclamk/aclamk-fix-bluefs-import
Fix ceph-bluestore-tool bluefs-import command

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2021-12-21 11:57:01 -08:00
Yuri Weinstein
e1e2070a01
Merge pull request #44328 from yaarith/gather_crashinfo-indexerror
mgr/telemetry: check that backtrace is not empty when redacting

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2021-12-21 10:04:54 -08:00
Yuri Weinstein
befc5074a4
Merge pull request #44327 from yaarith/gather_device_report-indexerror
mgr/telemetry: catch also IndexError in gather_device_report()

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-12-21 10:04:25 -08:00
Yuri Weinstein
302972b0ba
Merge pull request #44314 from locallocal/master
osd: remove unused variable legacy_infos_oid in the function PG::peek_map_epoch

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-12-21 10:03:31 -08:00
Yuri Weinstein
7c326866e8
Merge pull request #43686 from myoungwon/wip-ceph-dedup-tool-make-dedup-obj
tool: add  chunk/object-dedup command

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-12-21 10:03:10 -08:00
Mykola Golub
a9a09fffae qa/tasks: improve backfill_toofull test
1) Write more data to the pool so we operate with larger ratios.
2) Round up ratios when truncating.

Fixes: https://tracker.ceph.com/issues/53677
Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-12-21 20:00:28 +02:00
Ernesto Puerta
cdc9f742df
Merge pull request #44190 from rhcs-dashboard/grafana-regex
monitoring/grafana: improve grafana unit tests variable substitution

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-12-21 17:58:17 +01:00
Ernesto Puerta
5a22aec48e
Merge pull request #44362 from rhcs-dashboard/kcli-e2e-improvements
mgr/dashboard: cephadm e2e job: improvements 

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-12-21 17:53:41 +01:00
Ernesto Puerta
76eb7a57da
Merge pull request #43838 from rhcs-dashboard/fix-53128-master
mgr/dashboard: Cluster Expansion - Review Section: fixes and improvements

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-12-21 17:33:21 +01:00
Yingxin Cheng
53248f6a36 crimson/os/seastore: fix potential leak for onodes to live across transactions
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-21 22:36:33 +08:00
Ernesto Puerta
efb062e5c3
Merge pull request #43942 from rhcs-dashboard/host-drain-frontend
mgr/dashboard: Implement drain host functionality in dashboard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-12-21 13:33:51 +01:00
Nizamudeen A
524c340562 mgr/dashboard: Implement drain host functionality in dashboard
Fixes: https://tracker.ceph.com/issues/51587
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-12-21 16:23:17 +05:30
Willem Jan Withagen
174055edfb common: Fix missing utility include
See:
    https://en.cppreference.com/w/cpp/utility/move

Detected on FreeBSD/Clang/libc++:
/home/jenkins/workspace/ceph-master-compile/src/common/deleter.h:111:43: error: no member named 'move' in namespace 'std'
  impl(deleter next) : refs(1), next(std::move(next)) {}

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2021-12-21 11:38:54 +01:00
Kamoltat
abaab51dd8 Added ReleasesNotes and documentation
Add Release Notes and remove any `profile`
related stuff in the autoscaler documentation
and replace it with `bulk` flag.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-21 07:56:37 +00:00
Neha Ojha
1f28c06f2a
Merge pull request #42750 from aclamk/wip-aclamk-bluefs-log-incremental
os/bluestore: incremental update mode for bluefs log

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2021-12-20 17:15:13 -08:00
Ernesto Puerta
45b63ebf44
Merge pull request #44368 from ceph/fix-api-tests
mgr/dashboard: run-backend-api-tests.sh: Older setuptools

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2021-12-20 23:43:18 +01:00
Adam Kupczyk
2292a4d85a os/bluestore/bluefs: Add tracking of bluefs log in noop replay mode
Keep updating bluefs log when printing content of bluefs replay log.
Without this modification we only have initial content of log.
Log can be printed by 'ceph-bluestore-tool bluefs-log-dump'.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2021-12-20 21:55:37 +00:00
Adam Kupczyk
ae5c5b7655 os/bluestore/bluefs: Sync BlueFS log with its allocation delta
BlueFS log is the only file that we can append to.
When we append to file we must take into consideration previously commited allocations,
otherwise update will be miscalculated.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2021-12-20 21:55:37 +00:00