Commit Graph

123798 Commits

Author SHA1 Message Date
Xiubo Li
02cf1816bc os/memstore: make the used_bytes to atomic
Fixes: https://tracker.ceph.com/issues/51092
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-06-17 19:21:38 +08:00
Kefu Chai
cf8814d316
Merge pull request #41695 from tchaikov/wip-crimson-net-move
crimson/net: move from out_q into sent queue

Reviewed-by: Amnon Hanuhov <ahanukov@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-07 09:52:36 +08:00
Kefu Chai
76d882bd6d
Merge pull request #41708 from tchaikov/wip-seastore-open-coll
crimson/os/seastore: open_collection() returns nullptr if DNE

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-06-06 09:45:16 +08:00
Sage Weil
d49b3712d3 Merge PR #41665 into master
* refs/pull/41665/head:
	mgr/cephadm:fix alerts sent to wrong URL

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-06-05 16:43:36 -04:00
Kefu Chai
89951a1d20
Merge pull request #40652 from ronen-fr/wip-ronenf-cscrub-class
osd/scrub: modify "classic" OSD scrub state-machine to support Crimson

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-06-06 00:06:32 +08:00
Kefu Chai
0d38c8a668
Merge pull request #41154 from rzarzynski/wip-global-backtrace-bug-50647
global: fault handlers cope with simultaneous faults now.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-05 21:41:00 +08:00
Kefu Chai
4857c35084
Merge pull request #41604 from t-msn/wip-51030
osd/ECBackend: Fix null pointer dereference when enabling jaeger tracing

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-06-05 21:33:00 +08:00
Kefu Chai
4855e971ce
Merge pull request #41501 from aclamk/wip-bluefs-safer-flush
os/bluestore: Remove possibility of replay log and file inconsistency

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-06-05 21:26:04 +08:00
Kefu Chai
b2823a457f
Merge pull request #41506 from ceph/wip-cv-batch-fixes
ceph-volume: fix batch report and respect ceph.conf config values

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
2021-06-05 21:23:13 +08:00
Kefu Chai
6ba7763f80
Merge pull request #41688 from tchaikov/wip-debian-rook
debian/control: ceph-mgr-modules-core does not Recommend ceph-mgr-roo…

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-05 21:17:24 +08:00
Kefu Chai
9fbd60131b crimson/os/seastore: open_collection() returns nullptr if DNE
we check for the existence of meta collection by trying to open it,
if it exists, we continue check for the superblock stored in it, if
the superblock does not exist or corrupted, we consider it as a failure.

before this change, open_collection() always return a valud Collection
even if the store does not have the collection with specified cid. this
behavior could be misleading in the use case above.

after this change, open_collection() looks up the collections stored in
root collection node for the specfied cid, and return nullptr if it does
not exist.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-05 18:02:45 +08:00
Kefu Chai
ca48d1cbdb crimson/os/seastore: use structured binding
for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-05 18:02:45 +08:00
Kefu Chai
9370ac9fa8
Merge pull request #41581 from tchaikov/wip-options-mgr-mon
common/options: extract mgr and mon options out

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-06-05 10:06:07 +08:00
Kefu Chai
e8f1477da1
Merge pull request #40073 from jmolmo/delete_service_causes_osd_removal
mgr/cephadm: Warn about OSDs to remove manually when deleting an OSD service

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-06-05 08:44:42 +08:00
Patrick Donnelly
8f8ba3d783
Merge PR #41697 into master
* refs/pull/41697/head:
	script: add a few more volume mounts for sepia
	script: drop ceph-fuse from docker debugging
	script: enable centos debuginfo repo for debugging
	script: update repo url for multi-arch builds
	script: fetch autobuild.asc key via HTTPS

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-04 13:07:42 -07:00
Kefu Chai
68dd82e2c2
Merge pull request #41690 from tchaikov/wip-test-alloc_aging
test/objectstore/unittest_alloc_aging: init cct

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-06-05 01:57:03 +08:00
Kefu Chai
6d0c175ae7
Merge pull request #41698 from tchaikov/wip-qa-rook
qa/suites/orch/rook/smoke: stop testing on ubuntu 18.04

Reviewed-by: Sage Weil <sage@redhat.com>
2021-06-05 01:23:35 +08:00
Kefu Chai
104f054cee qa/suites/orch/rook/smoke: stop testing on ubuntu 18.04
even rook does not really install ceph packages in the host directly, it
uses the ceph container image. but teuthology insists on checking the
existence of debian packages by querying shaman server when it sees a
teuthology facet file which includes:

os_type: ubuntu
os_version: "18.04"

but since we've stopped building ubuntu/bionic packages, teuthology
just complains when we are scheduling test suites which are composed
from facets in qa/suites/orch/rook/smoke.

in this change, the ubuntu_18.04.yaml is dropped because ubuntu/bionic
does not really increase the test coverage of ceph. it helps to test
the rook and container runtime though.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-05 01:11:14 +08:00
Patrick Donnelly
51b60e990b
script: add a few more volume mounts for sepia
We now have a few Ceph file systems with various possible mount points
depending which lab machine you're using.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-04 09:33:54 -07:00
Patrick Donnelly
9d71fc1bee
script: drop ceph-fuse from docker debugging
Install this on the fly as necessary...

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-04 09:33:30 -07:00
Patrick Donnelly
efbfd678a2
script: enable centos debuginfo repo for debugging
So we can fetch e.g. the sqlite debuginfo packages.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-04 09:32:52 -07:00
Patrick Donnelly
472bc091ad
script: update repo url for multi-arch builds
Brad suggested this change based on his commit [1]. Thank you!

[1] 267cce9e83

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-04 09:31:19 -07:00
Patrick Donnelly
6223ab14cc
script: fetch autobuild.asc key via HTTPS
Rather than relying the key being avaiable on the LRC /ceph file system.
(Someone appears to have deleted it recently.)

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-04 09:30:04 -07:00
Kefu Chai
7d6c43d81c crimson/net: move from out_q into sent queue
to avoid the refcounting of underlying RefCountedObject.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-04 20:21:52 +08:00
Kefu Chai
523fcb711f
Merge pull request #41679 from AmnonHanuhov/wip-get_rid_of_pending_q
crimson/net: Use out_q instead of pending_q

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-04 20:13:54 +08:00
Amnon Hanuhov
a59c0a9296 crimson/net: Use out_q instead of pending_q
pending_q contains the same messages as in out_q and it is only used
for creating a bytestream out of these messages. We can just use out_q for that.

Signed-off-by: Amnon Hanuhov <ahanukov@redhat.com>
2021-06-04 14:08:56 +03:00
Kefu Chai
08ad13bca5
Merge pull request #41631 from tchaikov/wip-keyring-decode
auth/KeyRing: always decode keying as plaintext

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-06-04 17:15:06 +08:00
Kefu Chai
04fd0002a3
Merge pull request #41587 from cfsnyder/bugfix_47738
mgr/DaemonServer.cc: prevent mgr crashes caused by integer underflow that is triggered by large increases to pg_num/pgp_num

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-04 17:00:48 +08:00
Kefu Chai
fb114d994c
Merge pull request #41592 from tchaikov/wip-ceph-default-confffile
ceph.in: use rados.Rados.DEFAULT_CONF_FILES

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-06-04 16:59:24 +08:00
Kefu Chai
c0f619cf58
Merge pull request #41594 from tchaikov/wip/test/librados/list
test/librados/list: print reason why test fails

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-06-04 16:58:59 +08:00
Kefu Chai
8a0c13f437
Merge pull request #36941 from hoamer/patch-1
doc/mgr/administrator: add a more precise description for creating key

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-04 16:57:41 +08:00
hoamer
78bb36cb62 doc/mgr/administrator: add a more precise description for creating key
added a more precise description to handle filename when creating key for mgr

Signed-off-by: hoamer <kontakt@sebastian-neugebauer.de>
2021-06-04 16:56:56 +08:00
Kefu Chai
814fb28892 debian/control: ceph-mgr-modules-core does not Recommend ceph-mgr-rook anymore
per https://www.debian.org/doc/debian-policy/ch-relationships.html

> Recommends
>   This declares a strong, but not absolute, dependency.
>
> The Recommends field should list packages that would be found together
> with this one in all but unusual installations.

ceph-mgr-modules-core provides a set of ceph-mgr modules which are
always enabeld. but the rook module enables ceph-mgr to install and
configure a Ceph cluster using Rook. this module is very useful but
it does not have such a strong connection with ceph-mgr-modules-core.
we can always install it separately for using better intergration with
Rook.

See-also: https://tracker.ceph.com/issues/45574
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-04 16:18:23 +08:00
Kefu Chai
8b651b3522 test/objectstore/unittest_alloc_aging: init cct
* initialize the cct use by test, otherwise g_ceph_context is
  not set at all.
* instead of using g_ceph_context, use static member variable cct.
  less dependency to the global instance.
* setup and teardown the cct for test suite, because global_init()
  initialize g_ceph_context, which cannot be set multiple times.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-04 14:07:29 +08:00
Kefu Chai
f3ec742fe2 test/objectstore: s/TearDownTestCase/TearDownTestSuite/
TearDownTestCase is deprecated by GTest. let's use the new API instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-04 14:07:23 +08:00
Kefu Chai
dba26fc7a8
Merge pull request #41652 from tchaikov/wip-qa-asock-or
qa/tasks/admin_socket: support "foo || bar" as command

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-06-04 13:50:38 +08:00
Kefu Chai
c4d5121305
Merge pull request #41686 from t-msn/update-trace-doc
doc/dev: update how to use lttng/blkin trace

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-04 12:30:23 +08:00
Misono Tomohiro
53a68e27bb doc/dev: update how to use lttng/blkin trace
Update doc to reflect current status.

Signed-off-by: Misono Tomohiro <misono.tomohiro@jp.fujitsu.com>
2021-06-04 11:41:29 +09:00
Sage Weil
9b9d90bddf Merge PR #41553 into master
* refs/pull/41553/head:
	ceph-volume: replace __ with _ in device_id

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-03 22:04:55 -04:00
Sage Weil
ce033d629c Merge PR #41636 into master
* refs/pull/41636/head:
	mgr/cephadm/inventory: do not try to resolve current mgr host
	pybind/mgr/mgr_module: make get_mgr_ip() return mgr's IP from mgrmap
	mgr/restful: use get_mgr_ip() instead of hostname

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-03 22:04:32 -04:00
Kefu Chai
b5d9418c11
Merge pull request #41674 from tchaikov/wip-vstart-without-restful
vstart.sh: add an option named --without-restful

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-06-04 09:44:58 +08:00
Paul Cuzner
9d408a70c7 mgr/cephadm:fix alerts sent to wrong URL
The path_prefix in prometheus.yml was specifying an
endpoint prefix, which was invalid. This resulted in 404
errors when trying to send alerts to alertmanager and
blocked alerts being sent on to the ceph-dashboard API
receiver. This fix remves this prefix.

Fixes: https://tracker.ceph.com/issues/51073

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-06-04 12:52:35 +12:00
Kefu Chai
25480e2452
Merge pull request #41670 from tchaikov/wip-op-tracking-spin-off-0
crimson, common: improve const-correctness of Operation::dump()s.

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-06-04 07:50:44 +08:00
Kefu Chai
295afe68a2
Merge pull request #41672 from tchaikov/wip-crimson-test-handle-fut
test/crimson/seastore: always handle returned future<>

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-06-04 07:50:21 +08:00
Patrick Donnelly
e3c4ae389e
Merge PR #41654 into master
* refs/pull/41654/head:
	mds: do not infinitely recursively print a metric

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-06-03 13:34:54 -07:00
Patrick Donnelly
943915f8df
Merge PR #41639 into master
* refs/pull/41639/head:
	mds/scrub: write root inode backtrace at creation

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-03 13:33:58 -07:00
Patrick Donnelly
a12db7941b
Merge PR #41499 into master
* refs/pull/41499/head:
	qa/tasks/mds_thrash: fix thrash iteration never skip

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-03 13:33:27 -07:00
Patrick Donnelly
a52712f955
Merge PR #41443 into master
* refs/pull/41443/head:
	test: update log-ignorelist for fs:mirror test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-03 13:23:17 -07:00
Patrick Donnelly
4e1f812461
Merge PR #39910 into master
* refs/pull/39910/head:
	test: Add test for mgr hang when osd is full
	mgr: Set client_check_pool_perm to false
	mds: Add full caps to avoid osd full check

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-03 13:22:23 -07:00
Dan Mick
2544ee6d7f
Merge pull request #41559 from dmick/wip-grafana-container
monitoring/grafana/build/Makefile: revamp for arm64 builds, pushes to docker and quay, jenkins
2021-06-03 11:32:24 -07:00