Commit Graph

126754 Commits

Author SHA1 Message Date
David Galloway
3d244a2396
Merge pull request #43154 from ceph/wip-yuriw-pacific-16.2.6-RN
doc: 16.2.6 Release Notes
2021-09-17 09:38:54 -04:00
Matan Breizman
8f0678c3dd install-deps.sh: install newer version of pip
although pip comes with virtualenv, having a recent version of pip matters to use wheel packages.

Signed-off-by: Matan Breizman <Matan.Brz@gmail.com>
2021-09-17 13:35:28 +00:00
zdover23
189438a1fc
Merge pull request #43197 from anthonyeleven/anthonyeleven/stale-read
doc: clarify stale_read and placement-groups wording

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2021-09-17 15:52:34 +10:00
Patrick Donnelly
0d9753fa3c Merge PR #43122 into master
* refs/pull/43122/head:
	qa: add test for standby-replay marking rank damaged
	MDSMonitor: handle damaged from standby-replay
	mds: add config to mark rank damaged in standby-replay
	include: unset std::hex after printing CompatSet
	mds: refactor iterator lookup
	mds: harden rank lookup

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-09-16 21:47:40 -04:00
Anthony D'Atri
4396cb9411 doc: clarify stale_read and placement-groups wording
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2021-09-16 16:40:33 -07:00
Kefu Chai
5c20cfd449
Merge pull request #43011 from rzarzynski/wip-crimson-opsequencer-ooo-lesser-footprint
crimson/osd: bring OpRegistry-based OpSequencer to handle out-of-order ClientRequests

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-09-17 07:23:14 +08:00
Samuel Just
8749511446
Merge pull request #43192 from rzarzynski/wip-crimson-net-dangling-bindvec
crimson/net: fix dangling addrvec in SocketMessenger::bind().

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-16 12:22:18 -07:00
Mike Perez
a747322524 doc: updating RBD lead
Signed-off-by: Mike Perez thingee@gmail.com
2021-09-16 11:47:34 -07:00
David Galloway
0b8bfe2bc4
doc/releases/pacific.rst: Add note about Bullseye 2021-09-16 13:57:16 -04:00
Radoslaw Zarzynski
4802730827 crimson/net: fix dangling addrvec in SocketMessenger::bind().
`SocketMessenger::bind()` takes the address vector by `const&`.
while the callers in `OSD` are passing a temporary:

  ```cpp
  cluster_msgr->bind(pick_addresses(CEPH_PICK_ADDRESS_CLUSTER))
    // ...
  public_msgr->bind(pick_addresses(CEPH_PICK_ADDRESS_PUBLIC))
    // ...
  ```

  ```cpp
  entity_addrvec_t pick_addresses(int what) {
    // ...
    return addrs;
  }
  ```

The net result is a life-time mismatch and crashes like the following
one:

  ```
  WARN  2021-09-10 20:01:57,791 [shard 0] ms - [osd.0(client) v2:172.17.0.1:6800/3172806564@59988 >> mgr.? v2:172.17.0.7:6800/3846062660] waiting 3.2 seconds ...
  /opt/rh/gcc-toolset-9/root/usr/include/c++/9/bits/stl_iterator.h:820:17: runtime error: reference binding to misaligned address 0x000041b58ab3 for type 'const struct entity_addr_t', which requires 4 byte alignment
  0x000041b58ab3: note: pointer points here
  <memory cannot be printed>
  /opt/rh/gcc-toolset-9/root/usr/include/c++/9/bits/stl_vector.h:1132:16: runtime error: reference binding to misaligned address 0x000041b58ab3 for type 'const struct value_type', which requires 4 byte alignment
  0x000041b58ab3: note: pointer points here
  <memory cannot be printed>
  /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-7486-g27cb19ed/rpm/el8/BUILD/ceph-17.0.0-7486-g27cb19ed/src/msg/msg_types.h:561:22: runtime error: reference binding to misaligned address 0x000041b58ab3 for type 'const struct entity_addr_t', which requires 4 byte alignment
  0x000041b58ab3: note: pointer points here
  <memory cannot be printed>
  Segmentation fault on shard 0.
  ```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-09-16 17:21:51 +00:00
Neha Ojha
3492a7c82a doc/releases/pacific.rst: add core release notes
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-09-16 16:49:38 +00:00
Radoslaw Zarzynski
9dcb612b93 crimson/osd: rework OpSequencer for out-of-order op execution.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-09-16 15:58:03 +00:00
Samuel Just
d4fc4ecf0a
Merge pull request #43180 from athanatos/sjust/wip-52630
crimson/net/SocketMessenger: include sleep.hh

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-15 20:59:33 -07:00
Samuel Just
b47b727b42
Merge pull request #43178 from athanatos/sjust/wip-52623
crimson/os/seastore/cache: Cache::get_root check for invalid

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-15 20:59:09 -07:00
Sage Weil
21abbaf3c9 Merge PR #43044 into master
* refs/pull/43044/head:
	mgr/rook: add unit tests to Rook module
	mgr/rook: translate placement spec to node selector and vice versa

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-09-15 22:50:56 -04:00
Sage Weil
1a19d69679 Merge PR #43172 into master
* refs/pull/43172/head:
	qa/tasks/kubeadm: modify (do not clobber) daemon.json

Reviewed-by: Joseph Sawaya <jsawaya@redhat.com>
2021-09-15 22:48:36 -04:00
Samuel Just
7d8b27a35c crimson/net/SocketMessenger: include sleep.hh
4a00a145 added a call to seastar::sleep.

Fixes: https://tracker.ceph.com/issues/52630
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-09-15 19:39:04 -07:00
Patrick Donnelly
9051ad9323 Merge PR #43022 into master
* refs/pull/43022/head:
	doc/cephfs: add mds_dir_max_entries option into mds-config-ref.rst
	mds: add mds_dir_max_entries config option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-15 22:37:26 -04:00
Patrick Donnelly
b1e8297fca Merge PR #42943 into master
* refs/pull/42943/head:
	mon: do not quickly mark mds laggy when MON_DOWN
	mon: refactor quorum age calculation

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-09-15 22:36:18 -04:00
Patrick Donnelly
848fe5e5c0 Merge PR #42846 into master
* refs/pull/42846/head:
	mds: Add new flag to MClientSession

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-15 22:35:37 -04:00
Patrick Donnelly
15c93b701f Merge PR #42737 into master
* refs/pull/42737/head:
	mds: ensure that we send the btime in cap messages

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2021-09-15 22:34:58 -04:00
Patrick Donnelly
91c6f3364d Merge PR #42719 into master
* refs/pull/42719/head:
	mgr/volumes: Fix permission during subvol creation with mode

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-15 22:34:23 -04:00
Samuel Just
df428abd8f crimson/os/seastore/cache: Cache::get_root check for invalid
As with Cache::get_extent, we need to check that the ref
is still valid after wait_io since it's not in the
read set yet.

Fixes: https://tracker.ceph.com/issues/52623
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-09-16 02:33:37 +00:00
Patrick Donnelly
33331cf4aa Merge PR #42584 into master
* refs/pull/42584/head:
	doc: fix `daemon status` interface (exclude file system name)
	test: adjust mirroring tests for `daemon status` change
	mgr/mirroring: `daemon status` command does not require file system name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-15 22:33:18 -04:00
Patrick Donnelly
85211494c2 Merge PR #42541 into master
* refs/pull/42541/head:
	client: switch to use ceph_assert instead of assert
	mds: switch to use ceph_assert() instead of assert()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-15 22:32:31 -04:00
Patrick Donnelly
ef5d7febeb
qa: lengthen grace for fs map showing dead MDS
Fixes: https://tracker.ceph.com/issues/52625
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-15 22:21:03 -04:00
Samuel Just
11c8e258e7 crimson/os/seastore/cache: rename invalidate(Transaction&, CachedExtent&)
This particular overload is really only declaring the Transaction
conflicted -- it assumes the extent is already invalid.  Rename to
mark_transaction_conflicted instead to avoid confusion with
invalidate(CachedExtent&).

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-09-15 18:37:44 -07:00
Sage Weil
2a6ad93a76 qa/tasks/kubeadm: modify (do not clobber) daemon.json
Otherwise we blow away the mirror config.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-15 15:16:50 -05:00
Yuri Weinstein
8978bc4cd7 doc: updated the change log with three additional PRs merged on top
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-09-15 09:14:58 -07:00
Ernesto Puerta
42f15e087d doc: dashboard motd change
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2021-09-15 09:14:58 -07:00
Patrick Donnelly
f2a16a7345 doc: note simpler MDS upgrade procedure for v16.2.6
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-15 09:14:58 -07:00
Yuri Weinstein
c3b1cf0f59 doc: 16.2.6 Release Notes
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-09-15 09:14:58 -07:00
Kefu Chai
b70647e879
Merge pull request #43146 from jianwei1216/fix-partial-recovery-become-whole-object-recovery-for-master
osd: fix partial recovery become whole object recovery after restart osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-09-15 23:17:29 +08:00
Michael Fritch
d07e72c4b0
cephadm: raise error during pull failure
instead of a traceback to the console

Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-09-15 07:58:57 -06:00
Kefu Chai
f110ec33e5
Merge pull request #42465 from tchaikov/wip-ceph-volume
debian, rpm: split ceph-volume into a separated package

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-09-15 21:52:42 +08:00
Ernesto Puerta
d906f946e8
Merge pull request #43019 from rhcs-dashboard/fix-52028-master
mgr/dashboard: Incorrect MTU mismatch warning

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
2021-09-15 15:40:58 +02:00
Sebastian Wagner
84895674cf
Merge pull request #43115 from mgfritch/cephadm-rm-repo-no-podman
cephadm: skip podman check during `rm-repo`

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-15 08:38:48 +02:00
Samuel Just
ee7ad7895d
Merge pull request #43129 from cyx1231st/wip-seastore-optimize-onode
crimson/os/seastore: minimize the static size of onode_layout_t

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-14 21:44:22 -07:00
Samuel Just
da0fa14bfa
Merge pull request #43106 from rzarzynski/wip-crimson-msgr-bind
crimson: add support for ms_bind_retry_{delay,count}

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-14 21:41:46 -07:00
Samuel Just
b33e76d6c4
Merge pull request #43157 from liu-chunmei/seastore-binary-search
crimson/seastore:: add binary search for lba and omap iterator search

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-14 21:41:15 -07:00
Yingxin Cheng
a24b3b25e7 crimson/os/seastore: minimize the static size of onode_layout_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-15 10:39:34 +08:00
Yingxin Cheng
3aeea9b7e6 crimson: exclude oid when encode/decode object_info_t to/from object store
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-15 10:39:26 +08:00
chunmei-liu
6c3297d497 crimson/seastore:: add binary search for lba and omap iterator search
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2021-09-14 18:05:31 -07:00
Matt Benjamin
221fdb858b workunits/rgw: semicolon terminates perl statements
Fixes a lexical error in one line of code added in
90e9307ab0, removing the dependency
on lsb_release, on 8/16/2021.

Fixes: https://tracker.ceph.com/issues/52613

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-09-14 17:13:49 -04:00
Samuel Just
a05f6bf6a5
Merge pull request #43158 from athanatos/sjust/wip-seastore-omap
crimson/os/seastore: SeaStore::get_omap_iterator should seek_to_first

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-14 13:36:49 -07:00
Samuel Just
b17065f1ae
Merge pull request #43161 from rzarzynski/wip-crimson-fix-no-bs
crimson/os: allow to build crimson when WITH_BLUESTORE=OFF

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-14 13:36:24 -07:00
Patrick Donnelly
c0252063b9
test/libcephfs: put inodes after lookup
Otherwise, the client umount will hang due to inability to trim the
inodes looked up using the low-level interface. This results in slow-op
warnings and an eviction:

	2021-09-11T17:23:31.097+0000 7f99c3522700  0 log_channel(cluster) log [WRN] : evicting unresponsive client smithi176 (9756), after 303.924 seconds
	2021-09-11T17:23:31.097+0000 7f99c3522700 10 mds.0.server autoclosing stale session client.9756 172.21.15.176:0/3891214934 last renewed caps 303.924s ago

From: /ceph/teuthology-archive/yuriw-2021-09-11_16:21:09-smoke-pacific-distro-basic-smithi/6385038/remote/smithi175/log/ceph-mds.b.log.gz

Fixes: https://tracker.ceph.com/issues/52572
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-14 13:02:12 -04:00
Kefu Chai
707edc0b2d rpm, debian: drop xmlstarlet from build deps
xmlstarlet is not used anymore while performing "make check", so drop it
from the build dependency list.

it is still used by the teuthology test though, so keep it as a
dependency of ceph-test.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-09-14 23:25:19 +08:00
Kefu Chai
c5e49f5190 ceph.spec: remove parted from ceph-base deps
parted is only used by ceph-volume

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-09-14 23:25:19 +08:00
Kefu Chai
94945b6408 ceph.spec, debian: move deps from base to ceph-volume
this change makes util-linux, xfsprogs and e2fsprogs runtime deps of ceph-volume

ceph-volume uses blkid and lsblk, which are in turn packaged by
util-linux.

util-linux were added as build dependency to fulfill the needs of
ceph-disk. and we tested ceph-disk as part of "make check", since
ceph-disk was dropped, there is no need to have util-linux as
build dependency anymore.

the same applies to e2fsprogs and xfsprogs

see also a991778341

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-09-14 23:25:19 +08:00