Commit Graph

124601 Commits

Author SHA1 Message Date
Yingxin Cheng
2243b3d593 crimson/os/seastore/cache: add the missing extent invalid check
see 2bc257beb2

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
054b2eda32 crimson/os/seastore/cache: add missing add_to_read_set()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
5cd2c7c151 crimson/os/seastore/cache: cleanup get_extent_if_cached()
And remove the query_cache_for_extent(t).

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
82203cd353 crimson/os/seastore/cache: fix get_extent_by_type(t) to use Transaction::get_extent()
The original query_cache_for_extent() doesn't call wait_io() if the
extent is pending. And the following get_extent_by_type() already covers
the lookup to Cache::extents and also implements wait_io() correctly.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
1445ba17a1 crimson/os/seastore/cache: add absent extent to read-set before retire
So that transaction can be invalidated if the retiring extent has
conflict.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
a593927273 crimson/os/seastore/cache: remove retired extents from cache
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
91e91e5dca crimson/os/seastore: fix print_detail() of RetiredExtentPlaceholder
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
4c4405ee27 crimson/os/seastore/cache: cleanup try_construct_record() optional return
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:15:21 +08:00
Yingxin Cheng
e52d5469b7 crimson/onode-staged-tree: check invalid transaction only
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:13:07 +08:00
Yingxin Cheng
43ddfe3f3a crimson/os/seastore/cache: retire PRESENT extents and add to retired-set
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:13:07 +08:00
Yingxin Cheng
77839d6252 crimson/os/seastore/cache: invalidate transaction referencing retired extents
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-07-01 10:13:07 +08:00
Kefu Chai
85ac0c6442
Merge pull request #42103 from athanatos/sjust/wip-seastore-collection-ordering
crimson/seastore: enforce per-collection transaction ordering

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Xuehan Xu <xuxuehan@360.cn>
2021-07-01 10:06:40 +08:00
Kefu Chai
8f64ef1f02
Merge pull request #41932 from tchaikov/wip-mgr-mock-osdmap
mgr,pybind/mgr: add OSDMap.build_simple() method

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-07-01 09:50:45 +08:00
Ilya Dryomov
71274c8843
Merge pull request #41958 from ceph/wip-yuriw-notes-14.2.22_2
doc: 14.2.22 Release Notes

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-07-01 00:30:49 +02:00
Ilya Dryomov
4bc5f138aa doc/releases/nautilus,octopus: add a note for msgr2 interoperability fix
octopus 15.2.13 already shipped, let's add it retroactively.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-07-01 00:18:56 +02:00
Neha Ojha
b1f8afac33 doc/releases/nautilus: add notable changes for RADOS
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-07-01 00:18:56 +02:00
Yuri Weinstein
712e7a0e22 doc: 14.2.22 Release Notes
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-07-01 00:18:54 +02:00
Ilya Dryomov
ecf10ec13d
Merge pull request #42118 from sandrobonazzola/patch-3
doc/rbd/iscsi-initiator-linux: set "product" in multipath.conf

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-07-01 00:05:17 +02:00
Sandro Bonazzola
a5c361b648 doc/rbd/iscsi-initiator-linux: set "product" in multipath.conf
Adding missing parameter in multipath configuration.  See
https://bugzilla.redhat.com/show_bug.cgi?id=1769135.

Signed-off-by: Sandro Bonazzola <sbonazzo@redhat.com>
2021-06-30 23:46:11 +02:00
Josh Durgin
488e6be0ed
Merge pull request #42121 from ceph/wip-md
ceph-release-notes: Support for markdown for new ceph.io site

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-06-30 11:42:00 -07:00
David Galloway
8497f4b1d6 ceph-release-notes: Support for markdown for new ceph.io site
Signed-off-by: David Galloway <dgallowa@redhat.com>
2021-06-30 13:11:06 -04:00
Ernesto Puerta
849de7c98c
Merge pull request #42026 from rhcs-dashboard/bucket-name-regex-fix
mgr/dashboard: Fix bucket name input allowing space in the value

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-06-30 17:09:40 +02:00
Kefu Chai
5e6d1519f9
Merge pull request #41353 from a16bitsysop/mgr-node_modules
pybind/mgr/CMakeLists.txt: exclude files not used at runtime

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-06-30 22:44:55 +08:00
Ilya Dryomov
a408347e14
Merge pull request #41954 from pkalever/notrim
rbd-nbd: support notrim option with map command

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-06-30 14:02:10 +02:00
Kefu Chai
eb20648daf
Merge pull request #42089 from tchaikov/wip-xattr-cleanup
osd, crimson/osd: do_cmp_xattr() related cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-06-30 19:30:09 +08:00
Kefu Chai
6772c71114
Merge pull request #42054 from tchaikov/wip-os-xattrs
os: use transparent comparator in ObjectStore::getattrs()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2021-06-30 19:29:17 +08:00
Kefu Chai
85b7b1d91e
Merge pull request #42043 from tchaikov/wip-ceph-argparse-ann
pybind/ceph_argparse: do not set self.typeargs in ctor of CephArgtype

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-30 19:28:07 +08:00
Kefu Chai
a2876c7319
Merge pull request #42087 from tchaikov/wip-common-buffers
common/buffers: check _num directly in list::c_str()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-06-30 19:27:34 +08:00
Kefu Chai
e5c9315b11
Merge pull request #42084 from tchaikov/wip-49638
qa: run e2e test on centos only

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2021-06-30 19:26:42 +08:00
Kefu Chai
21f9046914
Merge pull request #42047 from tchaikov/wip-autoscaler-ann
pybind/mgr/pg_autoscaler: add typing annotations and cleanups

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-30 19:26:01 +08:00
Kefu Chai
c2a91c0d40
Merge pull request #42082 from fengchunsong/master
common: Use double instead of long double to improve performance

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-30 19:25:21 +08:00
Matt Benjamin
4bd071ea1a
Merge pull request #37866 from pritha-srivastava/wip-sts-47809
rgw/sts: fix for copy object operation using sts
2021-06-30 07:17:22 -04:00
Prasanna Kumar Kalever
2fa7f90d42 qa/workunits/rbd-nbd: add notrim test
Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2021-06-30 13:09:24 +05:30
Nizamudeen A
2e94611a65 mgr/dashboard: Fix bucket name input allows space in the value
Fixes: https://tracker.ceph.com/issues/51368
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-06-30 11:50:52 +05:30
Kefu Chai
1b0b32e44c pybind/mgr/pg_autoscaler: add typing annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 14:03:33 +08:00
Kefu Chai
83f841295d pybind/mgr/pg_autoscaler: do not index pool_root with pool_name
pool_root is indexed by pool_id, and we never index it with pool_name.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 14:03:33 +08:00
Kefu Chai
f725e09ae6 pybind/mgr/pg_autoscaler: do not create a tuple long_desc
long_desc is supposed to be a str, not a tuple of str.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 14:03:33 +08:00
Kefu Chai
9bb55e8480 pybind/mgr/pg_autoscaler: extract CrushSubtreeResourceStatus out
as it also serves as part of interface of get_subtree_resource_status(),
not only its internals. to ease adding the type annotations, this class
is promoted out of the class.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 14:03:33 +08:00
Kefu Chai
4efd740080 pybind/mgr/pg_autoscaler: define commands using CLICommand
simpler this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 14:03:33 +08:00
Kefu Chai
b40de19c23 pybind/mgr/pg_autoscaler: define options using Option
more consistent and less error-prune this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 14:03:33 +08:00
Kefu Chai
c42712dd18
Merge pull request #41919 from agayev/zoned-more-cleaning-support
os/bluestore: More support for cleaning zones.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-06-30 11:07:24 +08:00
Kefu Chai
0796dd1b5e
Merge pull request #42100 from rzarzynski/wip-crimson-assert_moveable
crimson: introduce assert_moveable().

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-30 10:22:24 +08:00
Kefu Chai
abce58d203 pybind/ceph_argparse: add more type annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-30 10:18:47 +08:00
Kefu Chai
8b8b943561
Merge pull request #41976 from tchaikov/wip-crimson-alienstore-lockless
crimson/os: use lockfree queue for sharded queue

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-06-30 08:38:41 +08:00
Patrick Donnelly
1cbcecdb5a
Merge PR #42101 into master
* refs/pull/42101/head:
	cephsqlite: add comment on atexit

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-29 11:20:36 -07:00
Samuel Just
95ace7e700 crimson/os/seastore: add collection ordering
Adds a mutex to SeastoreCollection which ensures that transactions are
ordered on a per-collection basis.  Future optimizations could enable
the transaction construction phase to be pipelined for a single collection,
but would require correctly handling the case where a more recently
submitted transaction encounters a conflict.

Fixes: https://tracker.ceph.com/issues/51358
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-29 10:41:15 -07:00
Samuel Just
c96faa8e8b crimson/os/seastore/seastore: preserve Transaction::handle on reset for writes
We're going to need to preserve the pipeline phase locking on conflict.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-29 10:14:45 -07:00
Samuel Just
e7ac30f36a crimson/os/seastore/ordering_handle: fix phase descriptions
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-29 10:08:55 -07:00
Samuel Just
a2b89dc01a crimson/os/seastore/transaction: reorder members, make handle private
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-29 10:08:55 -07:00
Samuel Just
8bc427aa75 crimson/os/seastore/transaction: remove unused initiated_after
retired_gate_token has this information, Transaction::initiated_after
was left by accident.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-06-29 10:08:55 -07:00