Commit Graph

123995 Commits

Author SHA1 Message Date
Kefu Chai
4837166f9e os/bluestore/AvlAllocator: specialize _block_picker()
before this change AvlAllocator::_block_picker() is used by both the
best-fit mode and first-fit mode. but since we cannot achieve the
locality by searching in the area pointed by curosr in best-fit mode,
we just pass a dummy cursor to AvlAllocator::_block_picker() when
searching in the best-fit mode.

but since the range_size_tree is already sorted by the size of ranges,
if _block_picker() fails to find one by the size, we should just give
up right away, and instead try again using a smaller size.

after this change, instead of sharing AvlAllocator::_block_picker()
across both the first-fit mode and the best-fit mode, this method
is specialize to two different variants: one for first-fit, and the
simplified one for best-fit.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-12 13:13:30 +08:00
Kefu Chai
7513b24aa5
Merge pull request #40480 from kamoltat/wip-ksirivad-fix-bug-49988
pybind/mgr/progress: Disregard unreported pgs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-06-12 08:37:35 +08:00
Kefu Chai
16c663eb7a
Merge pull request #41772 from cyx1231st/wip-seastore-onode-tree-node-size
crimson/onode-staged-tree: extend tree node sizes to fit insert upper-bounds

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-12 08:11:45 +08:00
Patrick Donnelly
95f0e9c959
Merge PR #39505 into master
* refs/pull/39505/head:
	qa: test nowsync option in kernel client workflows
	qa: deep merge top level overrides for fuse/kclient

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-06-11 17:10:41 -07:00
Kefu Chai
689ba06bca
Merge pull request #40952 from tchaikov/wip-deb-build-profile
debian: use build-profile to manage build deps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-12 08:08:47 +08:00
Patrick Donnelly
07bafc1b23
Merge PR #41683 into master
* refs/pull/41683/head:
	qa: update RHEL to 8.4

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-11 17:07:06 -07:00
Ernesto Puerta
0b9f06d63d
Merge pull request #41550 from aaryanporwal/navbar-fix
mgr/dashboard: fix for right sidebar nav icon not clickable

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: aaryanporwal <NOT@FOUND>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-06-11 19:46:15 +02:00
Yingxin Cheng
25254533a9 crimson/onode-staged-tree: convert ghobject_t to key_hobj_t to print
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
266e54b318 crimson/onode-staged-tree: merge with single-value tail internal node
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
ec3b7828dc crimson/onode-staged-tree: switch to and test larger node sizes
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
b1730b0502 crimson/onode-staged-tree: support unaligned read to leaf_sub_items_t::num_keys
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
ba9e465f2d crimson/onode-staged-tree: add the missing retired validation
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
e11c177396 crimson/onode-staged-tree: encode/decode stage_size instead
end-offset may risk overflow the node_offset_t, but stage_size will not.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
d163f1f9d1 crimson/onode-staged-tree: use extent_len_t and node_offset_t correctly
extent_len_t represents a value that may include the node size, but
node_offset_t cannot and may overflow. Also add validations when
try to cast a larger type to node_offset_t.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
b2f1c7df9c crimson/onode-staged-tree: remove unused code
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
ee005111fb crimson/onode-staged-tree: validate node size where possible
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
38a6b41614 crimson/onode-staged-tree: remove compile-time NODE_BLOCK_SIZE
Switch to run-time node_size.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
55605f6e34 crimson/onode-staged-tree: pass node_size to lower node stages
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:17 +08:00
Yingxin Cheng
ca86033b52 crimson/onode-staged-tree: remove compile-time node SIZE
Switch to run-time node_extent_t::node_size instead.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:06 +08:00
Yingxin Cheng
9ecaeadf61 crimson/onode-staged-tree: cleanup internal_fields_3_t template
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
2258730bee crimson/onode-staged-tree: pass node_size into node_extent_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
f7e77c9bee crimson/onode-staged-tree: extend num_keys_t to support larger nodes
Also adjust the accroding layout related unit tests.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
7e24c625ed crimson/onode-staged-tree: remove hard-coded node_stage_t::EXTENT_SIZE
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
70ced70d04 crimson/onode-staged-tree: check the maximum tree height
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
a28ad7ebb1 crimson/onode-staged-tree: validate safe-split from tree_conf_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
37d721cf69 crimson/onode-staged-tree: add and use node sizes in tree_conf_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
50d1afd7a2 crimson/onode-staged-tree: implement size upper-bounds to value
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
6fb8807678 crimson/onode-staged-tree: implement size upper-bounds to ns/oid
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
431d69ebd6 crimson/onode-staged-tree: introduce compile-time tree_conf_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
1cb6f09d3d crimson/onode-staged-tree: cleanup, decouple test_item_t from TestValue
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
8b6422b49a crimson/seastore: introduce TransactionManager::read_extent(t, offset)
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
88fd967b78 crimson/onode-staged-tree: correct the node size equation
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
9e8bb747ca crimson/onode-staged-tree: try merge peer if node has one value
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:47 +08:00
Yingxin Cheng
2921f27b97 crimson/onode-staged-tree: cleanup and introduce has_single_value()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:42:25 +08:00
Kefu Chai
8273a96198
Merge pull request #41814 from tchaikov/wip-crimson-fmt-seq
crimson/osd: specialize fmt::formatter<> for OpSequencer

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-06-11 19:59:46 +08:00
Ernesto Puerta
9dabec8485
Merge pull request #41759 from rhcs-dashboard/wip-api_label-master
.github/labeler: add api-change label

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-11 11:08:18 +02:00
Sebastian Wagner
de653833d1
Merge pull request #41242 from zdover23/wip-doc-cephadm-monitoring-deploying-monitoring-second-half-2021-05-10
doc/cephadm: rewrite "deploy. mon. w/cephadm" 2/2

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-11 10:45:47 +02:00
Sebastian Wagner
c64a6e9534
Merge pull request #41241 from zdover23/wip-doc-cephadm-monitoring-deploying-monitoring-first-half-2021-05-10
doc/cephadm: rewrite "deploy. mon. w/cephadm"

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-11 10:45:04 +02:00
Kefu Chai
b0c5a6f097 crimson/osd: specialize fmt::formatter<> for OpSequencer
so we can print it like fmt::format("{}", sequencer)

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-11 14:19:14 +08:00
Kefu Chai
3cbca12ef7
Merge pull request #41812 from agayev/zoned-fix-block-size
os/bluestore: Fix the size of the block in the Allocator base class t…

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-06-11 08:41:36 +08:00
Kefu Chai
d53d5d0aab
Merge pull request #41744 from tchaikov/wip-cmake-no-python-bindings-on-wnin32
cmake: vstart do not depend on cython_rbd if WIN32

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 08:32:30 +08:00
Patrick Donnelly
9147350fb4
Merge PR #41442 into master
* refs/pull/41442/head:
	doc/cephfs/nfs: add ganesha configuration hierarchy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-06-10 14:53:21 -07:00
Patrick Donnelly
3ed699d0f6
Merge PR #41797 into master
* refs/pull/41797/head:
	qa: update cephfs-shell distro to ubuntu 20.04

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-10 13:55:12 -07:00
Igor Fedotov
967c5354ed
Merge pull request #41575 from ifed01/wip-ifed-fix-no-osd-daemonperf
common/PriorityCache: low perf counters priorities for submodules.

Reviewed-by: Mark Nelson <mnelson@readhat.com>
2021-06-10 23:32:00 +03:00
Abutalib Aghayev
13cd140be9 os/bluestore: Fix the size of the block in the Allocator base class to avoid
the confusing log message about the block size.

Signed-off-by: Abutalib Aghayev <agayev@psu.edu>
2021-06-10 15:59:45 -04:00
Matt Benjamin
b4f83c6223
Merge pull request #41585 from pritha-srivastava/wip-rgw-sts-session-policy-eval
rgw/sts: correcting the evaluation of session policies
2021-06-10 07:56:52 -04:00
Matt Benjamin
29820ebafe
Merge pull request #41735 from pritha-srivastava/wip-rgw-sts-ops-log-updates
rgw/sts: adding role name and role session to ops log.
2021-06-10 07:56:31 -04:00
Sebastian Wagner
ee020ed4ff
Merge pull request #41653 from zdover23/wip-doc-cephadm-serve-man-setting-a-limit-2021-06-02
doc/cephadm: enriching "setting a limit"

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-10 12:52:17 +02:00
Sebastian Wagner
3afc13278e
Merge pull request #41693 from sebastian-philipp/cephadm-devenv-bootstrap-mount
doc/dev/cephadm: cephadm bootstrap --shared_ceph_folder

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-06-10 12:13:40 +02:00
Liu-Chunmei
2e45f16458
Merge pull request #41741 from liu-chunmei/seastore-fixe-read-invalid
crimson/seastore: fix OTree read invalid extent
2021-06-09 17:17:07 -07:00