Commit Graph

123998 Commits

Author SHA1 Message Date
Patrick Donnelly
0d9032771c
qa: fix api test failures
"device_health_metrics" pool is gone -- .mgr pool is in.

I don't think the pool removal code in some test cases is necessary any
longer with recent changes to remove those warnings; so that code is
gone too.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:17 -07:00
Patrick Donnelly
da551b0b04
pybind/mgr/devicehealth: load legacy device metrics pool
Fixes: https://tracker.ceph.com/issues/50278
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:16 -07:00
Patrick Donnelly
abd35d4769
pybind/mgr/devicehealth: update to store metrics in sqlite
This commit just modifies the module to use the sqlite3 database for
storing health metrics. A followup commit loads the legacy pool's data.

Fixes: https://tracker.ceph.com/issues/50278
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:16 -07:00
Patrick Donnelly
e3d771702d
pybind/mgr: add sqlite3 db module helpers
This creates a new '.mgr' pool for storing a default sqlite3 database
for each mgr module. Each module's database is stored in:

        file:///.mgr:<mgr module name>/main.db?vfs=ceph

The "main.db" is the only one used presently but perhaps a module may
want extra databases for some reason. The module name is used for the
RADOS namespace.

Databases are versioned in a common table called MgrModuleKV using the
"__version" key. A mechanism is in place (SCHEMA_VERSIONED) to allow
modules to upgrade their databases over time in a consistent way.

Fixes: https://tracker.ceph.com/issues/50278
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:16 -07:00
Kefu Chai
7513b24aa5
Merge pull request #40480 from kamoltat/wip-ksirivad-fix-bug-49988
pybind/mgr/progress: Disregard unreported pgs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-06-12 08:37:35 +08:00
Kefu Chai
16c663eb7a
Merge pull request #41772 from cyx1231st/wip-seastore-onode-tree-node-size
crimson/onode-staged-tree: extend tree node sizes to fit insert upper-bounds

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-12 08:11:45 +08:00
Patrick Donnelly
95f0e9c959
Merge PR #39505 into master
* refs/pull/39505/head:
	qa: test nowsync option in kernel client workflows
	qa: deep merge top level overrides for fuse/kclient

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-06-11 17:10:41 -07:00
Kefu Chai
689ba06bca
Merge pull request #40952 from tchaikov/wip-deb-build-profile
debian: use build-profile to manage build deps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-12 08:08:47 +08:00
Patrick Donnelly
07bafc1b23
Merge PR #41683 into master
* refs/pull/41683/head:
	qa: update RHEL to 8.4

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-11 17:07:06 -07:00
Ernesto Puerta
0b9f06d63d
Merge pull request #41550 from aaryanporwal/navbar-fix
mgr/dashboard: fix for right sidebar nav icon not clickable

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: aaryanporwal <NOT@FOUND>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-06-11 19:46:15 +02:00
Yingxin Cheng
25254533a9 crimson/onode-staged-tree: convert ghobject_t to key_hobj_t to print
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
266e54b318 crimson/onode-staged-tree: merge with single-value tail internal node
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
ec3b7828dc crimson/onode-staged-tree: switch to and test larger node sizes
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
b1730b0502 crimson/onode-staged-tree: support unaligned read to leaf_sub_items_t::num_keys
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
ba9e465f2d crimson/onode-staged-tree: add the missing retired validation
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
e11c177396 crimson/onode-staged-tree: encode/decode stage_size instead
end-offset may risk overflow the node_offset_t, but stage_size will not.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
d163f1f9d1 crimson/onode-staged-tree: use extent_len_t and node_offset_t correctly
extent_len_t represents a value that may include the node size, but
node_offset_t cannot and may overflow. Also add validations when
try to cast a larger type to node_offset_t.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
b2f1c7df9c crimson/onode-staged-tree: remove unused code
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
ee005111fb crimson/onode-staged-tree: validate node size where possible
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
38a6b41614 crimson/onode-staged-tree: remove compile-time NODE_BLOCK_SIZE
Switch to run-time node_size.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:18 +08:00
Yingxin Cheng
55605f6e34 crimson/onode-staged-tree: pass node_size to lower node stages
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:17 +08:00
Yingxin Cheng
ca86033b52 crimson/onode-staged-tree: remove compile-time node SIZE
Switch to run-time node_extent_t::node_size instead.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:59:06 +08:00
Yingxin Cheng
9ecaeadf61 crimson/onode-staged-tree: cleanup internal_fields_3_t template
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
2258730bee crimson/onode-staged-tree: pass node_size into node_extent_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
f7e77c9bee crimson/onode-staged-tree: extend num_keys_t to support larger nodes
Also adjust the accroding layout related unit tests.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
7e24c625ed crimson/onode-staged-tree: remove hard-coded node_stage_t::EXTENT_SIZE
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
70ced70d04 crimson/onode-staged-tree: check the maximum tree height
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
a28ad7ebb1 crimson/onode-staged-tree: validate safe-split from tree_conf_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
37d721cf69 crimson/onode-staged-tree: add and use node sizes in tree_conf_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
50d1afd7a2 crimson/onode-staged-tree: implement size upper-bounds to value
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
6fb8807678 crimson/onode-staged-tree: implement size upper-bounds to ns/oid
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
431d69ebd6 crimson/onode-staged-tree: introduce compile-time tree_conf_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
1cb6f09d3d crimson/onode-staged-tree: cleanup, decouple test_item_t from TestValue
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
8b6422b49a crimson/seastore: introduce TransactionManager::read_extent(t, offset)
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
88fd967b78 crimson/onode-staged-tree: correct the node size equation
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:58 +08:00
Yingxin Cheng
9e8bb747ca crimson/onode-staged-tree: try merge peer if node has one value
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:43:47 +08:00
Yingxin Cheng
2921f27b97 crimson/onode-staged-tree: cleanup and introduce has_single_value()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-06-11 22:42:25 +08:00
Kefu Chai
8273a96198
Merge pull request #41814 from tchaikov/wip-crimson-fmt-seq
crimson/osd: specialize fmt::formatter<> for OpSequencer

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-06-11 19:59:46 +08:00
Ernesto Puerta
9dabec8485
Merge pull request #41759 from rhcs-dashboard/wip-api_label-master
.github/labeler: add api-change label

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-11 11:08:18 +02:00
Sebastian Wagner
de653833d1
Merge pull request #41242 from zdover23/wip-doc-cephadm-monitoring-deploying-monitoring-second-half-2021-05-10
doc/cephadm: rewrite "deploy. mon. w/cephadm" 2/2

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-11 10:45:47 +02:00
Sebastian Wagner
c64a6e9534
Merge pull request #41241 from zdover23/wip-doc-cephadm-monitoring-deploying-monitoring-first-half-2021-05-10
doc/cephadm: rewrite "deploy. mon. w/cephadm"

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-11 10:45:04 +02:00
Kefu Chai
b0c5a6f097 crimson/osd: specialize fmt::formatter<> for OpSequencer
so we can print it like fmt::format("{}", sequencer)

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-06-11 14:19:14 +08:00
Kefu Chai
3cbca12ef7
Merge pull request #41812 from agayev/zoned-fix-block-size
os/bluestore: Fix the size of the block in the Allocator base class t…

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-06-11 08:41:36 +08:00
Kefu Chai
d53d5d0aab
Merge pull request #41744 from tchaikov/wip-cmake-no-python-bindings-on-wnin32
cmake: vstart do not depend on cython_rbd if WIN32

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 08:32:30 +08:00
Patrick Donnelly
9147350fb4
Merge PR #41442 into master
* refs/pull/41442/head:
	doc/cephfs/nfs: add ganesha configuration hierarchy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-06-10 14:53:21 -07:00
Patrick Donnelly
3ed699d0f6
Merge PR #41797 into master
* refs/pull/41797/head:
	qa: update cephfs-shell distro to ubuntu 20.04

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-10 13:55:12 -07:00
Igor Fedotov
967c5354ed
Merge pull request #41575 from ifed01/wip-ifed-fix-no-osd-daemonperf
common/PriorityCache: low perf counters priorities for submodules.

Reviewed-by: Mark Nelson <mnelson@readhat.com>
2021-06-10 23:32:00 +03:00
Abutalib Aghayev
13cd140be9 os/bluestore: Fix the size of the block in the Allocator base class to avoid
the confusing log message about the block size.

Signed-off-by: Abutalib Aghayev <agayev@psu.edu>
2021-06-10 15:59:45 -04:00
Matt Benjamin
b4f83c6223
Merge pull request #41585 from pritha-srivastava/wip-rgw-sts-session-policy-eval
rgw/sts: correcting the evaluation of session policies
2021-06-10 07:56:52 -04:00
Matt Benjamin
29820ebafe
Merge pull request #41735 from pritha-srivastava/wip-rgw-sts-ops-log-updates
rgw/sts: adding role name and role session to ops log.
2021-06-10 07:56:31 -04:00