Commit Graph

127080 Commits

Author SHA1 Message Date
Avan Thakkar
6644a00a2c mgr/dashboard: introduce gather facts in host list
Fixes: https://tracker.ceph.com/issues/52017
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-10-13 16:02:51 +05:30
Aashish Sharma
b914f59ff1 mgr/dashboard: Cluster Creation Add Services Section
Add Services section in cluster creation wizard
Create Cluster OSD Section Followups

1. The device preview disappearing when going to next step and coming back to the previous step
2. Even when clearing the device preview, the Storage Capacity count and the drive group spec doesn't get cleared.
3. Expanding the cluster without selecting any devices gives a 400
   error.
4. Renamed "Delete Host" to "Remove Host"
5. Generalizing most of the sub component code

Fixes: https://tracker.ceph.com/issues/52499
Fixes: https://tracker.ceph.com/issues/51991
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-10-13 16:01:21 +05:30
Nizamudeen A
ad1535eea4 mgr/dashboard: Cluster Creation Create OSDs Section
Create OSDs section in cluster creation wizard

Fixes: https://tracker.ceph.com/issues/51991
Fixes: https://tracker.ceph.com/issues/52298
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-10-13 15:56:09 +05:30
Avan Thakkar
2e31ba5427 mgr/dashboard: Review Section for the Create Cluster Workflow
Fixes: https://tracker.ceph.com/issues/50566
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-10-13 15:56:09 +05:30
Nizamudeen A
59cbf97e6c mgr/dashboard: Cluster Creation Add Host Section and e2es
Add host section of the cluster creation workflow.

1. Fix bug in the modal where going forward one step on the wizard and coming back opens up the add host modal.
2. Rename Create Cluster to Expand Cluster as per the discussions
3. A skip confirmation modal to warn the user when he tries to skip the
   cluster creation
4. Adapted all the tests
5. Did some UI improvements like fixing and aligning the styles,
   colors..
- Used routed modal for host Additon form
- Renamed the Create to Add in Host Form

Fixes: https://tracker.ceph.com/issues/51517
Fixes: https://tracker.ceph.com/issues/51640
Fixes: https://tracker.ceph.com/issues/50336
Fixes: https://tracker.ceph.com/issues/50565
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-10-13 15:55:23 +05:30
Avan Thakkar
b9f38cadc4 mgr/dashboard: Create Cluster Workflow welcome screen and e2e tests
A module option called CLUSTER_STATUS has two option. INSTALLED
AND POST_INSTALLED. When CLUSTER_STATUS is INSTALLED it will allow to show the
create-cluster-wizard after login the initial time.  After the cluster
creation is succesfull this option is set to POST_INSTALLED
Also has the e2e codes for the Review Section

Fixes: https://tracker.ceph.com/issues/50336
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-10-13 15:52:14 +05:30
Avan Thakkar
f41eae16af cephadm: expose gather-facts api method
Fixes: https://tracker.ceph.com/issues/51209

This PR intends to expose host metadata(gather-facts) api method

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2021-10-12 11:30:47 +05:30
Ali Maredia
8ca0012e47
Merge pull request #42052 from TRYTOBE8TME/wip-rgw-dpp-3
rgw: DPP addition 4

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2021-10-12 01:31:00 -04:00
Samuel Just
c349666838
Merge pull request #43181 from xxhdx1985126/wip-extent-placement-manager-multi-device-3
crimson/os/seastore: add multi-device support

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-11 22:17:52 -07:00
Samuel Just
c7e262fa83
Merge pull request #43449 from rzarzynski/wip-crimson-interruptible-peeringevent
crimson/osd: implement interruptions in PeeringEvent.

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-11 18:28:42 -07:00
Samuel Just
caafbf090f
Merge pull request #43483 from cyx1231st/wip-seastore-record-header-fullness
crimson/os/seastore: measure inline/ool record header fullness

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-10-11 18:25:35 -07:00
Sebastian Wagner
100a466e3f
Merge pull request #43471 from liewegas/fix-rook-1-node
qa/suites/orch/rook: replicate across osds for 1-node clusters

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-11 18:47:35 +02:00
Sebastian Wagner
76b0657e21
Merge pull request #43376 from Daniel-Pivonka/cephadm-apply-health
mgr/cephadm: set HEALTH warnings during apply phase in serve

Reviewed-by: Melissa Li <mingkli@redhat.com>
2021-10-11 16:45:58 +02:00
Sebastian Wagner
1be6dc174f
Merge pull request #43455 from liewegas/qa-nvme-loop
qa: use nvme_loop devices for (some) cephadm tests

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-11 16:43:10 +02:00
Sebastian Wagner
b7ce9d0d6f
Merge pull request #43450 from guits/fix_selinux_apply_spec
cephadm: shell --mount shouldnt enforce ':z' option

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-10-11 16:40:39 +02:00
Sebastian Wagner
146cf96af6
Merge pull request #43458 from mgfritch/cephadm-scp
mgr/cephadm: use `asyncssh.scp` to write remote files

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-10-11 16:38:35 +02:00
Sage Weil
0e7c0a81d8 mgr/rook: specify failureDomain on CephObjectStore CR
Signed-off-by: Sage Weil <sage@newdream.net>
2021-10-11 08:55:18 -05:00
Ernesto Puerta
e7cbf30387
Merge pull request #43473 from rhcs-dashboard/wip-pr_deps-master
.github: check if PR deps are merged/closed

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-10-11 14:52:02 +02:00
Ernesto Puerta
bbe2e6505c
Merge pull request #43485 from rhcs-dashboard/fix-pr_triage-master
.github/pr-triage: rename GH token

Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-10-11 14:45:45 +02:00
Ernesto Puerta
2220646c20
.github/pr-triage: rename GH token
Repo projects use GITHUB_TOKEN instead of MY_GITHUB_TOKEN:
https://github.com/srggrs/assign-one-project-github-action/blob/master/entrypoint.sh#L19

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2021-10-11 13:05:34 +02:00
Kalpesh Pandya
f20055163c src/rgw: New commit to fix make check
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-10-11 15:09:16 +05:30
Kalpesh Pandya
ca4ae7cb9f src/rgw: DPP addition to rgw_kms.cc
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-10-11 15:09:16 +05:30
Kalpesh Pandya
7086ccccfb src/rgw: DPP addition to rgw_keystone.cc
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-10-11 15:09:16 +05:30
Kalpesh Pandya
e66371fad3 src/rgw: DPP addition to rgw_sts.cc
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-10-11 15:09:16 +05:30
Ernesto Puerta
0bcc9d862a
Merge pull request #43472 from rhcs-dashboard/wip-gh_action_project_dashboard-master
.github: add dashboard PRs to Dashboard project

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-10-11 11:06:39 +02:00
Yingxin Cheng
326b79f75c crimson/os/seastore: measure inline/ool record header fullness
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-10-11 16:14:01 +08:00
Yingxin Cheng
a20fa150ed crimson/os/seastore: cleanup record_size_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-10-11 16:14:01 +08:00
Yingxin Cheng
d9044d3b39 crimson/os/seastore: rename ool_write_stats_t::overhead_bytes
To header_bytes to be more explicit.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-10-11 16:14:01 +08:00
Ilya Dryomov
f5b9646108
Merge pull request #43182 from CongMinYin/fix-writesame-assert
librbd/cache/pwl: initialize number_log_entries

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-10-10 17:33:51 +02:00
Samuel Just
5ee7916886 crimson/os/seastore/segment_cleaner: update segment_info_set_t to use segment_map_t
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-10-10 21:06:54 +08:00
Samuel Just
e6a39e218f crimson/os/seastore/segment_cleaner: rework SpaceTracker* to use a simpler segment map type
segment_info_set_t does extra things not relevant to these structures.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-10-10 14:22:10 +08:00
Samuel Just
9fdc148efe crimson/os/seastore: max_device -> DEVICE_ID_MAX, clarify users
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-10-10 14:22:10 +08:00
Samuel Just
f5aa0eb7b4 crimson/os/seastore/seastore_types.h: clarify segment_id_t visibility, constants
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-10-10 14:22:10 +08:00
Samuel Just
d062f6829b crimson/os/seastore/segment_cleaner: check for null in SpaceTrackerSimple constructor
Since we're passing a sparse pointer vector, we need to check for null
in every user.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-10-10 14:22:10 +08:00
Samuel Just
3b7176152d crimson/os/seastore/segment_cleaner.cc: adjust whitespace in init_segments()
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-10-10 14:22:10 +08:00
Samuel Just
7677f6dcd3 crimson/os/seastore/segment_cleaner: remove unnecessary template declarations
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-10-10 14:22:10 +08:00
Xuehan Xu
a615b39335 crimson/os/seastore: adjust segment cleaner's space counter calculation
Until now, segment cleaner calculate available/used spaces assuming that only the journal
does all the writes, which is not true any more. This commit make segment cleaner track
all segment managers' empty/open segments and further calculate the various space usage
based on that information

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-10-10 14:22:10 +08:00
Xuehan Xu
4554f3e3ff crimson/os/seastore: multi-device support
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-10-10 14:22:10 +08:00
Xuehan Xu
98caf058cf crimson/os/seastore: enable SegmentCleaner to hold multiple segmented devices
For now, all segmented devices are treated the same as SEGMENTED. In the future,
there may be different kinds of segmeted devices, like SEGMENTED_NVME, SEGMENTED_SSD,
and even SEGMENTED_SATA. We plan to use a dedicated segment cleaner for each kind of
those devices, and if there are multiple devices of the same kind, they share the same
segment cleaner.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-10-10 14:21:07 +08:00
Xuehan Xu
0f3fc5af09 crimson/os/seastore: change Scanner to ExtentReader
This commit makes Scanner an extent reader that route read requests to the corresponding
backing devices according to the device ids encapsulated in the segment ids.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-10-10 14:21:07 +08:00
Xuehan Xu
7de7f95246 crimson/os/seastore: make segment managers device-id aware
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-10-10 14:21:07 +08:00
Xuehan Xu
6f3afd83a8 crimson/os/seastore: introduce device id into segment_id_t
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-10-10 14:21:07 +08:00
Kefu Chai
55138b6d67
Merge pull request #43166 from rzarzynski/wip-crimson-no-subproc
crush, crimson: don't support crush_location_hook as crimson lacks SubProcess

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-10-10 09:42:35 +08:00
Kefu Chai
8f8ee5d29e
Merge pull request #43346 from hjwsm1989/fix-52765
tools/ceph-kvstore-tool: fix segfaults when repair the rocksdb

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-10-10 09:42:03 +08:00
Kefu Chai
a7ffc0540a
Merge pull request #43452 from adk3798/agent-perf1
cephadm: agent: subtract average time of previous iterations off wait time

Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-10-10 09:41:30 +08:00
Kefu Chai
9a71badb0d
Merge pull request #43401 from romoh/master
src/cephadm: Add support for mariner

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-10-10 09:38:22 +08:00
Kefu Chai
ae783dd81a
Merge pull request #43443 from tchaikov/wip-elapsed-in-double
msg/async/ProtocolV2: cast usec to double when converting from nsec

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: dongdong tao <dongdong.tao@canonical.com>
2021-10-10 09:36:57 +08:00
Yuri Weinstein
c2770fb650
Merge pull request #43343 from trociny/wip-crushdiff-compat
tools/crushdiff: support old format json dump

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-10-08 15:22:49 -07:00
Yuri Weinstein
3104bf46b7
Merge pull request #43324 from neha-ojha/wip-52640
common/options/global.yaml.in: add runtime flag for mon_max_pg_per_osd

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
2021-10-08 15:21:47 -07:00
Yuri Weinstein
cbcfc8a55b
Merge pull request #43232 from Rethan/feat-bluestore-fail-eio
os/bluestore: add option for bluestore fail eio

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-10-08 15:21:08 -07:00