Commit Graph

140451 Commits

Author SHA1 Message Date
Adam King
e2b54e39bd
Merge pull request #53612 from adk3798/fix-refreshed-column
mgr/cephadm: fix REFRESHED column of orch ps being unpopulated

Reviewed-by: Michael Fritch <mfritch@suse.com>
2023-09-30 16:59:42 -04:00
Adam King
6306e5c316
Merge pull request #53682 from phlogistonjohn/jjm-cephadm-move-pathify
cephadm: move pathify & get_file_timestamp to file_utils

Reviewed-by: Adam King <adking@redhat.com>
2023-09-30 15:25:59 -04:00
Adam King
46e4c40b91
Merge pull request #53683 from phlogistonjohn/jjm-cephadm-move-getters
cephadm: move context getters

Reviewed-by: Adam King <adking@redhat.com>
2023-09-30 15:22:12 -04:00
zdover23
8f07179437
Merge pull request #53726 from zdover23/wip-doc-2023-09-29-architecture-14-of-x
doc/architecture: edit "Replication"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph.@gmail.com>
2023-09-30 10:12:15 +10:00
Laura Flores
3deccad920
Merge pull request #53605 from sayantani11/osd-1
script/backport-resolve-issue: Update script with latest versions
2023-09-29 18:34:45 -04:00
zdover23
1d10b71792
Merge pull request #53723 from zdover23/wip-doc-2023-09-29-architecture-13-of-x
doc/architecture: edit "Data Scrubbing"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-29 16:02:14 +10:00
Zac Dover
4cf22e195a doc/architecture: edit "Replication"
Edit "Replication" in the "Smart Daemons Enable Hyperscale" section of
doc/architecture.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-29 15:30:14 +10:00
Zac Dover
d7b991646f doc/architecture: edit "Data Scrubbing"
Edit the "Data Scrubbing" listitem in the list of benefits conferred by
the use by OSDs of the aggregate power of the cluster, in the section
"Smart Daemons Enable Hyperscale" in doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-29 15:26:13 +10:00
Venky Shankar
6d8679ebcd Merge PR #53594 into main
* refs/pull/53594/head:
	qa: fix "no orch backend set" in nfs suite

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-29 10:01:17 +05:30
zdover23
8e5dda2493
Merge pull request #53707 from zdover23/wip-doc-2023-09-28-architecture-12-of-x
doc/architecture: edit "OSD Membership and Status"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-29 07:35:45 +10:00
Zac Dover
dbd85336b1 doc/architecture: edit "OSD Membership and Status"
Edit "OSD Membership and Status" in the "Smart Daemons Enable
Hyperscale" section of doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-29 04:28:56 +10:00
Casey Bodley
2f5657011f
Merge pull request #53608 from cbodley/wip-62536
qa/rgw/sts: keycloak task installs java manually

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-09-28 15:37:20 +01:00
Liu-Chunmei
80bcefadf7
Merge pull request #53432 from liu-chunmei/seastore_device_size
crimson/vstart: default seastore_device_size will be out of space f…

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-09-27 20:11:47 -07:00
Casey Bodley
de55616429
Merge pull request #53607 from cfsnyder/wip-cfsnyder-bucket-check-bug
rgw: fix radosgw-admin bucket check stat calculation bug

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-27 18:38:42 +01:00
Yuval Lifshitz
935c513a14
Merge pull request #52393 from yuvalif/wip-yuval-enable-trace-lua
common/tracer: remove is_enabled check in add_span methods

reviewed-by: cbodley, ljflores
2023-09-27 18:07:28 +03:00
Ilya Dryomov
73dd77f8e7
Merge pull request #53523 from rhcs-dashboard/add-ceph-daemon-label-labeled-counters
exporter: add ceph_daemon labels to labeled counters as well

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-09-27 09:27:04 +02:00
Nizamudeen A
3df6ce3071
Merge pull request #52828 from rhcs-dashboard/angular-15
mgr/dashboard: upgrade to angular v15

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-09-27 11:11:35 +05:30
Nizamudeen A
95d8f59938
Merge pull request #53596 from rhcs-dashboard/fix-validations-in-cephfs-forms
mgr/dashboard: fix cephfs forms validations

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
2023-09-27 10:43:14 +05:30
Venky Shankar
c01beb38b7 Merge PR #53529 into main
* refs/pull/53529/head:
	doc: update colorama, packaging
	cephfs-shell: drop LooseVersion for version.parse

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-27 09:57:25 +05:30
zdover23
4dee8b7928
Merge pull request #53685 from zdover23/wip-doc-2023-09-27-architecture-11-of-x
doc/architecture: edit "OSDs service clients directly"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-27 06:54:06 +10:00
Zac Dover
6f9dfd75b5 doc/architecture: edit "OSDs service clients directly"
Edit "OSDs service clients directly" in the list in
"Smart Daemons Enable Hyperscale" in doc/architecure.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-27 06:00:34 +10:00
John Mulligan
a8be9caefc cephadm: remove (doc)string
Remove a, now irrelevant (IMO), docstring that might have been
associated with the recently moved `cached_stdin` global. It's not
really clear how helpful it is in light of the new "compiled"
cephadm, so I am opting to remove it rather than move it.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-26 13:45:35 -04:00
John Mulligan
f680b7d381 cephadm: black format context_getters.py
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-26 13:31:26 -04:00
John Mulligan
6ec6384c07 cephadm: rename fetch_tcp_ports to fetch_endpoints
Rename fetch_tcp_ports to fetch_endpoints to more closely match what
the function is doing.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-26 13:31:26 -04:00
John Mulligan
fa4846a04a cephadm: move context based getters to context_getters.py
Move functions that exist mainly to pull information out of the
CephadmContext in various ways to a new context_getters.py module.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-26 13:31:26 -04:00
John Mulligan
f9e9f30b27 cephadm: move a logging line closer to where the data is used
Move a logging line closer to where the data being logging is
used. This avoids having a dependency on logging in a fairly
simple function and should make moving the function in a future
commit easier.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-26 13:31:26 -04:00
John Mulligan
3013780ea1 cephadm: move pathify & get_file_timestamp to file_utils
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-26 12:56:35 -04:00
Ronen Friedman
05c5f97c1d
Merge pull request #53615 from ronen-fr/wip-rf-great-move
tools, rgw/test: add std:: qualifiers to 'move'

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-09-26 17:34:41 +03:00
Laura Flores
1f378332c3
Merge pull request #53048 from YiteGu/add-slow-count-committed-kv
os/bluestore: add some slow count for bluestore
2023-09-26 10:22:44 -04:00
Laura Flores
4fbb4acab4
Merge pull request #52930 from leonid-s-usov/msg_wait
msg/AsyncMessenger: re-evaluate the stop condition when woken up in 'wait()'
2023-09-26 10:22:23 -04:00
Laura Flores
35506db4a4
Merge pull request #52906 from sseshasa/wip-fix-config-dump-pretty-print
mon/ConfigMonitor: Show localized name in "config dump --format json" output
2023-09-26 10:22:08 -04:00
Laura Flores
8dd1c9db87
Merge pull request #52200 from jinmyeonglee/61819
client: append to buffer list to save all result from wildcard command
2023-09-26 10:21:51 -04:00
Laura Flores
611c7b4cd1
Merge pull request #50585 from ssdohammer-sl/fix-metadata-obj-promote
osd: chunked type manifest object not to be promoted
2023-09-26 10:21:14 -04:00
Nizamudeen A
630ba3ab37 mgr/dashboard: upgrade to cypress 12
Looks like chrome 117 will need cypress >=12.15.0
https://github.com/cypress-io/cypress-documentation/issues/5479

Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-09-26 19:42:13 +05:30
Nizamudeen A
e2626fb63c mgr/dashboard: adapt and refactor jest test files
Use the `configureTestBed` as the placeholder for adding the
declarations, imports... that is required for the unit tests to run

Fixes: https://tracker.ceph.com/issues/62844
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-09-26 19:41:59 +05:30
Kamoltat (Junior) Sirivadhna
86047f0fe1
Merge pull request #51923 from kamoltat/wip-ksirivad-fix-61570
pybind/mgr/pg_autoscaler: fix warn when not too few pgs
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-09-26 09:45:18 -04:00
Adam Kupczyk
7e2c94fd48
Merge pull request #53324 from aclamk/wip-aclamk-osd-op-scraper-fixes
Set of scraper improvements
2023-09-26 15:20:36 +02:00
avanthakkar
f061955f0b exporter: add ceph_daemon labels to labeled counters as well
Exporter missed adding the `ceph_daemon` or `instance_id`
labels(in case if rgw metrics) to the new labeled performance counters.

Fixes: https://tracker.ceph.com/issues/62874
Signed-off-by: avanthakkar <avanjohn@gmail.com>
2023-09-26 16:45:54 +05:30
Yingxin
0f539cd011
Merge pull request #53284 from xxhdx1985126/wip-seastore-remap-intermediate_key
crimson/os/seastore/transaction_manager: move intermediate_key by "remap_offset" when remapping the "back" half of the original pin

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2023-09-26 16:36:43 +08:00
Yingxin
0102c2afa3
Merge pull request #53455 from xxhdx1985126/wip-seastore-no-touch-pending
crimson/os/seastore/cache: don't add EXIST_CLEAN extents to lru

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-09-26 16:35:16 +08:00
zdover23
3ed92db078
Merge pull request #53657 from zdover23/wip-doc-2023-09-26-architecture-10-of-x
doc/architecture: edit "SDEH"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-26 14:38:38 +10:00
Zac Dover
5054f6c753 doc/architecture: edit "SDEH"
Edit the front matter of the "Smart Daemons Enable Hyperscale" section
of doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-26 13:45:26 +10:00
Xuehan Xu
f60f318450 crimson/os/seastore/cache: replace is_clean by is_stable_clean wherever
possible

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-09-26 11:30:54 +08:00
Xuehan Xu
dc6c091fd3 crimson/os/seastore/transaction_manager: move intermediate_key by
"remap_offset" when remapping the "back" half of the original pin

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-09-26 11:17:07 +08:00
Kamoltat (Junior) Sirivadhna
dc5d6ffa42
Merge pull request #52442 from kamoltat/wip-ksirivad-fix-tracker-61922
pybind/mgr/pg_autoscaler: noautoscale flag retains individual pool configs
Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
2023-09-25 17:57:38 -04:00
Adam King
47c8ad4524 mgr/cephadm: add unit test for _process_ls_output
This is a weird function to make a unit test for
since it's essentially just moving data from a
list of dicts into a list of DaemonDescriptions,
but wanted to have some coverage to lower the
chance of breaking something again.

Signed-off-by: Adam King <adking@redhat.com>
2023-09-25 15:03:50 -04:00
Adam King
06cf5bb952 mgr/cephadm: fix REFRESHED column of orch ps being unpopulated
The way the daemon ls data was processed was changed in
1fd4132c7c
and it seems that commit removed a line that set the
last_refresh field. This commit just adds it back
in the new location after the change.

Without this in "ceph orch ps" the REFRESHED column
for every daemon just reports "-"

Fixes: https://tracker.ceph.com/issues/62954

Signed-off-by: Adam King <adking@redhat.com>
2023-09-25 15:02:47 -04:00
Adam King
ad54514806
Merge pull request #51926 from adk3798/host-drain-zap
mgr/cephadm: add ability to zap OSDs' devices while draining host

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-09-25 13:39:54 -04:00
Adam King
57d18f16e0
Merge pull request #53589 from adk3798/cephadm-refactor-host-facts
cephadm: create host_facts.py in cephadmlib

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-09-25 13:38:07 -04:00
Adam King
dec3717b45 cephadm: format black host_facts.py
Signed-off-by: Adam King <adking@redhat.com>
2023-09-25 10:26:53 -04:00