Commit Graph

149429 Commits

Author SHA1 Message Date
Vallari Agrawal 73d5c01ae6
qa/suites/nvmeof: add nvmeof warnings to log-ignorelist
Add NVMEOF_SINGLE_GATEWAY and NVMEOF_GATEWAY_DOWN
warnings to nvmeof:thrash job's log-ignorelist

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2024-11-13 14:26:31 +05:30
Zhansong Gao 11a4303d66 mds: the assert should be before the journal entry submit otherwise it's racy
Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
2024-11-13 16:34:36 +08:00
Zhansong Gao 79a33025d5 mds: add `importing_count` to session dump
Signed-off-by: Zhansong Gao <zhsgao@hotmail.com>
2024-11-13 16:34:35 +08:00
Patrick Donnelly 584a81c686
Merge PR #60464 into main
* refs/pull/60464/head:
	mds: add or update MDS thread names
	log: cache recent threads up to a day
	common: cache pthread names
	log: concatenate thread names and print once per thread

Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-11-12 22:17:59 -05:00
Patrick Donnelly 8ae8988275
Merge PR #60327 into main
* refs/pull/60327/head:
	mon/MDSMonitor: send reply to beacons with `state=DNE`

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-11-12 22:16:54 -05:00
Patrick Donnelly 9d2b3aaa96
Merge PR #60381 into main
* refs/pull/60381/head:
	doc: remove refrences to `mds_log_major_segment_event_ratio`
	mds: start a new major segment after reaching minor segment threshold
	mds: make parts of mdlog reusable to be used by beacon

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-11-12 22:14:20 -05:00
Patrick Donnelly ad153a8d19
Merge PR #60325 into main
* refs/pull/60325/head:
	mds/Beacon: wake up the thread in shutdown()

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-11-12 22:13:46 -05:00
Patrick Donnelly 3829eb6f08
Merge PR #60283 into main
* refs/pull/60283/head:
	mds: add issue_seq to all cap messages
	include/ceph_fs: correct ceph_mds_cap_peer field name
	include/ceph_fs: correct ceph_mds_cap_item field name
	messages/MClientCaps: use correct ceph_seq_t for cap sequence types
	messages/MClientCaps: dump issue_seq for debugging
	mds: remove dead code

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-11-12 22:12:27 -05:00
Patrick Donnelly 5fc414b82a
Merge PR #60226 into main
* refs/pull/60226/head:
	mds/QuiesceDbEncoding: add `inline` to work around linker error

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-11-12 22:10:57 -05:00
Patrick Donnelly 5ad3c86046
Merge PR #58586 into main
* refs/pull/58586/head:
	qa/suites/fs/thrash: add convolve operator for overrides
	qa/cephfs: s/prefetch_dirfrags/prefetch_oft_dirfrags

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-11-12 22:09:30 -05:00
Zack Cerza 96a8eddc8d
Merge pull request #60675 from zmc/make-dist-quiet 2024-11-12 12:21:23 -07:00
Ronen Friedman 489eed66cd osd/scrub: list additional information when dumping the queue
Extend the information provided for operator dump commands, to
include the basic identity and scheduling information of the
entries in the scrub queue.

This change mostly benefits automatic QA and our internal
testing.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-11-12 08:21:25 -06:00
Soumya Koduri 4e130affe1 rgw: Update README for DBStore and Posix drivers
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2024-11-12 12:08:19 +05:30
Xuehan Xu d833431ea4 crimson/osd/replicated_backend: add the dedicated method to construct
MOSDRepOp

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-12 11:30:45 +08:00
Xuehan Xu b75dd8d333 crimson/osd/pg: add is_missing_on_peer()
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-12 11:30:45 +08:00
Xuehan Xu b6f27f8305 crimson/osd/pg: reuse already defined methods as many as possible to
improve readability

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-12 11:30:45 +08:00
Xuehan Xu 8a1fab37f2 crimson/osd/ops_executor: call OpsExecutor::apply_stats() before
OpsExecutor::obc is moved out.

OpsExecutor::apply_stats() accesses OpsExecutor::obc indirectly

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-12 11:30:21 +08:00
Xuehan Xu cbd22c7ba2 crimson/osd/pg: fix dangerous lambda captures
In PG::submit_transaction(), osd_op_p was first moved to
ReplicatedBackend::submit_transaction(), and later its at_version is
captured in another lambda. The latter may be already empty at the time
of the capture.

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-12 11:30:21 +08:00
Anthony D'Atri 1c93566522
Merge pull request #60703 from zdover23/wip-doc-2024-11-12-rados-operations-add-or-rm-osds
doc/rados: correct "full ratio" note
2024-11-11 20:18:56 -05:00
Anthony D'Atri 45a1fa97d7
Merge pull request #60704 from zdover23/wip-doc-2024-11-12-start-hardware-recommendations
doc/start: fix "are are" typo
2024-11-11 20:17:26 -05:00
Anthony D'Atri bdd29036ac
Merge pull request #60705 from zdover23/wip-doc-2024-11-12-radosgw-account
doc/radosgw: s/Poliicy/Policy/
2024-11-11 20:10:55 -05:00
Zac Dover 961aef1bb4 doc/radosgw: s/Poliicy/Policy/
Correct "AttachGroupPoliicy" to "AttachGroupPolicy".

Fixes: https://tracker.ceph.com/issues/68902

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-11-12 09:54:56 +10:00
Zac Dover 22010719d7 doc/start: fix "are are" typo
Fix typo reading "They are are single-threaded".
s/are are/are/

Fixes: https://tracker.ceph.com/issues/68901

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-11-12 09:47:21 +10:00
Connor Fawcett 546423c7a2
Merge pull request #60092 from connorfawcett/vstart_runner_bytes_fix
qa/vstart-runner: Only remove non-ASCII characters from string-based command outputs
2024-11-11 23:39:41 +00:00
Zac Dover f1a2637c79 doc/rados: correct "full ratio" note
Correct a note that directed users not to add an OSD after the cluster
has reached its "full ratio". The note now says "Do not let your cluster
reach its full ratio before adding an OSD."

Hat tip: Oskar Berggren

Fixes: https://tracker.ceph.com/issues/68900

Co-authored-by: Oskar Berggren <oskar.berggren@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-11-12 09:31:28 +10:00
Vallari Agrawal a878460962
monitoring: add tests for 2 new nvmeof alerts
Add test for alerts NVMeoFMissingListener and
NVMeoFZeroListenerSubsystem to test_alerts.yml.

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>
2024-11-11 23:13:44 +05:30
Zac Dover 60ae04d860
Merge pull request #60529 from zdover23/wip-doc-2024-10-29-start-os-recommendations
doc/start: separate package chart from container chart

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-11-12 01:33:06 +10:00
Mark Kogan aa94b1574d
Merge pull request #59328 from mkogan1/wip-d3n-umask
rgw: d3n: set access permissions for the D3N cache directory when creating
2024-11-11 15:59:59 +02:00
Zac Dover e5ff1916e3 doc/start: separate package chart from container chart
Separate the packages-and-containers chart into two charts:
   (1) a chart that shows which OSes Ceph builds packages for
   (2) a chart that shows which OSes support Ceph's containers

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-11-11 23:31:20 +10:00
Vallari Agrawal 7994fea436
monitoring: add 2 new nvmeof alerts
Add NVMeoFMissingListener and NVMeoFZeroListenerSubsystem
alerts to prometheus_alerts.libsonnet.

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>
2024-11-11 17:23:04 +05:30
Vallari Agrawal f02e312844
monitoring: add 2 nvmeof alerts to prometheus_alerts.yaml
- `NVMeoFMissingListener`: trigger if all listeners
     are not created for each gateway in a subsystem
- `NVMeoFZeroListenerSubsystem`: trigger if a subsystem has no listeners

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>
2024-11-11 17:23:03 +05:30
Nizamudeen A 505f1a67a9
Merge pull request #60626 from ivoalmeida/carbon-version-update
mgr/dashboard: update carbon-components-angular

Reviewed-by: Afreen Misbah <afreen@ibm.com>
2024-11-11 16:12:43 +05:30
Nizamudeen A 9d79a06052
Merge pull request #60511 from rhcs-dashboard/health-test-fix
qa/dashboard: fix tasks.mgr.dashboard.test_health.HealthTest

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2024-11-11 15:39:08 +05:30
Xuehan Xu 1627e3836e test/crimson/seastore/test_object_data_handler: always access object
data based on offsets relative to the start of the object data base

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-11 16:46:15 +08:00
Xuehan Xu b6bdebe42b test/crimson/seastore/test_transaction_manager: take RootMetaBlock into
account

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-11 16:46:15 +08:00
Xuehan Xu 8911b29fa2 crimson/os/seastore/cache: throw enospc when failed to alloc new extents
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-11 16:46:15 +08:00
Xuehan Xu 4cb1243d03 crimson/os/seastore: move the root meta out of the root block
During massive data backfilling, new osdmaps keep being created due to
frequent pg status changes, which can lead to frequent osd meta updates.
Those updates will be translated into "SeaStore::write_meta"s, which
modifies the root block's meta field and invalidates all inflight
transactions. Since the osd meta updates can be very frequent, long
transactions may be kept invalidated and the corresponding IO requests
hang.

This commit moves the root meta out of the root block, so that updates
to it won't invalidate irrelevant transactions

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-11 16:46:15 +08:00
Connor Fawcett 6567e7d934 qa/vstart-runner: Only remove non-ASCII characters from string-based command outputs
Signed-off-by: Connor Fawcett <connorfa@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/68368
2024-11-11 00:11:33 +00:00
leonidc 47e9c8560e
Merge pull request #60663 from leonidc/wip-publish-rebalance-ana-group
mon/nvmeofgw*: monitors publish in nvme-gw show ana group responsible
2024-11-09 15:29:25 +02:00
Zac Dover 87eefcdb9b
Merge pull request #60605 from zdover23/wip-doc-2024-11-04-cephadm-services-osd
doc/cephadm: clean "Adv. OSD Service Specs"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam King <adking@redhat.com>
2024-11-09 22:53:34 +10:00
Samuel Just 7cffdb48cc
Merge pull request #60592 from athanatos/sjust/wip-crimson-io-2
crimson: switch to simple RAII obc locking mechanism

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-11-08 13:26:17 -08:00
Zack Cerza 80674a3e12 make-dist: Quiet submodule operations in Jenkins
Signed-off-by: Zack Cerza <zack@redhat.com>
2024-11-08 12:43:19 -07:00
Zack Cerza 94505eb09e
Merge pull request #60578 from zmc/rpm-sccache-toggle 2024-11-08 11:02:19 -07:00
Gal Salomon 1757f0f4e5
Merge pull request #60621 from galsalomon66/mask_parquet_dependencies
rgw: hiding parquet dependencies upon parquet-select option is off
2024-11-08 14:15:06 +02:00
Nizamudeen A a2a4a3415c qa/dashboard: fix test_list_enabled_module failure
Check the ports availability and go for a new port if the current one is
not available

Fixes: https://tracker.ceph.com/issues/62972
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-11-08 15:20:18 +05:30
Zac Dover 54a75a0e40
Merge pull request #60448 from anthonyeleven/improve-mgr-disable
doc: improve pending release notes and CephFS

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-11-08 19:33:57 +10:00
Leonid Chernin c3584838cf mon/nvmeofgw*: monitors publish in nvme-gw show ana group responsible
for  namespace rebalance

Signed-off-by: Leonid Chernin <leonidc@il.ibm.com>
2024-11-08 07:02:36 +00:00
Zack Cerza 64c9b53cf4 ceph.spec.in: Add option to enable sccache
Signed-off-by: Zack Cerza <zack@redhat.com>
2024-11-07 15:21:32 -07:00
Ivo Almeida 1ba4562889 mgr/dashboard: update carbon-components-angular
* update carbon-components-angular pkg to v5.48.0
* fixed change detection errors on unit tests
* fixed pagination page length when limit is 0 and data is empty

Fixes: https://tracker.ceph.com/issues/68837

Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
2024-11-07 19:21:58 +00:00
Samuel Just 865c66966c crimson/.../object_context: remove unused lock helpers
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-11-07 10:29:42 -08:00