Commit Graph

143433 Commits

Author SHA1 Message Date
Kamoltat (Junior) Sirivadhna
8b6a9ed8c4
Merge pull request #53222 from myoungwon/wip-62167
osd: check if adjacent clones are unreadable when rollback is called.
Reviewed-by: athanatos
2024-02-27 15:55:12 -05:00
Kamoltat (Junior) Sirivadhna
313b88631c
Merge pull request #55147 from Matan-B/wip-matanb-skip-past-interval-cheeck
osd/PeeringState: introduce osd_skip_check_past_interval_bounds
Reviewed-by athanatos
2024-02-27 15:54:45 -05:00
Kamoltat (Junior) Sirivadhna
06bcebffc7
Merge pull request #55227 from Svelar/wip-ci-clang
ARM CI: clang should >= 12 for supporting C++20
Reviewed by: Laura Flores <lajefl@gmail.com>
2024-02-27 15:54:01 -05:00
Yuri Weinstein
4a1c26b521
Merge pull request #54872 from amathuria/wip-amat-mclock-adjust-deletion-cost
osd: Change PG Deletion cost for mClock

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
2024-02-27 08:38:21 -08:00
Yuri Weinstein
80feaec5a1
Merge pull request #52891 from kamoltat/wip-ksirivad-fix-59172
qa/tasks/ceph_manager.py: Rewrite test_pool_min_size

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-27 08:37:34 -08:00
Casey Bodley
9e91f5305c
Merge pull request #55760 from cbodley/wip-64568
test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2024-02-27 16:05:51 +00:00
Pedro Gonzalez Gomez
f336a5d55f
Merge pull request #55752 from rhcs-dashboard/fix-vol-create
mgr/dashboard: fix volume creation with multiple hosts



Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-02-27 13:27:23 +01:00
Venky Shankar
b11e6e21f7 Merge PR #52859 into main
* refs/pull/52859/head:
	qa: test cases to make sure invalid paths don't get updated
	mgr/nfs: use helper to validate cephfs path
	mgr/nfs: validate path before updating a cephfs export
	mgr/nfs: add a helper to validate cephfs path

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-02-27 11:23:13 +05:30
Venky Shankar
40936ffd5e Merge PR #54687 into main
* refs/pull/54687/head:
	mds: allow lock state to be LOCK_MIX_SYNC in replica for filelock

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-02-27 11:20:54 +05:30
Venky Shankar
a302e3b67e Merge PR #55435 into main
* refs/pull/55435/head:
	qa: Fix fs/full suite

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-02-27 11:17:13 +05:30
Samuel Just
66b21ca59e
Merge pull request #55751 from cyx1231st/wip-fix-test-socket
test/crimson/test_socket: complete write-side errors in test_unexpected_down()

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-26 15:26:00 -08:00
Yuri Weinstein
3cb404b367
Merge pull request #54999 from Matan-B/wip-matanb-mon-osd-epochs
mon/OSDMonitor: fix get_min_last_epoch_clean()

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-26 07:47:57 -08:00
Casey Bodley
b4f3ddfe43 test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler
1ms sleeps are generally below the timer's resolution. increase run_for()
durations to 50ms to make the tests far less sensitive to timing. in
practice, none of the sleeps actually wait the full 50ms

Fixes: https://tracker.ceph.com/issues/64568

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-26 09:42:20 -05:00
Ilya Dryomov
e7ecafcd8e
Merge pull request #55683 from lxbsz/wip-62837-new
doc/man/8/mount.ceph.rst: add more mount options

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-02-26 10:17:25 +01:00
Yingxin
6c49b32fc5
Merge pull request #55705 from xxhdx1985126/wip-64535
crimson/os/seastore: fix wrong-positioned asserts

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-02-26 15:39:49 +08:00
Pedro Gonzalez Gomez
4313f9a59c mgr/dashboard: fix volume creation with multiple hosts
Fixes: https://tracker.ceph.com/issues/64559
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-02-26 08:12:53 +01:00
Yingxin Cheng
5b03e4d3d7 test/crimson/test_socket: complete write-side errors in test_unexpected_down()
Related: https://tracker.ceph.com/issues/64457
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-02-26 14:17:48 +08:00
zdover23
9dd5232c2e
Merge pull request #55739 from zdover23/wip-doc-2024-02-26-glossary-omap
doc/glossary: Add "OMAP" to glossary

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-02-26 15:20:40 +10:00
Xiubo Li
d5639cc670 doc/man/8/mount.ceph.rst: add more mount options
Fixes: https://tracker.ceph.com/issues/62837
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2024-02-26 09:28:32 +08:00
Zac Dover
1d8baa1d4c doc/glossary: Add "OMAP" to glossary
Add an entry for "OMAP" to the glossary. This commit represents only the
first improvement to the documentation of OMAP in the Ceph docs suite.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-26 07:27:52 +10:00
Ilya Dryomov
fa5ef874ac
Merge pull request #54802 from ajarr/wip-61617
qa: Add tests to validate synced images on rbd-mirror

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-02-23 23:47:42 +01:00
Casey Bodley
c72704b1d5
Merge pull request #55722 from cbodley/wip-64543
rgw/aio: avoid infinite recursion in aio_abstract()

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2024-02-23 18:11:03 +00:00
zdover23
65ca1a8b41
Merge pull request #55729 from zdover23/wip-doc-2024-02-24-rbd-nvmof-target-configure-list-repair
doc/rbd: repair ordered list

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-02-24 03:04:53 +10:00
Anthony D'Atri
dede3cccee
Merge pull request #55731 from zdover23/wip-doc-2024-02-24-dev-crimson
doc/dev: fix spelling in crimson.rst
2024-02-23 12:02:57 -05:00
Zac Dover
dfdb5e124a doc/dev: fix spelling in crimson.rst
Repair a confusing sentence in doc/dev/crimson.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-24 02:21:54 +10:00
zdover23
b1d93d3696
Merge pull request #55699 from Svelar/seastore_doc
doc/crimson: cleanup duplicate seastore description

Reviewed-by: Zac Dover <zac.dover@proton.me>
2024-02-24 02:10:56 +10:00
Zac Dover
6df12da2cd doc/rbd: repair ordered list
Fix the numbering in an ordered list. The numbering was thrown off
because a ".. prompt" directive was improperly indented (it wasn't
indented at all).

See https://github.com/ceph/ceph/pull/55540#discussion_r1500051264

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-24 02:05:42 +10:00
Casey Bodley
e754a39838
Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization
rgw/http/client-side: disable curl path normalization

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-23 16:01:24 +00:00
Casey Bodley
b9a467f8d8
Merge pull request #55627 from smanjara/wip-fix-log-op
rgw: don't pass log_op into link_olh during PutObject.

Reviewed-by: Jane Zhu <jzhu116@bloomberg.net>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-23 15:00:44 +00:00
Rixin Luo
87f6091b9e
Merge pull request #55713 from tchaikov/wip-debian-control-tab
debian/control: replace <tab> with spaces
2024-02-23 10:22:18 +08:00
Casey Bodley
0e223fdf43 rgw/aio: avoid infinite recursion in aio_abstract()
a recent regression from 320a2179a3 causes
aio_abstract() to recurse when given an empty optional_yield. this is
exposed by the librgw_file tests

Fixes: https://tracker.ceph.com/issues/64543

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-22 16:59:57 -05:00
Ilya Dryomov
4b9662c7bc
Merge pull request #55540 from oritwas/wip-doc-nvmeof
doc: Initial NVMe-oF gateway docs

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-02-22 21:48:00 +01:00
Igor Fedotov
36faec6d3d
Merge pull request #55700 from wanglinke521/wlk-bluefs-dev
os/bluestore: fix the problem of l_bluefs_log_compactions double recording

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2024-02-22 23:19:10 +03:00
Igor Fedotov
15fa1d70c1
Merge pull request #54992 from ifed01/wip-ifed-enforce-min-alloc-size
os/bluestore: introduce bluestore_debug_enforce_min_alloc_size config

Reviewed-by: Pere Diaz Bou <pere-altea@hotmail.com>
2024-02-22 23:17:49 +03:00
Samuel Just
45e44956a5
Merge pull request #55407 from xxhdx1985126/wip-64282
crimson/osd/shard_services: make sure that only up/acting members can create pgs

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-22 10:45:39 -08:00
Yuval Lifshitz
365171e6ad
Merge pull request #55688 from yuvalif/wip-yuval-split-notif-test
test/rgw/notifications: split tests between basic, kafka and amqp

reviewed-by: cbodley
2024-02-22 20:10:19 +02:00
Orit Wasserman
9f86c35a0d doc: Add NVMe-oF gateway documentation
- Add nvmeof-initiator-esx.rst
- Add nvmeof-initiator-linux.rst
- Add nvmeof-initiators.rst
- Add nvmeof-overview.rst
- Add nvmeof-requirements.rst
- Add nvmeof-target-configure.rst
- Add links to rbd-integrations.rst

Co-authored-by: Ilya Dryomov <idryomov@redhat.com>
Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: Orit Wasserman <owasserm@ibm.com>
2024-02-23 03:40:17 +10:00
Ramana Raja
b7aae5c3c5 qa: Add tests to validate syncing of images using rbd-mirror
Introduce functional tests to validate that the images under
workloads are correctly mirrored between two clusters using snapshot
based mirroring.

Run workload on a primary image using a krbd or nbd client. Take
mirror snapshots of the image under workload. Unmount the mapped image
and calculate its MD5 checksum before demoting it. After demotion,
wait for the mirror status of the image to be 'up+unknown' in both
the clusters. This is to make sure that the non-primary image in the
other cluster is ready to be promoted. Now promote the non-primary
image in the other cluster. Map the promoted image and calculate its
MD5 checksum. Verify that the checksums of the demoted and promoted
images in the two clusters are the same.

The above test is run as part of two different workunits:
 - a workunit that validates the syncing of multiple mirrored images
   with workloads running on them
 - another workunit that validates the syncing of a single mirrored
   image with workload running on it and the image is set as primary
   alternatively between the two clusters, as it happens during
   failover and failback scenarios.

Fixes: https://tracker.ceph.com/issues/61617
Signed-off-by: Ramana Raja <rraja@redhat.com>
Co-authored-by: Ilya Dryomov <idryomov@redhat.com>
Co-authored-by: Christopher Hoffman <choffman@redhat.com>
2024-02-22 11:44:36 -05:00
Ramana Raja
ea3a567f7f qa/workunits: make wait_for_status_in_pool_dir() reentrant
In rbd_mirror_helpers.sh, the `wait_for_status_in_pool_dir()` helper
stored `mirror image status` and `mirror pool status` command outputs
in files that could be shared over successive calls or calls from
multiple threads. Instead store the command outputs in local variables
to make `wait_for_status_in_pool_dir()` reentrant.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2024-02-22 11:44:28 -05:00
Casey Bodley
ceeb9e5c1d
Merge pull request #55634 from cbodley/wip-64480
rgw: RGWSI_SysObj_Cache::remove() invalidates after successful delete

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2024-02-22 16:37:13 +00:00
Kefu Chai
080e386098 debian/control: replace <tab> with spaces
to be consistent with the rest of this file

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2024-02-22 23:35:45 +08:00
Igor Fedotov
a0194583ad os/bluestore: introduce bluestore_debug_enforce_min_alloc_size config
parameter.

This allows to override persistent min_alloc_size if needed.
This might be helpful to troubleshoot and work around issues like
https://tracker.ceph.com/issues/63618

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
2024-02-22 18:06:57 +03:00
Ronen Friedman
57f90b1466
Merge pull request #55583 from ronen-fr/wip-rf-hobject
osd: improve hobject_t::to_str() performance

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-22 14:31:31 +02:00
wanglinke
d06f34c5e7 os/bluestore: fix bluefs perf counters about l_bluefs_log_compactions
In BlueFS::_compact_log_sync_LNF_LD,l_bluefs_log_compactions
is being counted two times.

Fixes: https://tracker.ceph.com/issues/64533
co-author: Jrchyang Yu <yuzhiqiang_yewu@cmss.chinamobile.com>
Signed-off-by: Wang Linke <wanglinke_yewu@cmss.chinamobile.com>
2024-02-22 18:55:55 +08:00
Yuval Lifshitz
6f28930602 test/rgw/notifications: split tests between basic, kafka and amqp
see comment: https://tracker.ceph.com/issues/64184#note-3

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-02-22 09:58:00 +00:00
Matan Breizman
9bce68a14f
Merge pull request #55641 from Matan-B/wip-matanb-crimson-alien-buf-v2
crimson/osd/main: Enable multicore client messenger

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
2024-02-22 11:29:19 +02:00
Xuehan Xu
b469cbb507 crimson/os/seastore: fix wrong-positioned asserts
Fixes: https://tracker.ceph.com/issues/64535
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-22 17:03:43 +08:00
Nizamudeen A
3e76b89b9b
Merge pull request #55643 from afreen23/fix-62089
mgr/dashboard: Handle errors for /api/osd/settings

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-02-22 10:20:09 +05:30
Kefu Chai
ac1d58ab3e
Merge pull request #55328 from rosinL/wip-fix-64117
cmake/AddCephTest: bind crimson unittest to different cores

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-02-22 10:47:29 +08:00
Rongqi Sun
8d766c5717 doc/crimson: cleanup duplicate seastore description
Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
2024-02-22 10:41:43 +08:00