Commit Graph

145670 Commits

Author SHA1 Message Date
Zac Dover
607f68759c
Merge pull request #57720 from zdover23/wip-doc-2024-05-27-cephfs-fs-volumes
doc/cephfs: s/subvolumegroups/subvolume groups

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-05-28 20:14:22 +10:00
Yuval Lifshitz
73b55f03cb
Merge pull request #57638 from yuvalif/wip-yuval-66033
test/rgw/notifications: allow http server to buffer more requests

Reviewed-By: Casey Bodley <cbodley@ibm.com>
2024-05-28 10:33:23 +03:00
Kefu Chai
700916cbab
Merge pull request #57700 from tchaikov/wip-mgr-prometheus-packaging
mgr/prometheus: s/pkg_resources.packaging/packaging/

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2024-05-28 09:08:04 +08:00
Ilya Dryomov
0cd602b1d1
Merge pull request #57671 from idryomov/wip-labeler-qa
.github: expand tests label to all files under qa

Reviewed-by: Ramana Raja <rraja@redhat.com>
2024-05-27 16:12:20 +02:00
Zac Dover
7ad607615e
Merge pull request #57628 from joscollin/wip-B66173-doc-per-client-metrics
doc: document metrics exported by CephFS

Reviewed-by: Zac Dover <zac.dover@proton.me>
2024-05-27 22:59:06 +10:00
Zac Dover
b303417f65 doc/cephfs: s/subvolumegroups/subvolume groups
Use the term "subvolume groups" instead of "subvolumegroups" where the
term appears in plain English. The string "subvolumegroups" is correct
in commands, and remains unchanged.

Also add formatting to command output, to make clearer that the output
is indeed output.

Fixes: https://github.com/ceph/ceph/pull/57574#discussion_r1606988766

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-05-27 21:09:40 +10:00
Jos Collin
f8f47852f3
doc: document metrics exported by CephFS
Fixes: https://tracker.ceph.com/issues/66173
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-05-27 14:42:56 +05:30
Nizamudeen A
423a086601
Merge pull request #57584 from rhcs-dashboard/dashboard-pendingreleasenotes
doc: Update pendingreleasenotes for dashboard

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2024-05-27 00:51:12 -04:00
Patrick Donnelly
2815aea2c5
Merge PR #57393 into main
* refs/pull/57393/head:
	doc/man: add missing long option switches

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2024-05-25 20:51:35 -04:00
Ilya Dryomov
1ec2f264a2
Merge pull request #57609 from Svelar/asan_rbd_mirror
test/rbd-mirror: free remote_journaler in PrepareRemoteImageRequest tests

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-05-25 23:42:07 +02:00
Yuval Lifshitz
5717482a06
Merge pull request #56033 from yuvalif/wip-yuval-kafka-cleanup
rgw/kafka: do not destroy the connection on errors

Reviewed-By: Krunal Chheda <kchheda3@bloomberg.net>, Casey Bodley <cbodley@ibm.com>
2024-05-25 18:29:05 +03:00
Anthony D'Atri
4ff73880b1
Merge pull request #57701 from zdover23/wip-doc-2024-05-25-cephfs-fs-volumes
doc/cephfs: disambiguate two sentences
2024-05-25 09:48:39 -04:00
Zac Dover
32155e2360 doc/cephfs: disambiguate two sentences
Rewrite two sentences so that they are unambgiuously in the indicative
mood and not, as they previously seemed, in the imperative mood.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-05-25 18:41:03 +10:00
Rongqi Sun
27eb87b799 test/rbd: free remote_journaler in PrepareRemoteImageRequest tests
When sanitizer is enabled, unittest_rbd_mirror shows

```
=================================================================
==1377627==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 2 byte(s) in 2 object(s) allocated from:
    #0 0xaaaac462d088 in operator new(unsigned long) (/root/ceph/build/bin/unittest_rbd_mirror+0x30cd088) (BuildId: 054d3b6699c622daad91c7f70e36616220fbd5ad)
    #1 0xaaaac522f13c in rbd:🪞:image_replayer::PrepareRemoteImageRequest<librbd::(anonymous namespace)::MockTestImageCtx>::get_client() /root/ceph/src/tools/rbd_mirror/image_replayer/PrepareRemoteImageRequest.cc:148:24
    #2 0xaaaac522e60c in rbd:🪞:image_replayer::PrepareRemoteImageRequest<librbd::(anonymous namespace)::MockTestImageCtx>::handle_get_mirror_info(int) /root/ceph/src/tools/rbd_mirror/image_replayer/PrepareRemoteImageRequest.cc:120:5
    #3 0xaaaac5232d1c in librbd::util::detail::C_CallbackAdapter<rbd:🪞:image_replayer::PrepareRemoteImageRequest<librbd::(anonymous namespace)::MockTestImageCtx>, &(rbd:🪞:image_replayer::PrepareRemoteImageRequest<librbd::(anonymous namespace)::MockTestImageCtx>::handle_get_mirror_info(int))>::finish(int) /root/ceph/src/librbd/Utils.h:63:5
    #4 0xaaaac4863428 in Context::complete(int) /root/ceph/src/include/Context.h:99:5
    #5 0xaaaac489ac30 in librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()::operator()() const /root/ceph/src/librbd/asio/ContextWQ.h:31:12
    #6 0xaaaac489aaf4 in boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>::operator()() /root/ceph/build/boost/include/boost/asio/detail/bind_handler.hpp:60:5
    #7 0xaaaac489aaac in void boost::asio::asio_handler_invoke<boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()> >(boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>&, ...) /root/ceph/build/boost/include/boost/asio/handler_invoke_hook.hpp:88:3
    #8 0xaaaac489aa4c in void boost_asio_handler_invoke_helpers::invoke<boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>, librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>(boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>&, librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()&) /root/ceph/build/boost/include/boost/asio/detail/handler_invoke_helpers.hpp:54:3
    #9 0xaaaac489a9ec in void boost::asio::detail::asio_handler_invoke<boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>, librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>(boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>&, boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>*) /root/ceph/build/boost/include/boost/asio/detail/bind_handler.hpp:111:3
    #10 0xaaaac4899c00 in void boost_asio_handler_invoke_helpers::invoke<boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>, boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()> >(boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>&, boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>&) /root/ceph/build/boost/include/boost/asio/detail/handler_invoke_helpers.hpp:54:3
    #11 0xaaaac489c814 in boost::asio::detail::executor_op<boost::asio::detail::binder0<librbd::asio::ContextWQ::queue(Context*, int)::'lambda'()>, std::allocator<void>, boost::asio::detail::scheduler_operation>::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long) /root/ceph/build/boost/include/boost/asio/detail/executor_op.hpp:71:7
    #12 0xaaaac489fb4c in boost::asio::detail::scheduler_operation::complete(void*, boost::system::error_code const&, unsigned long) /root/ceph/build/boost/include/boost/asio/detail/scheduler_operation.hpp:40:5
    #13 0xaaaac489f074 in boost::asio::detail::strand_executor_service::run_ready_handlers(std::shared_ptr<boost::asio::detail::strand_executor_service::strand_impl>&) /root/ceph/build/boost/include/boost/asio/detail/impl/strand_executor_service.ipp:150:8
    #14 0xaaaac489ed2c in boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void>::operator()() /root/ceph/build/boost/include/boost/asio/detail/impl/strand_executor_service.hpp:136:5
    #15 0xaaaac489ebd4 in void boost::asio::asio_handler_invoke<boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void> >(boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void>&, ...) /root/ceph/build/boost/include/boost/asio/handler_invoke_hook.hpp:88:3
    #16 0xaaaac489e284 in void boost_asio_handler_invoke_helpers::invoke<boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void>, boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void> >(boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void>&, boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void>&) /root/ceph/build/boost/include/boost/asio/detail/handler_invoke_helpers.hpp:54:3
    #17 0xaaaac48a3e08 in boost::asio::detail::executor_op<boost::asio::detail::strand_executor_service::invoker<boost::asio::io_context::basic_executor_type<std::allocator<void>, 0ul> const, void>, std::allocator<void>, boost::asio::detail::scheduler_operation>::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long) /root/ceph/build/boost/include/boost/asio/detail/executor_op.hpp:71:7
    #18 0xaaaac489fb4c in boost::asio::detail::scheduler_operation::complete(void*, boost::system::error_code const&, unsigned long) /root/ceph/build/boost/include/boost/asio/detail/scheduler_operation.hpp:40:5
    #19 0xaaaac6766b1c in boost::asio::detail::scheduler::do_run_one(boost::asio::detail::conditionally_enabled_mutex::scoped_lock&, boost::asio::detail::scheduler_thread_info&, boost::system::error_code const&) /root/ceph/build/boost/include/boost/asio/detail/impl/scheduler.ipp:493:12
    #20 0xaaaac67660a4 in boost::asio::detail::scheduler::run(boost::system::error_code&) /root/ceph/build/boost/include/boost/asio/detail/impl/scheduler.ipp:210:10
    #21 0xaaaac7562d48 in boost::asio::io_context::run() /root/ceph/build/boost/include/boost/asio/impl/io_context.ipp:64:24
    #22 0xaaaac7562bcc in ceph::async::io_context_pool::start(short)::'lambda'()::operator()() const /root/ceph/src/common/async/context_pool.h:69:16
    #23 0xaaaac7562b18 in void std::__invoke_impl<void, ceph::async::io_context_pool::start(short)::'lambda'()>(std::__invoke_other, ceph::async::io_context_pool::start(short)::'lambda'()&&) /usr/bin/../lib/gcc/aarch64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:61:14
    #24 0xaaaac7562960 in std::__invoke_result<ceph::async::io_context_pool::start(short)::'lambda'()>::type std::__invoke<ceph::async::io_context_pool::start(short)::'lambda'()>(ceph::async::io_context_pool::start(short)::'lambda'()&&) /usr/bin/../lib/gcc/aarch64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:96:14
    #25 0xaaaac7562804 in std::invoke_result<ceph::async::io_context_pool::start(short)::'lambda'()>::type std::invoke<ceph::async::io_context_pool::start(short)::'lambda'()>(ceph::async::io_context_pool::start(short)::'lambda'()&&) /usr/bin/../lib/gcc/aarch64-linux-gnu/11/../../../../include/c++/11/functional:97:14
    #26 0xaaaac75627dc in auto std::thread make_named_thread<ceph::async::io_context_pool::start(short)::'lambda'()>(std::basic_string_view<char, std::char_traits<char> >, ceph::async::io_context_pool::start(short)::'lambda'()&&)::'lambda'(ceph::async::io_context_pool::start(short)::'lambda'()&&)::operator()<ceph::async::io_context_pool::start(short)::'lambda'()>(ceph::async::io_context_pool::start(short)::'lambda'()&&) const /root/ceph/src/common/Thread.h:79:10
    #27 0xaaaac7562728 in ceph::async::io_context_pool::start(short)::'lambda'() std::__invoke_impl<void, std::thread make_named_thread<ceph::async::io_context_pool::start(short)::'lambda'()>(std::basic_string_view<char, std::char_traits<char> >, ceph::async::io_context_pool::start(short)::'lambda'()&&)::'lambda'(ceph::async::io_context_pool::start(short)::'lambda'()&&), ceph::async::io_context_pool::start(short)::'lambda'()>(std::__invoke_other, std::thread make_named_thread<ceph::async::io_context_pool::start(short)::'lambda'()>(std::basic_string_view<char, std::char_traits<char> >, ceph::async::io_context_pool::start(short)::'lambda'()&&)::'lambda'(ceph::async::io_context_pool::start(short)::'lambda'()&&)&&, ceph::async::io_context_pool::start(short)::'lambda'()&&) /usr/bin/../lib/gcc/aarch64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:61:14
    #28 0xaaaac75624ec in std::__invoke_result<ceph::async::io_context_pool::start(short)::'lambda'()>::type std::__invoke<std::thread make_named_thread<ceph::async::io_context_pool::start(short)::'lambda'()>(std::basic_string_view<char, std::char_traits<char> >, ceph::async::io_context_pool::start(short)::'lambda'()&&)::'lambda'(ceph::async::io_context_pool::start(short)::'lambda'()&&), ceph::async::io_context_pool::start(short)::'lambda'()>(ceph::async::io_context_pool::start(short)::'lambda'()&&) /usr/bin/../lib/gcc/aarch64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:96:14
    #29 0xaaaac756231c in void std:🧵:_Invoker<std::tuple<std::thread make_named_thread<ceph::async::io_context_pool::start(short)::'lambda'()>(std::basic_string_view<char, std::char_traits<char> >, ceph::async::io_context_pool::start(short)::'lambda'()&&)::'lambda'(ceph::async::io_context_pool::start(short)::'lambda'()&&), ceph::async::io_context_pool::start(short)::'lambda'()> >::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) /usr/bin/../lib/gcc/aarch64-linux-gnu/11/../../../../include/c++/11/bits/std_thread.h:259:13

SUMMARY: AddressSanitizer: 2 byte(s) leaked in 2 allocation(s).
```

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
2024-05-25 08:32:41 +00:00
Kefu Chai
f3ff76a392
Merge pull request #57693 from tchaikov/cmake-shec_utils
cmake: : link shec_utils against legacy-option-headers

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-05-25 15:57:27 +08:00
Kefu Chai
844b66de41 mgr/prometheus: s/pkg_resources.packaging/packaging/
instead of relying on the internal implementation of pkg_resources,
let's import packaging directly.

in this change, we also add the dependency to the packaging module
in the packaging recipes.

See also https://github.com/pypa/setuptools/issues/4385

Fixes https://tracker.ceph.com/issues/66201
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2024-05-25 15:22:32 +08:00
Patrick Donnelly
15eaef742e
Merge PR #57686 into main
* refs/pull/57686/head:
	script/ceph-backport: update Ceph PR id

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
2024-05-24 16:43:40 -04:00
Venky Shankar
af71de46d8
Merge pull request #57689 from kotreshhr/fix_unpack_first_damage
tools/first-damage: Fix struct unpack

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-05-24 16:11:57 +05:30
Kefu Chai
02bd5e1b7f cmake: : link shec_utils against legacy-option-headers
in c24a6ffe20, we tried to link all target dependent on legacy option
headers against legacy-option-headers, but we missed some of them.
in our CI, we spotted build failure like:
```
In file included from /home/jenkins-build/build/workspace/ceph-pull-requests/src/erasure-code/ErasureCode.cc:26:
In file included from /home/jenkins-build/build/workspace/ceph-pull-requests/src/osd/osd_types.h:41:
In file included from /home/jenkins-build/build/workspace/ceph-pull-requests/src/common/ceph_context.h:41:
In file included from /home/jenkins-build/build/workspace/ceph-pull-requests/src/common/config_proxy.h:6:
In file included from /home/jenkins-build/build/workspace/ceph-pull-requests/src/common/config.h:27:
In file included from /home/jenkins-build/build/workspace/ceph-pull-requests/src/common/config_values.h:59:
/home/jenkins-build/build/workspace/ceph-pull-requests/src/common/options/legacy_config_opts.h:1:10: fatal error: 'global_legacy_options.h' file not found
         ^~~~~~~~~~~~~~~~~~~~~~~~~
1 error generated.
```
so in this change, we link the shec_utils to `legacy-option-headers`
as well to fulfill the build dependency.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2024-05-24 17:53:33 +08:00
Kotresh HR
df2d65c5ae tools/first-damage: Fix struct unpack
The first field is a 64 bit integer, the script
was unpacking it as 32 bit integer. Fixed the
same.

Also printing the 'first' value in debug

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2024-05-24 13:47:00 +05:30
Yingxin
9637ffe6f9
Merge pull request #57654 from zhscn/fix-error
crimson/os/seastore: fix compile error in release build

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-05-24 10:28:55 +08:00
Yingxin
03ea719c36
Merge pull request #57656 from Matan-B/wip-matanb-crimson-get-param
test/crimson/seastore/transaction_manager_test_state: fix compilation…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-05-24 09:39:27 +08:00
Patrick Donnelly
f1874b7e95
script/ceph-backport: update Ceph PR id
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-23 20:52:41 -04:00
Casey Bodley
6ce969b287
Merge pull request #57188 from cbodley/wip-boost-asio-yield-group
common/async: add primitives for structured concurrency with optional_yield

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2024-05-23 18:22:24 +01:00
Casey Bodley
c3eda279c2
Merge pull request #57630 from cbodley/wip-boost-asio-spawn-unlock
rgw/pubsub: Waiter unlocks before suspend

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-05-23 18:15:41 +01:00
Ilya Dryomov
0543b9264f .github: expand tests label to all files under qa
The test job definition under qa/suites is an integral part of almost
any test.  Often, the test logic is split between the task or workunit
and respective snippet(s) under qa/suites.

Other files under qa are less used, but still related to nothing but
testing, so just add the label on all of it.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2024-05-23 18:28:24 +02:00
Zac Dover
36499642a0
Merge pull request #57554 from zdover23/wip-doc-2024-05-20-cephfs-fs-volumes-fs-subvolumes-sections
doc/cephfs: separate commands into sections

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-05-24 00:47:54 +10:00
Zac Dover
5789fdef05
Merge pull request #57567 from zdover23/wip-doc-2024-05-20-cephfs-fs-volumes-cloning-snapshots
doc/cephfs: edit "Cloning Snapshots" in fs-volumes.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-05-24 00:21:54 +10:00
Zac Dover
88582e0590
Merge pull request #57574 from zdover23/wip-doc-2024-05-21-cephfs-fs-volumes-pinning-subvolumes
doc/cephfs: edit "Pinning Subvolumes..."

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-05-24 00:14:00 +10:00
Casey Bodley
25017d6196 common/async: add max_concurrent_for_each() algorithm
inspired by seastar's max_concurrent_for_each(), implemented for
optional_yield in terms of yield_throttle

can also be overloaded for co_await() and co_throttle (not part of this
branch)

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-05-23 09:06:06 -04:00
Matan Breizman
8a182dffc1 test/crimson/seastore/transaction_manager_test_state: fix compilation error
Introduced in: 898efa78e2

Followup: https://github.com/ceph/ceph/pull/53433

```
FAILED: src/crimson/tools/CMakeFiles/perf-staged-fltree.dir/perf_staged_fltree.cc.o
 error: ‘GetParam’ was not declared in this scope
  287 |     if (std::get<1>(GetParam()) == integrity_check_t::FULL_CHECK) {
      |                     ^~~~~~~~
/home/yogisha/ceph/src/test/crimson/seastore/transaction_manager_test_state.h: In member function ‘virtual seastar::future<> SeaStoreTestState::_init()’:
/home/yogisha/ceph/src/test/crimson/seastore/transaction_manager_test_state.h:439:21: error: ‘GetParam’ was not declared in this scope
  439 |     if (std::get<1>(GetParam()) == integrity_check_t::FULL_CHECK) {
      |                     ^~~~~~~~
```

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-05-23 11:06:41 +00:00
Yuval Lifshitz
ef9bf76518
Merge pull request #57639 from yuvalif/wip-yuval-skip-reload-tests
test/rgw/notifications: skip reload tests when there is no realm

Reviewed-By: ali.masarwa@ibm.com
2024-05-23 13:54:29 +03:00
Zhang Song
36c7eb73fe crimson/os/seastore: fix compile error in release build
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-05-23 17:12:06 +08:00
Nizamudeen A
ef3e179b99 doc: Update pendingreleasenotes for dashboard
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-05-23 12:12:29 +05:30
Zac Dover
de7b8ac030
Merge pull request #57633 from mcv21/patch-1
Docs: clarify use of location: in host spec

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Adam King <adking@redhat.com>
2024-05-23 11:26:07 +10:00
Patrick Donnelly
c3463d5005
Merge PR #57493 into main
* refs/pull/57493/head:
	qa/cephfs: pass MDS name, not FS name, to "ceph mds fail" cmd

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-22 21:18:17 -04:00
Patrick Donnelly
eb10f3df6e
Merge PR #57469 into main
* refs/pull/57469/head:
	mds: set dispatcher order
	mds: use regular dispatch for processing beacons
	msg: add priority to dispatcher invocation order
	mds: note when dispatcher is called

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
2024-05-22 21:16:32 -04:00
Patrick Donnelly
6b2942f89e
Merge PR #57392 into main
* refs/pull/57392/head:
	common/Formatter: use CachedStackStringStream for efficiency

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-05-22 21:15:57 -04:00
Patrick Donnelly
8b6d0c77a6
Merge PR #57374 into main
* refs/pull/57374/head:
	common/Formatter: trivial cons/des should be default

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-05-22 21:15:33 -04:00
Patrick Donnelly
3767887144
Merge PR #57215 into main
* refs/pull/57215/head:
	doc: document new --output-file switch
	test/cli: ignore tmp_file_template
	qa/workunits: add --output-file test in cephtool workunit
	common,ceph: add output file switch to dump json to
	common/options: add configs for temporary files made by daemons
	common/Formatter: write the pending string on flush

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2024-05-22 21:15:07 -04:00
Patrick Donnelly
8a59d49311
Merge PR #57170 into main
* refs/pull/57170/head:
	client: set LIBMOUNT_FORCE_MOUNT2=always

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2024-05-22 21:12:24 -04:00
Patrick Donnelly
52d39c3398
Merge PR #57081 into main
* refs/pull/57081/head:
	messages/MClientMetrics: increase priority ahead of regular requests
	mds: use regular dispatch for processing metrics

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-05-22 21:11:52 -04:00
Dan Mick
f7240f874c
Merge pull request #57642 from dmick/wip-release-doc
doc/dev/release-process.rst: note new 'project' arguments
2024-05-22 17:59:16 -07:00
Dan Mick
7e64c6386e doc/dev/release-process.rst: note new 'project' arguments
Support added to the release scripts (from ceph-build.git) to
work for ceph-iscsi, so 'project' must be passed to these scripts,
and will appear in the prerelease pathnames.  See also
https://github.com/ceph/ceph-build/pull/2243 and
https://github.com/ceph/ceph-container/pull/2210

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2024-05-22 16:14:16 -07:00
Casey Bodley
c7a49fa2f3
Merge pull request #57575 from cbodley/wip-rgw-maintainers-ali
rgw: remove Ali Maredia from MAINTAINERS.md

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2024-05-22 22:25:49 +01:00
Casey Bodley
0da024f928 common/async: add spawn_throttle for bounded concurrency with optional_yield
a primitive for structured concurrency with stackful coroutines from
boost::asio::spawn(). this relies on spawn()'s support for per-op
cancellation to guarantee that the lifetime of child coroutines won't
exceed the lifetime of their spawn_throttle, making it safe for children
to access memory from their parent's stack

by taking optional_yield in the constructor, spawn_throttle transparently
supports synchronous execution (where optional_yield is empty) and
asynchronous execution within a stackful coroutine (where optional_yield
contains the parent's yield_context)

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-05-22 17:02:15 -04:00
Yuval Lifshitz
a94db0f179 test/rgw/notifications: skip reload tests when there is no realm
this does not impact teuthology, only local runs.
in teuthology all bucket notification tests are defined with a realm

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-05-22 19:04:45 +00:00
Yuval Lifshitz
454f6f764f test/rgw/notifications: allow http server to buffer more requests
python doc:
https://docs.python.org/3/library/socketserver.html#socketserver.ThreadingMixIn
say tha the default is 5

Fixes: https://tracker.ceph.com/issues/66033

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-05-22 18:48:23 +00:00
Yuval Lifshitz
1b6e850156 rgw/kafka: do not destroy the connection on errors
as well as other simplifications:
* do not store temporary configuration in the connection object. just
  use as a local variable
* do not create a connection without a producer

other improvements:
* copy to a local list before publishing
* convert internal error codes to errno

Fixes: https://tracker.ceph.com/issues/66017

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
2024-05-22 18:29:45 +00:00
Casey Bodley
e4d5b4e937 common/async: add cancel_on_error enum
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-05-22 13:58:54 -04:00