Commit Graph

139076 Commits

Author SHA1 Message Date
Casey Bodley
6333285a90 qa/rgw: specify cluster name in 'radosgw-admin gc process'
we create multiple ceph clusters in the multisite tests, so this command
needs to specify the target cluster name

Fixes: https://tracker.ceph.com/issues/61862

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-24 12:14:02 -04:00
Casey Bodley
84e169d5b7
Merge pull request #51772 from caisan/multisite-hang-period-update
rgw:multisite hang when update and commit period

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-07-24 10:30:39 -04:00
Casey Bodley
8612ec0641
Merge pull request #52056 from cbodley/wip-56993
rgw: s3 object lock avoids overflow in retention date

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-07-24 10:28:14 -04:00
Casey Bodley
6abe46cff1
Merge pull request #52036 from adamemerson/wip-rgw-mdlog-yield
rgw: Thread optional_yield through RGWMetadataLog operations

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-07-24 10:27:57 -04:00
Matan Breizman
3f87e4da85
Merge pull request #52529 from xxhdx1985126/wip-61943
crimson/osd/osd_operations: add pipeline to LogMissingRequest to sync it

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2023-07-24 16:54:17 +03:00
Ali Masarwa
d22df1378d
Merge pull request #52439 from AliMasarweh/wip-alimasa-persistant-q-observability
RGW: fix issue in observability over the persistent topics queue
2023-07-24 10:06:36 +03:00
Xuehan Xu
0b7c47db78 crimson/osd/osd_operations: add pipeline to LogMissingRequest to sync it
with ReplicateRequest

This commit is a follow-up for e141428949
and f4d336a2db

Fixes: https://tracker.ceph.com/issues/61943
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-07-24 13:39:55 +08:00
Yingxin
8c4d93c2d7
Merge pull request #52221 from xxhdx1985126/wip-collection-bug-fix
crimson/os/seastore/collection_manager: fill CollectionNode::decoded on clean reads

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-07-24 09:56:37 +08:00
Yingxin
cf49dbed53
Merge pull request #52446 from xxhdx1985126/wip-seastore-lazy-read-patch
crimson/os/seastore/transaction_manager: data loss issues

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-24 09:55:54 +08:00
Soumya Koduri
01bc98b489
Merge pull request #52445 from soumyakoduri/wip-skoduri-syncpolicy-fixes
rgw/sync-policy: Correct "sync status" & "sync group" commands

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-07-23 23:11:14 +05:30
Soumya Koduri
094460c26b rgw: Read sync status from only the zones allowed to sync from
Using multisite sync policy, zones within a zonegroup can be configured
not to sync from certain zones. Filter such zones while reading sync
status.

Fixes: https://tracker.ceph.com/issues/62014
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-07-23 19:51:07 +05:30
Soumya Koduri
fa5759922f rgw/sync-policy: Do not allow empty group names
Fixes: https://tracker.ceph.com/issues/62015
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-07-23 19:51:07 +05:30
zdover23
4868f0b6fb
Merge pull request #52587 from zdover23/wip-doc-2023-07-22-rados-configuration-ceph-conf-4-of-x
doc/rados: edit ceph-conf.rst (4 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-23 22:11:24 +10:00
Zac Dover
ac47899863 doc/rados: edit ceph-conf.rst (4 of x)
Edit doc/rados/configuration/ceph-conf.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-23 21:56:05 +10:00
Igor Fedotov
d71eea965d
Merge pull request #51820 from ifed01/wip-ifed-fragmentation-info
os/bluestore: introduce allocator state histogram

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>
2023-07-22 17:38:13 +03:00
zdover23
fed7e2f605
Merge pull request #52542 from zdover23/wip-doc-2023-07-19-rados-configuration-ceph-conf-3-of-x
doc/rados: edit ceph-conf.rst (3 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-22 15:25:32 +10:00
Zac Dover
b1fb80ae08 doc/rados: edit ceph-conf.rst (3 of x)
Edit doc/rados/configuration/ceph-conf.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-22 14:42:32 +10:00
Casey Bodley
4aedde734a
Merge pull request #52475 from yuvalif/wip-yuval-multisite-vstart-params
rgw/test: allow passing vstart parameters to multisite tests script

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-07-21 10:18:33 -04:00
Ilya Dryomov
6fb5be540f
Merge pull request #52057 from nbalacha/tracker-61672
rbd-mirror: fix race preventing local image deletion

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2023-07-21 12:14:57 +02:00
Yuri Weinstein
104bec4041
Merge pull request #52025 from rzarzynski/wip-ec-drop-unused-requires_overwrite
osd: drop the unused ECTransaction::requires_overwrite()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2023-07-20 17:46:56 -04:00
Ilya Dryomov
a9d794ff39
Merge pull request #52491 from cbodley/wip-61566
valgrind: replace suppression for EVP_DecryptFinal_ex

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-07-20 22:56:21 +02:00
Ilya Dryomov
cce5996425
Merge pull request #52427 from petrutlucian94/fix_win32_boost
win32_deps_build: skip patching removed boost files

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2023-07-20 21:03:19 +02:00
Casey Bodley
3281eb85ce
Merge pull request #52143 from cbodley/wip-61567
test/pybind: replace nose with pytest

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-20 14:51:05 -04:00
Anthony D'Atri
410e9a9e59
Merge pull request #52563 from zdover23/wip-doc-2023-07-21-governance-orman-email-update
doc: governance.rst - update D Orman
2023-07-20 13:54:43 -04:00
Zac Dover
46f503975e doc: governance.rst - update D Orman
Update David Orman's email address in doc/governance.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-21 03:35:52 +10:00
Laura Flores
6ded6f7a8f
Merge pull request #52544 from rhcs-dashboard/debug-make-check
install-deps: remove the legacy resolver flags
2023-07-20 12:19:41 -05:00
Casey Bodley
d6d9986315 valgrind: remove stale openssl suppressions
years ago in commit fe97a00099, the
signature of authenticated_decrypt_update_final() changed and this
suppression no longer matches its mangled form:

-  fun:_ZN4ceph6crypto6onwire25AES128GCM_OnWireRxHandler34authenticated_decrypt_update_finalEONS_6buffer7v*4listEj
+  fun:_ZN4ceph6crypto6onwire25AES128GCM_OnWireRxHandler34authenticated_decrypt_update_finalERNS_6buffer7v15_2_04listE

the fact that we didn't notice must mean that we don't need the
suppressions anymore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-20 11:10:04 -04:00
Yuri Weinstein
5a86a314f4
Merge pull request #52374 from rosinL/wip-cleanup
crush/CrushLocation: remove useless flag

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-20 10:26:10 -04:00
Casey Bodley
ef61386862 valgrind: suppress uninitialized value in OpenSSL
Fixes: https://tracker.ceph.com/issues/61566

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-20 09:22:55 -04:00
Nizamudeen A
d179b95ddf install-deps: remove the legacy resolver flags
This was a workaround that was introduced long time ago. This will be
something that could be deprectaed at some point [1]. And its preventing some of the dependencies to be
downloaded or stored into the wheelhouse. Deps like jsonschema, parse,
mypy, cryptography etc.

[1] https://pip.pypa.io/en/latest/user_guide/#deprecation-timeline

Fixes: https://tracker.ceph.com/issues/62082
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-07-20 17:16:34 +05:30
Yuri Weinstein
0b61c8659e
Merge pull request #49332 from shreyanshjain7174/stuck_peering
mon: stuck peering since warning is misleading

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
2023-07-19 12:10:32 -04:00
Yuri Weinstein
bace1df330
Merge pull request #51438 from NitzanMordhai/wip-nitzan-cbt-perf-ci
cbt perf ci

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-19 12:06:32 -04:00
Yuri Weinstein
608d14d9ec
Merge pull request #50301 from liuqinfei/support_compile_on_openeuler_main
ceph.spec.in: add support for openEuler OS

Reviewed-by: Rongqi Sun <sunrongqi@huawei.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-07-19 12:06:05 -04:00
Yuri Weinstein
ad569f6055
Merge pull request #49480 from flyingcircusio/fix-mon-delete-iterator
mon: fix iterator mishandling in PGMap::apply_incremental


Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-07-19 12:04:08 -04:00
Yuri Weinstein
a3aee41505
Merge pull request #52021 from xxhdx1985126/wip-61650
osd/PeeringState: recheck pg readability when renewing leases for no-replica pools

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-19 12:00:45 -04:00
Yuri Weinstein
38b9568458
Merge pull request #50441 from cbodley/wip-qa-distros-centos9
qa/distros: add centos stream 9 as supported distro

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2023-07-19 11:33:28 -04:00
Ilya Dryomov
a49357a6c2
Merge pull request #52124 from idryomov/wip-61733
mon/MonClient: resurrect original client_mount_timeout handling

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-07-19 11:41:55 +02:00
Matan
460e4bf672
Merge pull request #52266 from amathuria/wip-crimson-amat-fix-config-show
crimson/mgr: Fix config show command

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-19 10:45:15 +03:00
Venky Shankar
4e5d800406 Merge PR #51539 into main
* refs/pull/51539/head:
	doc: users now need to provide scrub_mdsdir and recursive flags
	qa: add recursive flag to test_flag_scrub_mdsdir
	mds: remove code to bypass dumping empty header scrub info
	mds: dump_values no more needed
	mds: enqueue ~mdsdir at the time of enqueing root

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-18 20:15:24 +05:30
Casey Bodley
21ad52551d
Merge pull request #51700 from cfsnyder/wip-cfsnyder-put-404
rgw: fix consistency bug with OLH objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-07-18 09:28:48 -04:00
Lucian Petrut
80d2d01d61 test/common: skip unittest_back_trace with mingw-gcc
We're getting an ICE when trying to compile this test using
mingw-gcc and recent Boost versions. Note that mingw-llvm works fine.

    during IPA pass: inline
    /mnt/data/workspace/ceph.pr/src/test/common/test_back_trace.cc:44:1:
    internal compiler error: Segmentation fault
       44 | }
          | ^
    0x7f9c4a86c51f ???
            ./signal/../sysdeps/unix/sysv/linux/x86_64/libc_sigaction.c:0
    0x7f9c4a853d8f __libc_start_call_main
            ../sysdeps/x86/libc-start.c:58
    0x7f9c4a853e3f __libc_start_main_impl
            ../sysdeps/nptl/libc_start_call_main.h:392

For now, we'll just skip the test when using mingw-gcc. Note
that we're planing to switch to mingw-llvm anyway:
https://github.com/ceph/ceph/pull/51197

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-07-18 12:28:12 +00:00
Lucian Petrut
9d92c2d74e win32_deps_build: skip patching removed boost files
We're attempting to patch some Python files that have been removed
from recent Boost versions.

Now that the Boost version has been bumped, we'll need to address
this in order to unblock the Windows build.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-07-18 12:28:11 +00:00
Adam Kupczyk
236f8b632f
Merge pull request #52193 from aclamk/wip-aclamk-fix-55260
os/bluestore: Fixes ceph-bluestore-tool bluefs-bdev-new-db
2023-07-18 14:27:24 +02:00
Venky Shankar
09fb085cd3 Merge PR #52173 into main
* refs/pull/52173/head:
	mds: MDLog::_recovery_thread: handle the errors gracefully

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-18 16:10:24 +05:30
Xuehan Xu
5eb473b99c crimson/os/seastore/collection_manager: fill CollectionNode::decoded on
clean reads

Otherwise, deltas of collection nodes can't be replayed correctly,
because the data of nodes is not loaded to CollectionNode::decoded

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-07-18 17:09:09 +08:00
Casey Bodley
cbdd520995 qa/suites: install pytest for pybind tasks
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-17 16:31:08 -04:00
Ali Masarwa
10addc6485 RGW: fix issue in observability over the persistent topics queue
when releasing entires, we don't decrease them in the urgent data

Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>
2023-07-17 18:13:50 +03:00
Igor Fedotov
5cdd29f78b os/bluestore: do not include single AU allocations to allocation
fragmentation stats.

The rationale is that such allocations always get single framgent.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
2023-07-17 16:25:27 +03:00
Igor Fedotov
600fc5b0f1 test/allocator_replay: introduce allocator fragmentation histogram.
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
2023-07-17 16:25:27 +03:00
Igor Fedotov
625e3461fb os/bluestore: implement allocator fragmentation histogram
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
2023-07-17 16:25:27 +03:00