Commit Graph

139104 Commits

Author SHA1 Message Date
Frank S. Filz
6b50da636d test: Add nonblocking I/O client test
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:04 -07:00
Frank S. Filz
b4e39f3ecc libcephfs: Add nonblocking readv/writev I/O interface
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
94b55cbb99 Client: Add ll_preadv_pwritev to expose non-blocking I/O to libcephfs
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
1210ddf7a1 Client: Add non-blocking helper classes
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
162935c036 Client: Break some code into new methods in prep for non-blocking I/O
These bits of code need to be invoked from a separate spot when we
introduce non-blocking I/O, so break them out now.

Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
d3c3bf5b77 Buffers: Add function to buffer.h to copy bufferlist to an iovec
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
bf98aec6d3 ObjectCacher: Prepare file_write path for non-blocking I/O
For non-blocking I/O, we will want to be able to override
block_writes_upfront so rename the member cfg_block_writes_upfront and add
an option to pass block_writes_upfront as a parameter along with a member
access method so caller can pass cfg_block_writes_upfront.

Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:02 -07:00
Casey Bodley
3f09d56bed
Merge pull request #52521 from cbodley/wip-62059
valgrind: update suppression for SyscallParam under call_init

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2023-07-24 14:06:01 -04:00
Neha Ojha
7cb0e36fc4
Merge pull request #52601 from idryomov/wip-doc-redundant-tiering-note
doc/rados: remove redundant cache tiering deprecation note

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-07-24 10:06:23 -07:00
Rishabh Dave
211621588b
Merge pull request #51934 from kotreshhr/fix-assert-rename
mds: Fix the linkmerge assert check

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-07-24 21:44:27 +05:30
Yuval Lifshitz
cc450e23e6
Merge pull request #52473 from vedanshbhartia/null_deref
rgw: add coverity annotations and asserts for null dereferences
2023-07-24 19:11:44 +03:00
Yuval Lifshitz
589535e0e7
Merge pull request #52437 from vedanshbhartia/coverity_missing_break
rgw: Add coverity annotation for missing break statement in switch
2023-07-24 19:11:01 +03:00
Yuval Lifshitz
2ad5a66cd8
Merge pull request #52436 from vedanshbhartia/coverity_logical_dead
rgw: Remove logically dead code
2023-07-24 19:10:08 +03:00
Yuval Lifshitz
4aa76cc98a
Merge pull request #52434 from vedanshbhartia/coverity_1511179
rgw: Fix potential null pointer dereference in rgw_user.cc
2023-07-24 19:08:06 +03:00
Yuval Lifshitz
45b81cdba6
Merge pull request #52433 from vedanshbhartia/coverity_1510266
rgw: When finding bucket owner info, handle account name being empty
2023-07-24 19:07:31 +03:00
Yuval Lifshitz
7876f44d2a
Merge pull request #52432 from vedanshbhartia/coverity_1511177
rgw: Fix potential null dereference error in bucket name parsing
2023-07-24 19:06:42 +03:00
Yuval Lifshitz
c065a24d98
Merge pull request #52253 from vedanshbhartia/coverity_1515338
rgw: Init res id with cls_2pc_reservation::NO_ID
2023-07-24 19:05:04 +03:00
Yuval Lifshitz
c4754156da
Merge pull request #51648 from vedanshbhartia/coverity_1510684
rgw: refactor D3nDataCache::d3n_io_write to avoid resource leaks
2023-07-24 19:04:08 +03:00
Casey Bodley
84e169d5b7
Merge pull request #51772 from caisan/multisite-hang-period-update
rgw:multisite hang when update and commit period

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-07-24 10:30:39 -04:00
Casey Bodley
8612ec0641
Merge pull request #52056 from cbodley/wip-56993
rgw: s3 object lock avoids overflow in retention date

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-07-24 10:28:14 -04:00
Casey Bodley
6abe46cff1
Merge pull request #52036 from adamemerson/wip-rgw-mdlog-yield
rgw: Thread optional_yield through RGWMetadataLog operations

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-07-24 10:27:57 -04:00
Casey Bodley
063721da35 valgrind: update suppression for SyscallParam under call_init
centos9 has a slightly different call stack here

Fixes: https://tracker.ceph.com/issues/62059

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-24 10:16:18 -04:00
Matan Breizman
3f87e4da85
Merge pull request #52529 from xxhdx1985126/wip-61943
crimson/osd/osd_operations: add pipeline to LogMissingRequest to sync it

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2023-07-24 16:54:17 +03:00
Ilya Dryomov
12ccd29466 doc/rados: remove redundant cache tiering deprecation note
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-07-24 15:01:26 +02:00
Ali Masarwa
d22df1378d
Merge pull request #52439 from AliMasarweh/wip-alimasa-persistant-q-observability
RGW: fix issue in observability over the persistent topics queue
2023-07-24 10:06:36 +03:00
Xuehan Xu
0b7c47db78 crimson/osd/osd_operations: add pipeline to LogMissingRequest to sync it
with ReplicateRequest

This commit is a follow-up for e141428949
and f4d336a2db

Fixes: https://tracker.ceph.com/issues/61943
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-07-24 13:39:55 +08:00
Yingxin
8c4d93c2d7
Merge pull request #52221 from xxhdx1985126/wip-collection-bug-fix
crimson/os/seastore/collection_manager: fill CollectionNode::decoded on clean reads

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-07-24 09:56:37 +08:00
Yingxin
cf49dbed53
Merge pull request #52446 from xxhdx1985126/wip-seastore-lazy-read-patch
crimson/os/seastore/transaction_manager: data loss issues

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-24 09:55:54 +08:00
Soumya Koduri
01bc98b489
Merge pull request #52445 from soumyakoduri/wip-skoduri-syncpolicy-fixes
rgw/sync-policy: Correct "sync status" & "sync group" commands

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-07-23 23:11:14 +05:30
Soumya Koduri
094460c26b rgw: Read sync status from only the zones allowed to sync from
Using multisite sync policy, zones within a zonegroup can be configured
not to sync from certain zones. Filter such zones while reading sync
status.

Fixes: https://tracker.ceph.com/issues/62014
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-07-23 19:51:07 +05:30
Soumya Koduri
fa5759922f rgw/sync-policy: Do not allow empty group names
Fixes: https://tracker.ceph.com/issues/62015
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-07-23 19:51:07 +05:30
zdover23
4868f0b6fb
Merge pull request #52587 from zdover23/wip-doc-2023-07-22-rados-configuration-ceph-conf-4-of-x
doc/rados: edit ceph-conf.rst (4 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-23 22:11:24 +10:00
Zac Dover
ac47899863 doc/rados: edit ceph-conf.rst (4 of x)
Edit doc/rados/configuration/ceph-conf.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-23 21:56:05 +10:00
Igor Fedotov
d71eea965d
Merge pull request #51820 from ifed01/wip-ifed-fragmentation-info
os/bluestore: introduce allocator state histogram

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>
2023-07-22 17:38:13 +03:00
zdover23
fed7e2f605
Merge pull request #52542 from zdover23/wip-doc-2023-07-19-rados-configuration-ceph-conf-3-of-x
doc/rados: edit ceph-conf.rst (3 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-22 15:25:32 +10:00
Zac Dover
b1fb80ae08 doc/rados: edit ceph-conf.rst (3 of x)
Edit doc/rados/configuration/ceph-conf.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-22 14:42:32 +10:00
Casey Bodley
4aedde734a
Merge pull request #52475 from yuvalif/wip-yuval-multisite-vstart-params
rgw/test: allow passing vstart parameters to multisite tests script

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-07-21 10:18:33 -04:00
Ilya Dryomov
6fb5be540f
Merge pull request #52057 from nbalacha/tracker-61672
rbd-mirror: fix race preventing local image deletion

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2023-07-21 12:14:57 +02:00
Yuri Weinstein
104bec4041
Merge pull request #52025 from rzarzynski/wip-ec-drop-unused-requires_overwrite
osd: drop the unused ECTransaction::requires_overwrite()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2023-07-20 17:46:56 -04:00
Ilya Dryomov
a9d794ff39
Merge pull request #52491 from cbodley/wip-61566
valgrind: replace suppression for EVP_DecryptFinal_ex

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-07-20 22:56:21 +02:00
Ilya Dryomov
cce5996425
Merge pull request #52427 from petrutlucian94/fix_win32_boost
win32_deps_build: skip patching removed boost files

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2023-07-20 21:03:19 +02:00
Casey Bodley
3281eb85ce
Merge pull request #52143 from cbodley/wip-61567
test/pybind: replace nose with pytest

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-20 14:51:05 -04:00
Anthony D'Atri
410e9a9e59
Merge pull request #52563 from zdover23/wip-doc-2023-07-21-governance-orman-email-update
doc: governance.rst - update D Orman
2023-07-20 13:54:43 -04:00
Zac Dover
46f503975e doc: governance.rst - update D Orman
Update David Orman's email address in doc/governance.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-21 03:35:52 +10:00
Laura Flores
6ded6f7a8f
Merge pull request #52544 from rhcs-dashboard/debug-make-check
install-deps: remove the legacy resolver flags
2023-07-20 12:19:41 -05:00
Casey Bodley
d6d9986315 valgrind: remove stale openssl suppressions
years ago in commit fe97a00099, the
signature of authenticated_decrypt_update_final() changed and this
suppression no longer matches its mangled form:

-  fun:_ZN4ceph6crypto6onwire25AES128GCM_OnWireRxHandler34authenticated_decrypt_update_finalEONS_6buffer7v*4listEj
+  fun:_ZN4ceph6crypto6onwire25AES128GCM_OnWireRxHandler34authenticated_decrypt_update_finalERNS_6buffer7v15_2_04listE

the fact that we didn't notice must mean that we don't need the
suppressions anymore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-20 11:10:04 -04:00
Yuri Weinstein
5a86a314f4
Merge pull request #52374 from rosinL/wip-cleanup
crush/CrushLocation: remove useless flag

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-20 10:26:10 -04:00
Casey Bodley
ef61386862 valgrind: suppress uninitialized value in OpenSSL
Fixes: https://tracker.ceph.com/issues/61566

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-20 09:22:55 -04:00
Nizamudeen A
d179b95ddf install-deps: remove the legacy resolver flags
This was a workaround that was introduced long time ago. This will be
something that could be deprectaed at some point [1]. And its preventing some of the dependencies to be
downloaded or stored into the wheelhouse. Deps like jsonschema, parse,
mypy, cryptography etc.

[1] https://pip.pypa.io/en/latest/user_guide/#deprecation-timeline

Fixes: https://tracker.ceph.com/issues/62082
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-07-20 17:16:34 +05:30
Yuri Weinstein
0b61c8659e
Merge pull request #49332 from shreyanshjain7174/stuck_peering
mon: stuck peering since warning is misleading

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
2023-07-19 12:10:32 -04:00