Commit Graph

138542 Commits

Author SHA1 Message Date
Casey Bodley
c9e873cc52 qa/distos: centos9 enables ceph/el9 copr
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 10:41:46 -04:00
Casey Bodley
5e0985a70a qa/distros/supported-random: add centos_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 10:41:46 -04:00
Casey Bodley
9d2450a7aa qa/distros/supported: update centos_latest.yaml and add centos_8.stream.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 10:41:46 -04:00
Casey Bodley
a85f50c24b qa/distros/all: add centos_latest.yaml symlink to centos_9.stream.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 10:41:46 -04:00
Casey Bodley
69fe8543df qa/distros/all: add centos_9.stream.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 10:41:46 -04:00
Mark Kogan
bcf5df86fc
Merge pull request #51819 from mkogan1/wip-d3n-obj-w-slash
rgw: D3N: cache objects which oid contains slash
2023-06-22 17:28:12 +03:00
Yuval Lifshitz
e36a5fc393
Merge pull request #52129 from yuvalif/wip-yuval-kafka-memleak
rgw/kafka: fix potential memory leak when push to queue fails
2023-06-22 11:09:45 +03:00
Matan
af70f82f1e
Merge pull request #51961 from Matan-B/wip-matanb-crimson-single-mosdmap-handling
Crimson/osd: Disable concurrent MOSDMap handling

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-06-22 10:17:47 +03:00
Yuri Weinstein
d05da0b4d1
Merge pull request #52072 from NitzanMordhai/wip-nitzan-add-ec-clay-teuthology-tests
qa: adding clay test to thrash erasure code big

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-06-21 17:16:00 -04:00
Yuri Weinstein
feb98924e8
Merge pull request #51667 from Matan-B/wip-matanb-share-osdmap
osd/OSD: cleanup OSDService::maybe_share_map()

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-06-21 17:12:38 -04:00
Yuri Weinstein
b1ed114a66
Merge pull request #51450 from batrick/i59716
pybind/rados: keep byte representation if decode fails

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-06-21 17:12:08 -04:00
Casey Bodley
7c9486412d
Merge pull request #50206 from TRYTOBE8TME/wip-rgw-yield-work
rgw: replace null_yields with optional ones

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-06-21 14:52:20 -04:00
zdover23
a0766f1254
Merge pull request #52123 from zdover23/wip-doc-2023-06-20-rados-operations-control-1-of-x
doc/rados: edit control.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-21 23:34:55 +10:00
Zac Dover
d14b828a1a doc/rados: edit control.rst (1 of x)
Edit doc/rados/operations/control.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-21 22:53:12 +10:00
Ilya Dryomov
ca20127c70
Merge pull request #52109 from idryomov/wip-61616
librbd: avoid object map corruption in snapshots taken under I/O

Reviewed-by: Mykola Golub <mgolub@suse.com>
2023-06-21 11:43:26 +02:00
Ilya Dryomov
acb270a3dd qa/workunits/rbd: make continuous export-diff test actually work
The current version is pretty useless:

- "rbd bench" writes the same byte (0xff) over and over again, so
  almost all checksumming is in vain
- snapshots are taken in a steady state (i.e. not under I/O), so no
  race conditions can get exposed
- even with these caveats, it's not wired up into the suite

Redo this workunit to be a reliable reproducer for the issue fixed
in the previous commit and wire it up for both krbd and rbd-nbd.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-06-20 22:14:39 +02:00
Matan Breizman
ba519f5e72 crimson/osd/osd_operations/pg_advance_map: 'from' epoch may vary between PGS explanation
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 18:10:04 +00:00
Matan Breizman
06bf661543 crimson/osd/osdmap_gate: got_map() assert increase of current epoch
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 18:10:02 +00:00
Samuel Just
ff8144fac0
Merge pull request #51827 from liu-chunmei/get_assert
crimson:  fix RefCountedObject::_get() assert

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-20 11:06:31 -07:00
Matan Breizman
a8800c7e70 crimson/osd/shard_services: get_or_create_pg() remove unused variable
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:54 +00:00
Matan Breizman
ecac14a700 crimson/osd/shard_services: Refactor OSDSingletonState::load_map
Added logs
If case reconstructed - epoch is unsigned.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:54 +00:00
Matan Breizman
558758f81e crimson/osd/osd_meta: Abort instead of throwing runtime_error
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:54 +00:00
Matan Breizman
6dfb8f2fcb crimson/osd: Add logs around handling of osdmaps
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:53 +00:00
Matan Breizman
569fdda551 crimson/osd/pg: Fix assert of osd_debug_verify_cached_snaps
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:14:41 +00:00
Anthony D'Atri
7e2d7c43e6
Merge pull request #52104 from anthonyeleven/anthonyeleven/fixfft
doc/rados/operations: Improve formatting in crush-map.rst
2023-06-20 08:38:04 -04:00
Anthony D'Atri
540d6ce3ee doc/rados/operations: Improve formatting in crush-map.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-06-20 08:16:08 -04:00
Yuval Lifshitz
3ff96dc35a rgw/kafka: fix potential memory leak when push to queue fails
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-06-20 10:21:33 +00:00
Venky Shankar
b02e1b41f1 Merge PR #51500 into main
* refs/pull/51500/head:
	test/libcephfs: add test case for revoking caps
	client: issue a cap release immediately if no cap exists
	mds: add the revoking caps back to _revokes list
	mds: move confirm_receipt() to Capability.cc

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-06-20 15:34:30 +05:30
Venky Shankar
5265e991ab Merge PR #51655 into main
* refs/pull/51655/head:
	mds: display sane hex value (0x0) for empty feature bit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-06-20 10:05:31 +05:30
Kalpesh Pandya
05ddbb712b src/rgw: Additional changes based on comments
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2023-06-20 03:18:30 +05:30
Kalpesh Pandya
02e604fc94 src/rgw: Changing null_yield to optional_yield
Changing null_yield in rgw_sal_rados.cc

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2023-06-20 03:18:30 +05:30
Kalpesh Pandya
60a8a087c4 src/rgw: Changing null_yield to optional_yield
Changing null_yield in rgw_reshard.cc

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2023-06-20 03:18:30 +05:30
Kalpesh Pandya
402ebcaa9a src/rgw: Changing null_yield to optional_yield
Passing optional_yield to rgw_rados.cc

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2023-06-20 03:18:30 +05:30
Kalpesh Pandya
de766abe5b src/rados: Changing null_yield to optional_yield
Passing optional_yield at all places in rgw_bucket.cc

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2023-06-20 03:18:30 +05:30
Kalpesh Pandya
dee8dfeedc src/rgw: Changing null_yield to optional_yield
Focused on rgw_rados_operate() and passing null_yield in
rgw_lc.cc, rgw_gc.cc, rgw_object_expirer_core.cc

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2023-06-20 03:18:30 +05:30
Yehuda Sadeh
77381526d3 rgw: pubsub: pass yield context
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2023-06-20 03:18:30 +05:30
Yehuda Sadeh
95ffd2adc9 rgw: rados: pass yield context in a few places
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2023-06-20 03:18:30 +05:30
Casey Bodley
5916d13593
Merge pull request #51681 from cbodley/wip-61349
librados: aio operate functions can set mtimes

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-06-19 14:10:19 -04:00
Yuri Weinstein
e4d28e9fef
Merge pull request #51737 from cbodley/wip-rocksdb-44
bump rocksdb submodule to latest ceph-reef-v7.9.2


Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-06-19 13:31:23 -04:00
Ronen Friedman
5fd5913cfc
Merge pull request #51669 from ronen-fr/wip-rf-max-scrub-3
osd/scrub: increasing max_osd_scrubs to 3

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-06-19 20:29:50 +03:00
Yuri Weinstein
5ae95880bf
Merge pull request #48209 from kamoltat/wip-ksirivad-fix-tracker-57570
osd/OSDMap: Check for uneven weights & != 2 buckets post stretch mode

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2023-06-19 13:29:21 -04:00
Mark Kogan
fcb91f3e2a rgw: D3N cache objects which oid contains slash
Fixes: https://tracker.ceph.com/issues/59739

Signed-off-by: Mark Kogan <mkogan@redhat.com>
2023-06-19 17:33:42 +03:00
Jos Collin
2ee9b3af82
mds: display sane hex value (0x0) for empty feature bit
Print a valid hex (0x0) during empty feature bit, so that the clients could recognize it.
When the _vec size becomes 0, print() function creates an invalid hex (0x) and 'perf stats'
crashes with the below error:
"
File "/opt/ceph/src/pybind/mgr/stats/fs/perf_stats.py", line 177, in notify_cmd
metric_features = int(metadata[CLIENT_METADATA_KEY]["metric_spec"]["metric_flags"]["feature_bits"], 16)
ValueError: invalid literal for int() with base 16: '0x'
"
This patch creates  a valid hex (0x0), when _vec size is 0.

Fixes: https://tracker.ceph.com/issues/59551
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-06-19 13:24:19 +05:30
Ilya Dryomov
584f865ae1 librbd: stop passing IOContext to image dispatch write methods
This is a major footgun since any value passed e.g. at the API layer
may be stale by the time we get to object dispatch.  All callers are
passing the IOContext returned by get_data_io_context() for their
ImageCtx anyway, highlighting that the parameter is fictitious.

Only the read method can meaningfully take IOContext.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-06-18 17:25:01 +02:00
Ilya Dryomov
e4b1e04663 librbd: use an up-to-date snap context when owning the exclusive lock
By effectively moving capturing of the snap context to the API layer,
commit 1d0a3b17f5 ("librbd: pass IOContext to image-extent IO
dispatch methods") introduced a nasty regression.  The snap context can
be captured only after exclusive lock is safely held for the duration
of dealing with the image request and even then must be refreshed if
a snapshot creation request is accepted from a peer.  This is needed to
ensure correctness of the object map in general and fast-diff states in
particular (OBJECT_EXISTS vs OBJECT_EXISTS_CLEAN) and object deltas
computed based off of them.  Otherwise the object map that is forked
for the snapshot isn't guaranteed to accurately reflect the contents of
the snapshot when the snapshot is taken under I/O (as in disabling the
object map may lead to different results being returned for reads).

The regression affects mainly differential backup and snapshot-based
mirroring use cases with object-map and/or fast-diff enabled: since
some object deltas may be incomplete, the destination image may get
corrupted.

This commit represents a reasonable minimal fix: IOContext passed
through to ImageDispatch is effected only for reads and just gets
ignored for writes.  The next commit cleans up further by undoing the
passing of IOContext through the image dispatch layers for writes.

Fixes: https://tracker.ceph.com/issues/61616
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-06-18 17:25:01 +02:00
Anthony D'Atri
1ee89e3fe3
Merge pull request #52105 from gsantella/patch-update-typo-on-dashboard
doc/mgr/dashboard: fix a typo
2023-06-17 12:50:03 -04:00
gsantella
d64c52150c doc/mgr/dashboard: fix a typo
Signed-off-by: Guido Santella <gsantella@southhills.edu>
2023-06-17 09:49:15 -04:00
zdover23
8f46596415
Merge pull request #52100 from zdover23/wip-doc-2023-06-17-rados-operations-crush-map-firefly-tunables
doc/rados: edit firefly tunables section

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-06-17 19:54:40 +10:00
Zac Dover
66eb789d6c doc/rados: edit firefly tunables section
Edit the firefly tunables section in
/doc/rados/operations/crush-map.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-17 10:51:51 +10:00
zdover23
d383fb6137
Merge pull request #52092 from zdover23/wip-doc-2023-06-16-rados-operations-crush-map-4-of-x
doc/rados: edit crush-map.rst (4 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-17 08:17:41 +10:00