Commit Graph

138721 Commits

Author SHA1 Message Date
zdover23
e84e44efef
Merge pull request #52167 from zdover23/wip-doc-2023-06-23-rados-operations-crush-map-edits-1-of-x
doc/rados: edit crush-map-edits.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-06-24 15:55:43 +10:00
Zac Dover
f447c290a8 doc/rados: edit crush-map-edits.rst (1 of x)
Edit doc/rados/operations/crush-map-edits.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-24 14:09:19 +10:00
N Balachandran
bc9fe5b08b rbd-mirror: add logs to PoolReplayer
This commit adds logs to some PoolReplayer functions
in order to make debugging easier.

Signed-off-by: N Balachandran <nibalach@redhat.com>
2023-06-23 18:43:13 +05:30
Venky Shankar
dd3d546012 Merge PR #51974 into main
* refs/pull/51974/head:
	doc: fix grammar in cephfs/standby

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-06-23 10:40:51 +05:30
chunmei
00a5eaea46 crimson/osd: modify the interface to integrate with milticore-msg
Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-06-23 04:35:38 +00:00
chunmei
c7628de4d2 crimson/osd: remove seastar::now() to gurantee sequence in pipline
in debug build, if wait_barrier is seastar::now, will cause reactor
schedule the following continuation away, but can't schedule them back
in the same order as by which they are scheduled away, so the continuations
are out of order here.

Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-06-23 04:25:53 +00:00
chunmei
324191130a crimson/osd: make OSDState and OSDMap_Gate sharded
put them into PerShardState to avoid cross core calling for normal cases.

Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-06-23 03:35:09 +00:00
chunmei
d657afc7a7 crimson/osd: change OSD::ms_dispatch to take an ConnectionFRef
Shortly, we will need to be able to pass a ConnectionRef from another core.

Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-06-23 03:18:54 +00:00
chunmei
6bb4f00a9d crimson/osd: relax requirement that PGShardManager methods be invoked on PRIMARY_CORE
Proxy uses of osd_singleton_state to PRIMARY_CORE as needed.

Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-06-23 03:18:48 +00:00
chunmei
a3052969bf crimson/osd: enable PGShardMapping access from all cores
Previously, all accesses (incuding loookups) had to occur on core 0.  Now that
we want to be able to dispatch from all cores, we need PGShardManager to be
accessible from all cores.  To that end, we now proxy updates to core 0, but maintain
local copies of the map so that cores can perform local lookups.

Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-06-23 03:18:43 +00:00
chunmei
5f82fbbc72 crimson/osd: make osd sharded
Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-06-23 03:18:15 +00:00
Laura Flores
7917b8de66
Merge pull request #52164 from ljflores/wip-balancer-documentation-fix
doc/rados/operations: change file back to original name
2023-06-22 17:39:16 -05:00
Laura Flores
89c3dc4b93 doc/rados/operations: change file back to original name
The name of this file was changed in
4fcab2e7fc,
but on second thought, this could cause 404 situations.
Reverting the file name back to the original name.

Signed-off-by: Laura Flores <lflores@redhat.com>
2023-06-22 17:20:51 -05:00
Ali Maredia
26fda85af2
Merge pull request #52156 from cbodley/wip-qa-rgw-s3tests-extra-attrs
qa/rgw/s3tests: make extra_attrs additive
2023-06-22 16:15:02 -04:00
Casey Bodley
39e5f096d1
Merge pull request #52085 from alimaredia/wip-rgw-tempest-keystone-fix
Tempest tests Keystone Fix

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 13:46:46 -04:00
Ali Maredia
703effd45b qa: rgw/tempest suite only runs on ubuntu latest
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-06-22 11:59:59 -04:00
Tobias Urdin
fffa119424 qa: update rgw openstack versions
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-06-22 11:59:53 -04:00
Adam King
54413fd570
Merge pull request #51738 from phlogistonjohn/jjm-cephadm-new-deploy
cephadm: create a new version of the deploy command

Reviewed-by: Adam King <adking@redhat.com>
2023-06-22 11:39:49 -04:00
Laura Flores
e36ab74891
Merge pull request #51499 from ljflores/wip-balancer-documentation
doc/man/8: add documentation about read balancer
2023-06-22 10:32:38 -05:00
Laura Flores
4fcab2e7fc doc/man/8: add documentation about read balancer
Signed-off-by: Laura Flores <lflores@redhat.com>
Co-authored-by: Josh Salomon <josh.salomon@gmail.com>
2023-06-22 09:54:48 -05:00
Mark Kogan
bcf5df86fc
Merge pull request #51819 from mkogan1/wip-d3n-obj-w-slash
rgw: D3N: cache objects which oid contains slash
2023-06-22 17:28:12 +03:00
Casey Bodley
596e32f542 qa/s3tests: remove stale comment about rfc2616
this comment was about the old fails_strict_rfc2616 attr that was
removed in 6238eaaf0b

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 08:54:33 -04:00
Casey Bodley
1e65b50f60 qa/s3tests: clean up extra_attrs and extra_args logic
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 08:54:33 -04:00
Casey Bodley
1c006c92e1 qa/s3tests: make extra_attrs additive
the s3tests.py task is filtering out several attrs by default. but
when dbstore uses `extra_attrs` to add 'not fails_on_dbstore', it
overwrites those other filters

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-22 08:54:14 -04:00
Yuval Lifshitz
e36a5fc393
Merge pull request #52129 from yuvalif/wip-yuval-kafka-memleak
rgw/kafka: fix potential memory leak when push to queue fails
2023-06-22 11:09:45 +03:00
Matan
af70f82f1e
Merge pull request #51961 from Matan-B/wip-matanb-crimson-single-mosdmap-handling
Crimson/osd: Disable concurrent MOSDMap handling

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-06-22 10:17:47 +03:00
Yuri Weinstein
d05da0b4d1
Merge pull request #52072 from NitzanMordhai/wip-nitzan-add-ec-clay-teuthology-tests
qa: adding clay test to thrash erasure code big

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-06-21 17:16:00 -04:00
Yuri Weinstein
feb98924e8
Merge pull request #51667 from Matan-B/wip-matanb-share-osdmap
osd/OSD: cleanup OSDService::maybe_share_map()

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-06-21 17:12:38 -04:00
Yuri Weinstein
b1ed114a66
Merge pull request #51450 from batrick/i59716
pybind/rados: keep byte representation if decode fails

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-06-21 17:12:08 -04:00
Casey Bodley
7c9486412d
Merge pull request #50206 from TRYTOBE8TME/wip-rgw-yield-work
rgw: replace null_yields with optional ones

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-06-21 14:52:20 -04:00
John Mulligan
f890d82478 qa/workunits/cephadm: update script use use cephadm _orch deploy
cephadm _orch deploy will eventually be the only deploy method so
we need to update the test script.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-06-21 13:19:16 -04:00
John Mulligan
3028216a61 cephadm: dont set ctx.image if json deploy image is unset
If no image has been provided in the "deploy from" json do not set
ctx.image to it (empty-string or None) as we may have had a valid
value passed on the --image CLI option.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-06-21 13:19:16 -04:00
zdover23
a0766f1254
Merge pull request #52123 from zdover23/wip-doc-2023-06-20-rados-operations-control-1-of-x
doc/rados: edit control.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-21 23:34:55 +10:00
Zac Dover
d14b828a1a doc/rados: edit control.rst (1 of x)
Edit doc/rados/operations/control.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-21 22:53:12 +10:00
Ilya Dryomov
ca20127c70
Merge pull request #52109 from idryomov/wip-61616
librbd: avoid object map corruption in snapshots taken under I/O

Reviewed-by: Mykola Golub <mgolub@suse.com>
2023-06-21 11:43:26 +02:00
Yuval Lifshitz
38d819b3d7 rgw/amqp: remove possible race conditions with the amqp connections
* simplify memory management of the connection by not using a unique_ptr
* simplify the logic by handling all issues inside the amqp manager
* fix iterator invalidation issue with miltiple n/acks
* allow different connections with different exchanges
* modify the unit tests according to the new behavior

Fixes:
* https://tracker.ceph.com/issues/61639
* https://tracker.ceph.com/issues/46127

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-06-21 08:06:17 +00:00
Ilya Dryomov
acb270a3dd qa/workunits/rbd: make continuous export-diff test actually work
The current version is pretty useless:

- "rbd bench" writes the same byte (0xff) over and over again, so
  almost all checksumming is in vain
- snapshots are taken in a steady state (i.e. not under I/O), so no
  race conditions can get exposed
- even with these caveats, it's not wired up into the suite

Redo this workunit to be a reliable reproducer for the issue fixed
in the previous commit and wire it up for both krbd and rbd-nbd.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-06-20 22:14:39 +02:00
Matan Breizman
ba519f5e72 crimson/osd/osd_operations/pg_advance_map: 'from' epoch may vary between PGS explanation
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 18:10:04 +00:00
Matan Breizman
06bf661543 crimson/osd/osdmap_gate: got_map() assert increase of current epoch
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 18:10:02 +00:00
Samuel Just
ff8144fac0
Merge pull request #51827 from liu-chunmei/get_assert
crimson:  fix RefCountedObject::_get() assert

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-20 11:06:31 -07:00
Matan Breizman
a8800c7e70 crimson/osd/shard_services: get_or_create_pg() remove unused variable
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:54 +00:00
Matan Breizman
ecac14a700 crimson/osd/shard_services: Refactor OSDSingletonState::load_map
Added logs
If case reconstructed - epoch is unsigned.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:54 +00:00
Matan Breizman
558758f81e crimson/osd/osd_meta: Abort instead of throwing runtime_error
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:54 +00:00
Matan Breizman
6dfb8f2fcb crimson/osd: Add logs around handling of osdmaps
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:19:53 +00:00
Matan Breizman
569fdda551 crimson/osd/pg: Fix assert of osd_debug_verify_cached_snaps
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-20 17:14:41 +00:00
Anthony D'Atri
7e2d7c43e6
Merge pull request #52104 from anthonyeleven/anthonyeleven/fixfft
doc/rados/operations: Improve formatting in crush-map.rst
2023-06-20 08:38:04 -04:00
Anthony D'Atri
540d6ce3ee doc/rados/operations: Improve formatting in crush-map.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-06-20 08:16:08 -04:00
Yuval Lifshitz
3ff96dc35a rgw/kafka: fix potential memory leak when push to queue fails
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-06-20 10:21:33 +00:00
Venky Shankar
b02e1b41f1 Merge PR #51500 into main
* refs/pull/51500/head:
	test/libcephfs: add test case for revoking caps
	client: issue a cap release immediately if no cap exists
	mds: add the revoking caps back to _revokes list
	mds: move confirm_receipt() to Capability.cc

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-06-20 15:34:30 +05:30
Venky Shankar
5265e991ab Merge PR #51655 into main
* refs/pull/51655/head:
	mds: display sane hex value (0x0) for empty feature bit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-06-20 10:05:31 +05:30