Commit Graph

142312 Commits

Author SHA1 Message Date
Adam King
4c20f74644
Merge pull request #54978 from pcuzner/add-device-count-summary
orchestrator: Add summary line to orch device ls output

Reviewed-by: Adam King <adking@redhat.com>
2024-01-09 13:30:47 -05:00
Yuri Weinstein
7e79aee3c0
Merge pull request #54913 from jianwei1216/visualize_osd_superblock_oldest_map_newest_map_main
OSD: oldest_map and newest_map should be displayed directly

Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
2024-01-09 08:05:45 -08:00
Yuri Weinstein
13e02409a7
Merge pull request #54634 from NitzanMordhai/wip-nitzan-mgr-restful-mod-leaking-memory-results
mgr/BaseMgrModule: Optimize CPython Call in Finish Function

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-01-09 08:05:12 -08:00
Casey Bodley
6c24ca5483
Merge pull request #54829 from awojno-bloomberg/wip-fix-role-delete-replication
rgw/iam: fix role deletion replication

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-09 14:53:46 +00:00
Casey Bodley
f909132c64
Merge pull request #53156 from qiuxinyidian/rgw-dev
rgw: modify string match_wildcards with fnmatch

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-09 14:53:22 +00:00
Ronen Friedman
08f4347558
Merge pull request #55009 from ronen-fr/wip-rf-actpr-requeue
osd/scrub: remove scrub_clear_state() 

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-09 14:37:03 +02:00
Samuel Just
fb6cce24b5
Merge pull request #54870 from Svelar/crimson_g_conf
crimson: add set_val and rm_val to global conf

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-08 18:55:55 -08:00
Casey Bodley
5a5ca59f48
Merge pull request #52315 from ronen-fr/wip-rf-rgw-tasserts
test/rgw: annotating variables with maybe_unused

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2024-01-08 19:30:32 +00:00
Laura Flores
d1c5a588c4
Merge pull request #55088 from cbodley/wip-make-dist-wget 2024-01-08 12:00:27 -06:00
Casey Bodley
f872a2cda0
Merge pull request #54587 from cbodley/wip-45736
rgw: add headers to guide cache update in 304 response

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-01-08 17:49:38 +00:00
Adam King
e2874ef7d4
Merge pull request #54715 from rkachach/fix_issue_63678
mgr/rook: fixing inconsistencies on the dashboard 'services' view

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-01-08 11:40:09 -05:00
Adam King
9d63452bb3
Merge pull request #54676 from rkachach/fix_list_devices_issue
mgr/rook: fixing devices listing on rook

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2024-01-08 11:38:35 -05:00
Casey Bodley
2ba7d6e59e make-dist: don't use --continue option for wget
the boost jfrog mirror is broken and returns an HTML error page instead
of the archive. the file size of this page is 11534 bytes

when download_from() retries the download from download.ceph.com, the -c
option tells it to resume the download of the existing file. the
resulting boost_1_82_0.tar.bz2 ends up with the correct total file size
of 121325129 bytes, but the first 11534 bytes still correspond to the
HTML from jfrog. that causes the sha256sum mismatch

remove the -c option so that wget fetches the archive in its entirety

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-08 08:24:29 -08:00
Ilya Dryomov
adb1aeea31
Merge pull request #55081 from petrutlucian94/boost_mirror
win32_deps_build.sh: change Boost URL

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-01-08 12:56:51 +01:00
zdover23
e33ea91ef1
Merge pull request #55075 from zdover23/wip-doc-2024-01-07-radosgw-admin-quota
doc/radosgw: edit admin.rst - quota

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-08 20:31:21 +10:00
Zac Dover
22fce3c7a5 doc/radosgw: edit admin.rst - quota
Edit the "Quota Management" section (all of it) in
doc/radosgw/admin.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-08 20:18:07 +10:00
Lucian Petrut
594d1e5e83 win32_deps_build.sh: change Boost URL
The Boost download URL is broken again [1], we'll switch to a
working mirror.

[1] https://github.com/boostorg/boost/issues/842

Fixes: https://tracker.ceph.com/issues/63952

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2024-01-08 09:44:56 +00:00
Paul Cuzner
50a4cd3a18 orchestrator: Add summary line to orch device ls
This patch just adds a summary line to the plain
text output of orch device ls when the --summary
switch is given. This helps to quickly understand your
device countswhen managing hosts with many devices.

Fixes: https://tracker.ceph.com/issues/63864

Signed-off-by: Paul Cuzner <pcuzner@ibm.com>
2024-01-07 20:36:12 -05:00
Yingxin
60c4b643f9
Merge pull request #54525 from myoungwon/wip-delta-overwrite-inplace-replay
crimson/os/seastore:  introduce inplace rewrite for RBM

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-08 09:24:21 +08:00
Matan Breizman
930ed08a21
Merge pull request #54613 from Matan-B/wip-matanb-crimson-build-inc-maps
crimson/osd: Support incremental maps

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-07 14:38:19 +02:00
Ronen Friedman
f9d92f1817 osd/scrub: remove scrub_clear_state()
Its functionality is now handled by the FSM when existing
'Session' or 'ActiveReplicaOp' states.
For a PG that is not active - no need to do anything.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-06 00:20:12 -06:00
Ronen Friedman
7455933732
Merge pull request #54996 from ronen-fr/wip-rf-active-primary
osd/scrub: add a "clean primary" base state

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-06 08:06:16 +02:00
zdover23
6c2c477d92
Merge pull request #55069 from ceph/wip-rgw-adminops-user-info-doc-update
doc: update rgw admin api req params for get user info

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-06 09:20:39 +10:00
Ali Maredia
e6c58dcd61 doc: update rgw admin api req params for get user info
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2024-01-05 20:51:06 +00:00
Laura Flores
d9686b8f77
Merge pull request #54993 from ljflores/wip-balancer-status-detail-documentation 2024-01-05 12:30:02 -06:00
Yuri Weinstein
b67b33500a
Merge pull request #54890 from kamoltat/wip-ksirivad-fix-63389
src/mon/OSDMonitor.cc: more descriptive loggings for crc mismatch

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-01-05 07:40:50 -08:00
Yuri Weinstein
5e54413c0b
Merge pull request #54708 from amathuria/wip-amathuria-bz-2134786-fix-norecover
mgr/pg_autoscaler: add check for norecover flag

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
2024-01-05 07:40:11 -08:00
Yuri Weinstein
02805817e8
Merge pull request #52380 from kamoltat/wip-ksirivad-fix-tracker-59564
mon/ConnectionTracker.cc: disregard connection scores from mon_rank = -1 

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2024-01-05 07:38:53 -08:00
Yuri Weinstein
556bd56b70
Merge pull request #48175 from amathuria/wip-add-test-case-bz-2011756
DaemonServer.cc: fix config show command for RGW daemons

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 07:37:54 -08:00
Ronen Friedman
6d6cc71456 osd/scrub: avoid "over clearing" queued_or_active flag
If two StartScrub messages are received in quick succession, the earlier
one might clear the queued_or_active flag as it fails for being from an old
interval.
When that happens - a 3'rd scrub request will actually be allowed to go
through, while the scrubber is still handling the second one.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 09:00:10 -06:00
Ronen Friedman
569c07f979 osd/scrub: manage queue registration lifetime in the FSM
As the state of 'being registered in the OSDs scrub queue'
corresponds to the PrimaryActive FSM state.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 08:44:21 -06:00
Anthony D'Atri
c6bca26183
Merge pull request #55065 from zdover23/wip-doc-2024-01-05-radosgw-admin-add-remove-admin-caps
doc/radosrgw: edit admin.rst
2024-01-05 09:32:54 -05:00
Zac Dover
1f0ff27898 doc/radosrgw: edit admin.rst
Edit "Add / Remove Admin Capabilities" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-05 21:11:59 +10:00
Myoungwon Oh
72c9d6d17f crimson/os/seastore/cache: return false explicitly if delta is not replayed
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:46:43 +09:00
Myoungwon Oh
ad8b3f29ad crimson/os/seastore: check correct crc for inplace-rewritten extents after replay is done
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:44:44 +09:00
Myoungwon Oh
cba051d6e0 test/crimson/seastore: fix overflow issue and make len > 0 when set_contents is called
set_contents causes the overflow at times because
alloc_extent is allowed to use uint32_t.

Specifically, in random_writes case, PADDING_SIZE is 256<<10,
whereas set_contents's len is uint16_t.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:44:37 +09:00
Myoungwon Oh
6d42ff4c7e crimson/os/seastore/epm: detect transaction confict during rbm write using OOL
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:44:31 +09:00
Myoungwon Oh
3ca63d79b8 crimson/os/seastore: introduce modified_region in DATA_BLOCK to keep track of modified region
It has a limitation to keep track of the modified region using the existing
deltas because we can not get the correct region in two cases: 1) a case where replay
is done and 2) duplicate_for_write. This commit introduces modified region
to solve the problem.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:44:25 +09:00
Myoungwon Oh
5307f252d6 crimson/os/seastore: write only modified region when rewriting the extent in an inplace manner
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:44:18 +09:00
myoungwon oh
78dc32bada test/crimson/seastore: add a random overwrite test to test_objec_date_handler
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:44:12 +09:00
Myoungwon Oh
1b29691318 crimson/os/seastore/cache: reset version to 1 if inplace write occurs before in prepare_record
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:43:55 +09:00
Matt Benjamin
2bcc413346
Merge pull request #54425 from linuxbox2/wip-lcnotify-cleanup
rgwlc:  additional lc notify cleanups
2024-01-04 21:37:24 -05:00
Adam King
1464da9cf0
Merge pull request #54889 from phlogistonjohn/jjm-cephadm-build-with-wheels
cephadm: build with wheels, enabling pyyaml dependency

Reviewed-by: Guillaume Abrioux <gabrioux@ibm.com>
2024-01-04 20:12:30 -05:00
Adam King
cd3c69782a
Merge pull request #54722 from phlogistonjohn/jjm-cephadm-sidecars
cephadm: add support for sidecar containers

Reviewed-by: Adam King <adking@redhat.com>
2024-01-04 20:11:41 -05:00
Matt Benjamin
8a935bb115 rgwlc: even current object versions have a unique instance
Fixes: https://tracker.ceph.com/issues/63546

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2024-01-04 15:23:36 -05:00
Matt Benjamin
9183de7309 rgwlc: additional lc notify cleanups
Follow the same formula to build up obj_state and version_id
in all call sites.

Resolves: rhbz#2163667

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2024-01-04 15:23:27 -05:00
Casey Bodley
6704c04a6a
Merge pull request #50055 from cbodley/wip-rgw-polymorphic-executor
rgw/beast: switch back to polymorphic executor

Reviewed-by: Mark Kogan <mkogan@ibm.com>
2024-01-04 20:19:54 +00:00
Casey Bodley
fe747f40fa
Merge pull request #54903 from cbodley/wip-63829
radosgw-admin: 'zone set' won't overwrite existing default-placement

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2024-01-04 20:19:08 +00:00
Casey Bodley
6787c4dd08
Merge pull request #54505 from adamemerson/wip-lazyfifo-no-mutex-over-coro
rgw/multisite: Fix deadlock by not holding mutex over coroutine

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-04 20:18:38 +00:00
Samuel Just
d451898573
Merge pull request #49594 from Matan-B/wip-matanb-crimson-calc-subsets
crimson: Support Partial Object Recovery

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-04 10:13:40 -08:00