Commit Graph

142684 Commits

Author SHA1 Message Date
Samuel Just
d82257223b crush: add choosemsr rule
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-08 19:25:54 -08:00
Samuel Just
88a7fc2713 crush: add msr tunables
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-08 19:25:52 -08:00
Samuel Just
fb6cce24b5
Merge pull request #54870 from Svelar/crimson_g_conf
crimson: add set_val and rm_val to global conf

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-08 18:55:55 -08:00
Casey Bodley
5a5ca59f48
Merge pull request #52315 from ronen-fr/wip-rf-rgw-tasserts
test/rgw: annotating variables with maybe_unused

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2024-01-08 19:30:32 +00:00
Samuel Just
52654551cc osd/OSDMap: minor formatting nit
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-08 10:50:17 -08:00
Samuel Just
196205dcf5 crush: add msr rule types and CrushWrapper infrastructure
Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-08 10:50:16 -08:00
Samuel Just
22ab2747c5 src/crush: add a rule type enum
We're going to add more rule types that don't map directly onto
pool types.

Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-08 10:50:16 -08:00
Samuel Just
ec9fdd4a9b OSDMonitor: update require_osd_release for crush features
The existing implementation checks that the currently live
OSDs support the pending crush features, but we don't
actually check that require_osd_release is new enough.

Signed-off-by: Samuel Just <sjust@redhat.com>
2024-01-08 10:50:16 -08:00
Laura Flores
d1c5a588c4
Merge pull request #55088 from cbodley/wip-make-dist-wget 2024-01-08 12:00:27 -06:00
Casey Bodley
f872a2cda0
Merge pull request #54587 from cbodley/wip-45736
rgw: add headers to guide cache update in 304 response

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-01-08 17:49:38 +00:00
Adam King
e2874ef7d4
Merge pull request #54715 from rkachach/fix_issue_63678
mgr/rook: fixing inconsistencies on the dashboard 'services' view

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-01-08 11:40:09 -05:00
Adam King
9d63452bb3
Merge pull request #54676 from rkachach/fix_list_devices_issue
mgr/rook: fixing devices listing on rook

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2024-01-08 11:38:35 -05:00
Casey Bodley
2ba7d6e59e make-dist: don't use --continue option for wget
the boost jfrog mirror is broken and returns an HTML error page instead
of the archive. the file size of this page is 11534 bytes

when download_from() retries the download from download.ceph.com, the -c
option tells it to resume the download of the existing file. the
resulting boost_1_82_0.tar.bz2 ends up with the correct total file size
of 121325129 bytes, but the first 11534 bytes still correspond to the
HTML from jfrog. that causes the sha256sum mismatch

remove the -c option so that wget fetches the archive in its entirety

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-08 08:24:29 -08:00
Adam King
df2e42c02f qa/cephadm: mgr-nfs-upgrade, match any migration > 2
I believe this check was originally added because
the 2->3 migration migrated some nfs related bits. Since
then we've had to update the migration this checks
for every time we bump the max migration. This change
is intended to instead just have it check for a
miration > 2 so we don't have to keep updating it.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 10:07:03 -05:00
Adam King
967716f2e6 qa/upgrade/reef-x: pull compiled cephadm to start upgrades from reef
The compiled zipapp cephadm that began in reef needs
to be pulled differently than the old single python script
cephadm from earlier releases. This commit updates the reef-x
upgrade suite to pull cephadm in this new way.

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 09:51:52 -05:00
Adam King
67c5669157 qa/cephadm: support to pull stable branch compiled cephadm
This is to allow us to pull the latest build of
cephadm off of a stable branch (currently the only
valid option for that is reef, although this hopefully
will work with squid, T release, etc. in the future).

This should allow us to bootstrap cliusters based on
those stable branches for use in upgrade testing

Signed-off-by: Adam King <adking@redhat.com>
2024-01-08 09:51:52 -05:00
Ilya Dryomov
adb1aeea31
Merge pull request #55081 from petrutlucian94/boost_mirror
win32_deps_build.sh: change Boost URL

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-01-08 12:56:51 +01:00
Florian Weimer
a49d154f4a pybind: Fix C type errors in Cython-generated Python bindings
Several Ceph APIs use bool * types, which correspond to
libcpp.bool * types in Cython.  The bint type has an incorrect
size 4 and cannot be used as a replacement.

This prevents a compilation failure with future compilers:

…-build/src/pybind/rbd/rbd.c: In function ‘__pyx_pf_3rbd_3RBD_104namespace_exists’:
…-build/src/pybind/rbd/rbd.c:42165:76: error: passing argument 3 of ‘rbd_namespace_exists’ from incompatible pointer type
42165 |         __pyx_v_ret = rbd_namespace_exists(__pyx_v__ioctx, __pyx_v__name, (&__pyx_v__exists));
      |                                                                           ~^~~~~~~~~~~~~~~~~
      |                                                                            |
      |                                                                            int *
In file included from …-build/src/pybind/rbd/rbd.c:1268:
…/src/include/rbd/librbd.h:1496:45: note: expected ‘_Bool *’ but argument is of type ‘int *’
 1496 |                                       bool *exists);
      |                                             ^

Signed-off-by: Florian Weimer <fweimer@redhat.com>
2024-01-08 12:04:16 +01:00
Florian Weimer
f9aea9105b tracing: Fix C type errors in librados tracing
This fixes type errors like this:

In file included from /usr/include/lttng/tracepoint-event.h:69,
                 from …-build/include/tracing/librados.h:4143,
                 from …/src/tracing/librados.c:6
:
…-build/include/tracing/librados.h:
 In function ‘lttng_ust__event_probe__librados___rados_mon_command_exit’:
…-build/include/tracing/librados.h:477:9: error: initialization of ‘size_t’ {aka ‘long unsigned int’} from ‘size_t *’ {aka ‘long unsigned int *’} makes integer from pointer without a cast
  477 |         ceph_ctf_integerp(size_t, outslen, outslen)
      |         ^~~~~~~~~~~~~~~~~

GCC 14 will likely treat these type mismatches as an error
and fail the build.

Signed-off-by: Florian Weimer <fweimer@redhat.com>
2024-01-08 12:02:38 +01:00
zdover23
e33ea91ef1
Merge pull request #55075 from zdover23/wip-doc-2024-01-07-radosgw-admin-quota
doc/radosgw: edit admin.rst - quota

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-08 20:31:21 +10:00
Zac Dover
22fce3c7a5 doc/radosgw: edit admin.rst - quota
Edit the "Quota Management" section (all of it) in
doc/radosgw/admin.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-08 20:18:07 +10:00
Lucian Petrut
594d1e5e83 win32_deps_build.sh: change Boost URL
The Boost download URL is broken again [1], we'll switch to a
working mirror.

[1] https://github.com/boostorg/boost/issues/842

Fixes: https://tracker.ceph.com/issues/63952

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2024-01-08 09:44:56 +00:00
Paul Cuzner
50a4cd3a18 orchestrator: Add summary line to orch device ls
This patch just adds a summary line to the plain
text output of orch device ls when the --summary
switch is given. This helps to quickly understand your
device countswhen managing hosts with many devices.

Fixes: https://tracker.ceph.com/issues/63864

Signed-off-by: Paul Cuzner <pcuzner@ibm.com>
2024-01-07 20:36:12 -05:00
Yingxin
60c4b643f9
Merge pull request #54525 from myoungwon/wip-delta-overwrite-inplace-replay
crimson/os/seastore:  introduce inplace rewrite for RBM

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-08 09:24:21 +08:00
Matan Breizman
930ed08a21
Merge pull request #54613 from Matan-B/wip-matanb-crimson-build-inc-maps
crimson/osd: Support incremental maps

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-07 14:38:19 +02:00
Ronen Friedman
f9d92f1817 osd/scrub: remove scrub_clear_state()
Its functionality is now handled by the FSM when existing
'Session' or 'ActiveReplicaOp' states.
For a PG that is not active - no need to do anything.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-06 00:20:12 -06:00
Ronen Friedman
7455933732
Merge pull request #54996 from ronen-fr/wip-rf-active-primary
osd/scrub: add a "clean primary" base state

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-01-06 08:06:16 +02:00
Milind Changire
b3ff5f7949
PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:37 +05:30
Milind Changire
dfc35a4679
snap_schedule/tests: fix db upgrade issue
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Milind Changire
2533ac5b90
qa: add yaml for on demand subvol version testing
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Milind Changire
006c68f492
qa: add test cases for testing --subvol and --group arguments
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Milind Changire
0c5804ab4e
mgr/volumes: conditionalize subvolume upgrade
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Milind Changire
614d112cff
mgr/volumes: ensure correct init of v1 subvol
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Milind Changire
5b250907d0
mgr/snap_schedule: add subvol and subvol group arguments to cli
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:36 +05:30
Milind Changire
ffa197c031
mds/snap_schedule: add subvolume group column management
Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:35 +05:30
Milind Changire
d2205bf824
mgr/volumes: add remote helper methods to fetch subvolume info
* add remote method to fetch subvolume path
  * add remote method to list subvolumes
  * add remote method to fetch subvolume attributes

Signed-off-by: Milind Changire <mchangir@redhat.com>
2024-01-06 08:58:30 +05:30
zdover23
6c2c477d92
Merge pull request #55069 from ceph/wip-rgw-adminops-user-info-doc-update
doc: update rgw admin api req params for get user info

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-01-06 09:20:39 +10:00
Prashant D
950aa4963d mon: initialize ProgressEvent::add_to_ceph_s
The add_to_ceph_s field was not initialized causing unit
test failures from check-generated.sh:

**** ProgressEvent test 1 dump_json check failed ****
   ceph-dencoder type ProgressEvent select_test 1 dump_json > /tmp/typ-akwRrjNtt
   ceph-dencoder type ProgressEvent select_test 1 encode decode dump_json > /tmp/typ-iDmGaq17A
4c4
<     "add_to_ceph_s": false
---
>     "add_to_ceph_s": true

Fixes: https://tracker.ceph.com/issues/63950

Signed-off-by: Prashant D <pdhange@redhat.com>
2024-01-05 17:31:11 -05:00
Ali Maredia
e6c58dcd61 doc: update rgw admin api req params for get user info
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2024-01-05 20:51:06 +00:00
Laura Flores
d9686b8f77
Merge pull request #54993 from ljflores/wip-balancer-status-detail-documentation 2024-01-05 12:30:02 -06:00
Yaarit Hatuka
937aa7ec21 mgr/telemetry: add pool flags
Pool flags can help us learn how certain features are being used, for
example, the "crimson" flag implies a crimson cluster.

We add a basic_pool_flags collection to the "basic" channel for this
purpose.

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2024-01-05 17:44:30 +00:00
Yuri Weinstein
b67b33500a
Merge pull request #54890 from kamoltat/wip-ksirivad-fix-63389
src/mon/OSDMonitor.cc: more descriptive loggings for crc mismatch

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-01-05 07:40:50 -08:00
Yuri Weinstein
5e54413c0b
Merge pull request #54708 from amathuria/wip-amathuria-bz-2134786-fix-norecover
mgr/pg_autoscaler: add check for norecover flag

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
2024-01-05 07:40:11 -08:00
Yuri Weinstein
02805817e8
Merge pull request #52380 from kamoltat/wip-ksirivad-fix-tracker-59564
mon/ConnectionTracker.cc: disregard connection scores from mon_rank = -1 

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2024-01-05 07:38:53 -08:00
Yuri Weinstein
556bd56b70
Merge pull request #48175 from amathuria/wip-add-test-case-bz-2011756
DaemonServer.cc: fix config show command for RGW daemons

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 07:37:54 -08:00
Ronen Friedman
6d6cc71456 osd/scrub: avoid "over clearing" queued_or_active flag
If two StartScrub messages are received in quick succession, the earlier
one might clear the queued_or_active flag as it fails for being from an old
interval.
When that happens - a 3'rd scrub request will actually be allowed to go
through, while the scrubber is still handling the second one.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 09:00:10 -06:00
Ronen Friedman
569c07f979 osd/scrub: manage queue registration lifetime in the FSM
As the state of 'being registered in the OSDs scrub queue'
corresponds to the PrimaryActive FSM state.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-05 08:44:21 -06:00
Anthony D'Atri
c6bca26183
Merge pull request #55065 from zdover23/wip-doc-2024-01-05-radosgw-admin-add-remove-admin-caps
doc/radosrgw: edit admin.rst
2024-01-05 09:32:54 -05:00
Zac Dover
1f0ff27898 doc/radosrgw: edit admin.rst
Edit "Add / Remove Admin Capabilities" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-05 21:11:59 +10:00
Myoungwon Oh
72c9d6d17f crimson/os/seastore/cache: return false explicitly if delta is not replayed
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-01-05 15:46:43 +09:00