Commit Graph

143096 Commits

Author SHA1 Message Date
Zac Dover
aa1e6352d0 doc/glossary: Add link to CRUSH paper
Add a link in the CRUSH definition to the original CRUSH paper.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-13 01:06:05 +10:00
Aashish Sharma
4a87939b9c
Merge pull request #55467 from rhcs-dashboard/rgw-s3-analytics-grafana-dashboard
mgr/dashboard: Add RGW per user/bucket panels in  grafana


Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-02-12 12:46:48 +05:30
Nizamudeen A
e2b2e038b8
Merge pull request #55494 from ivoalmeida/snapshot-schedule-delete-activate
mgr/dashboard: added delete and activation actions

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-02-12 11:58:03 +05:30
Kefu Chai
6c275abe19
Merge pull request #55529 from tchaikov/cmake-cap
cmake: find_package(cap) before linking against it

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-12 09:23:21 +08:00
Ivo Almeida
e0bb711703 mgr/dashboard: added delete and activation actions
Fixes: https://tracker.ceph.com/issues/64355
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
2024-02-11 20:00:24 +00:00
Kefu Chai
ce8c2f3124
Merge pull request #55528 from tchaikov/cmake-boost-debug
cmake: build boost debug variant when CMAKE_BUILD_TYPE is Debug

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-12 00:39:04 +08:00
Casey Bodley
f394e08415
Merge pull request #55199 from igomon-bloomberg/wip-publish-commit-async
rgw/s3-notifications: async commit to persistent notification queue

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-02-11 16:15:17 +00:00
Casey Bodley
0151e6a554
Merge pull request #55371 from pritha-srivastava/wip-rgw-correct-err-msg
rgw/auth: correcting the error message to indicate

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-11 16:14:42 +00:00
Casey Bodley
f0de0424d7
Merge pull request #55250 from cbodley/wip-64084
rgw/auth/s3: validate x-amz-content-sha256 for empty payloads

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2024-02-11 16:12:48 +00:00
Ronen Friedman
f912e9045a
Merge pull request #55478 from ronen-fr/wip-rf-update-times
osd: restoring timely collection of PG stats

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-02-11 13:25:47 +02:00
Kefu Chai
0de5755531 cmake: find_package(cap) before linking against it
before this change, we link against libcap without finding it. this
works fine as long as libcap-devel or libcap-dev is installed in the
system. but if it is not, the source would fail to build due to missing
`sys/capability.h`. this is not a great developer experience.

in this change, a `Findcap.cmake` is added to find the capability
library. which would fail the build at the configure phase.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2024-02-11 16:57:38 +08:00
Kefu Chai
c7155c3db7 cmake: build boost debug variant when CMAKE_BUILD_TYPE is Debug
boost has some different predefined  build variants. they are quite
like CMake's CMAKE_BUILD_TYPE. in which, "debug" enables some
features related features. so it would be nice if we can have it
enabled for the Debug build, if the boost is built from source.
see also
https://www.boost.org/build/doc/html/bbv2/overview/builtins/features.html

before this change, we always build the "release" variant.  in this
change, "debug" variant is built if Ceph's is built with
CMAKE_BUILD_TYPE=Debug. please note, this change does not change
the way how boost is built when packaging Ceph, as our debian/rpm
receipts do not define CMAKE_BUILD_TYPE and respect the distros'
settings, in that case, the "release" variant is still built.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2024-02-11 15:48:54 +08:00
zdover23
8bbeeb80a5
Merge pull request #55525 from zdover23/wip-doc-2024-02-11-radosgw-55524-rollback
doc/radosgw: undo 55524

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-11 00:47:59 +10:00
Zac Dover
284e99ebc6 doc/radosgw: undo 55524
Roll back the docs changes made in
https://github.com/ceph/ceph/pull/55524, in accordance with Casey
Bodley's instructions to me here:
https://github.com/ceph/ceph/pull/55524#issuecomment-1937020543.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-11 00:36:29 +10:00
Anthony D'Atri
6c52f1ab47
Merge pull request #55524 from zdover23/wip-doc-2024-02-10-radosgw-lua-scripting-options
doc/radosgw: remove invalid LUA context options
2024-02-10 06:30:41 -05:00
Laura Flores
228dab8510
Merge pull request #55507 from ljflores/wip-tracker-64343 2024-02-09 23:36:21 -06:00
Zac Dover
8bfe2d1ae6 doc/radosgw: remove invalid LUA context options
Remove "background", "getdata", and "putdata" from the list of LUA
context options. Passing these options throws the following error:
"ERROR: invalid script context: background. must be one of: preRequest,
postRequest".

Fixes: https://tracker.ceph.com/issues/64327

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-10 13:14:59 +10:00
Laura Flores
00fc7960f6 qa/suites/orch: whitelist warnings that are expected in test environments
Fixes: https://tracker.ceph.com/issues/64343
Signed-off-by: Laura Flores <lflores@ibm.com>
2024-02-09 13:52:47 -06:00
Aashish Sharma
a572a0c167 mgr/dashboard: Add RGW per user/bucket panels in grafana
Fixes: https://tracker.ceph.com/issues/64359

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2024-02-09 21:14:27 +05:30
Kefu Chai
f8e4e33149
Merge pull request #53521 from xxhdx1985126/wip-62857
crimson/osd/replicated_backend: don't put pg's metadata updates in repops

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-09 23:11:18 +08:00
Adam Kupczyk
0855adb8fd
Merge pull request #54650 from pereman2/buffer_map-noptr
os/bluestore: use buffer values instead of pointers in buffer_map
2024-02-09 16:07:17 +01:00
Ronen Friedman
d706cecb41 osd: no 'legacy' form for two configuration options
also - fixing review comments not addressed in the original PR.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-02-09 04:14:10 -06:00
Ronen Friedman
d828847b51 osd: restoring timely collection of PG stats
500 seconds is way too long, e.g. when compared to the 5s
default configuration option for the manager collection of the OSD data.

Fixes tracker issue 53342 note 5 (a specific scenario leading
to 'not all pgs scrubbed')

Fixes: https://tracker.ceph.com/issues/53342 - partial fix

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-02-09 04:14:10 -06:00
Nizamudeen A
ff6d095713
Merge pull request #55462 from afreen23/fix-64270
mgr/dashboard: fix error while accessing roles tab when policy attached

Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-02-09 12:35:47 +05:30
Rishabh Dave
c656228efa
Merge pull request #55365 from kotreshhr/ceph-mds-replica-debug-logs
mds: Add debug messages in replica handling

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2024-02-09 12:24:00 +05:30
Rishabh Dave
fadd7860b1
Merge pull request #55411 from rishabh-d-dave/qa-cephfs-caps_helper
qa/cephfs: declare f-string to get values to substitute variable names

Reviewed-by: Jos Collin <jcollin@redhat.com>
2024-02-09 12:20:13 +05:30
Venky Shankar
d56402f830 Merge PR #55493 into main
* refs/pull/55493/head:
	client: remove unused/undefined fake_write_size()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2024-02-09 10:03:08 +05:30
Casey Bodley
2d61900c60
Merge pull request #55499 from cbodley/wip-squid-deprecate-blkin
doc: deprecate blkin tracing

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-02-08 22:14:54 +00:00
Radoslaw Zarzynski
72be1f4a8a
Merge pull request #55332 from athanatos/sjust/wip-crush-multi-choose
crush: add multistep retry rules

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2024-02-08 22:56:55 +01:00
Casey Bodley
16acfe0213
Merge pull request #54624 from cbodley/wip-cmake-qat
cmake: add ExternalProjects to enable QAT by default

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-02-08 21:13:52 +00:00
zdover23
e160811c5f
Merge pull request #55490 from eroldan/patch-2
doc/start: fix typo in hw-recs

Reviewed-by: Zac Dover <zac.dover@proton.me>
2024-02-09 05:38:48 +10:00
Eduardo Roldan
b80c12d080 doc:start.rst fix typo in hw-recs
s/power less/power loss/

Signed-off-by: Eduardo Roldan <trazor@gmail.com>
2024-02-09 03:06:32 +10:00
Casey Bodley
de57824519 doc: deprecate blkin tracing
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-08 10:56:03 -05:00
Kefu Chai
8ac5645372
Merge pull request #55267 from athos-ribeiro/cmake-empty-submodules
cmake: quote variable to allow empty values

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-02-08 23:14:09 +08:00
Guillaume Abrioux
dc8bb268c1
Merge pull request #55398 from ifed01/wip-ifed-fix-ceph-vol-migrate-wal
ceph-volume: Fix migration from WAL to data with no DB
2024-02-08 15:26:38 +01:00
Dhairya Parmar
7bcd0b0354 client: remove unused/undefined fake_write_size()
there are no usages of this function in entire codebase

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2024-02-08 17:58:42 +05:30
Afreen
5247d7d194 mgr/dashboard: fix error while accessing roles tab when policy attached
Fixes https://tracker.ceph.com/issues/64270

Issue:
======
Accessing Object->Users-Roles tab causing 500 internal servor error.
This is due to the "PermissionPolicies" which are attached to role and
backend was not handling this field for rgw roles.

Fix:
====
Added "PermissionPolicies" as the valid field in backend and updated
frontend to render the attached policy in formatted JSON

Signed-off-by: Afreen <afreen23.git@gmail.com>
2024-02-08 14:52:37 +05:30
Ivo Almeida
c1da4c673c
Merge pull request #55416 from ivoalmeida/snapshot-schedule-edit
mgr/dashboard: added edit functionality

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-02-08 05:51:46 -03:00
Venky Shankar
f9d771f002
Merge pull request #55465 from neesingh-rh/wip-63991
doc: add description of metric fields for cephfs-top

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2024-02-08 11:01:04 +05:30
Casey Bodley
d4bdde9e7d
Merge pull request #55479 from ronen-fr/wip-rf-fifolegacy
rgw: mark maybe_unused variables

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 20:47:23 +00:00
zdover23
608a5b2b92
Merge pull request #55475 from zdover23/wip-doc-2024-02-07-radosgw-admin-confval
doc/radosgw: add confval directives

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-02-08 05:04:35 +10:00
Adam King
583a355d5e
Merge pull request #55149 from rkachach/fix_issue_63992
mgr/prometheus: fix orch check to prevent Prometheus from crashing 

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2024-02-07 13:54:19 -05:00
Casey Bodley
84af8357d1 cmake: WITH_QATLIB/ZIP disabled on aarch64
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:13:21 -05:00
Casey Bodley
5d2560762e compressor: move QatAccel out of common
move the QatAccel instance out of the Compressor base class and into
the zlib and lz4 compressors that can use it

this avoids having to link QAT into the ceph-common library, and only
the plugins where it's necessary

had to add LZ4Compressor.cc to store the new static variable

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:13:21 -05:00
Casey Bodley
ec2e4b62a9 build/win32: disable qat options
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:13:21 -05:00
Casey Bodley
7710719dec rpm: add system_qat option, default on for centos9
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:13:21 -05:00
Casey Bodley
15046cf1ad cmake: enable WITH_QATLIB and WITH_QATZIP by default
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:13:21 -05:00
Casey Bodley
4e159853d2 cmake: WITH_QATZIP requires WITH_QATLIB or WITH_QATDRV
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:13:21 -05:00
Casey Bodley
1df11fd17c cmake: build from qatzip submodule
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:13:20 -05:00
Casey Bodley
e4e7dfd472 cmake: build qatzip from source when WITH_SYSTEM_QATZIP=OFF
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 11:12:45 -05:00