Commit Graph

137542 Commits

Author SHA1 Message Date
Ilya Dryomov
465bf1d23a
Merge pull request #50915 from idryomov/wip-rbd-mirror-labeled-perf-release-note
PendingReleaseNotes: add a note for rbd-mirror daemon perf counters

Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-04-06 15:25:05 +02:00
Casey Bodley
75d37028fe
Merge pull request #50707 from max-licc/rgw_cache_disable
rgw: fix rgw cache invalidation after unregister_watch() error

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2023-04-06 09:11:40 -04:00
Casey Bodley
2d6d195afa
Merge pull request #50550 from cbodley/wip-58908
rgw/keystone: use secret key from EC2 for sigv4 streaming mode

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2023-04-06 09:10:49 -04:00
Casey Bodley
7dd680ac8c
Merge pull request #49409 from 5cs/fix-multipart-upload-encryption
rgw/sse-s3: fix bucket encryption of multipart upload

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-04-06 09:08:51 -04:00
Nizamudeen A
8b9559e12a
Merge pull request #50884 from rhcs-dashboard/fix-grafana-e2e
mgr/dashboard: fix for grafana e2e failing on rgw daemon performance

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2023-04-06 16:37:08 +05:30
Ilya Dryomov
e89f581513 PendingReleaseNotes: add a note for rbd-mirror daemon perf counters
This was missed in commit 1a1477b9fd ("rbd-mirror: add and rename
perf counters for journal and snapshot mirroring").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-06 12:32:11 +02:00
Nizamudeen A
adbccad770 mgr/dashboard: fix for grafana e2e failing on rgw daemon performance
Started happening after: https://github.com/ceph/ceph/pull/49248/

Fixes: https://tracker.ceph.com/issues/59353
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-06 14:43:08 +05:30
Nizamudeen A
ca8b107cf2 mgr/dashboard: fix create osds step failing on the default option
the backend was reporting with a keyError which doesn't find the
`encrypted` key.

Fixes: https://tracker.ceph.com/issues/59319
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-06 12:07:20 +05:30
Nizamudeen A
caa0c456b1 mgr/dashboard: add option to skip the create OSDs step
Fixes: https://tracker.ceph.com/issues/59319
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-06 12:06:52 +05:30
zdover23
898e092461
Merge pull request #50825 from zdover23/wip-doc-2023-04-02-rados-operations-health-checks-2-of-x
doc/rados/ops: edit health-checks.rst (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-06 15:12:22 +10:00
Xiubo Li
907bf5214d qa/workunit: print the detail commands excuted in the scripts
This will make it to be much easier when debugging the qa tests failures.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-04-06 10:38:14 +08:00
Zac Dover
0565f59698 doc/rados/ops: edit health-checks.rst (2 of x)
Edit docs/rados/operations/health-checks.rst (2 of x). PR#50674, the PR
that immediately precedes this PR in the series of PRs that line-edit
health-checks.rst, wrongly identified this series as having five
sections. This has been rectified by using the "2 of x" formulation.

Follows https://github.com/ceph/ceph/pull/50674

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-06 12:04:49 +10:00
Patrick Donnelly
69565dbbf1
qa: load file system info if not created
Mounts may create a Filesystem object which does not create the file
system. This causes self.id to be Null when we try to wait for daemons
to be up. Load it just in time!

Fixes: https://tracker.ceph.com/issues/59332
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-04-05 18:24:22 -04:00
Yuri Weinstein
9fa38ab17f
Merge pull request #50574 from rzarzynski/wip-bug-51900
msg/async: don't abort when public addrs mismatch bind addrs

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2023-04-05 14:53:02 -07:00
Yuri Weinstein
a1d1280cbd
Merge pull request #49987 from ifed01/wip-ifed-fix-spillover-alert
os/bluestore: fix spillover alert

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2023-04-05 14:51:57 -07:00
Yuri Weinstein
f85e0f1242
Merge pull request #50490 from ronen-fr/wip-rf-expected
common: bump up tl:expected to latest version

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-04-05 14:35:28 -07:00
Yuri Weinstein
cfe15d3371
Merge pull request #50479 from cbodley/wip-fmt-undef-header-only
fmt: remove FMT_HEADER_ONLY defines

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2023-04-05 14:33:48 -07:00
Yuri Weinstein
f32fc724f0
Merge pull request #50095 from ifed01/wip-ifed-fix-fit-to-fast
os/bluestore: allow 'fit_to_fast' selector for single-volume osd

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2023-04-05 14:32:21 -07:00
Yuri Weinstein
992f1bc926
Merge pull request #50499 from idryomov/wip-remove-osd-op-soid
osd: remove unused OSDOp::soid member

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-04-05 14:31:53 -07:00
Ilya Dryomov
071167fa75
Merge pull request #50816 from idryomov/wip-list-watchers-clear
librbd: clear Image::list_watchers() list before populating it

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2023-04-05 19:04:12 +02:00
Pere Diaz Bou
780f49325a mgr/dashboard: fix eviction of all FS clients
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
2023-04-05 18:56:36 +02:00
Soumya Koduri
a3b7f99840
Merge pull request #50859 from soumyakoduri/wip-skoduri-gc-cmd
rgw/gc: Check for valid RadosStore for `radosgw-admin gc` cmd

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-04-05 21:57:48 +05:30
Rishabh Dave
8b14da0466 do_cmake.sh: set python version for Fedora 37
If do_cmake.sh is being exeuted on Fedora 37 set Python version to 3.11.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-05 21:57:26 +05:30
Casey Bodley
d4f94e8b17
Merge pull request #50842 from mkogan1/wip-ubu-SigDoesNotMatch-cont
rgw : fix python script using s3cmd with error code 403 for ubuntu 20.04

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-04-05 11:57:05 -04:00
Rishabh Dave
a2b3bafcfb
Merge pull request #50664 from rishabh-d-dave/fs-qa-caps-helper-mds
qa/cephfs: upgrade gen_mds_cap_str() in caps_helper 

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-04-05 19:47:36 +05:30
Rishabh Dave
53ac817bde
Merge pull request #50665 from rishabh-d-dave/fs-qa-test-multifs-auth-simplify
qa/cephfs: simplify some code in test_multifs_auth.py 

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-04-05 19:47:06 +05:30
Aashish Sharma
ea5f4f0ad5
Merge pull request #50557 from rhcs-dashboard/dashboard-edit-zone-zonegroup
mgr/dashboard: add support for editing RGW zonegroup


Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-05 16:45:45 +05:30
Rishabh Dave
265abc79b3 qa/cephfs: simplify some code in test_multifs_auth.py
test_mutlifs_auth.TestMDSCaps._create_client() not only creates a client
but also generate caps strings for the client as per the parameter this
method receives and and then writes the keyring to all remote machines.
This creates confusion when reading code on test methods in TestMDSCaps.
Let's re-arrange this code such that this confusion is avoided.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-05 16:07:46 +05:30
Nizamudeen A
5870e561db
Merge pull request #50843 from rhcs-dashboard/mirror-progress
mgr/dashboard: fix displaying mirror image progress

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-04-05 12:49:52 +05:30
zdover23
477d70cbdb
Merge pull request #50855 from zdover23/wip-doc-2023-04-04-rados-operations-monitoring-osd-pg-1-of-x
doc/rados/ops: edit monitoring-osd-pg.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-05 15:26:48 +10:00
Zac Dover
bd213c244e doc/rados/ops: edit monitoring-osd-pg.rst (1 of x)
Line-edit doc/rados/operations/monitoring-osd-pg.rst (1 of x).

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-05 14:41:09 +10:00
Adam King
5a4b88b005
Merge pull request #48630 from rkachach/fix_issue_57931
mgr/cephadm: Adding extra arguments support for RGW frontend

Reviewed-by: Adam King <adking@redhat.com>
2023-04-04 20:53:53 -04:00
avanthakkar
d9efaed62e mgr/dashboard: add support for editing RGW zonegroup
Fixes: https://tracker.ceph.com/issues/59239
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Co-authored-by: Aashish Sharma <aasharma@redhat.com>
2023-04-05 02:15:31 +05:30
Avan
9c3ffdda1c
Merge pull request #49248 from rhcs-dashboard/rm-perf-counters-prometheus-module
mgr/prometheus: introduce fetch_perf_counters_metrics module option

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-05 02:00:56 +05:30
Adam King
735bed9d7f
Merge pull request #50237 from rkachach/fix_issue_rgw_multisite_automated_testing
qa: Adding rgw multisite support testing

Reviewed-by: Adam King <adking@redhat.com>
2023-04-04 14:29:41 -04:00
Adam King
73e064bdfc
Merge pull request #50736 from rkachach/fix_issue_59189
mgr/cephadm: use a dedicated cephadm tmp dir to copy remote files

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-04-04 14:21:31 -04:00
Adam King
355430a752
Merge pull request #50846 from rkachach/fix_issue_59298
mgr/cephadm: use SFTP instead of SCP to copy cephadm remote files

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-04-04 14:13:56 -04:00
Avan Thakkar
5a058b8fb3 mgr/prometheus: introduce fetch_perf_counters_metrics module option
Fixes: https://tracker.ceph.com/issues/58164
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Introducing module option in prometheus module to enable/disable support for exporting ceph daemons
perf counters as prometheus metrics, by default this option will be disabled. The use case for this option
is in case if ceph-exporter deployment failed for any reason then user still can have option to fetch metrics
from promethues exporter.
2023-04-04 23:12:29 +05:30
Adam King
5a46fd10ba
Merge pull request #50743 from phlogistonjohn/jjm-update-mypy
update pinned mypy version

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-04-04 13:15:33 -04:00
Soumya Koduri
1103966d81 rgw/gc: Check for RadosStore for radosgw-admin gc command
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-04-04 22:45:27 +05:30
Ilya Dryomov
76856d90e0 librbd: avoid generating ESHUTDOWN in ManagedLock
EBLOCKLISTED has a very special meaning but happens to be an alias for
ESHUTDOWN.  If the client gets blocklisted, we always want to propagate
EBLOCKLISTED error code since it's generated by the OSD.

For ManagedLock use case of indicating that an operation on the lock
raced with lock shut down, meaning that a higher level request can just
be restarted, ERESTART should do.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Ilya Dryomov
1d943f8c47 librbd: fix recursive locking on owner_lock in ImageDispatch
needs_exclusive_lock() calls acquire_lock() with owner_lock held.
If lock acquisiton races with lock shut down, ManagedLock completes
ImageDispatch context directly and dispatch is retried immediately on
the same thread (due to DISPATCH_RESULT_RESTART).  This results in
recursion into needs_exclusive_lock() and, barring locking issues, can
lead to unbounded stack growth if lock shut down takes its time.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Ilya Dryomov
a14498eff6 test/librados_test_stub: drop watches only after actually blocklisting
Eliminate a race where a client is able to submit an operation after
WatchCtx2::handle_error() is invoked on its watch due to blocklisting.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Ilya Dryomov
0dfe87d3b6 test/librados_test_stub: raise a watch error on blocklisting
Simulate getting MWatchNotify CEPH_WATCH_EVENT_DISCONNECT message after
the client is blocklisted.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Pedro Gonzalez Gomez
ddb22aa0b3
Merge pull request #50600 from rhcs-dashboard/delete-rgw-multisite
mgr/dashboard: delete rgw multisite


Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-04 16:43:16 +02:00
Guillaume Abrioux
2cd5eb5a36
Merge pull request #50279 from cfsnyder/wip-58857-ceph-volume-fast-allocs
ceph-volume: fix issue with fast device allocs when there are multiple PVs per VG
2023-04-04 15:08:52 +02:00
Anthony D'Atri
078bc30936
Merge pull request #50819 from bluikko/bluikko-cephfs-volumes-prompts
doc/cephfs: fix prompts in fs-volumes.rst
2023-04-04 07:45:01 -04:00
Neeraj Pratap Singh
658133ac67 doc: updating the doc with chamges related to delay option in cephfs-top
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2023-04-04 16:26:05 +05:30
Neeraj Pratap Singh
07ffc8e1b4 cephfs-top: fixing the -d [--delay] option in cephfs-top
Fixes: https://tracker.ceph.com/issues/59188
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
2023-04-04 16:25:36 +05:30
Nizamudeen A
832e1e9622
Merge pull request #50845 from rhcs-dashboard/update-grafana-version
monitoring/grafana: update the grafana version

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-04 11:31:23 +05:30