Commit Graph

149032 Commits

Author SHA1 Message Date
John Mulligan
96a2f89dc5 CODEOWNERS: let orchestration cover all of python-common
While it's not perfectly correct to say the orchestration team owns
src/python-common, it's closer to the truth than not. It also ensures
that someone with domain specific knowledge is looking at the rest of
python-common outside just the deployment section (short of creating
some sort of new python-sig type group). This is relevant due to the
changes in PR #60377 as python-common's ceph package will be included
in cephadm.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2024-10-29 16:35:00 -04:00
Patrick Donnelly
13f4266694
Merge PR #60386 into main
* refs/pull/60386/head:
	qa/cephfs: override testing kernel with -k option

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-25 12:21:34 -04:00
Rishabh Dave
64350ee087
Merge pull request #60117 from rishabh-d-dave/mgr-vol-base-init
mgr/vol: better to call base class __init__() at beginning

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-25 18:40:59 +05:30
Rishabh Dave
fc40c9196d
Merge pull request #60153 from rishabh-d-dave/mgr-vol-cv-waiting
mgr/vol: remove unused variable

Reviewed-by: Jos Collin <jcollin@redhat.com>
2024-10-25 18:40:19 +05:30
Guillaume Abrioux
df4367e352
Merge pull request #60395 from guits/replace-osd-enhancement
ceph-volume: support zapping by osd-id for RAW OSDs
2024-10-25 13:45:20 +02:00
Guillaume Abrioux
4941d098e3 ceph-volume: support zapping by osd-id for RAW OSDs
Currently it is only possible to zap by osd-id for LVM-based OSDs.

This commit introduces the required changes in order to support zapping
by osd-id for RAW-based OSDs.

Fixes: https://tracker.ceph.com/issues/68576

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
2024-10-25 07:52:05 +00:00
Rishabh Dave
eb6dbeec13
Merge pull request #59847 from rishabh-d-dave/mgr-vol-spawn-threads
mgr/vol: reuse code to spawn threads

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-25 11:58:38 +05:30
Anthony D'Atri
0449faaa8e
Merge pull request #60480 from truongsinh/patch-2
doc: Note that to set layouts or quotas, clients require the `p` flag
2024-10-24 21:47:29 -04:00
TruongSinh Tran-Nguyen
13c7c9d998 doc/cephfs: use 'p' flag to set layouts or quotas
Remind users that clients must use the 'p' flag when writing file
layouts.

This PR is made in response to
https://www.reddit.com/r/ceph/comments/1gbad51/comment/ltkgd5v/

Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: TruongSinh Tran-Nguyen <i@truongsinh.pro>
2024-10-25 10:42:35 +10:00
Adam King
bd0160de81
Merge pull request #59982 from rkachach/fix_issue_mgmt_gw_high_availability
Adding HA support for mgmt-gateway and oauth2-proxy services

Reviewed-by: Adam king <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2024-10-24 10:45:42 -04:00
Rishabh Dave
adc6f2dbb5
Merge pull request #58898 from neesingh-rh/wip-fix-strict-iec-cast
src/common : proper handling of units in `strict_iec_cast`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-10-24 19:46:48 +05:30
Rishabh Dave
a9824956d4 mgr/vol: add helpers to spawn all threads and more threads
Also add log messages for in these helper methods to allow tracking when
and why more threads were spawned.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-24 19:21:35 +05:30
Rishabh Dave
72395884f9 mgr/vol: reuse code for spawning threads
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2024-10-24 19:21:33 +05:30
Patrick Donnelly
0e12e2454c
Merge PR #60473 into main
* refs/pull/60473/head:
	mailmap, githubmap, organisationmap: Add Anuradha Gadge

Reviewed-by: Adam King <adking@redhat.com>
2024-10-24 08:34:54 -04:00
Patrick Donnelly
e63c8c56ca
Merge PR #60457 into main
* refs/pull/60457/head:
	.github/check-license: add friendly name

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-10-24 08:32:46 -04:00
Rishabh Dave
230d131b36
Merge pull request #59002 from neesingh-rh/wip-65820
qa/tasks/fwd_scrub: remove unnecessary traceback

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-10-24 16:57:17 +05:30
Rishabh Dave
a35e7b26da
Merge pull request #60119 from rishabh-d-dave/mgr-vol-comments
mgr/vol: add comments to explain queuing data structures

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2024-10-24 16:54:50 +05:30
Ilya Dryomov
dcd399e666
Merge pull request #60042 from sunilangadi2/migration_with_namespace_test
qa/workunits/rbd: cover native migration between namespaces

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-10-24 12:02:09 +02:00
Anuradha Gadge
5b5db8974b mailmap, githubmap, organisationmap: Add Anuradha Gadge
Signed-off-by: Anuradha Gadge <anuradha.gadge@ibm.com>
2024-10-24 12:46:12 +05:30
Ilya Dryomov
cf96f21550
Merge pull request #60420 from nbalacha/wip-nbalacha-namespace-doc
doc/rbd: namespace mirroring updates

Reviewed-by: Sunil Angadi <Sunil.Angadi@ibm.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-10-24 09:12:30 +02:00
afreen23
92edf6c897
Merge pull request #60355 from rhcs-dashboard/carbonize-hosts-form
mgr/dashboard: carbonize Cluster > Hosts form

Reviewed-by: Afreen Misbah <afreen@ibm.com>
2024-10-24 12:11:07 +05:30
Zac Dover
25d9bedaa1
Merge pull request #60465 from zdover23/wip-doc-2024-10-24-cephfs-troubleshooting
doc/cephfs: edit "Disabling Volumes Plugin"

Reviewed-by: Jos Collin <jcollin@redhat.com>
2024-10-24 15:27:17 +10:00
Zac Dover
3e043a903c doc/cephfs: edit "Disabling Volumes Plugin"
Improve the English language in the section 'Disabling Volumes Plugin"
(which here becomes "Disabling the Volumes Plugin") in the
doc/cephfs/troubleshooting.rst file.

The change here is similar to a change introduced in
https://github.com/ceph/ceph/pull/60448/. That PR seems to be unable to
pass the "make check", and this PR is part of a test to see if breaking
the changes in that PR into several smaller changes results in mergeable
PRs.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-10-24 14:52:58 +10:00
Venky Shankar
6910e4c010
Merge pull request #59027 from hit1943/65971_fix
client: fixed a bug that read operation hung

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-10-24 09:54:11 +05:30
N Balachandran
69992c8f79 doc/rbd : add namespace mirroring updates
Updates the rbd docs with the new remote-namespace
mirroring configuration option.

Signed-off-by: N Balachandran <nibalach@redhat.com>
2024-10-24 09:48:29 +05:30
Yingxin
20f7d47e86
Merge pull request #60276 from ceph/bypass_sr
test/crimson: disable stall-detector on aarch64 to fix asan failures

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-10-24 09:29:11 +08:00
Zac Dover
9f53c881dc
Merge pull request #60460 from zdover23/wip-doc-2024-10-24-start-beginners-guide
doc/start: add vstart install guide

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-10-24 10:19:40 +10:00
Zac Dover
a42be085bd doc/start: add vstart install guide
Add "vstart Cluster Installation and Configuration Procedure" to the
Beginner's Guide.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-10-24 09:04:08 +10:00
Gil Bregman
5c93605731
Merge pull request #60413 from gbregman/main
Add namespace netmask parameters to nvmeof configuration
2024-10-23 22:54:01 +03:00
Ernesto Puerta
42e4b45d30
.github/check-license: add friendly name
In the absence of `name`, GH uses the `job` ID of the action to select which checks are required, and `pull_request` is rather confusing.

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
2024-10-23 20:34:40 +02:00
Dnyaneshwari
68c9f16fab mgr/dashboard: carbonize Cluster > Hosts form
Fixes: https://tracker.ceph.com/issues/68264

Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redbat.com>
2024-10-23 22:00:08 +05:30
afreen23
d908c9ec8a
Merge pull request #60399 from rhcs-dashboard/rgw-bucket-get-fix-for-account
mgr/dashboard: fix bucket get for s3 account owned bucket

Reviewed-by: Afreen Misbah <afreen@ibm.com>
2024-10-23 21:28:03 +05:30
Ernesto Puerta
64f2dfd69d
Merge pull request #60388 from ceph/fix-check_license_typo-main
ci: fix typo in check-license
2024-10-23 16:12:35 +01:00
Sunil Angadi
8403096655 added tests migration with namespace
Signed-off-by: Sunil Angadi <Sunil.Angadi@ibm.com>
2024-10-23 19:06:41 +05:30
Hemanth
fca07e95ea
Merge pull request #58647 from rishabh-d-dave/mgr-vol-mod-disable
mgr: allow disabling always-on modules
2024-10-23 17:57:50 +05:30
Vallari Agrawal
d10ea1f412
Merge pull request #60316 from VallariAg/wip-nvmeof-teuthology-mtls-test
qa/suites/nvmeof: add mtls test
2024-10-23 17:28:53 +05:30
Soumya Koduri
16b44ff67e
Merge pull request #60157 from soumyakoduri/wip-skoduri-lc-nullinstance
rgw/lc: Fix issues with non-current objects with instance empty

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-10-23 17:22:08 +05:30
Adam Kupczyk
e7d047a589
Merge pull request #60258 from aclamk/wip-aclamk-cbt-improve-show-label
os/bluestore/ceph-bluestore-tool: Modify show-label for many devs
2024-10-23 13:38:15 +02:00
cailianchun
5639030d48 test/crimson: disable stall-detector on aarch64 to fix asan failures
Ceph crimson uses seastar on debug mode which would enable ASAN, while stall-detector uses glibc backtrace function which would cause ASAN failures on aarch64.
Reason see scylladb/scylladb#15090 (comment)

Because arm ci servers in lab are "elderly", causing stall happened often, this PR is to disable stall-detector until seastar upstream migrated to libunwind, see scylladb/seastar#1878
Seastar does not provide a function to disable stall-detector, at present, increase stall-detector time to avoid stall-detector timeout on arm platform.

fixes: https://tracker.ceph.com/issues/65635

Signed-off-by: cailianchun <arm7star@qq.com>
2024-10-23 03:00:55 +00:00
Anthony D'Atri
f2a7ed4952
Merge pull request #60433 from indirasawant/doc_fix_1
doc/cephfs: rearrange subvolume group information
2024-10-22 18:48:06 -04:00
Indira Sawant
f6cf7ae528 doc/cephfs: rearrange subvolume group information
Rearranging the documentation to align it with CephFS encapsulation design.

Signed-off-by: Indira Sawant <indira.sawant@ibm.com>
2024-10-22 16:45:10 -05:00
Zac Dover
429b01cb94
Merge pull request #60423 from zdover23/wip-doc-2024-10-22-cephadm-services-smb
doc/cephadm: correct "ceph orch apply" command

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-10-23 06:17:21 +10:00
Nizamudeen A
dd4549238e mgr/dashboard: fix bucket get for s3 account owned bucket
**Issue 1:**

When a bucket is created with a user that is owner by the account user,
it fails to fetch the info for the bucket because the owner of that
bucket is considered as owned by the account rather than the user.

dashboard api try to fetch some info for the bucket on the basis of the
bucket owner which in this case fails since its not a real user.

To keep the existing behavior as it is and fix the current issue, I am
doing a check to make sure the user id exists or not. if it doesn't
exist, we goes on to fetch using the dashboard user.

**Issue 2**
Editing the bucket owner by the account is broken. So disabling the
ownership change for the bucket owned by account until we have user
account management for rgw in the dashboard

Fixes: https://tracker.ceph.com/issues/68622
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-10-22 19:18:39 +05:30
Soumya Koduri
60149ade9d rgw/lc: Fix issues with non-current objects with instance empty
When the bucket versioning is enabled, old plain object entry is converted
to versioned by updating its instance as "null" in its raw head/old object.
However its instance remains empty in the bi list entry. Same is the case for
the entries created after versioning is suspended and re-enabled.

So to access such objects which are non-current, we need to set rgw_obj_key.instance as
1) "null" to read the actual raw obj and
2) empty while accessing/updating their bi entry.

Fixes: https://tracker.ceph.com/issues/68402

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2024-10-22 19:08:13 +05:30
Zac Dover
c420667664 doc/cephadm: correct "ceph orch apply" command
s/orch apply/ceph orch apply/ in a command where "ceph" was missing.

This was reported by Eugen Block to Zac Dover on 22 Oct 2024 through
Slack.

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-10-22 21:30:02 +10:00
Patrick Donnelly
ee6523b618
Merge PR #60106 into main
* refs/pull/60106/head:
	msg/async/ProtocolV2: pass `desc` as `std::string_view` to write()

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2024-10-21 21:00:21 -04:00
Patrick Donnelly
4c38857ab2
Merge PR #60174 into main
* refs/pull/60174/head:
	common/Finisher: pass name as std::string_view to ctor
	common/Finisher: add method get_thread_name()
	mgr/ActivePyModule: build thread name with fmt
	mgr/ActivePyModule: return std::string_view instead of std::string copy
	common/Finisher: use fmt to build strings
	common/Finisher: un-inline ctor and dtor
	common/Finisher: add `const` to several fields
	common/Finisher: merge duplicate field initializers
	common/Finisher: call notify_one() instead of notify_all()
	common/Finisher: wake up after pushing to the queue
	common/Finisher: do not wake up the thread if already running
	common/Finisher: call logger without holding the lock
	common/Finisher: use `std::lock_guard` instead of `std::unique_lock`
	common/Finisher: merge all queue() container methods into one template

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-10-21 20:57:15 -04:00
Patrick Donnelly
35c0078261
Merge PR #60214 into main
* refs/pull/60214/head:
	mds/MDCache: use `auto`
	mds/CDir: use the erase() return value
	mds/MDCache: remove unnecessary empty() check
	mds/MDCache: use the erase() return value
	mds/MDCache: pass iterator by value

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-10-21 20:56:01 -04:00
Patrick Donnelly
514ff50d95
Merge PR #60216 into main
* refs/pull/60216/head:
	common/options: pass name as rvalue reference
	common/config: use libfmt to build strings
	common/config: use emplace_back() instead of push_back()
	common/HeartbeatMap: pass name as rvalue reference
	common/config_obs_mgr: use the erase() return value
	common/SloppyCRCMap: use the erase() return value
	common: disable `boost::intrusive::constant_time_size`

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-10-21 20:54:15 -04:00
Patrick Donnelly
bb13534243
Merge PR #60220 into main
* refs/pull/60220/head:
	msg/async/AsyncConnection: move the writeCallback instead of copying it
	msg/async/AsyncConnection: do not wrap writeCallback in `std::optional`
	msg/async/frames_v2: use zero-initialization instead of memset()
	msg/async/Event: use zero-initialization instead of memset()
	msg/Message: use zero-initialization instead of memset()
	msg/async/ProtocolV2: eliminate redundant std::map lookups
	msg/async/ProtocolV[12]: reverse the std::map sort order
	msg/async/ProtocolV[12]: use `auto`
	msg/async/ProtocolV[12]: use range-based `for`
	msg/async/ProtocolV1: use zero-initialization instead of memset()

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
2024-10-21 20:53:44 -04:00