Commit Graph

136153 Commits

Author SHA1 Message Date
John Mulligan
47f5bdb149 mgr/nfs: convert _cmd_nfs_cluster_info to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
57e94dd502 cephfs/test_nfs: adapt _test_list_cluster to expect JSON output
Previously, the '... nfs cluster ls' command emitted newline separated
list of cluster names. For consistency with other module commands
reporting via JSON the cluster ls mgr function now emits JSON. Update
the test to match the new behavior of the module.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
b53ffbf865 mgr/nfs: convert _cmd_nfs_cluster_ls to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:10 -05:00
John Mulligan
fdac9f71e4 mgr/nfs: convert _cmd_nfs_export_info to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:10 -05:00
John Mulligan
656376d90a mgr/nfs: convert _cmd_nfs_export_ls to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:10 -05:00
J. Eric Ivancich
eac2905d9f rgw: implement initial flight server functionality
Implements the ability for a flight to be created when the object is
retrieved by an S3 get.

Adds FlightServer abilities ListFlights, GetFlightInfo, GetSchema, and
DoGet. Adds an interface for a store for flight information and adds
an in-memory implemtation of it.

This code is functionality is early-stage and lacks some planned
efficiencies.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2023-01-12 13:14:50 -05:00
Anthony D'Atri
82c9fe989f doc/releases: Clarify Quincy CephFS MDS upgrade process
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-01-12 09:21:57 -05:00
Aashish Sharma
cb17f28627
Merge pull request #49713 from rhcs-dashboard/fix-sse-daemon-name
mgr/dashboard: rgw server side encryption daemon name fix

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-01-12 10:30:40 +05:30
Yingxin
3c63fafa9c
Merge pull request #49540 from xxhdx1985126/wip-rebuild-missing-set
crimson/osd/pg: rebuild missing set when a new interval is created

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-01-12 11:50:09 +08:00
Xiubo Li
e268728014 mds: fix and skip submitting invalid osd request
When the first dentry have enough metadata and the size is larger
than max_write_size, it may submitting one invalid osd request to
Rados, which will cause the cephfs to be readonly.

Fixes: https://tracker.ceph.com/issues/58082
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-01-12 09:11:02 +08:00
Liu-Chunmei
9c97a7afa0
Merge pull request #48575 from liu-chunmei/multicore-cyanstore
crimson/os: cyanstore support multicore

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2023-01-11 16:40:33 -08:00
Laura Flores
e03067541c
Merge pull request #49712 from tchaikov/wip-packaging-in-setuptools
mgr/prometheus: use vendored "packaging" instead
2023-01-11 17:50:47 -06:00
colemitchell
cf27b3038c
Merge pull request #49719 from zdover23/wip-doc-2023-01-12-dev-developer-guide-basic-workflow-miscellaneous-reorganization
doc/dev: add push.autoSetupRemote instructions

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-01-11 16:33:02 -05:00
Zac Dover
049e5aaade doc/dev: add push.autoSetupRemote instructions
Explain how to set up push.autoSetupRemote so that the origin branch is
properly set up when running "get push" without the need for the
"--set-upstream" option.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-12 06:24:55 +10:00
Matan
ed409237e3
Merge pull request #48756 from Matan-B/wip-matanb-rollback-snap
crimson/osd: Support snapshot rollbacks 

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-01-11 18:18:43 +02:00
Matan
660f7bb15b
Merge pull request #49568 from Matan-B/wip-matanb-crimson-modified-ranges
crimson/osd/*recovery_backend: Rename Push/Pull Info/Op

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
2023-01-11 18:16:51 +02:00
Anthony D'Atri
c0db0bfdfa
Merge pull request #49715 from zdover23/wip-doc-2023-01-12-cephadm-host-management-osd-capitalization
doc/cephadm: s/osd/OSD/ where appropriate
2023-01-11 10:57:07 -05:00
Venky Shankar
317f672465 Merge PR #49711 into main
* refs/pull/49711/head:
	ceph.spec.in: remove the bcond_without cephfs_java option

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2023-01-11 21:01:51 +05:30
Zac Dover
559fea8b42 doc/cephadm: s/osd/OSD/ where appropriate
Capitalize the initialization "OSD" where it occurs in natural language
in cephadm/host-management.rst. This PR answers a request made by
Anthony D'Atri and seconded by Cole Mitchell in https://github.com/ceph/ceph/pull/49699#discussion_r1066171002.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-12 01:12:24 +10:00
Kefu Chai
cf6089200d mgr/prometheus: use vendored "packaging" instead
instead of using the top-level "packaging" module, use the one
vendored by setuptools.

packaging python module provides versioning defined by PEP-440.
but python3-packaging is provided by CentOS8 powertools repo,
which is not enabled by default. and in CentOS9, this package
is provided by AppStream instead of BaseOS.

as prometheus mgr module is included by ceph-mgr-module-core,
it would be desirable if our user can install ceph-mgr-module-core
without enabling powertools or AppStream repo on a CentOS or
its derivative distros.

fortunately, setuptools vendors packaging module. and both
CentOS8 and CentOS9 provide python3-setuptools in their BaseOS
repos.

in this change, instead of using "packging" module, we use the
venderored one, which is in turn embedded in pkg_resources.
this python module is provided by python3-setuptools on CentOS
distros, and python3-pkg-resources on Debian and its derivatives.

the packaging recipes are updated accordingly to reflect the
new runtime dependency.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2023-01-11 20:31:03 +08:00
Aashish Sharma
f1727f028d mgr/dashboard: rgw server side encryption daemon name fix
The config values for the server side encryption currently are wrongly set to the mon daemon by default. This PR intends to fix this issue

Fixes: https://tracker.ceph.com/issues/58419
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2023-01-11 18:00:09 +05:30
Adam C. Emerson
04d3a4f068 rgw: SimpleRadosReadAttrsCR uses an async RADOS call
Don't go through the 'system object' cache. This also saves us the use
of the RADOS async completion processor.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-11 01:46:45 -05:00
Adam C. Emerson
634673a64e rgw: Use cls_version for read/writes to global data sync status
The `radosgw-admin data sync init` command does *not* use
`cls_version` and just overwrites.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-11 01:37:41 -05:00
Adam C. Emerson
25ef265513 rgw: Reread sync status after acquiring lock in RGWDataSyncCR
If someone else got there first, we won't smash their work.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-11 01:35:58 -05:00
Adam C. Emerson
b0d401a0f4 rgw: Pull lock out of RGWInitDataSyncStatusCoroutine
RGWDataSyncCR manages the lock instead, holding it through StateInit
and StateBuildingFullSyncMaps but releasing it by StateSync.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-11 01:32:21 -05:00
Adam C. Emerson
2b3fbcf9b1 rgw: RGWContinuousLeaseCR takes arguments by value and moves them
Since we were taking them by reference and copying before, this is
strictly better. Callers that give us an RValue can skip the copy.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-11 01:26:29 -05:00
Adam C. Emerson
77deaa9b02 rgw: Get rid of some COOKIE_LEN preprocessor macros
Sticking random #defines everywhere is just atrocious style.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-11 01:26:27 -05:00
Yingxin
9ef2b8d2dd
Merge pull request #49686 from xxhdx1985126/wip-crimson-dump-metrics
crimson/admin: correct metrics dumping methods

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-01-11 13:44:23 +08:00
chunmei-liu
543b7d3334 crimson/os: make cyanstore not use proxy
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2023-01-10 21:40:00 -08:00
chunmei-liu
bc5876e3b9 crimson/os: make load_pgs() load pg on proper core
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2023-01-10 21:39:16 -08:00
chunmei-liu
7a58e875a5 crimson/os: support multicores for cyanstore
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-01-10 21:30:51 -08:00
Casey Bodley
113cda8834 rgw: add rgw_curl_tcp_keepalive option for http client requests
this can be useful to prevent long-lived connections from being dropped
due to inactivity

Fixes: https://tracker.ceph.com/issues/48402

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-01-11 00:23:40 -05:00
Shilpa Jagannath
852e60d6f3 rgw/multisite: clear objv before reading bucket sync status
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-11 00:21:27 -05:00
Soumya Koduri
e1c31b2997 rgw/bucket-sync: flush marker_tracker when the lease is lost
Also clear objv before reading the bucket sync status.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-01-11 00:17:57 -05:00
Shilpa Jagannath
d0725750b6 rgw/multisite: marker_tracker->finish() returns error
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-11 00:16:48 -05:00
Shilpa Jagannath
180d5d9783 rgw/multisite: if remote datalog is trimmed prematurely, sync status will report that it's behind the remote's max-marker even if there are no more entries to sync for each behind shard. if we get an empty listing, remove that shard from behind_shards.
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-11 00:15:23 -05:00
Soumya Koduri
abc5883604 rgw/multisite: Update marker and objv after acquiring the lease
In RGWDataSyncShardCR, after acquiring the lease, reread sync status
shard object to fetch the latest marker & objv stored.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-01-11 00:13:59 -05:00
Shilpa Jagannath
9aeb2aa38d rgw/multisite: add cls versioning for tracking data sync per shard object and store it in a vector
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-11 00:13:56 -05:00
Samuel Just
68149e9c99 ceph.spec.in: remove the bcond_without cephfs_java option
This effectively disable cephfs_java for rpm builds for now.
The only user appears to be cephfs jni bindings.

Fixes: https://tracker.ceph.com/issues/58382
Signed-off-by: Samuel Just <sjust@redhat.com>
2023-01-10 20:06:06 -08:00
Xuehan Xu
702fe1ccc3 crimson/admin: correct metrics dumping methods
First level object has no key, so we have to inclose metric objects with
an outer one

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-01-11 02:30:06 +00:00
colemitchell
58f33d83bc
Merge pull request #49699 from zdover23/wip-doc-2023-01-11-cephadm-host-management-removing-hosts
doc/cephadm: refine "Removing Hosts"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-01-10 14:31:23 -05:00
colemitchell
1eb04cbc5e
Merge pull request #49703 from zdover23/wip-doc-2023-01-11-rados-operations-move-colon
doc/rados: move colon

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-01-10 14:24:11 -05:00
colemitchell
7fe7819c71
Merge pull request #49700 from zdover23/wip-doc-2023-01-11-css-h3-padding
doc/css: add top-bar padding for h3 html element

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-01-10 14:20:16 -05:00
Zac Dover
b1a53d7621 doc/rados: move colon
Move colon in add-or-rm-osds.rst so that the sentence reads properly.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-11 05:08:35 +10:00
Zac Dover
c28cb53390 doc/css: add top-bar padding for h3 html element
Add "scroll-margin-top: 4em;" property to h3 html element.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-11 04:48:32 +10:00
Zac Dover
2e1fd63087 doc/cephadm: refine "Removing Hosts"
An intended edit to remove a redundant indefinite article became a
longer (but still brief) full editorial pass.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-11 04:29:02 +10:00
zdover23
7c9cfc9013
Merge pull request #49692 from zdover23/wip-doc-2023-01-11-header-fix
doc/css: add "span" padding to custom.css

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-01-11 04:10:22 +10:00
Ilya Dryomov
e55a6f618e
Merge pull request #49690 from idryomov/wip-58398
doc/man/ceph-rbdnamer: remove obsolete udev rule

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-01-10 18:44:28 +01:00
Zac Dover
dd9555b0ae doc/css: add "span" padding to custom.css
Add "scroll-top-bar: 2em;" for the "span" html element in custom.css so
that the top bar doesn't get in the way of headings bounded by the "span
element".

See also https://github.com/ceph/ceph/pull/49644.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-11 01:55:55 +10:00
Ilya Dryomov
8ca3bd5042 doc/man/ceph-rbdnamer: remove obsolete udev rule
Fixes: https://tracker.ceph.com/issues/58398
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-01-10 13:43:03 +01:00