Commit Graph

135954 Commits

Author SHA1 Message Date
Adam King
f7a5a3b49b
Merge pull request #47383 from rhcs-dashboard/ceph-exporter-cephadm-changes
exporter: cephadm changes

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 11:54:01 -05:00
Adam King
afdc8d3bec
Merge pull request #49389 from adk3798/git-archive-fix
qa/tasks/cephadm.py: fix pulling cephadm from git.ceph.com

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 10:31:21 -05:00
Nizamudeen A
6a7742f5df
Merge pull request #49726 from rhcs-dashboard/cephadm-e2e-fixes
mgr/dashboard: cephadm dashboard e2e fixes 

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-01-13 20:31:11 +05:30
Soumya Koduri
230a6e0c0e rgw: Resolve sync stuck in previous gen
In case if any data log entries are missing for the older
generations, the sync server may not mark those shards as done
and can get stuck in that old gen for ever.

To avoid that, whenever a future gen entry is read, write the undone (shard,gen)
entry to error repo so that it can be processed and marked as done
and hence sync can progress eventually.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-01-13 09:49:56 -05:00
Adam King
1366e8f276
Merge pull request #49635 from rkachach/fix_issue_58378
mgr/mgr_util: fixing some tox issues

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-01-13 09:47:33 -05:00
Shilpa Jagannath
fb92311b3e rgw/multisite: return error from RGWLastCallerWinsCR() to track marker update failures
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-13 09:46:44 -05:00
Adam C. Emerson
dc4685f693 rgw: Check for lost lease more often
Flush the marker tracker and abort if we don't still have it.

Resolves: rhbz#2129718
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-13 09:19:53 -05:00
Shilpa Jagannath
8ff79b1c62 rgw/multisite: don't disable versioning on archive zone upon source bucket modifications
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-13 09:12:33 -05:00
Shilpa Jagannath
bcea963d97 rgw/multisite: object should generate version id on archive zone, even when versioning
is disabled on primary

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-13 08:53:21 -05:00
Shilpa Jagannath
bfebd24591 rgw/multisite: take the bucket lease before checking if bucket sync is enabled/disabled
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-13 08:51:03 -05:00
Soumya Koduri
c55c505090 rgw/multisite: Add testcases for sync policy feature
Added test cases for the various use-cases of multisite sync
policy feature listed in
https://docs.ceph.com/en/latest/radosgw/multisite-sync-policy/

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-01-13 08:27:47 -05:00
Yehuda Sadeh
9f774b4dec rgw: fix get sync policy handler if bucket_id is empty
Fixes: https://tracker.ceph.com/issues/48416

bucket was passed in without bucket_id, now reading entrypoint
info if needed.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2023-01-13 08:27:47 -05:00
Adam C. Emerson
a1ea877635 rgw: LatencyConcurrencyControl warns on very high latency
Limited to only warn every five minutes.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-13 08:27:39 -05:00
Nizamudeen A
fe8d757e13 mgr/dashboard: cephadm dashboard e2e fixes
Fixes: https://tracker.ceph.com/issues/58406
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-01-13 14:56:16 +05:30
Samuel Just
e4b1598994
Merge pull request #49417 from athanatos/sjust/backburner/wip-smp-option
crimson/osd/main: get full config before starting reactor

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-01-12 18:34:48 -08:00
Adam C. Emerson
b5d5da9c4d rgw: Reduce data sync parallelism in response to RADOS lock latency
Lock latency in RGWContinuousLeaseCR gets high enough under load that
the locks end up timing out, leading to incorrect behavior.

Monitor lock latency and cut concurrent operations in half if it goes
above ten seconds.

Cut currency to one if it goes about twenty seconds.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-12 18:13:46 -05:00
Adam C. Emerson
900068ef93 rgw: SimpleRadosWriteAttrsCR uses an async RADOS call
Don't go through the 'system object' cache. This also saves us the use
of the RADOS async completion processor.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-12 18:05:41 -05:00
Adam C. Emerson
aea643ada6 rgw: SimpleRadosWriteCR uses an async RADOS call
Don't go through the 'system object' cache. This also saves us the use
of the RADOS async completion processor.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-12 18:03:43 -05:00
Adam C. Emerson
a366b900b5 rgw: SimpleRadosReadCR uses an async RADOS call
Don't go through the 'system object' cache. This also saves us the use
of the RADOS async completion processor.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-12 17:49:55 -05:00
Patrick Donnelly
fc7bf39dee
tools/cephfs: fix traceback from missing envvar
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-01-12 16:12:52 -05:00
John Mulligan
e03331e7c4 qa/test_nfs: fix test failure when cluster does not exist
The patches that add object formatting / decorators to the nfs module
also made error handling more generic when accessing an nfs cluster and
now returns a nonzero exit code. A test was after the PR adding the
object format support that only checked an error message.
Update the test to match the new nfs module behavior as well as fixing a
typo.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 15:43:54 -05:00
John Mulligan
55db320d2e mgr/nfs: autopep8 updates
These formatting changes are made by autopep8 when running tox.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
ea021f7ca4 mgr/nfs: remove unused exception_handler function
This function is now unused as we no longer need to coerce exceptions
into response tuples at the layer in the code.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
098c244983 mgr/nfs: remove unused export_cluster_checker function
This decorator is no longer needed as equivalent functionality is
handled internally by the class.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
9a73887291 mgr/nfs: convert _cmd_nfs_cluster_config_get to ErrorResponseHandler decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
40d36a98b5 mgr/nfs: convert _cmd_nfs_cluster_config_reset to EmptyResponder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
a4c131885f mgr/nfs: convert _cmd_nfs_cluster_config_set to EmptyResponder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
59b15dd89e mgr/nfs: convert _cmd_nfs_export_apply to use Responder decorator
The "export apply" functionality is unusual in that it allows either
one or multiple nested requests to change or create an export.
The previous implementation would concatenate the results of
multiple change operations into a single string. It also would continue
making changes if one case failed, adding the error to the string
and setting a non-zero error code.

The updated version keeps the general behavior but returns structured
JSON (or other formatted data) with one entry per change request.  In
order to accomplish this and match the old behavior as closely as
possible we add an intermediate type (AppliedExportResults) that can
return both the response data (the `to_simplified` method) and track if
there was a failure mixed in with the various updates (the
`mgr_return_value` method).

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
ea78326852 mgr/nfs: convert _cmd_nfs_cluster_rm to use EmptyResponder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
3c9102bcba mgr/nfs: convert _cmd_nfs_cluster_create to use EmptyResponder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
ee34bd9361 mgr/nfs: convert _cmd_nfs_export_rm to use EmptyResponder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
ff5730a8e8 mgr/nfs: convert _cmd_nfs_export_create_cephfs to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
47f5bdb149 mgr/nfs: convert _cmd_nfs_cluster_info to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
57e94dd502 cephfs/test_nfs: adapt _test_list_cluster to expect JSON output
Previously, the '... nfs cluster ls' command emitted newline separated
list of cluster names. For consistency with other module commands
reporting via JSON the cluster ls mgr function now emits JSON. Update
the test to match the new behavior of the module.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:11 -05:00
John Mulligan
b53ffbf865 mgr/nfs: convert _cmd_nfs_cluster_ls to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:10 -05:00
John Mulligan
fdac9f71e4 mgr/nfs: convert _cmd_nfs_export_info to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:10 -05:00
John Mulligan
656376d90a mgr/nfs: convert _cmd_nfs_export_ls to use Responder decorator
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-01-12 13:44:10 -05:00
J. Eric Ivancich
eac2905d9f rgw: implement initial flight server functionality
Implements the ability for a flight to be created when the object is
retrieved by an S3 get.

Adds FlightServer abilities ListFlights, GetFlightInfo, GetSchema, and
DoGet. Adds an interface for a store for flight information and adds
an in-memory implemtation of it.

This code is functionality is early-stage and lacks some planned
efficiencies.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2023-01-12 13:14:50 -05:00
Anthony D'Atri
82c9fe989f doc/releases: Clarify Quincy CephFS MDS upgrade process
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-01-12 09:21:57 -05:00
Aashish Sharma
cb17f28627
Merge pull request #49713 from rhcs-dashboard/fix-sse-daemon-name
mgr/dashboard: rgw server side encryption daemon name fix

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-01-12 10:30:40 +05:30
Yingxin
3c63fafa9c
Merge pull request #49540 from xxhdx1985126/wip-rebuild-missing-set
crimson/osd/pg: rebuild missing set when a new interval is created

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-01-12 11:50:09 +08:00
Liu-Chunmei
9c97a7afa0
Merge pull request #48575 from liu-chunmei/multicore-cyanstore
crimson/os: cyanstore support multicore

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2023-01-11 16:40:33 -08:00
Laura Flores
e03067541c
Merge pull request #49712 from tchaikov/wip-packaging-in-setuptools
mgr/prometheus: use vendored "packaging" instead
2023-01-11 17:50:47 -06:00
colemitchell
cf27b3038c
Merge pull request #49719 from zdover23/wip-doc-2023-01-12-dev-developer-guide-basic-workflow-miscellaneous-reorganization
doc/dev: add push.autoSetupRemote instructions

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-01-11 16:33:02 -05:00
Zac Dover
049e5aaade doc/dev: add push.autoSetupRemote instructions
Explain how to set up push.autoSetupRemote so that the origin branch is
properly set up when running "get push" without the need for the
"--set-upstream" option.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-12 06:24:55 +10:00
Matan
ed409237e3
Merge pull request #48756 from Matan-B/wip-matanb-rollback-snap
crimson/osd: Support snapshot rollbacks 

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-01-11 18:18:43 +02:00
Matan
660f7bb15b
Merge pull request #49568 from Matan-B/wip-matanb-crimson-modified-ranges
crimson/osd/*recovery_backend: Rename Push/Pull Info/Op

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
2023-01-11 18:16:51 +02:00
Anthony D'Atri
c0db0bfdfa
Merge pull request #49715 from zdover23/wip-doc-2023-01-12-cephadm-host-management-osd-capitalization
doc/cephadm: s/osd/OSD/ where appropriate
2023-01-11 10:57:07 -05:00
Venky Shankar
317f672465 Merge PR #49711 into main
* refs/pull/49711/head:
	ceph.spec.in: remove the bcond_without cephfs_java option

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2023-01-11 21:01:51 +05:30
Zac Dover
559fea8b42 doc/cephadm: s/osd/OSD/ where appropriate
Capitalize the initialization "OSD" where it occurs in natural language
in cephadm/host-management.rst. This PR answers a request made by
Anthony D'Atri and seconded by Cole Mitchell in https://github.com/ceph/ceph/pull/49699#discussion_r1066171002.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-12 01:12:24 +10:00