Commit Graph

142684 Commits

Author SHA1 Message Date
Matan Breizman
4997eadda7 crimson/osd/pg: move maybe_submit_error_log
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
0f99cdc81e crimson/osd/pg: on_removal to assert empty log_entry map
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
b44c41f08c crimson/osd/pg: submit_error_log cleanup
* error log completion logic is moved into maybe_submit_error_log
* renamed it and it2
* maybe_submit_error_log is moved outside of failure_func
* failure_func no longer gets rep_tid and record_error params
* log_entry_version is removed, submit_error_log returns the version instead

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Matan Breizman
841bc653ef crimson/osd/pg: do_osd_ops_execute drop error_func_ptr
std::move to the only user instead

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-01-16 12:42:58 +00:00
Dhairya Parmar
d8d18011a8 qa: typo fixes in ceph_test_case docstrings
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2024-01-16 18:09:54 +05:30
Rishabh Dave
9085e776af
Merge pull request #54484 from batrick/mds-const-mdreqref
mds: use const qualifier for MDRequestRef

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2024-01-16 17:48:21 +05:30
Rishabh Dave
2c5acead4f
Merge pull request #54390 from shminjs/feat-purgequeue-executed-ops
mds/purgequeue: add l_pq_executed_ops counter

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:47:21 +05:30
Rishabh Dave
e283219800
Merge pull request #53670 from mchangir/mds-enqueue-all-child-frags-for-scrub-for-a-given-fragset
mds/scrub: enqueue all child frags for a given fragset

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:46:08 +05:30
Rishabh Dave
158f916f25
Merge pull request #54208 from neesingh-rh/json_asok_fix
qa: fix rank_asok() to handle errors from asok commands

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:45:09 +05:30
Rishabh Dave
38d614c85d
Merge pull request #54381 from lxbsz/wip-cleanup-auth
mds: misc fixes for MDSAuthCaps code

Reviewed-by: Leonid Usov <leonid.usov@ibm.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:44:04 +05:30
Rishabh Dave
4b39dedc5d
Merge pull request #54406 from vshankar/wip-63482
qa: enable debug mds/client for fs/nfs suite

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:42:37 +05:30
Rishabh Dave
9f57d8d0c3
Merge pull request #54519 from lxbsz/wip-63552
mds: use explicitly sized types for network and disk encoding

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:40:59 +05:30
Rishabh Dave
bdd0c89185
Merge pull request #54590 from vshankar/wip-57087
qa: set mds config with `config set` for a particular test

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-01-16 17:39:21 +05:30
Nizamudeen A
35488a4485
Merge pull request #55185 from rhcs-dashboard/docs-build-fix
admin/doc-requirements: bump Sphinx to 5.0.2

Reviewed-by: Matan-B <NOT@FOUND>
2024-01-16 17:35:23 +05:30
Zac Dover
a1fca50dfd doc/radosgw: edit "Enable/Disable Bucket Rate Limit"
Edit "Enable/Disable Bucket Rate Limit" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-16 20:37:17 +10:00
Aashish Sharma
d169a206d1 mgr/dashboard: add frontend unit tests for rgw multisite sync status
card

Fixes: https://tracker.ceph.com/issues/64039

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2024-01-16 15:57:36 +05:30
Nizamudeen A
a916feeee7 admin/doc-requirements: bump Sphinx to 5.0.2
```
Running Sphinx v4.5.0

Sphinx version error:
The sphinxcontrib.applehelp extension used by this project needs at least Sphinx v5.0; it therefore cannot be built with this version.
```

Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-01-16 14:17:25 +05:30
Zhang Song
6bd05fcf62 crimson/os/seastore: correct the parameter passed to LBAManager::clone_mapping
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-01-16 16:14:57 +08:00
Nizamudeen A
ceb5df6109
Merge pull request #55143 from afreen23/main
mgr/dashboard: Fixes multisite topology page breadcrumb

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-01-16 13:19:20 +05:30
Nizamudeen A
6e3d03eeda
Merge pull request #54645 from rhcs-dashboard/revert-tls-1.2-main
Revert "mgr/dashboard: allow tls 1.2 with a config option"

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2024-01-16 12:04:18 +05:30
Yingxin Cheng
dad7e5f67c common/options/crimson: increase crimson_osd_obc_lru_size to 512
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-16 14:32:29 +08:00
Pedro Gonzalez Gomez
9bb8ee4871
Merge pull request #55120 from rhcs-dashboard/snapshot-delete
mgr/dashboard: delete cephfs snapshot

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: afreen23 <NOT@FOUND>
2024-01-15 11:19:32 +01:00
Aashish Sharma
65ec74434d mgr/dashboard: increase the number of plottable graphs in charts
Fixes: https://tracker.ceph.com/issues/64024

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2024-01-15 14:19:38 +05:30
Ronen Friedman
f5e6b607b9 test/scrub: modify selection of max-scrubs configuration values
As the osd-max-scrubs default was increased from 1 to (currently) 3, the
original set of optional values under rados/thrash/3-scrub-overrides are
no longer useful.  This commits changes the set of optional values to
reflect the current default.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2024-01-14 20:53:38 +02:00
Ilya Dryomov
d5457a2330
Merge pull request #54974 from fweimer-rh/c99
GCC 14 compatibility fixes

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-01-14 18:54:12 +01:00
Zac Dover
e9b3ef4cb1 doc/radosgw: edit admin.rst "set bucket rate limit"
Edit "Set Bucket Rate Limit" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-14 20:23:25 +10:00
Matan Breizman
8be184a654
Merge pull request #55039 from cyx1231st/wip-crimson-alienstore-submit-concurrently
crimson/os/alienstore: submit from the alien world concurrently

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-01-14 10:37:08 +02:00
Zac Dover
1cd996b6fe docs/radosgw: edit admin.rst "enable/disable user rate limit"
Edit "Enable/Disable User Rate Limit" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-14 04:06:12 +10:00
tobydarling
c636e3ed2d doc/rados/operations: Fix off-by-one errors in control.rst
Description of examples was off by one

Signed-off-by: tobydarling <anothercoffee@gmail.com>
2024-01-13 14:42:15 +00:00
Casey Bodley
26b361d1ed rgw/common: rgw_bl_str(bl) avoids bl.c_str()
where bl contains multiple buffer segments, c_str() has to
rellocate and copy those segments into a single buffer. use c_str()
instead, which just copies each segment into the resulting string

this allows the function to take the bufferlist argument by const ref

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-12 11:26:22 -05:00
Casey Bodley
9a93e9375f rgw: forward_iam_request_to_master() trims trailing null from response
fix a regression from commit d3ad0efaee
which changed how we parse the response bufferlist:

-  std::string r = response.c_str();
+  std::string r = response.to_str();

when the response contains a trailing null character, this now ends up in
`r` and breaks json parsing in `parser.parse(r.c_str(), r.length(), 1)`

replace `response.to_str()` with `rgw_bl_str(response)` which trims
trailing nulls

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-12 11:08:42 -05:00
Casey Bodley
d5a08ba987 test/rgw: metadata sync checkpoint waits on global 'sync' status
in testing, i was seeing meta sync checkpoints finish even though sync
hadn't started yet:
```
rgw_multi.tests: DEBUG: current meta sync status={
    "sync_status": {
        "info": {
            "status": "building-full-sync-maps",
```

wait for the global status to reach "sync" before starting to compare
period epochs or sync markers

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-12 11:05:52 -05:00
Zhang Song
aedde7fa2c common: fix ambiguous error when using gcc 13
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2024-01-12 21:39:09 +08:00
Nizamudeen A
c3d7f70b7a mgr/dashboard: delete cephfs snapshot
Fixes: https://tracker.ceph.com/issues/63990
Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-01-12 14:30:27 +05:30
Yingxin Cheng
c15e56e386 crimson/os/alienstore: submit from the alien world concurrently
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-01-12 10:30:05 +08:00
Casey Bodley
49c27499af
Merge pull request #53678 from cbodley/wip-qa-rgw-upgrade-reef
qa/rgw/upgrade: add reef as a starting release

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2024-01-11 16:08:24 +00:00
Casey Bodley
209e3ed6f1 rgw: fix use of creds in forward_iam_request()
variable `creds` was moved into the `RGWRESTConn` constructor before being
passed into `forward_iam_request()`. change `forward_iam_request()` so
it uses the member variable from the constructor instead of taking it as
an argument

Fixes: https://tracker.ceph.com/issues/63994

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-01-11 10:28:03 -05:00
Mark Nelson
2971ff482b
Merge pull request #54882 from Svelar/isa_xor_dev
erasure-code/isa/xor_op: add neon-based region_xor implementation
2024-01-11 09:10:44 -06:00
Anthony D'Atri
965284231a
Merge pull request #55142 from zdover23/wip-doc-2024-01-11-radosgw-user-rate-limit-ops
doc/radosgw - edit admin.rst "set user rate limit"
2024-01-11 09:30:47 -05:00
Anthony D'Atri
a6110a830a
Merge pull request #55146 from zdover23/wip-doc-2024-01-11-radosgw-get-user-rate-limit
doc/radosgw: edit admin.rst "get user rate limit"
2024-01-11 09:21:29 -05:00
Zac Dover
1c561e2bea doc/radosgw: edit admin.rst "get user rate limit"
Edit "Get User Rate Limit" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-11 23:40:42 +10:00
Afreen Misbah
f75a9da287 mgr/dashboard: Fixes multisite topology page breadcrumb
The multi-site topology page just says object in breadcrumb.
The fix adds the missing "multi-site" breadcrumb.

Fixes https://tracker.ceph.com/issues/63635

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
2024-01-11 14:09:49 +05:30
Zac Dover
8660b4edc7 doc/radosgw - edit admin.rst "set user rate limit"
Edit "Set User Rate Limit" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-01-11 18:34:21 +10:00
Milind Changire
f14f60afd5
Merge PR #53999 into main
* refs/pull/53999/head:
	PendingReleaseNotes: support for subvolumes and subvolume groups in snap_schedule
	snap_schedule/tests: fix db upgrade issue
	qa: add yaml for on demand subvol version testing
	qa: add test cases for testing --subvol and --group arguments
	mgr/volumes: conditionalize subvolume upgrade
	mgr/volumes: ensure correct init of v1 subvol
	mgr/snap_schedule: add subvol and subvol group arguments to cli
	mds/snap_schedule: add subvolume group column management
	mgr/volumes: add remote helper methods to fetch subvolume info

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-01-11 10:31:31 +05:30
Jane Zhu
17ca50e704 rgw/lc: use flag and named constants instead of booleans as argument in interface
Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
2024-01-10 17:10:30 -05:00
Jane Zhu
a15b7d1cc5 rgw/lc: remove default arguments in virtual functions
Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
2024-01-10 16:36:35 -05:00
Jane Zhu
4341fc51d0 rgw/lc: do not add datalog/bilog for some lc actions
Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
2024-01-10 16:36:35 -05:00
Patrick Donnelly
5e6fc0bf5f
pybind/mgr/devicehealth: skip legacy objects that cannot be loaded
Log looks like after test:

    2023-12-21T16:09:28.804+0000 7fbe7fd86700  0 [devicehealth DEBUG root] loading object ABC_DEADB33F_FA
    2023-12-21T16:09:28.805+0000 7fbe7fd86700  0 [devicehealth DEBUG root] object rados.Object(ioctx=<rados.Ioctx object at 0x7fbeee0c4668>,key=ABC_DEADB33F_FA,nspace=--default--,locator=None) does not exist because it is deleted in HEAD
    2023-12-21T16:09:28.805+0000 7fbe7fd86700  0 [devicehealth DEBUG root] finished reading legacy pool, complete = True

Credit to Greg Farnum for postulating the cause.

Fixes: https://tracker.ceph.com/issues/63882
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-01-10 14:52:37 -05:00
Patrick Donnelly
aa30adbaa7
qa: test devicehealth legacy load of deleted snap obj
Failure without fix looks like:

    2023-12-21T16:05:55.737+0000 7fbe585b0700  0 [devicehealth DEBUG root] loading object ABC_DEADB33F_FA
    2023-12-21T16:05:55.737+0000 7fbe585b0700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'devicehealth' while running on mgr.x: [errno 2] RADOS object not found (Failed to operate read op for oid ABC_DEADB33F_FA)
    2023-12-21T16:05:55.737+0000 7fbe585b0700 -1 devicehealth.serve:
    2023-12-21T16:05:55.737+0000 7fbe585b0700 -1 Traceback (most recent call last):
    File "/home/pdonnell/ceph/src/pybind/mgr/devicehealth/module.py", line 394, in serve
        self._do_serve()
    File "/home/pdonnell/ceph/src/pybind/mgr/mgr_module.py", line 524, in check
        return func(self, *args, **kwargs)
    File "/home/pdonnell/ceph/src/pybind/mgr/devicehealth/module.py", line 354, in _do_serve
        finished_loading_legacy = self.check_legacy_pool()
    File "/home/pdonnell/ceph/src/pybind/mgr/devicehealth/module.py", line 326, in check_legacy_pool
        if self._load_legacy_object(ioctx, obj.key):
    File "/home/pdonnell/ceph/src/pybind/mgr/devicehealth/module.py", line 300, in _load_legacy_object
        ioctx.operate_read_op(op, oid)
    File "rados.pyx", line 3723, in rados.Ioctx.operate_read_op
    rados.ObjectNotFound: [errno 2] RADOS object not found (Failed to operate read op for oid ABC_DEADB33F_FA)

Credit to Greg Farnum for postulating the cause.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-01-10 14:52:37 -05:00
Patrick Donnelly
a066467c9d
qa: allow failing whatever the active mgr is
Vanilla `mgr fail` will just fail the active.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-01-10 14:52:37 -05:00