Commit Graph

137810 Commits

Author SHA1 Message Date
Zac Dover
e4b35de2ab doc/radosgw: rabbitmq - push-endpoint edit
Remove a note that directed users to change "push-endpoint" (with a
hyphen) to "push_endpoint" (with an underscore) when using rabbitmq.

Re: https://github.com/ceph/ceph/pull/48486#issuecomment-1529925389

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-05-02 03:14:01 +10:00
Jane Zhu
31a390bb6b rgw/notification: read object size from the rados obj when populate sync notification
Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
2023-05-01 12:36:18 -04:00
Laura Flores
80d460005e mgr: add urllib3==1.26.15 to mgr/requirements.txt
We do not depend on any particular version of
urllib3, but as a workaround to the incompatibility
of urllib3 constraints between kubernetes and
requests, we need to pin it temporarily to
the version both are happy with.

Fixes: https://tracker.ceph.com/issues/59591
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-05-01 16:30:20 +00:00
Soumya Koduri
0f69011743 rgw/cloud-transition: New attrs to detect cloudtiered objects
Add new attrs "RGW_ATTR_CLOUD_TIER_TYPE" and "RGW_ATTR_CLOUD_TIER_CONFIG"
to store details about cloud-tiered objects so that they get synced accordingly
in a multisite environment.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-05-01 19:34:06 +05:30
Soumya Koduri
4db632567d rgw: Dump tier_* config in RGWObjManifest
This was missed as part of refactoring done to encoder
and decoder methods (2414c7584e)

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-05-01 19:30:58 +05:30
Soumya Koduri
cec19b09ef rgw/cloudtransition: Allow multisite zones to sync cloudtiered objects
In a multisite configuration, zones should be able to fetch & sync
cloud-transitioned objects as well. To allow this, a new header
'x-rgwx-sync-cloudtiered' is added to be used by sync client to GET
such objects.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-05-01 19:30:58 +05:30
Soumya Koduri
e33946b89e rgw/cloudtier: Fix bug with decoding tier_targets
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-05-01 19:30:58 +05:30
Anthony D'Atri
362a9d8e89
Merge pull request #51284 from zdover23/wip-doc-2023-04-29-cephfs-nfs
doc/cephfs: improve sentence in nfs.rst
2023-05-01 08:39:42 -04:00
Ali Masarwa
080e8b91f8
Merge pull request #51138 from AliMasarweh/wip-alimasa-pubsub-hide-autogen-topics
RGW: bucket notification - hide auto generated topics when listing topics
2023-05-01 14:12:40 +03:00
Matan Breizman
32fecf11ca test/cls_rbd/test_cls_rbd: Skip mirror_image_status (Crimson)
This commit is part of an initial attempt to establish a Crimson testing baseline.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-05-01 09:09:20 +00:00
Matan Breizman
27e309ef96 qa/suites/crimson-rados/rbd: Add new rbd image format api tests
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-05-01 09:09:20 +00:00
Matan Breizman
89d50e933d test/librbd: Skip unsupported Crimson tests
This commit is part of an initial attempt to establish a Crimson testing baseline.

test_librbd notes:

* Skip ListChildrenTiered (Crimson):
  Cache tiering is not supported.

test_internal notes:

* Skip SnapshotCopyup (Crimson):
  Clone overlap calculation is WIP: https://tracker.ceph.com/issues/58263

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-05-01 09:09:20 +00:00
Gregory Farnum
7179c0e0c7
Merge pull request #51293 from yuvalif/wip-yuval-revert-47457
revert PRs #47457 and #51031

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2023-04-30 10:33:52 -07:00
Yuval Lifshitz
e39ca6b6b8 Revert "tracer/osd/librados/build/rgw: rgw and osd end2end tracing using opentelemetry"
This reverts commit 5d4c5e65be.

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-04-30 13:31:19 +00:00
Yuval Lifshitz
ebe92994c0 Revert "rgw/aio: fix recursion from tracing changes"
This reverts commit 9f160e4f1a.

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-04-30 13:29:55 +00:00
zdover23
0ae30b6b0a
Merge pull request #51285 from zdover23/wip-doc-2023-04-29-rados-operations-stretch-mode-stretch-mode
doc/rados: edit stretch-mode procedure

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-30 05:45:39 +10:00
Zac Dover
a19ff7a5ea doc/rados: edit stretch-mode procedure
Edit the "stretch mode" section in doc/rados/operations/stretch-mode.rst
so that the procedure is formatted as a procedure and the sentences
correctly have heads.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-30 05:29:35 +10:00
zdover23
9e251d29f9
Merge pull request #51276 from pcuzner/fix-prom-docs
docs: Update the cephadm docs for Prometheus endpoint info

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-04-29 11:18:37 +10:00
Zac Dover
4f783ef71f doc/cephfs: improve sentence in nfs.rst
Corect a sentence that should have been corrected in
https://github.com/ceph/ceph/pull/51204.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-29 05:21:09 +10:00
Jos Collin
10a74b9f09
cephfs-top: fix help text for delay
Updates:

`
  -d {1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25}, --delay {1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25}
                        Refresh interval in seconds (default: 1)
`

to

`
  -d DELAY, --delay DELAY
                        Refresh interval in seconds (default: 1, range: 1 - 25)
`

Fixes: https://tracker.ceph.com/issues/59553
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-04-28 17:22:54 +05:30
Jos Collin
4f87b9a2b9
doc: add a note for minimum compatible python version and supported distros
Fixes: https://tracker.ceph.com/issues/58677
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-04-28 17:21:55 +05:30
Jos Collin
581d892ae2
tools/cephfs/top/CMakeList.txt: check the minimum compatible python version for cephfs-top
The minimum compatible python version for cephfs-top is 3.6.0, which supports
the curses apis and constants used in cephfs-top.

Fixes: https://tracker.ceph.com/issues/58677
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-04-28 17:21:55 +05:30
Lucian Petrut
6669aafa17 dokan: handle std::stoul exceptions
We're using std::stoul to parse cli args, however we aren't
catching the exceptions.

This change will handle the exceptions and log the according
error message. For consistency, we'll use the std conversion
functions throughout ceph-dokan.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-04-28 09:27:06 +00:00
Juan Miguel Olmo
11b3cc2e02
Merge pull request #51069 from rhcs-dashboard/exporter-prom
exporter: promethize counter names
2023-04-28 08:21:53 +02:00
Paul Cuzner
690d34ab08 docs: Update the Prometheus endpoint info
This patch just tidies up some of the links and adds
an example showing how the http_sd_configs option
may be used.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2023-04-28 17:21:39 +12:00
zdover23
dd1365716d
Merge pull request #51271 from zdover23/wip-doc-2023-04-28-rados-configuration-mon-config-ref-background
doc/rados: m-config-ref: edit "background"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-28 08:55:45 +10:00
Zac Dover
9223863fc8 doc/rados: m-config-ref: edit "background"
Edit the "Background" section of doc/rados/monitor/config-ref.rst

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-28 08:45:04 +10:00
Zac Dover
5a90d64b34 doc/mgr: update prompts in prometheus.rst
Update prompts in prometheus.rst so that they're unselectable.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-28 08:10:29 +10:00
Laura Flores
70c5a4d548 mgr/telemetry: compile all channels and collections in selftest
The selftest currently compiles only channels and collections that
are on by default. This change tests the compilation of all channels
and collections.

Signed-off-by: Laura Flores <lflores@redhat.com>
2023-04-27 19:21:00 +00:00
Matan Breizman
12af68c24d crimson/osd/heartbeat: add latest epoch sent concept
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-04-27 16:12:05 +00:00
Matan Breizman
7550d423b1 crimson/osd/shard_services: Add logs to load_map_bls
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-04-27 16:12:05 +00:00
Matan Breizman
0075349661 crimson/osd/heartbeat: add a rename todo
In continuation to: bfbbc311f1

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-04-27 16:11:30 +00:00
Matan Breizman
bfbbc311f1 crimson/osd/heartbeat: Rename Peer's created at epoch
As these getter and setter represent the epoch at which the peer was added

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-04-27 16:08:11 +00:00
Xuehan Xu
670bbaa4d8 crimson/osd/heartbeat: share osdmap to peers when necessary
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-04-27 16:08:11 +00:00
Radoslaw Zarzynski
d8655c08ab crimson/osd: drop the OSDMap caching from PG
`PG` directly aggregates both `OSDMap` and `PeeringState` which
maintains its own `OSDMap` instance. This duplication leads to
issues as the `PG::osdmap` never gets updated.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-04-27 15:37:01 +00:00
Radoslaw Zarzynski
24098bf9bb crimson/osd: implement watcher blocklisting
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-04-27 15:37:01 +00:00
Radoslaw Zarzynski
03b6c21b53 crimson/osd: check for blocklisted clients
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-04-27 15:27:25 +00:00
Ilya Dryomov
472c7b60fd test/librbd: use GTEST_SKIP macro to skip tests
The use of SUCCEED macro predates the introduction of GTEST_SKIP macro
to GTest 1.10.  Having skipped tests reported as passed is misleading!

Before:

[ RUN      ] TestMockOperationSnapshotRemoveRequest.FlattenedCloneRemovesChild
SKIPPING
[       OK ] TestMockOperationSnapshotRemoveRequest.FlattenedCloneRemovesChild (9 ms)
...
[ RUN      ] TestMockOperationSnapshotRemoveRequest.RemoveChildError
SKIPPING
[       OK ] TestMockOperationSnapshotRemoveRequest.RemoveChildError (112 ms)
...
[  PASSED  ] 16 tests.

After:

[ RUN      ] TestMockOperationSnapshotRemoveRequest.FlattenedCloneRemovesChild
../src/test/librbd/operation/test_mock_SnapshotRemoveRequest.cc:381: Skipped
Skipping due to unmet REQUIRE
[  SKIPPED ] TestMockOperationSnapshotRemoveRequest.FlattenedCloneRemovesChild (9 ms)
...
[ RUN      ] TestMockOperationSnapshotRemoveRequest.RemoveChildError
../src/test/librbd/operation/test_mock_SnapshotRemoveRequest.cc:727: Skipped
Skipping due to enabled deep-flatten
[  SKIPPED ] TestMockOperationSnapshotRemoveRequest.RemoveChildError (111 ms)
...
[  PASSED  ] 14 tests.
[  SKIPPED ] 2 tests, listed below:
[  SKIPPED ] TestMockOperationSnapshotRemoveRequest.FlattenedCloneRemovesChild
[  SKIPPED ] TestMockOperationSnapshotRemoveRequest.RemoveChildError

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-27 15:53:14 +02:00
Nizamudeen A
09de6be991 mgr/dashboard: fix the rbd mirroring configure check
In one-way mirroring, the condition we are checking now for configuring
the mirroring will fail because only one cluster needs to have the
mirror daemon present. Thus even if mirroring is successfuly happening
the page won't load. For now relaxing the rule until we find a better
api call to check for the status

Fixes: https://tracker.ceph.com/issues/59573
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-27 16:54:24 +05:30
Matan
6de55cb759
Merge pull request #50530 from Matan-B/wip-matanb-crimson-only-new-rbd-v2
crimson/osd: Handle rollback to head obejct

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-04-27 12:53:38 +03:00
Matan
dbe797bf9d
Merge pull request #50584 from Matan-B/wip-matanb-crimson-only-add-thrash
qa/suites/crimson-rados/thrash: Enable supported tests and ops

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-04-27 12:43:00 +03:00
Matan
3169d61c32
Merge pull request #51198 from Matan-B/wip-matanb-snap-trimmer-loop
crimson/osd/snaptrim_event: Handle missing clone obc case

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-04-27 12:40:07 +03:00
Nizamudeen A
864336f564
Merge pull request #51189 from rhcs-dashboard/fix-cephpgimbalance-alert
mgr/dashboard: fix CephPGImbalance alert

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-04-27 11:05:19 +05:30
Xuehan Xu
08625c27f9 crimson/osd/snaptrim_event: avoid leaking txn ops for updating head obcs
when removing clones

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-04-27 03:34:07 +00:00
Xuehan Xu
ba8732d2a9 crimson/osd/snaptrim_event: encode head oi with no oid
This is required by PGBackend::load_metadata

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-04-27 03:33:59 +00:00
Xuehan Xu
f5194e60a2 crimson/osd/snaptrim_event: don't clear head obc's snaps
There may be valid snaps for a head object, although some snap is
being removed

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-04-27 03:33:54 +00:00
zdover23
555bcd3ed6
Merge pull request #51154 from zdover23/wip-doc-2023-04-20-rados-operations-3-of-x
doc/rados/ops: edit user-management.rst (3 of x)

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-04-27 10:11:24 +10:00
zdover23
c15bbb2dc6
Merge pull request #51204 from zdover23/wip-doc-2023-04-25-cephfs-nfs-ganesha-permissions
doc/cephfs: explain cephfs data and metadata set

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-27 08:08:07 +10:00
Zac Dover
9152f97004 doc/cephfs: explain cephfs data and metadata set
Explain how to set application metadata for the CephFS data pool and the
CephFS metadata pool.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-27 07:46:46 +10:00
Ilya Dryomov
c9f0ecd242
Merge pull request #51228 from jsoref/spelling-rbd
rbd: fix spelling errors

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-26 23:07:47 +02:00