Commit Graph

138361 Commits

Author SHA1 Message Date
Casey Bodley
522251642e qa: suppress SyscallParam error during startup on jammy
Fixes: https://tracker.ceph.com/issues/61428

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-12 16:25:56 -04:00
Yuval Lifshitz
2f8a7159a3
Merge pull request #51864 from yuvalif/wip-yuval-fix-61540
rgw/kafka: make sure that destroy is called after connection is removed
2023-06-12 12:04:48 +03:00
zdover23
99127073e7
Merge pull request #51994 from zdover23/wip-doc-2023-06-11-rados-operations-placement-groups-3-of-x
doc/rados: edit placement-groups.rst (3 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-12 07:46:53 +10:00
Zac Dover
25224acac0 doc/rados: edit placement-groups.rst (3 of x)
Edit doc/rados/operations/placement-groups.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-12 07:00:14 +10:00
Yuval Lifshitz
b1a443fec3
Merge pull request #51366 from SMIL-Infra/fix-test-build
rgw: fix tests build w/o AMQP
2023-06-11 21:22:17 +03:00
Yuval Lifshitz
f08722e960
Merge pull request #51468 from vedanshbhartia/coverity_time
rgw: Add coverity annotations to ignore warnings about 32 bit time
2023-06-11 17:36:25 +03:00
zdover23
02012691fc
Merge pull request #51992 from zdover23/wip-doc-2023-06-10-rados-operations-change-mon-elections
doc/rados: edit change-mon-elections

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-11 18:33:07 +10:00
zdover23
9f217cf3f1
Merge pull request #51991 from zdover23/wip-doc-2023-06-09-rados-operations-placement-groups-2-of-x
doc/rados: edit placement-groups.rst (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-11 10:42:18 +10:00
Zac Dover
8bdd27165c doc/rados: edit placement-groups.rst (2 of x)
Edit doc/rados/operations/placement-groups.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-11 10:06:02 +10:00
Zac Dover
dc93181f04 doc/rados: edit change-mon-elections
Edit doc/rados/operations/change-mon-elections.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-10 22:20:02 +10:00
Laura Flores
219d315c3a
Merge pull request #51988 from ljflores/wip-release-checklist
doc/dev: update release checklist
2023-06-09 12:55:46 -05:00
Casey Bodley
98fcccee88
Merge pull request #49316 from BryceCao/wip-add-initialization-for-RGWGC-process-call
rgw : fix add initialization for RGWGC::process()

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-06-09 13:21:01 -04:00
Casey Bodley
e6550c15ad
Merge pull request #51715 from awojno-bloomberg/replication-race-condition-fix
RGW: Pass and check destination zone trace when fetching object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
2023-06-09 13:20:29 -04:00
Laura Flores
3b25afc6f2 doc/dev: update release checklist
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-06-09 10:20:36 -05:00
zdover23
1e3835abb2
Merge pull request #51975 from zdover23/wip-doc-2023-06-09-rados-operations-placement-groups-1-of-x
doc/rados: edit placement-groups.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-09 23:30:32 +10:00
Zac Dover
d6e1116d0d doc/rados: edit placement-groups.rst (1 of x)
Edit doc/rados/operations/placement-groups.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-09 23:12:59 +10:00
Casey Bodley
4167b5c797
Merge pull request #48879 from samarahu/wip-d4n
RGW: WIP D4N

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-06-08 11:44:55 -04:00
Anthony D'Atri
863ab1adf9
Merge pull request #51967 from Dazul/add-config-missing-custom-container-images
doc: Add missing custom container_image
2023-06-08 08:23:07 -04:00
zdover23
cd6e922cd9
Merge pull request #51958 from zdover23/wip-doc-2023-06-07-rados-operations-pools-4-of-x
doc/rados: edit pools.rst (4 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-06-08 22:04:13 +10:00
Nizamudeen A
098f175d71
Merge pull request #51955 from rhcs-dashboard/teuth-e2e-fix
qa/workunits: fix test_dashboard_e2e.sh: no spec files found

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-06-08 14:18:14 +05:30
Ronen Friedman
6620562d85
Merge pull request #51911 from ronen-fr/wip-rf-recovery-updates
qa/standalone: osd-recovery-scrub: fix slow updates and recovery concurrency

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
2023-06-08 11:43:59 +03:00
Luis Domingues
e0dcedab77
doc: Add missing custom container_image
While testing cephadm in order to migrate to it in the near
futur, I needed to use some custom images for haproxy
and keepalived. I needed to see into the code to see what
existed. So I put what I found on the code into documentation.

Signed-off-by: Luis Domingues <domingues.luis@protonmail.ch>
2023-06-08 10:17:24 +02:00
Yingxin
ea80783410
Merge pull request #51948 from xxhdx1985126/wip-61608
crimson/os/seastore/cached_extent: add prepare_commit interface

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-06-08 09:14:20 +08:00
Neha Ojha
26c124173d
Merge pull request #51917 from sseshasa/wip-mclock-cost-fix-relnotes
PendingReleaseNotes: Document mClock scheduler fixes and enhancements

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-06-07 10:49:09 -07:00
Yuri Weinstein
ab3569fee8
Merge pull request #51892 from rzarzynski/wip-bug-61547
mon: fix timestamp formatting in cluster log

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-06-07 11:03:18 -04:00
Zac Dover
92cf93b1fe doc/rados: edit pools.rst (4 of x)
Edit doc/operations/rados/pools.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-08 00:32:13 +10:00
zdover23
fd6c853512
Merge pull request #51930 from zdover23/wip-doc-2023-06-06-rados-operations-pools-3-of-x
doc/rados: edit pools.rst (3 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-07 19:53:27 +10:00
Matan
53399f60a0
Merge pull request #46062 from markhpc/wip-crimson-tcmalloc
crimson: Enable tcmalloc when using seastar

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-06-07 11:15:03 +02:00
Nizamudeen A
bec3140b20 qa/workunits: fix test_dashboard_e2e.sh: no spec files found
Fixes: https://tracker.ceph.com/issues/61578
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-06-07 14:04:33 +05:30
Nizamudeen A
6baf9c2824
Merge pull request #50054 from rhcs-dashboard/cache-invalidation
mgr/dashboard: RBD cache invalidation

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-06-07 13:59:50 +05:30
Sridhar Seshasayee
49aad118aa PendingReleaseNotes: Document mClock scheduler fixes and enhancements
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2023-06-07 13:08:23 +05:30
Xuehan Xu
f179c72a61 crimson/os/seastore/cached_extent: add prepare_commit interface
move new fixedkv-btree nodes' inter-node pointer adjustments into
the prepare_commit interface

Fixes: https://tracker.ceph.com/issues/61608
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2023-06-07 09:55:38 +08:00
Laura Flores
8c6374e8da
Merge pull request #51927 from ljflores/wip-rook-tests
qa/suites/rados: remove rook coverage from the rados suite
2023-06-06 13:35:35 -05:00
Samarah
cd1d249678 QA: Add D4N teuthology suite
Signed-off-by: Samarah <samarah.uriarte@ibm.com>
2023-06-06 14:04:47 -04:00
Anthony D'Atri
90477c252d
Merge pull request #51943 from dvanders/update-contact-dan
Update affiliation for Dan van der Ster
2023-06-06 13:18:04 -04:00
Laura Flores
96dac3b18c
Merge pull request #51925 from ljflores/wip-tracker-59192
qa/suites/rados: whitelist POOL_APP_NOT_ENABLED for cls tests
2023-06-06 11:14:32 -05:00
Dan van der Ster
362cc53a34 Update affiliation for Dan van der Ster
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
2023-06-06 08:08:44 -07:00
Mark Nelson
d884a45aea crimson: Enable tcmalloc when using seastar
classic-osds have always caused significant memory fragmentation
when using the libc memory allocator due to the way that Ceph
tends to utilize memory.  In recent testing, crimson-osd was found
to use 25-27GB of RAM with the stock 3GB bluestore cache settings
(osd_memory_target is only used when tcmalloc is available).  Upon
further testing, it was found that the classic OSD is even worse,
using between 32-33GB of RAM after a 5 minute 4K sequential
write test when using libc malloc.

The good news is that it appears that crimson-osd is able to use
tcmalloc for alienstore without significant modification. Better
still, it drastically reduces memory usage.  In the same test that
resulted in 25GB RSS memory usage for crimson-osd with libc malloc,
a tcmalloc linked version took around 9GB (with an 8GB
osd_memory_target).  Since we do not yet (afaik) expose classic OSD
debugging in crimson it is tough to tell why we are still a little
over, but it's clear that for alienstore we are going to need to
use tcmalloc as we do in classic.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
2023-06-06 14:55:09 +00:00
Matan Breizman
96c6c2681f Revert "[CHERRY-PICKED FOR TESTING ONLY] crimson: Enable tcmalloc when using seastar"
This reverts commit 380bc6d2e4.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-06-06 14:53:58 +00:00
Samuel Just
03a63b94a1
Merge pull request #51875 from Matan-B/wip-matanb-crimson-supress-tcmalloc
crimson/osd/lsan_suppressions.cc: Add MallocExtension::Initialize()

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-06-06 07:48:30 -07:00
Zac Dover
09eff30f5f doc/rados: edit pools.rst (3 of x)
Edit doc/operations/rados/pools.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-06 22:29:49 +10:00
zdover23
cf1446c667
Merge pull request #51914 from zdover23/wip-doc-2023-06-05-rados-operations-pools-2-of-x
doc/rados: edit pools.rst (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-06 22:23:12 +10:00
zdover23
f582a1ab12
Merge pull request #51932 from stackhpc/typo-fix
doc/rados/operations: fix typo in balancer.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-06-06 22:15:45 +10:00
Zac Dover
fe9a4d2567 doc/rados: edit pools.rst (2 of x)
Edit doc/operations/rados/pools.rst.

There remains confusion in this part of the document regarding pg_num
and pgp_num. pg_num and pgp_num are not explained with sufficient
clarity. A future commit will clear up this confusion. There is also
some potential confusion between on the one hand the strings "pg-num"
and "pgp-num" and on the other hand "pg_num" and "pgp_num". The strings
with the hyphens are used in dummy commands, and the strings with the
underscores are used as key names. I think it possible that this could
confuse a reader, but I am open to discussion on the matter.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-06 22:07:51 +10:00
Pierre Riteau
e4083b3a68 doc/rados/operations: fix typo in balancer.rst
Signed-off-by: Pierre Riteau <pierre@stackhpc.com>
2023-06-06 08:31:07 +02:00
Ilya Dryomov
1caadd7f2a
Merge pull request #50341 from yangdongsheng/ubbd
rbd: add support for new device type of ubbd

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-06-05 23:12:28 +02:00
Laura Flores
66a6e7fdeb qa/suites/rados: whitelist POOL_APP_NOT_ENABLED for rados cls tests
Fixes: https://tracker.ceph.com/issues/59192
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-06-05 15:35:54 -05:00
Laura Flores
c26674ef4c qa/suites/rados: remove rook coverage from the rados suite
The rook team relies on a daily CI system to validate
rook changes. It doesn't seem that the teuthology tests
are maintained, so it makes sense to remove them from the
rados suite.

By removing this symlink, rook test coverage will remain
in the orch suite, and coverage will only be removed from the
rados suite.

Workaround for: https://tracker.ceph.com/issues/58585
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-06-05 15:23:42 -05:00
Pere Diaz Bou
5e58d00957
Merge pull request #51294 from cfsnyder/wip-59588
mgr/dashboard: add 'omit_usage' query param to dashboard api 'get rbd' endpoint

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-06-05 22:15:35 +02:00
Casey Bodley
7abe77962a cmake/rgw: include cpp_redis as system headers
this hides a lot of c++20-related warnings

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-06-05 13:06:47 -04:00