Commit Graph

138755 Commits

Author SHA1 Message Date
Ville Ojamo
0961c7d18c
doc/man/radosgw: use underscores in configuration
Most of the documentation already uses underscores instead of spaces in configuration variable names.

Update radosgw(8) man page to follow, changing spaces into underscores.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2023-07-07 16:49:21 +07:00
Ronen Friedman
8780efffd3
Merge pull request #52337 from ronen-fr/wip-rf-osdtypes-const
osd/osd_types_fmt: mark fmt::formatter<>::format() const

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-07-07 08:10:07 +03:00
Yingxin
4dd700c760
Merge pull request #51179 from aisakaki/wip-lazy-read-r2
crimson/os/seastore: realize lazy read in split overwrite with overwrite refactor

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Zhang Song <zhangsong325@gmail.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-07 11:36:19 +08:00
Yingxin
f8ad0e240e
Merge pull request #51770 from myoungwon/wip-multicore-rbm
crimson/os/seastore/rbm: make rbm support multiple shards

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2023-07-07 09:13:15 +08:00
zdover23
e076c6aae2
Merge pull request #52324 from zdover23/wip-doc-2023-07-06-radosgw-multisite
doc/radosgw: add Zonegroup purpose

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-07 06:32:52 +10:00
zdover23
1a2ec4d62a
Merge pull request #52319 from Thingee/foundation-mem-update-202307
doc/foundation: Updating foundation members for July 2023

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-07 06:26:17 +10:00
Zac Dover
5c46a1a009 doc/radosgw: add Zonegroup purpose
Add a note about the telos of zonegroups. The information added in this
commit was originally sent to ceph-users by Casey Bodley on 30 Jun 2023
in response to a question from Yixin Jin. Alexander Patrakov then
suggested that Casey's response should be added to
doc/radsogw/multisite.rst.

Co-authored-by: Casey Bodley <cbodley@redhat.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-07 06:21:13 +10:00
Ali Masarwa
4c13a61ab2
Merge pull request #52087 from AliMasarweh/wip-alimasa-persistant-q-observability
RGW: Add observability over the persistent topics queue
2023-07-06 18:10:23 +03:00
Casey Bodley
744c8b0841
Merge pull request #52216 from cbodley/wip-61838
qa/s3tests: filter on 'sts_tests' and 'webidentity_tests'

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2023-07-06 09:59:31 -04:00
Matan
9465f7e9b9
Merge pull request #50458 from Matan-B/wip-matanb-c-perf-basic
qa/suites/crimson-rados: Introduce performance testing

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Mark Nelson <mark.nelson@clyso.com>
2023-07-06 15:42:05 +03:00
Ronen Friedman
fc63588822 osd/osd_types_fmt: mark fmt::formatter<>::format() const
For some formatters missed or added after PR#47830 (that fixed
most of the missing 'const's in this file)

Required to allow the use of the formatters in const member functions.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-07-06 06:18:55 -05:00
Ali Masarwa
9d64b3f3e6 RGW: Add observability over the persistent topics queue
Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>
2023-07-06 11:47:32 +03:00
Ronen Friedman
de051591de
Merge pull request #52293 from ronen-fr/wip-rf-consttime
common: make some common ctors and accessors constexpr

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2023-07-06 09:28:41 +03:00
myoungwon oh
7a15d484c5 src/test/crimson/seastore/nvmedevice: update a test case based on rbm multi shard change
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-07-06 04:28:04 +00:00
myoungwon oh
1d6beef975 crimson/os/seastore/rbm: make rbm support multiple shards
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-07-06 04:27:48 +00:00
Patrick Donnelly
58df861608
Merge PR #52290 into main
* refs/pull/52290/head:
	pybind/rbd: drop GIL when calling into librbd
	pybind/cephfs: drop gil during cephfs callouts

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2023-07-05 13:10:13 -04:00
Mike Perez
640390906f doc/foundation: Updating foundation members for July 2023
Signed-off-by: Mike Perez <thingee@gmail.com>
2023-07-05 08:31:04 -07:00
Pedro Gonzalez Gomez
4de76bf550
Merge pull request #50558 from rhcs-dashboard/fix-dataUnits-graph-plotting
mgr/dashboard: fix a bug where data would plot wrongly

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-07-05 12:29:20 +02:00
Ronen Friedman
540d4ec12b common: make some common ctors and accessors constexpr
Add the constexpr qualifier to:
- some utime_t ctors and accessors;
- a shard_id_t ctor;
- ceph_le operator

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-07-05 04:35:45 -05:00
Matan
e509829189
Merge pull request #51852 from Matan-B/wip-matanb-crimson-watch-notify-logs
crimson/osd/watch: Add logs around Watch/Notify

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-05 11:33:31 +03:00
Ilya Dryomov
fa09e736f3
Merge pull request #52086 from pkalever/fix-mirror-status-desc
rbd-mirror: fix image replayer shut down description on force promote

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-07-05 00:22:53 +02:00
zdover23
c5d4dbf405
Merge pull request #52207 from zdover23/wip-doc-2023-06-27-rados-operations-crush-map-edits-2-of-x-2nd-attempt
doc/rados: edit crush-map-edits (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-05 05:22:33 +10:00
Zac Dover
ae04debe9e doc/rados: edit crush-map-edits (2 of x)
Edit doc/rados/operations/crush-map-edits.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-05 05:11:25 +10:00
zdover23
baeb4d541e
Merge pull request #52308 from zdover23/wip-doc-2023-07-05-seqdiag-test
doc/dev: remove seqdiag assets

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2023-07-05 03:55:15 +10:00
Zac Dover
ce96ddd4c7 doc/dev: remove seqdiag assets
Remove seqdiag assets to determine whether the docs can be built if they
are absent. (Currently they cannot be built when they are present.) If
this works, then these diagrams will be replaced, probably with .png
files.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-05 03:37:10 +10:00
Matan Breizman
780f6f55cd qa/tasks/cbt.py: Install collectl manually
See: d4a04809fd

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-07-04 11:42:34 +00:00
Matan Breizman
abdbfa2275 qa/suites/crimson-rados: Introduce performance testing
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-07-04 11:42:34 +00:00
Xinyu Huang
9d973efe32 test/crimson/seastore: test if lazy read work correctly
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
efd3cdc710 test/crimson/seastore: test overwrite pin
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
b5931d2795 test/crimson/seastore: add test for TransactionManager::remap_pin
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
dc4a23cef3 crimson/os/seastore: check if length exist in mark_space_used and mark_space_free
to avoid misuse of buffer length and data length when there is a no actual data extent

Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
026066a7e5 crimson/os/seastore: deepcopy the buffer of exist clean extent when duplicate_for_write
Beacuse exist clean extent shares buffer with original clean extent.

Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
5d00ec0d00 crimson/os/seastore: realize lazy read in split overwrite with overwrite refactor
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
55d33b69b0 crimson/os/seastore/transaction_manager: implement remap_pin
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
cf6e46e57a crimson/os/seastore/transaction_manager: implement alloc_remapped_extent
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:13 +08:00
Xinyu Huang
f19de7c77f crimson/os/seastore: support no data extent in read path
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-04 17:07:08 +08:00
zdover23
0f303c0149
Merge pull request #51422 from yuvalif/wip-yuval-cephadm-lua-doc
doc/rgw/lua: add info uploading a script in cephadm deployment

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-07-04 03:47:40 +10:00
Ilya Dryomov
1a60f66b0a pybind/rbd: drop GIL when calling into librbd
This was missing for rbd_mirror_peer_site_add() and
rbd_get_data_pool_id().

While at it, add a test for data_pool_id().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-07-03 19:07:21 +02:00
Casey Bodley
813fb284c7
Merge pull request #52247 from cbodley/wip-57905
rgw: rgwx-skip-decrypt also skips decompression of encrypted objects

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-07-03 11:19:36 -04:00
Mark Kogan
19f97fc5a9
Merge pull request #52249 from mkogan1/wip-t61661-d3n-valg
rgw: d3n: fix valgrind reported leak related to libaio ops
2023-07-03 17:06:21 +03:00
Xinyu Huang
7cb44d350b crimson/os/seastore: let CachedExtent::ptr optional
separate buffer length and data length, since no buffer extent is allowed

Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2023-07-03 14:05:05 +08:00
Soumya Koduri
0c5a77f4c9
Merge pull request #52160 from soumyakoduri/wip-skoduri-lc-acl
rgw/set_attrs: Do not modify mtime

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-07-03 10:20:48 +05:30
J. Eric Ivancich
7d93aa83bb
Merge pull request #51983 from clwluvw/aws4-date-header
rgw: pick http_date in case of http_x_amz_date absence

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-07-02 16:30:26 -04:00
Patrick Donnelly
5d249a4c97
pybind/cephfs: drop gil during cephfs callouts
This has disastorous consequences including the possibility of deadlock.
In the best case, you have the rmdir holding the GIL until the MDS
responds!

Fixes: https://tracker.ceph.com/issues/61869
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-07-02 12:05:08 -04:00
Matan Breizman
3548489f62 crimson/osd/watch: don't print bufferlists
The bufferlists clutter the logs and don't infrom of anything useful:
```
DEBUG 2023-05-26 23:36:29,780 [shard 2] osd - send_completion sending notify replies: {notify_reply_t{watcher_gid=4220, watcher_cookie=139786421930752, bl=buffer::list(len=0,

)}, notify_reply_t{watcher_gid=4220, watcher_cookie=139786422032096, bl=buffer::list(len=0,

)}}
```

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-07-02 13:57:49 +00:00
Matan Breizman
b1c05f9ace crimson/osd/watch: Add logs around Watch/Notify
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-07-02 13:57:49 +00:00
Matan
c42efbf587
Merge pull request #49044 from rzarzynski/wip-crimson-ertr-plain-rets
crimson/ertr: let ErrVisitorT return plain value if ValueFuncT returns seastar::future

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-07-02 14:02:01 +03:00
Matan
55fcd87221
Merge pull request #52032 from Matan-B/wip-matanb-crimson-no-ignore
crimson/osd: don't ignore start_pg_operation returned future

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-02 13:53:25 +03:00
Matan
6bd7cd4c38
Merge pull request #51147 from liu-chunmei/multicore-osd
Crimson/osd: support multicore osd

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-02 13:15:02 +03:00
Matan
1f1800b26e
Merge pull request #51916 from cyx1231st/wip-seastar-msgr-multi-core-2
crimson/net: support connections in multiple shards

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-02 13:05:04 +03:00