Commit Graph

998 Commits

Author SHA1 Message Date
Ali Masarwa
4abb31a5f4 RGW: added a per topic configuration to control the notification persistency
Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>
2023-09-04 10:20:55 +03:00
Anthony D'Atri
c837584207
Merge pull request #50360 from tgfree7/wip-doc-2023-03-03-multisite-migrating-a-single-site
doc/radosgw: multisite - edit "migrating a single-site"
2023-09-03 08:05:17 -04:00
zdover23
87e8ad2c67
Merge pull request #52715 from zdover23/wip-doc-2023-08-01-radosgw-admin-rate-limit-management
doc/radosgw: update rate limit management

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-08-10 11:06:20 +10:00
Yuval Lifshitz
776eea8c65 rgw/lua: add configurable memory limit for the lua state
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-08-06 16:42:47 +00:00
Ville Ojamo
9dd86773b3 doc/radosgw: Improve language and formatting in config-ref.rst
The "Topic persistency settings" section includes convoluted
and incomplete sentences so attempt to improve the
language. The section lacks context so add a link to the
relevant documentation about Notifications.

The "Garbage Collection settings" note includes a sentence
that looks incomplete so try to improve the language.

Don't capitalize "Ops" in "RGW Ops" especially when the
same sentence talks about "op queue" with lower case "o".

Also improve formatting: indentation of a note and wrap
several very long lines.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2023-08-06 16:48:36 +07:00
Casey Bodley
bb5ad067ed doc/rgw: correct statement about default zone features
this sentence wasn't updated when we added the Default column to the
table below

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-04 13:00:59 -04:00
Casey Bodley
ab6ec66a2f doc/rgw: several response headers are supported
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 17:31:31 -04:00
Ali Masarwa
c62a170718
Merge pull request #52634 from AliMasarweh/wip-alimasa-persistant-q-enhance
RGW: control the persistency of the notification
2023-08-03 17:28:18 +03:00
Ali Masarwa
c583f69e0c RGW: control the persistency of the notification
via adding expiry by number of retries and time
and controling the frequency of retries by sleep duration (in the options of vstart)

Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>
2023-08-02 16:40:41 +03:00
Zac Dover
51b7ff76fc doc/radosgw: update rate limit management
Improve the grammar and readability of the "Rate Limit Management"
section of doc/radosgw/admin.rst. This commit follows from
https://github.com/ceph/ceph/pull/52131.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-01 07:27:10 +10:00
Piotr Parczewski
50bfbab6d9
doc/radosgw: correct emphasis in rate limit section
Signed-off-by: Piotr Parczewski <piotr@stackhpc.com>
2023-07-31 16:42:26 +02:00
Ville Ojamo
dd16ad9055 doc/radosgw: Add missing space to date option spec in admin.rst
The start time and end time CLI option specification is missing a space between the date and the optional time value. Also expand the text to talk about "optional time" after the date.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2023-07-28 10:54:06 +07:00
Casey Bodley
669f76b058
Merge pull request #52300 from cbodley/wip-rgw-zonegroup-feature-compress-encrypted
rgw: require zonegroup feature to compress encrypted objects

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-07-11 08:26:20 -04:00
Casey Bodley
d85011a7fc doc/rgw: document compress-encrypted zonegroup feature flag
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-07 14:39:56 -04:00
Casey Bodley
39be699629 doc/rgw: don't capitalize zonegroup feature flags
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-07 14:00:36 -04:00
Casey Bodley
cdb1be836c rgw: don't enable all zone features by default
on zonegroup creation, all `supported` features get enabled by default.
however, some features should remain opt-in. add a separate list of
`enabled` features for the subset of features we want enabled by default
on zonegroup creation

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-07-07 14:00:36 -04:00
Zac Dover
c6400ed79b doc/radosgw: add Zonegroup policy explanation
Add revised Zonegroup policy for "multi-zonegroups". This commit
includes changes that Casey Bodley made in
https://github.com/ceph/ceph/pull/52324#discussion_r1253482258 and that
I have integrated into the docs only now.

Co-authored-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-08 03:35:15 +10:00
Zac Dover
5c46a1a009 doc/radosgw: add Zonegroup purpose
Add a note about the telos of zonegroups. The information added in this
commit was originally sent to ceph-users by Casey Bodley on 30 Jun 2023
in response to a question from Yixin Jin. Alexander Patrakov then
suggested that Casey's response should be added to
doc/radsogw/multisite.rst.

Co-authored-by: Casey Bodley <cbodley@redhat.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-07 06:21:13 +10:00
zdover23
0f303c0149
Merge pull request #51422 from yuvalif/wip-yuval-cephadm-lua-doc
doc/rgw/lua: add info uploading a script in cephadm deployment

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-07-04 03:47:40 +10:00
Anthony D'Atri
00edceddba
Merge pull request #52280 from zdover23/wip-doc-2023-07-01-radosgw-multisite
doc/radosgw: refine "Zones" in multisite.rst
2023-07-01 09:46:19 -04:00
Zac Dover
8dab6c066c doc/radosgw: refine "Zones" in multisite.rst
Describe in greater detail the function of Zones in serving S3 objects,
as requested by Alexander Patrakov here:
https://github.com/ceph/ceph/pull/49981#issuecomment-1615866374.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-01 21:51:15 +10:00
Zac Dover
71c327ef4f doc/radosgw: s/s3select/S3 Select/
Correct several misspelling of "S3 Select". Hat tip to Anthony D'Atri,
who caught this in an earlier PR.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-01 21:14:30 +10:00
Zac Dover
4d2c09b683 doc/radosgw: edit "Basic Workflow" in s3select.rst
Edit the "Basic Workflow" section in doc/radosgw/s3select.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-30 01:27:52 +10:00
Zac Dover
e051dd1a75 doc/radosgw: edit "Overview" in s3select.rst
Edit the "Overview" section in doc/radosgw/s3select.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-28 16:16:00 +10:00
zdover23
69cfd0e6d2
Merge pull request #52181 from zdover23/wip-doc-2023-06-25-radosgw-s3select-formatting
doc/radosgw: remove pipes from s3select.rst

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-06-25 23:46:11 +10:00
Zac Dover
a4d302ee1a doc/radosgw: remove pipes from s3select.rst
Remove strange formatting introduced in
61d6813726.

Note to the documentation team: This is not a line-edit. This commit
includes nothing but the removal of pipes added to the left of much of
the text in this file. Several future commits will line-edit this file
and correct its formatting.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-25 19:03:07 +10:00
Yuval Lifshitz
38d819b3d7 rgw/amqp: remove possible race conditions with the amqp connections
* simplify memory management of the connection by not using a unique_ptr
* simplify the logic by handling all issues inside the amqp manager
* fix iterator invalidation issue with miltiple n/acks
* allow different connections with different exchanges
* modify the unit tests according to the new behavior

Fixes:
* https://tracker.ceph.com/issues/61639
* https://tracker.ceph.com/issues/46127

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-06-21 08:06:17 +00:00
samarah
8d37f60c10 RGW: Add D4N classes and unit testing; update cpp_redis submodule
Signed-off-by: samarah <suriarte@redhat.com>
2023-06-05 13:06:46 -04:00
Yuri Weinstein
b2ec2aff80
Merge pull request #50651 from rosinL/cleanup
Cleanup the LevelDB residue


Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-06-05 11:32:51 -04:00
Casey Bodley
bdf903f7ff doc/rgw: fix multisite resharding feature to say Reef instead of Quincy
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-05-30 11:30:05 -04:00
Zac Dover
d4ed4223d9 doc/radosgw: explain multisite dynamic sharding
Add a note to doc/radosgw/dynamicresharding.rst and a note to
doc/radosgw/multisite.rst that explains that dynamic resharding is not
supported in releases prior to Reef.

This commit is made in response to a request from Mathias Chapelain.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-05-19 17:59:42 +10:00
Yuval Lifshitz
5cec4f7195 doc/rgw/lua: add info uploading a script in cephadm deployment
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2023-05-10 13:37:26 +03:00
zdover23
045a4e8484
Merge pull request #51392 from parth-gr/rgw-mutisite-ceph-doc
doc: update multisite doc

Reviewed-by:  Jiffin Tony Thottan <jthottan@redhat.com>
Reviewed-by:  Casey Bodley <cbodley@redhat.com>
Reviewed-by:  Zac Dover <zac.dover@proton.me>
2023-05-09 12:37:40 +10:00
Daniel Gryniewicz
09f857ec3e
Merge pull request #43245 from thiagoarrais/docs-java-examples
[rgw]: Update AWS SDK in Java examples
2023-05-08 11:47:15 -04:00
parth-gr
edab93b2f1 doc: update multisite doc
cmd for getting zone group was spelled incorrectly
Updated to rdosgw-admin

Signed-off-by: parth-gr <paarora@redhat.com>
2023-05-08 19:31:41 +05:30
luo rixin
6da360833a doc: remove leveldb support from doc
Signed-off-by: luo rixin <luorixin@huawei.com>
2023-05-04 10:43:08 +08:00
Zac Dover
e4b35de2ab doc/radosgw: rabbitmq - push-endpoint edit
Remove a note that directed users to change "push-endpoint" (with a
hyphen) to "push_endpoint" (with an underscore) when using rabbitmq.

Re: https://github.com/ceph/ceph/pull/48486#issuecomment-1529925389

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-05-02 03:14:01 +10:00
Cole Mitchell
13cf134c06 doc/radosgw: format part of s3select
Partially format the 'Basic Workflow' section's introduction and 'Basic Functionalities' subsection in s3select. Nothing else is being fixed.

Signed-off-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-04-17 05:51:53 -04:00
Cole Mitchell
a6a84471a7 doc/radosgw: format part of s3select
Format the first section of s3select. Nothing else is being fixed.

Signed-off-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-04-16 09:13:56 -04:00
Casey Bodley
7b56006e0e doc/rgw: remove rgw_thread_pool_size from frontend options
this is a config variable, not a frontend option. and the description is
not accurate

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-11 14:15:31 -05:00
Yuval Lifshitz
4aa930e9f9
Merge pull request #48911 from yuvalif/test-kafka-sasl-scram
rgw: test kafka sasl scram

reviewed-by: anthonyeleven, cbodley
2023-03-07 20:20:28 +02:00
zdover23
96019dd0b9
Merge pull request #50384 from anthonyeleven/anthonyeleven/tweak-50374
doc/radosgw: Redd up s3select.rst as followup to #49411

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-07 13:45:46 +10:00
Anthony D'Atri
78b42ee0d2 doc/radosgw: Redd up s3select.rst as followup to #49411
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-03-06 18:54:27 -05:00
zdover23
03773dfbea
Merge pull request #50382 from zdover23/wip-doc-2023-03-05-radosgw-multisite-caption-3
doc/rgw: fix caption

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-06 23:37:00 +10:00
tgfree
579c14055d doc/radosgw: multisite - edit "migrating a single-site"
Add the import step of the section "Migrating a Single-Site Deployment to Multi-Site"
in doc/radosgw/multisite.rst. The field "name" and "api_name" should be matched.

Signed-off-by: Qi Tao <tgfree7@gmail.com>
2023-03-06 09:33:37 +08:00
Zac Dover
1beab1e8ab doc/rgw - fix grammar in table in s3.rst
Put an "only" in the correct place. Also, this is a very small change
that will allow me to see if Jenkins is working (it probably isn't).

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-06 10:09:24 +10:00
Zac Dover
8fa5214660 doc/rgw: fix caption
Rewrite the third paragraph of the caption to the figure depicting how a
zonegroup works.

Follows https://github.com/ceph/ceph/pull/50316.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-05 16:43:38 +10:00
Anthony D'Atri
aa971a236f
Merge pull request #50375 from zdover23/wip-doc-2023-03-04-radosgw-keycloak-rewrite
doc/rgw: refine keycloak.rst
2023-03-03 15:01:50 -05:00
Zac Dover
5706ff1e45 doc/rgw: refine keycloak.rst
Full line-edit of doc/radosgw/keycloak.rst. Corrected syntax, grammar,
RST, and broken links.

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-04 05:36:35 +10:00
Casey Bodley
d08115f701
Merge pull request #49411 from ceph/json_rgw_integration
rgw/s3select: json integration: identifying new data-source and execute a JSON flow.

Reviewed-by: Albin Antony <aantony@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-03-03 14:35:32 -05:00