Commit Graph

136766 Commits

Author SHA1 Message Date
Laura Flores
f96dd0dda6
Merge pull request #50410 from ljflores/wip-tracker-58925
qa: suppress memory leak in rocksdb
2023-03-07 09:56:38 -06:00
Matan
274adef5ee
Merge pull request #49779 from Matan-B/wip-matanb-c-lru-comments
common/intrusive_lru: Improve readability

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-03-07 17:10:03 +02:00
Nizamudeen A
c05ab3eab9
Merge pull request #50380 from rhcs-dashboard/script-reef-fix
script: update backport scripts for reef

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: neha-ojha <NOT@FOUND>
2023-03-07 11:36:12 +05:30
Soumya Koduri
a8546872ec
Merge pull request #50397 from soumyakoduri/wip-skoduri-multisite
rgw/tests: Reset endpoint before creating additional zones

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-03-07 09:51:25 +05:30
zdover23
96019dd0b9
Merge pull request #50384 from anthonyeleven/anthonyeleven/tweak-50374
doc/radosgw: Redd up s3select.rst as followup to #49411

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-07 13:45:46 +10:00
Anthony D'Atri
78b42ee0d2 doc/radosgw: Redd up s3select.rst as followup to #49411
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-03-06 18:54:27 -05:00
Laura Flores
7d6390dfbd qa: suppress memory leak in rocksdb
Fixes: https://tracker.ceph.com/issues/58925
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-03-06 21:59:49 +00:00
zdover23
9ec470a8fa
Merge pull request #50398 from zdover23/wip-doc-2023-03-07-dev-guide-basic-workflow-full-stop
doc/dev: add full stop to sentence in basic-wo

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-07 02:31:19 +10:00
Zac Dover
262b115b75 doc/dev: add full stop to sentence in basic-wo
Add a full stop to a sentence in basic-workflow.rst. I looked at this
document and noticed that it wasn't there, and it was just bugging me.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-07 02:15:27 +10:00
Adam King
ce08eda429
Merge pull request #48697 from phlogistonjohn/jjm-cleaner-build-sh
build scripts: various cleanups and minor changes preparing for containerized build and test

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2023-03-06 11:04:09 -05:00
Soumya Koduri
d3811f1d02 rgw/tests: Reset endpoint before creating additional zones
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Fixes: https://tracker.ceph.com/issues/58822
2023-03-06 19:55:34 +05:30
zdover23
03773dfbea
Merge pull request #50382 from zdover23/wip-doc-2023-03-05-radosgw-multisite-caption-3
doc/rgw: fix caption

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-06 23:37:00 +10:00
Venky Shankar
1e73d52216 Merge PR #50310 into main
* refs/pull/50310/head:
	client: remove unused method

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-06 10:57:46 +05:30
Venky Shankar
648c6c7722 Merge PR #48894 into main
* refs/pull/48894/head:
	qa/tasks/cephfs: add "extra data pool" cephfs-data-scan tests
	qa/tasks/cephfs: use cephfs tags when recreating osd caps
	tools/cephfs-data-scan: make data pool command args optional
	tools/cephfs-data-scan: support for multi-datapool
	cls/cephfs: extend accumulate_inode_metadata client method to store pool id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-06 09:42:32 +05:30
zdover23
9775a25709
Merge pull request #50386 from zdover23/wip-doc-2023-03-06-radosgw-s3-table
doc/rgw - fix grammar in table in s3.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-06 11:37:55 +10:00
Zac Dover
1beab1e8ab doc/rgw - fix grammar in table in s3.rst
Put an "only" in the correct place. Also, this is a very small change
that will allow me to see if Jenkins is working (it probably isn't).

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-06 10:09:24 +10:00
Casey Bodley
0d01e69689
Merge pull request #50003 from mkogan1/wip-fix-t58552
qa: d3n: fix test failure when "inline_data": false

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-03-05 09:33:03 -05:00
Zac Dover
8fa5214660 doc/rgw: fix caption
Rewrite the third paragraph of the caption to the figure depicting how a
zonegroup works.

Follows https://github.com/ceph/ceph/pull/50316.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-05 16:43:38 +10:00
Nizamudeen A
3d15f685a8 script: update backport scripts for reef
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-03-04 11:45:57 +05:30
Zack Cerza
8a291f4cc7
Merge pull request #50373 from zmc/nop-suite 2023-03-03 13:53:01 -07:00
Anthony D'Atri
aa971a236f
Merge pull request #50375 from zdover23/wip-doc-2023-03-04-radosgw-keycloak-rewrite
doc/rgw: refine keycloak.rst
2023-03-03 15:01:50 -05:00
Casey Bodley
b13a417f00
Merge pull request #50329 from cbodley/wip-58891
rgw/reshard: treat old RGWBucketInfo::num_shards=0 as 1 shard

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-03-03 14:43:18 -05:00
Zac Dover
5706ff1e45 doc/rgw: refine keycloak.rst
Full line-edit of doc/radosgw/keycloak.rst. Corrected syntax, grammar,
RST, and broken links.

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-04 05:36:35 +10:00
Casey Bodley
d08115f701
Merge pull request #49411 from ceph/json_rgw_integration
rgw/s3select: json integration: identifying new data-source and execute a JSON flow.

Reviewed-by: Albin Antony <aantony@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-03-03 14:35:32 -05:00
Zack Cerza
1927e50807 qa/suites/teuthology/nop: Add 2nd job, with a node
Signed-off-by: Zack Cerza <zack@redhat.com>
2023-03-03 11:52:53 -07:00
Guillaume Abrioux
1c728e9111
Merge pull request #49969 from guits/fix-drive-group-limit
drive_group: fix limit filter in drive_selection.selector
2023-03-03 15:56:38 +01:00
zdover23
60ff142c53
Merge pull request #50364 from anthonyeleven/anthonyeleven/fix-caps
doc/cephadm: Redd up compatibility.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-03 18:46:49 +10:00
Anthony D'Atri
d608dec43b doc/cephadm: Redd up compatibility.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-03-03 02:44:26 -05:00
Anthony D'Atri
329f4962ff
Merge pull request #50354 from zdover23/wip-doc-2023-03-03-multisite-master-zonegroup-image-refinement
doc/rgw: clean zone-sync.svg
2023-03-02 18:48:55 -05:00
galsalomon66
9f20e75a0b json integration: identifying new data-source and execute json flow.
s3select submodule

integrate the limit-operator into RGW. current changes is for CSV format

integrate the limit-operator with CSV-flow, and JSON-flow. an update of s3select submodule

a fix for the input-serialization-type selection

debug functionality.

fix for error handling

adding the scan-range feature. i.e. enables the user to define the range of processing(text only)

remove the temp variable(the s3select-layer handles the sql-result setting upon JSON flow)

adding documentation. for JSON, SQL limit-operator, scan-range option.
a fix for JSON test framework in s3select module

investigate crash. replace len with it.length()

editorial changes; non-initialized variables

adding validation for offset&length. (it seems that the offset&length causes Invalid reads, in some cases)

changes related to trino integration.(1) syntax issues related to trino-engine statement conbersions(s3select parser handles that) (2).
(2). trino rejects(HIVE_CURSUR_ERROR) some of the s3select responses do to its size, the change is about control the size of the respond.

update JSON documentation

trino changes: response in paging (limitation on size), trino syntax issues.

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2023-03-03 00:24:37 +02:00
Daniel Gryniewicz
0faf48cbc0
Merge pull request #46150 from dang/wip-dang-bucket-owner
RGW - Replace set_owner workaround with new fix

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-03-02 14:26:09 -05:00
Zac Dover
064fdc9d9b doc/rgw: clean zone-sync.svg
Refine zone-sync.svg (fix kerning and use fonts that render properly).

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-03 05:24:00 +10:00
Anthony D'Atri
c2bd611053
Merge pull request #50351 from zdover23/wip-doc-2023-03-03-radosgw-multisite-admonition-formatting
doc/radosgw: format admonitions
2023-03-02 14:17:47 -05:00
Zac Dover
4db68f5711 doc/radosgw: format admonitions
Break up the text of two similar admonitions into three paragraphs (in
each of the two instances). This makes the content of the admonition
much easier to read at a glance.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-03 04:04:30 +10:00
Casey Bodley
c8c099fba6
Merge pull request #50345 from cbodley/wip-redmine-reef
script: add 'reef' release to backport-create-issue

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-03-02 10:32:00 -05:00
Venky Shankar
7f65724a25 Merge PR #49756 into main
* refs/pull/49756/head:
	qa: add test for 'dump dir'
	mds: add a command to dump directory information

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-02 19:41:10 +05:30
Casey Bodley
8c5ca361c9
Merge pull request #50172 from cbodley/wip-58794
rgw: catch manifest decode errors in GetObj

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-03-02 09:06:53 -05:00
Casey Bodley
b2e5576e09 script: add 'reef' release to backport-create-issue
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-02 08:16:14 -05:00
Casey Bodley
835e203ca9
Merge pull request #50171 from cbodley/wip-58793
rgw: don't dereference nullopt in DeleteMultiObj

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-03-02 07:44:59 -05:00
Casey Bodley
962a2ce2a4
Merge pull request #50169 from cbodley/wip-rgw-unsal-rados
rgw/rados: remove sal handles from RGWRados::Object ops

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-03-02 07:44:38 -05:00
Venky Shankar
1426cdfaab Merge PR #50217 into main
* refs/pull/50217/head:
	qa: enable the xfstests generic/317 test case
	qa: make the xfstests tmp directories to be readable and excutable

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-03-02 11:04:33 +05:30
Yingxin
943ccfd0bc
Merge pull request #50317 from xxhdx1985126/wip-rbm-prepare-write
crimson/os/seastore/epm: also do prepare_write for rbm

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-03-02 10:07:29 +08:00
Casey Bodley
3e10944ff5 rgw/reshard: avoid infinite loop if bi_list() returns -ENOENT
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-01 17:20:06 -05:00
zdover23
e83c189e5a
Merge pull request #50335 from adk3798/cephadm-compatability-update
doc/cephadm: update cephadm compatability and stability page

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-02 07:36:46 +10:00
Casey Bodley
46f89cbae7 rgw/rados: RGWSI_BucketIndex_RADOS requires layouts, not num_shards
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-01 16:22:02 -05:00
Casey Bodley
c8908fdd4c rgw/rados: use rgw::num_shards() helper
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-01 16:22:02 -05:00
Casey Bodley
4db197e858 rgw/reshard: refuse to reshard to new_num_shards=0
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-01 16:22:02 -05:00
Casey Bodley
e376080940 rgw/reshard: use the rgw::num_shards() helper
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-01 16:22:02 -05:00
Adam King
383f46aa79 doc/cephadm: update cephadm compatability and stability page
This page is very out of date. This commit probably doesn't
cover everything there is to say about stability and compatability
in cephadm, but it at least gets it noticeably closer to reality

Signed-off-by: Adam King <adking@redhat.com>
2023-03-01 16:10:41 -05:00
zdover23
0bd1b34742
Merge pull request #50316 from zdover23/wip-doc-2023-03-01-radosgw-multisite-diagram-object-replication-text-revision
doc/rgw: improve diagram caption

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-02 04:04:25 +10:00