Commit Graph

129504 Commits

Author SHA1 Message Date
Matt Benjamin
c8291d9662 rgwlc: add cls_rgw_lc_get_entry_ret to rgw_types.h (dencoder)
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-31 19:17:36 -05:00
Casey Bodley
36711cc49c
Merge pull request #44408 from linuxbox2/wip-rgwlc-warn-attr
rgwlc:  warn on missing RGW_ATTR_LC

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2022-01-31 17:49:35 -05:00
Casey Bodley
0fad609d4d qa/rgw: rgw/verify no longer pins centos 8.0
the symlink rgw/verify/centos_latest.yaml already selects centos

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 17:23:27 -05:00
Ernesto Puerta
5f32eb29c0
Merge pull request #44384 from rhcs-dashboard/cephadm-e2e-static-ip
mgr/dashboard: cephadm e2e job: display info on error & other improvements

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-31 22:33:22 +01:00
David Galloway
837d393cbb
Merge pull request #44846 from cbodley/wip-qa-centos8-eol
qa: remove centos8 from supported distros
2022-01-31 16:12:45 -05:00
Casey Bodley
e0c9f4e264
Merge pull request #38750 from xxhdx1985126/wip-rgw-setattr-write-bug-fix
librgw: make rgw file handle versioned

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2022-01-31 15:26:00 -05:00
Casey Bodley
3b71b41190 qa/distros: remove duplicate centos_8.stream.yaml from supported
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 14:52:09 -05:00
Casey Bodley
0f4e51f05f qa/distros: centos_8.yaml is now a symlink to centos_8.stream.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 14:51:00 -05:00
Matan
2a10ab8481
Merge pull request #44805 from Matan-B/wip-matanb-deps-unicode
install-deps.sh: set a UTF-8 locale when running pip

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-01-31 20:38:02 +02:00
Casey Bodley
82a3bfa199
Merge pull request #35849 from inspur-wyq/wip-decode-user-policy
rgw: add try catch for user policies decode

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 13:05:58 -05:00
Casey Bodley
7cee2d5e86
Merge pull request #44785 from xijiacun/default-placement
rgw: Match decode_json with dump for default-placement in RGWZoneGroup.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 13:05:27 -05:00
Casey Bodley
218bc2938c
Merge pull request #44562 from ivancich/wip-fix-minor-bi-list-calc
rgw: fix bucket index list minor calculation bug

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2022-01-31 13:04:35 -05:00
Casey Bodley
8e80343cd5
Merge pull request #37665 from clwluvw/role-policy-doc
rgw: add infile arg to role-policy put

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2022-01-31 13:01:17 -05:00
Casey Bodley
b23c7720ff
Merge pull request #44357 from mfatemipour/rgw-bucket-chown-bad-memory-usage
rgw: bucket chown bad memory usage

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-01-31 13:00:04 -05:00
Casey Bodley
99801854bb
Merge pull request #44395 from BryceCao/wip-add-error-message-when-rm-key
rgw : add error message when rm key

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 12:59:50 -05:00
Casey Bodley
d42ebc6d77
Merge pull request #44399 from BryceCao/wip-modify-error-message-when-user-info-by-access-key
rgw : modify error message when user info by access-key

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-31 12:59:15 -05:00
Ilya Dryomov
29e1fc1722
Merge pull request #44833 from fstachura/wip-doc-more-pdf-links
doc: Fix links to CRUSH, RADOS and DSP research papers

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-30 17:58:07 +01:00
Franciszek Stachura
f841def599 doc: Fix links to CRUSH, RADOS and DSP research papers.
Signed-off-by: Franciszek Stachura <fbstachura@gmail.com>
2022-01-30 17:23:33 +01:00
Nitzan Mordechai
79ec68177d mailmap: Add Nitzan Mordechai
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2022-01-30 15:35:05 +02:00
Ilya Dryomov
4ed1e74d83 qa/suites/rbd: add cram-based mon command API test
With mon (rbd_support mgr module in this case) command definitions
generated automatically by @CLI{Read,Write}Command decorator, it's
very easy to accidentally break the external facing API.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-30 14:22:35 +01:00
Ilya Dryomov
a5eef01e92 mgr/rbd_support: level_spec is optional for schedule list/status
Commit fea6fdff4c ("mgr/rbd_support: level_spec passed to some
commands is not optional") is wrong.  While it is true that a valid
level_spec is needed to create a LevelSpec instance, an empty string
is very much a valid level spec -- it signifies "all levels".

This wasn't caught because within Ceph these commands are wrapped by
rbd CLI which injects an empty string in get_level_spec_args().

Fixes: https://tracker.ceph.com/issues/54058
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-30 14:22:35 +01:00
Ilya Dryomov
2f5faabf42 mgr/rbd_support: "trash remove" takes image_id_spec, not image_spec
Because of @CLIWriteCommand, the parameter name has to adhere to
the mon command API.  Commit dcb51b067a49 ("mgr/rbd_support: define
commands using CLICommand") accidentally changed image_id_spec to
image_spec, breaking external users such as go-ceph.

Fixes: https://tracker.ceph.com/issues/54057
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-29 15:10:33 +01:00
Kefu Chai
9b5a77eb1a
Merge pull request #44707 from liumiaomiaoIntel/qatdoc
doc/radosgw: update QAT acceleration to specify the configuration

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-01-29 14:13:41 +08:00
Miaomiao Liu
6a7f1f6c37 doc/radosgw: update QAT acceleration to specify the configuration
add and change the configuration steps to enable latest version of QAT
driver on QAT based encryption and compression

Signed-off-by: Miaomiao Liu <miaomiao.liu@intel.com>
2022-01-29 12:41:37 +08:00
Matt Benjamin
a177503673 rgwlc: fix compat-decoding of cls_rgw_lc_get_entry_ret
Fix compat-decode of cls_rgw_lc_get_entry_ret, which had changed
earlier in 394750597.  While not initially a problem, the more
recent change to allow radosgw-admin lc process to operate on a single
bucket created a way to decode an un-upgraded structure.

Fixes: https://tracker.ceph.com/issues/53927

Reported by Jeegn Chen <jeegnchen@gmail.com>.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-28 17:04:48 -05:00
Casey Bodley
85fa474b4d
Merge pull request #44816 from cbodley/wip-rgw-cmake-system
cmake/rgw: src/rgw and src/rgw/services are not system headers

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-01-28 14:09:59 -05:00
J. Eric Ivancich
aa0071ce8b rgw: in bucket reshard list, clarify new num shards is tentative
With dynamic bucket index resharding, when the average number of
objects per shard exceeds the configured value, that bucket is
scheduled for reshard. That bucket may receive more new objects before
the resharding takes place. As a result, the existing code
re-calculates the number of new shards just prior to resharding,
rather than waste a resharding opportunity with too low a value.

The same holds true for a user-scheduled resharding.

A user reported confusion that the number reported in `radosgw-admin
reshard list` wasn't the number that the reshard operation ultimately
used. This commit makes it clear that the new number of shards is
"tentative". And test_rgw_reshard.py is updated to reflect this
altered output.

Additionally this commit adds some modernization and efficiency to the
"reshard list" subcommand.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-01-28 12:05:54 -05:00
Redouane Kachach
5a4f5fb29e
doc/cephadm: fixing cluster purging section
https://tracker.ceph.com/issues/54018
ceph orch is not enough to stop all cephadm operations

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-01-28 17:16:27 +01:00
Sebastian Wagner
39f972a152
Merge pull request #44801 from sebastian-philipp/doc-cephadm-count-per-host
doc/cephadm: Co-location of daemons

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by:Anthony D'Atri <anthony.datri@gmail.com>
2022-01-28 16:19:35 +01:00
Daniel Gryniewicz
ebabf9b225
Merge pull request #44823 from andriytk/fix-install-deps2
install-deps.sh: fix cortx-motr installation condition
2022-01-28 09:39:41 -05:00
Andriy Tkachuk
71ab238a5d install-deps.sh: fix cortx-motr installation condition
Don't try to install cortx-motr if it is already installed
or not needed. (Currently, it installs on any run from an
interactive terminal session).

Signed-off-by: Andriy Tkachuk <andriy.tkachuk@seagate.com>
2022-01-28 12:57:18 +00:00
Pere Diaz Bou
239f884c31 mgr/dashboard: perform daemon actions on cluster->services
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Fixes: https://tracker.ceph.com/issues/50322
2022-01-28 11:44:35 +01:00
zdover23
7c1eb0cd5f
Merge pull request #44711 from zdover23/wip-doc-2022-01-21-rados-bluestore-cache-autotune-interval-rewrite-2
src/rados: rewrite bs cache autotune instructions

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-01-28 09:29:14 +10:00
Adam King
a773c53b11
Merge pull request #44703 from phlogistonjohn/jjm-issue46773
cephadm: validate that the constructed YumDnf baseurl is usable

Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-01-27 17:35:21 -05:00
Adam King
1b861305ea
Merge pull request #44517 from adk3798/agent-cache
mgr/cephadm: store agent metadata in its own cache

Reviewed-By: Sebastian Wagner <sewagner@redhat.com>
2022-01-27 17:34:01 -05:00
Casey Bodley
56510a1471 cmake/rgw: src/rgw and src/rgw/services are not system headers
include these with -I instead of -isystem so we don't hide their
compiler warnings

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-01-27 16:31:02 -05:00
zdover23
13a37c7f73
Merge pull request #44719 from zdover23/wip-doc-2021-01-22-man-page-radosgw-multitenancy-remove-double-quotes
doc/radosgw: replace double quotes with single

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-28 04:16:16 +10:00
Daniel Gryniewicz
43b373b08e
Merge pull request #44379 from andriytk/add-motr-rgw-sal
rgw: add CORTX Motr SAL implementation

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-01-27 11:33:25 -05:00
Ernesto Puerta
03b1b357e5
Merge pull request #44654 from rhcs-dashboard/page-title-feature
mgr/dashboard: Page title should indicate current location 

Reviewed-by: Sarthak0702 <NOT@FOUND>
Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-01-27 16:10:40 +01:00
Venky Shankar
bc51231769
Merge pull request #44793 from anthonyeleven/anthonyeleven/cephfs-mirroring
doc/cephfs: Clean up mirroring

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-27 18:27:44 +05:30
Matan Breizman
5e5c47090a install-deps.sh: set a UTF-8 locale when running pip
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-01-27 11:32:28 +00:00
Andriy Tkachuk
bf24c479b9 rgw: add CORTX Motr SAL implementation
To build with Motr backend, use -DWITH_RADOSGW_MOTR=YES cmake
option. cortx-motr-devel rpm should be installed beforehand.

To connect to Motr cluster, add the following configuration
parameters to ceph.conf:

    [client]
            ...
            rgw backend store = motr
            motr profile fid  = 0x7000000000000001:0x4f
            motr ha endpoint  = inet:tcp:10.0.0.1@2001
    ...
    [client.rgw.8000]
            ...
            motr my endpoint  = inet:tcp:10.0.0.1@5001
            motr my fid       = 0x7200000000000001:0x29

The correct values for the Motr connection parameters can be
taken from `hctl status` cmd output after Motr cluster is
bootstrapped. In the example above, the values were taken from
the following output:

    Profile:
        0x7000000000000001:0x4f
    Services:
        centos8n1
        [started] hax       0x7200000000000001:0x6  inet:tcp:10.0.0.1@5001
        ...
        [unknown] m0_client 0x7200000000000001:0x29 inet:tcp:10.0.0.1@5001

Motr pkgs for the build/run can be taken from
https://github.com/Seagate/cortx-motr/releases/tag/2.0.0-rgw.

Co-authored-by: Sining Wu <sining.wu@seagate.com>

Signed-off-by: Andriy Tkachuk <andriy.tkachuk@seagate.com>
2022-01-27 10:45:25 +00:00
Sarthak0702
14eb1890da mgr/dashboard: Page title should indicate current location
Added titleService to BreadcrumbsComponent.

Fixes: https://tracker.ceph.com/issues/36587
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
2022-01-27 15:38:39 +05:30
Sebastian Wagner
bae07a4417
doc/cephadm: Co-location of daemons
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-27 10:58:29 +01:00
Ernesto Puerta
13a6c8930c
Merge pull request #44693 from rhcs-dashboard/configuration-test
mgr/dashboard: navigation page e2e fix 

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-27 10:37:07 +01:00
Yingxin
763f9909c1
Merge pull request #44748 from cyx1231st/wip-crimson-improve-log-tm
crimson/os/seastore/transaction_manager: cleanups and logs

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-01-27 13:25:21 +08:00
Adam King
531c8e3b17
Merge pull request #44760 from mgfritch/fixup-asyncssh-mypy
mgr/cephadm: improve asyncssh type checking

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Melissa Li <melissali@redhat.com>
2022-01-26 21:42:39 -05:00
Paul Cuzner
cbeab5c566 monitoring: remove old MIB
The MIB file that matches the OID definitions in the alerts is
CEPH-MIB.txt. The old MIB from the original SuSE snmp
gateway work, therefore needs to be removed to avoid
confusion.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2022-01-27 11:24:34 +13:00
Neha Ojha
4673864b40
Merge pull request #44792 from Matan-B/wip-matanb-email-contact
mailmap: Add Matan Breizman

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-26 12:48:51 -08:00
Anthony D'Atri
778973176e doc/cephfs: Clean up mirroring
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-01-26 12:10:05 -08:00