Commit Graph

133911 Commits

Author SHA1 Message Date
Matt Benjamin
c12ed2906a rgw/main: move service_map_meta into AppMain
The RGWRealmReloader holds a reference on it.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:19:03 -04:00
Matt Benjamin
3904adfbc2 rgw/main: move signal handler actions out of shutdown()
AppMain::shutdown() had borrowed the unregister_async_signal_handler()
text from librgw, but of course, that's wrong.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:18:41 -04:00
Matt Benjamin
2282a803b2 rgwlib: robustify non-default initialization
Don't rely on the conf-default value of rgw_nfs_frontends to
provide "rgw-nfs," as that's not optional when running under
librgw.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:17:32 -04:00
Matt Benjamin
54094b97f0 rgw_main: remove unused tracepoint decls
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:17:22 -04:00
Matt Benjamin
8e9dae8195 rgwlib: rework linkage
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:17:12 -04:00
Matt Benjamin
9dccf5e20b rgw_a: build reorganization
Reorganize some dependencies shared by the librgw.so and radosgw
main units.  The librgw.so build no longer builds a main(...)
unit.

Build time should be slightly reduced, as several shared dependencies
have been moved into rgw_a.

There are some other cleanups, e.g., rgw_signal.{h,cc}.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:16:36 -04:00
Matt Benjamin
8f5f70ba45 rgw/main: remove friends, see_also
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:11:48 -04:00
Matt Benjamin
482fd72029 rgw/main: various doc and comment corrections by doc writers
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:11:42 -04:00
Matt Benjamin
d0424e842d rgw/main: use AppMain in c++ main function
Consolidate standalone and library initialization into one
unit.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:11:34 -04:00
Matt Benjamin
08e687fc9e rgw/main: AppMain
s/rgw::InitHelper/rgw::AppMain/;

Move program state from RGWLib into AppMain, preparing it to
manage program state for all RGW instances (e.g., main()).

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:11:27 -04:00
Matt Benjamin
67d30e5556 librgw: add ability to conditionally export HTTP frontends/apis
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-09-09 11:11:09 -04:00
Guillaume Abrioux
4b3d174f88 ceph-volume: fix inventory with device arg
there's no need to go through all devices present when
a device is passed to the `ceph-volume inventory` command.

Fixes: https://tracker.ceph.com/issues/57085

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-09-09 16:52:12 +02:00
Nizamudeen A
d84a03e989
Merge pull request #47700 from s0nea/wip-rgw-overview-labels
monitoring/ceph-mixin: add RGW host to label info

Reviewed-by: MrFreezeex <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-09-09 17:36:40 +05:30
Jos Collin
aa33e1ab50
stop.sh: kill cephfs-top
Signed-off-by: Jos Collin <jcollin@redhat.com>
2022-09-09 17:08:09 +05:30
nsedrickm
d1d2793104 mgr/dashboard: add cypress e2e accessibility tests for dashboard
* Add cypress e2e accessibility tests
* Log accessibility violations to console for quick debugging
* Disable retries to avoid duplicate logs

Signed-off-by: nsedrickm <nsedrick101@gmail.com>
2022-09-09 10:03:16 +01:00
nsedrickm
0bd10c0e12 mgr/dashboard: Improve accessibility for dashboard health page
* Add new color variables to meet WCAG level AA color contrast for info cards and cluster health label
* Increase font size of cluster health label for better legibility with updated color
* Apply darker warning color for logs summary description and increase their font size and font-weight
* Add accessible names for info group icons
* Replace health status labels HEALTH_OK, HEALTH_WARN and HEALTH_ERR with OK, WARNING and ERROR

Fixes: https://tracker.ceph.com/issues/55867
Signed-off-by: nsedrickm <nsedrick101@gmail.com>
2022-09-09 08:09:44 +01:00
Nizamudeen A
5f8eff3bef mgr/dashboard: osd form preselect db/wal device filters
If the hostname is selected for the primary devices, then we can
preselect the hostname filter for the db/wal devices because osds will
be deployed only on the hostname of the primary device. If preselected
it'll be clear that only this devices will be used to deploy.

Addition to this, usually ssd devices are used for db/wal devices. So I
am preselecting these too in the filters.

Fixes: https://tracker.ceph.com/issues/57118
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-09-09 10:48:28 +05:30
Nizamudeen A
0a60e89992
Merge pull request #47784 from rhcs-dashboard/ingress-unmanaged
mgr/dashboard: fix unmanaged service creation

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-09-09 10:44:35 +05:30
Nizamudeen A
84f4e123be
Merge pull request #47959 from rhcs-dashboard/service-id-filter-undefined
mgr/dashboard: fix Cannot read properties of undefined (reading 'filter')

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-09-09 09:27:14 +05:30
Sage Weil
fa8ad5568c auth/Crypto: add clear()
Signed-off-by: Sage Weil <sage@newdream.net>
2022-09-08 16:11:30 -04:00
Ilya Dryomov
f4bb197f3e
Merge pull request #48014 from idryomov/wip-57116-cont
test/{librbd, rgw}: increase delay between and number of bind attempts

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-09-08 20:52:28 +02:00
Daniel Gryniewicz
0cdd0c47bc
Merge pull request #48003 from dang/wip-dang-zipper-admin-api
RGW - Zipper - Allow per-store admin APIs

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-09-08 14:36:46 -04:00
Ilya Dryomov
5855c7890f
Merge pull request #48009 from ljflores/wip-install-deps-focal-bionic
install-deps.sh: fix install-deps script for focal and bionic

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-09-08 20:05:15 +02:00
Daniel Gryniewicz
70c6cac4e6 RGW - Zipper - Allow per-store admin APIs
Some of the existing admin APIs are rados-specific, and other stores
will want to add specific APIs.  Allow this by having a function to add
store-specific APIs.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-09-08 12:38:57 -04:00
Radoslaw Zarzynski
dbfb50453c PendingReleaseNotes: document online and offline trimming of PG Log's dups
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-09-08 15:35:38 +00:00
Redouane Kachach
4da92c5959
mgr/cephadm: Adding --storage.tsdb.retention.size prometheus option
fixes: https://tracker.ceph.com/issues/57422

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-09-08 13:51:08 +02:00
Ilya Dryomov
48016eaa15 test/{librbd, rgw}: increase delay between and number of bind attempts
Commit aa7885f7cc ("test/{librbd, rgw}: retry when bind fail with
port 0") reduced the frequency of sporadic unit test failures caused
by EADDRINUSE a lot, but not entirely.

Currently, it yields a cumulative sleep of ~9 seconds.  Let's increase
that to 1 minute.

Fixes: https://tracker.ceph.com/issues/57116
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-09-08 11:46:58 +02:00
Yuval Lifshitz
72f8cfadb3
Merge pull request #47274 from faithuniterh/Golang-Notification-creation
examples/golang : Add put notification creation golang example code

reviewed-by: yuvalif
2022-09-08 12:31:24 +03:00
Nizamudeen A
165de92cc1
Merge pull request #46757 from nSedrickm/navigation-component-accessibility-update
mgr/dashboard: Improve accessibility for navigation components

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-09-08 09:41:29 +05:30
Laura Flores
0d2a5f3466 install-deps.sh: fix install-deps script for focal and bionic
When run on focal and bionic, install-deps ends early
due to this extra debug message that was added to the
end of `ensure_decent_gcc_on_ubuntu`. The debug message
prints when the script is run in a jenkins environment.

When the script is not run in a jenkins environment, the
value returned there is "false" or "0", which acts as
an early return. This stops the script from completing.

We can remove this line, as `ensure_decent_gcc_on_ubuntu`
is only called for focal and bionic, and most of the jenkins
nodes are running jammy. Also, there is a debug message at the
beginning of the function that should suffice.

Fixes: https://tracker.ceph.com/issues/57466
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-09-07 19:45:57 +00:00
Adam King
91befb14d5 doc/cephadm: correct version staggered upgrade got in pacific
This didn't end up making 16.2.10 so the first version
it will actually be available is 16.2.11

Signed-off-by: Adam King <adking@redhat.com>
2022-09-07 15:19:02 -04:00
Yuval Lifshitz
e85e121747
Merge pull request #47091 from faithuniterh/Golang-Topic-creation
Topic creation example and sorting Golang examples into different folders

reviewed-by: anthonyeleven, yuvalif
2022-09-07 21:15:52 +03:00
Yuval Lifshitz
10fd49e073
Merge pull request #47864 from yuvalif/wip-yuval-fix-53186
rgw/notifications: add region to bucket ARN

reviewed-by: mattbenjamin, nthonyeleven
2022-09-07 21:09:16 +03:00
Casey Bodley
e82d5994fb
Merge pull request #47924 from tchaikov/wip-57355
denc: support non-c++20 compliant C++ standard library

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-09-07 12:53:36 -04:00
Zuhair AlSader
7efceddac8
rgw: add DAOS SAL implementation
To build with DAOS backend, use -DWITH_RADOSGW_DAOS=YES cmake
option. `daos-devel` rpm should be installed beforehand.

To connect to DAOS pool, add the following configuration
parameters to ceph.conf:
```
    [client]
            ...
            rgw backend store = daos
            daos pool = tank
```

A pool could be created using the following command:
```
    dmg pool create --size=<size> <pool_name>
```

To install `daos-devel` do:
```
    sudo wget -O /etc/yum.repos.d/daos-packages.repo https://packages.daos.io/v2.0/EL8/packages/x86_64/daos_packages.repo
    sudo rpm --import https://packages.daos.io/RPM-GPG-KEY
    sudo yum install -y epel-release daos-server daos-client daos-devel
```

Co-authored-by: Walter Warniaha <walter.warniaha@seagate.com>

Signed-off-by: Zuhair AlSader <zuhair.alsader@seagate.com>
2022-09-07 12:19:41 -04:00
J. Eric Ivancich
558df7c10b
Merge pull request #47935 from ivancich/wip-simplify-bucket-listing-logging
rgw: simplify bucket listing logging

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2022-09-07 11:30:21 -04:00
Laura Flores
934e487a91
Merge pull request #47741 from ljflores/wip-python3-fix
do_cmake.sh: build with python3.10 on ubuntu version >= 22.0
2022-09-07 10:11:08 -05:00
Pere Diaz Bou
521caba4f3
Merge pull request #47857 from nSedrickm/duplicate-id-accessibility-update
mgr/dashboard: remove duplicate ids from table column filters

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-09-07 16:56:08 +02:00
Aashish Sharma
2ae1bca1d9 mgr/dashboard: fix snapshot creation with duplicate name
Snapshot creation with same name on UI throwing 500 Internal Error, This PR intends to fix this issue.

Fixes: https://tracker.ceph.com/issues/57456
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2022-09-07 17:06:52 +05:30
Yingxin
815125eaad
Merge pull request #47981 from myoungwon/wip-rbm-cleanup2
crimson/os/seastore: RBM cleanups (mkfs, open, unittest)

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-09-07 18:54:27 +08:00
Xinyu Huang
dcaf4368fd test/crimson/seastore: lack of config.inclusive==true situation in omap_manager list test
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2022-09-07 09:45:42 +00:00
Pere Diaz Bou
a1719ab4f2
Merge pull request #47054 from nSedrickm/grafana-component-accessibility-update
mgr/dashboard: Improve level A accessibility for grafana component

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-09-07 10:30:00 +02:00
myoungwon oh
594f1a360b crimson/os/seastore/rbm: use RBMDevice::size instead of TestMemory::size in TestMemory
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-09-07 14:58:48 +09:00
myoungwon oh
c4d2314058 crimson/os/seastore/rbm: force to make rbm superblock when mkfs is called
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-09-07 14:58:40 +09:00
myoungwon oh
2c13b1a58c crimson/os/seastore/rbm: call device.open() before rbm.open() or rbm.mkfs()
This commit also deletes open_device() in rbn.open()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-09-07 14:58:33 +09:00
myoungwon oh
52e0c81f06 test/crimson/seastore: fix randomblockmanager test
1. remove transaction manager initialization in rbm test
2. do not call check_bitmap_blocks directly and use close() and open()
because open() invokes it internally

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-09-07 14:58:23 +09:00
Xinyu Huang
b720f100af crimson/os/seastore/omap: fix assert bug
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
2022-09-07 00:01:33 +00:00
Ilya Dryomov
7c73866e7d
Merge pull request #47987 from idryomov/wip-52810
librbd: retry ENOENT in V2_REFRESH_PARENT as well

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2022-09-06 20:17:15 +02:00
Casey Bodley
d465f17d38
Merge pull request #47783 from soumyakoduri/wip-skoduri-sync-flow
radosgw-admin: fix crash with 'sync flow' cmd without 'flow-type'

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2022-09-06 12:29:53 -04:00
Yuri Weinstein
747d1d39bb
Merge pull request #45883 from ifed01/wip-ifed-fix-bluefs-truncate
os/bluestore: fix no metadata update on truncate+fsync 

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2022-09-06 09:12:29 -07:00