Commit Graph

132803 Commits

Author SHA1 Message Date
Matt Benjamin
ba410b3a36 rgwlc: define RGWLC::thr_name() and use it to name lc lock cookies
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-07-29 12:34:30 -04:00
Matt Benjamin
216b7f7f4c rgwlc: try hard to get lc locks when saving policy
During active lifecycle processing, there can be high contention for
lifecycle shard locks.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-07-29 12:31:07 -04:00
J. Eric Ivancich
2fd96b93b9
Merge pull request #47187 from cfsnyder/wip-cfsnyder-56646
rgw: optimizations for handling ECANCELED errors from within get_obj_state

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-07-29 12:16:22 -04:00
David Galloway
bb49238d7a
Merge pull request #47343 from ceph/ljflores-patch-1
doc/releases: write a note about the "invalid regex" mgr bug
2022-07-29 12:04:13 -04:00
Laura Flores
9da99242fb doc/releases: add release note about "invalid regex" bug in mgr
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-07-29 09:44:34 -05:00
Daniel Gryniewicz
953eaefb65
Merge pull request #47190 from dang/wip-dang-zipper-filter
RGW - Zipper - Base filter implementation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-07-29 10:01:04 -04:00
zdover23
5515138425
Merge pull request #47347 from anthonyeleven/anthonyeleven/essthree
doc/radosgw: Uppercase s3

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-07-29 19:03:37 +10:00
Anthony D'Atri
73f0d5707d doc/radosgw: Uppercase s3
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-07-29 00:11:22 -07:00
Nizamudeen A
1e46a223c1
Merge pull request #47260 from rhcs-dashboard/fix-frontend-monitor-port-fields
mgr/dashboard: add required validation for frontend and monitor port

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-07-29 12:37:01 +05:30
Anthony D'Atri
ac0e45656e
Merge pull request #47284 from anthonyeleven/anthonyeleven/prom-localrules-tweaks
monitoring/ceph-mixin: clean up prometheus_alerts.yml
2022-07-29 00:06:06 -07:00
Liu-Chunmei
e55f8fe637
Merge pull request #47328 from liu-chunmei/crimson-cmpext
crimson: for cmp_fail error, return -MAX_ERRNO-index

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-28 20:06:47 -07:00
Anthony D'Atri
9b65974468 monitoring/ceph-mixin: clean up prometheus_alerts.yml
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-07-28 19:17:51 -07:00
Yingxin
a73b295d6b
Merge pull request #47291 from cyx1231st/wip-seastore-journal-head
crimson/os/seastore: fixes to trimming

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-07-29 09:31:19 +08:00
Kefu Chai
8a0832701c
Merge pull request #47275 from myoungwon/wip-rbm-cleanup
seastore: RBM clean-ups

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-29 08:10:22 +08:00
chunmei-liu
895188987d crimson: for cmp_fail error, return -MAX_ERRNO-index
instead of cmp_fail error code.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-28 16:59:15 -07:00
Casey Bodley
c5975ce85b
Merge pull request #47308 from mdw-at-linuxbox/wip-master-implanon
rgw: better tenant id from the uri on anonymous access

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-28 17:38:28 -04:00
Guillaume Abrioux
483c7e22e6
Merge pull request #47170 from guits/dep-dev-inventory
ceph-volume: report slave devices in inventory
2022-07-28 22:19:31 +02:00
Guillaume Abrioux
1274ba34b4 ceph-volume/tests: migrate to pyfakefs
ceph-volume unit tests shouldn't actually create contents on the
filesystem from where it runs (even though they are written in a tmp
dir), let's use pyfakefs.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-28 20:14:06 +02:00
Guillaume Abrioux
7ab9d99420 ceph-volume/tests: fix test_path_is_valid()
When ceph-volume tests are run from a host where there's no `/dev/sda`
device, this test fails.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-28 20:14:06 +02:00
Guillaume Abrioux
1ac2a8270c ceph-volume: report slave devices in inventory
`ceph-volume inventory` currently reports the following:

```

Device Path               Size        rotates available Model name
/dev/mapper/mpatha        50.00 GB    True    True
/dev/mapper/mpathaa       6.00 GB     True    True
/dev/mapper/mpathab       6.00 GB     True    True
/dev/mapper/mpathac       6.00 GB     True    True
/dev/mapper/mpathad       6.00 GB     True    True
/dev/mapper/mpathae       6.00 GB     True    True
```

whereas something like following would be useful:

```

Device Path               Size         Device nodes    rotates available Model name
/dev/mapper/mpatha        50.00 GB     sdf,sde         True    True
/dev/mapper/mpathaa       6.00 GB      sdbe,sdat       True    True
/dev/mapper/mpathab       6.00 GB      sdav,sdbf       True    True
/dev/mapper/mpathac       6.00 GB      sdbb,sdbl       True    True
/dev/mapper/mpathad       6.00 GB      sdas,sdbc       True    True
/dev/mapper/mpathae       6.00 GB      sdax,sdbh       True    True
```

Fixes: https://tracker.ceph.com/issues/56624

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-28 20:14:06 +02:00
Guillaume Abrioux
306325a256
Merge pull request #47169 from guits/improve-mpath-reporting
ceph-volume: improve mpath devices reporting
2022-07-28 20:11:30 +02:00
Guillaume Abrioux
3bf846a76e
Merge pull request #46893 from guits/ceph-volume-symlinks-guits
ceph-volume: allow symlinks as devices
2022-07-28 20:11:03 +02:00
Kefu Chai
9a8f20f42e
Merge pull request #47310 from tchaikov/ceph-context-formatting
common/ceph_context: fix the formatting

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-07-28 22:39:33 +08:00
Pere Diaz Bou
473d46161d
Merge pull request #46996 from rhcs-dashboard/html-injection-bug
mgr/dashboard: added pattern validaton for form input

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-07-28 09:38:41 +02:00
Ronen Friedman
18206817b9
Merge pull request #46970 from ronen-fr/wip-rf-unlocked-logs
osd/scrub: pre-prepare the description text of the current state

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-07-28 08:48:37 +03:00
zdover23
89409d6fb8
Merge pull request #46024 from sirtoobii/patch-2
doc/radosgw/STS: sts_key and user capabilities

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-07-28 14:38:28 +10:00
myoungwon oh
c4fedd1901 seastore/rbm: rename nvme_device to random_block_device
rename nvme_device namespace to random_block_device, and
introduce random_block_device::nvme

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-07-28 13:27:44 +09:00
Kefu Chai
f362941446
Merge pull request #44039 from richael02/update-isal-crypto-source
.gitmodules: update isa-l_crypto source address

Reviewed-by: Yibo Cai <yibo.cai@arm.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-28 10:29:28 +08:00
Adam King
eed140c259
Merge pull request #46420 from pcuzner/add-disk-rescan
mgr/cephadm: Add disk rescan feature to the orchestrator

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-07-27 19:50:59 -04:00
Kefu Chai
da14b005b0
Merge pull request #47286 from tchaikov/wip-fmt-ranges
osd: use fmt/ranges.h for printing ranges

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-07-28 07:50:43 +08:00
Adam King
3f1f862b9c
Merge pull request #46883 from adk3798/custom-config
mgr/cephadm: support for miscellaneous config files for daemons

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-07-27 19:49:44 -04:00
Adam King
dae8b562b8
Merge pull request #46955 from hookak/monitoring-stack
cephadm: Add promtail and loki when bootstrap

Reviewed-by: Adam King <adking@redhat.com>
2022-07-27 19:48:09 -04:00
Adam King
257d259e28
Merge pull request #47088 from adk3798/cephadm-logging
cephadm: reduce spam to cephadm.log

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-07-27 19:47:16 -04:00
Kefu Chai
a49a475403 common/ceph_context: fix the formatting
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-28 07:46:55 +08:00
Adam King
6c795c597a
Merge pull request #47178 from adk3798/logrotate-owner
cephadm: add "su root root" to cephadm.log logrotate config

Reviewed-by: Guillaume Abrioux gabrioux@redhat.com
2022-07-27 19:46:04 -04:00
Kefu Chai
d3a7e5e564
Merge pull request #46618 from aclamk/wip-dout-for-alien
crimson/alienstore: Add douts

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-28 07:45:39 +08:00
Adam King
f1cbe5225e
Merge pull request #47269 from adk3798/fix-repo-test
qa/workunits/cephadm: update test_repos master -> main

Reviewed-by: Guillaume Abrioux gabrioux@redhat.com
2022-07-27 19:45:11 -04:00
Richael Zhuang
4ad4e1fbc7 .gitmodules: update isa-l_crypto source address
Update address to https://github.com/intel/isa-l_crypto for it's
moved under intel repo.

Signed-off-by: Richael Zhuang <richael.zhuang@arm.com>
2022-07-28 07:41:26 +08:00
Kefu Chai
65307131e4
Merge pull request #44499 from SMIL-Infra/fix-missed-lease-ack
osd/PeeringState: fix missed recheck_readable from laggy

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-28 07:40:09 +08:00
Kefu Chai
f9aaf7fe15
Merge pull request #45135 from lmlg/fix-32-bit
rgw,test: Fix build errors in 32 bit platforms

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-07-28 07:39:00 +08:00
Kefu Chai
d7fe19d05b
Merge pull request #43005 from wxypro/timeout_conn_msg_opt
msg: Add target_addr to log when connections timed out

Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-07-28 07:38:14 +08:00
Kefu Chai
98c074a93f
Merge pull request #44040 from richael02/update-isal-crypto-version
crypto: update isa-l_crypto version

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-28 07:34:59 +08:00
Kefu Chai
9b76560557
Merge pull request #44762 from Zhiwei-Dai/wip-zlib-compressor-isal-for-aarch64
compressor/zlib: isa-l optimization for zlib algorithm on aarch64

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-28 07:34:04 +08:00
Marcus Watts
b5880caa50 rgw: better tenant id from the uri on anonymous access
When anonymous tries access public bucket, it gets 404,
because rgw doesn't check tenant correctly.

A previous fix for this broke legacy implicit tenants,
because it didn't check for anonymous access.  This version
restricts its behavior to the anonymous user.

Fixes: https://tracker.ceph.com/issues/48001 https://tracker.ceph.com/issues/48382

Original fix by
Author: Rafał Wądołowski <rafal@rafal.net.pl>
Signed-off-by: Rafał Wądołowski <rwadolowski@cloudferro.com>

This fix
Signed-off-by: Marcus Watts <mwatts@redhat.com>
2022-07-27 16:59:47 -04:00
Daniel Gryniewicz
3b8fb3d498 RGW - Zipper - Add temporary Filter testing
In order to test filters, we need to be able to instantiate one and
stack it over a store.  Add a temporary config option to specify a
filter that can be used for testing.  This will be replaced with a
better system once the loadable module work is done.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-27 13:32:53 -04:00
Daniel Gryniewicz
fc78286fb3 RGW - Zipper - Filter base implementation
This is the base implementation for filters.  It passes each call on
each object through to the next layer down.  This allows filters to
subclass these, and only implement the bits they care about, leaving the
rest as pass-through.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-27 13:32:53 -04:00
Daniel Gryniewicz
fcd7b14a67 RGW - Zipper - make Serializer use unique_ptr
Serializer needs to use a unique_ptr like the rest of the SAL API.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-27 13:32:53 -04:00
Jan Sobczak
9ddc5b7737 ceph-volume: support symlinks as devices
This makes ceph-volume support passing symlinks as devices.

Fixes: https://tracker.ceph.com/issues/49103

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-27 16:48:53 +02:00
Guillaume Abrioux
01112ba689 ceph-volume: drop self.abspath in Device()
seems useless to have both self.path and self.abspath attributes.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-27 16:41:26 +02:00
Guillaume Abrioux
e439ada4c2
Merge pull request #47167 from guits/drop-bs-tool-call
ceph-volume: drop `ceph-bluestore-tool` call in Device._parse()
2022-07-27 16:34:08 +02:00