Commit Graph

132841 Commits

Author SHA1 Message Date
Xiubo Li
91fcdbb58e test/libcephfs: add newops test case
Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-08-16 08:30:52 +08:00
Xiubo Li
953d637db4 client: fail the request if the peer MDS doesn't support getvxattr op
Just fail the request instead sending the request out, or the peer
MDS will crash.

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-08-16 08:30:31 +08:00
Xiubo Li
c7a0e71040 mds: add CEPHFS_FEATURE_OP_GETVXATTR feature bit support
For old ceph if they receive unknown OPs, they will crash the MDS
daemons directly. So we need to distiguish whether the new OPs
is supported by the peer MDSs or not.

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-08-16 08:24:51 +08:00
Nizamudeen A
e9d361f621
Merge pull request #47334 from s0nea/wip-osd-objectstore-types-fix
monitoring/ceph-mixin: OSD overview typo fix

Reviewed-by: MrFreezeex <NOT@FOUND>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-08-01 13:47:03 +05:30
Soumya Koduri
99c9a35477
Merge pull request #45602 from soumyakoduri/wip-skoduri-dbstore-obj-versioning
rgw/dbstore: Object versioning feature support

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-08-01 09:35:43 +05:30
Yingxin
7c5d9d305d
Merge pull request #47345 from cyx1231st/wip-seastore-log-improvements
crimson/os/seastore: misc fixes and log improvements

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-08-01 09:15:27 +08:00
Adam King
4f4eedf5af
Merge pull request #47280 from adk3798/remove-error-upgrade-unpause
mgr/cephadm: clear error message when resuming upgrade

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-07-31 14:11:09 -04:00
Adam King
9d11d2ca99
Merge pull request #47318 from adk3798/rescan-parser-name
cephadm: give disk rescan its own parser object

Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
2022-07-31 14:10:31 -04:00
Adam King
715f2f29a8
Merge pull request #47338 from ksperis/master
cephadm: Fix repo_gpgkey should return 2 vars

Reviewed-by: Adam King <adking@redhat.com>
2022-07-31 14:09:01 -04:00
Adam King
ae0ee6536b
Merge pull request #47361 from guits/fix-simple-scan
ceph-volume: fix simple scan

Reviewed-by: Adam King <adking@redhat.com>
2022-07-31 14:07:57 -04:00
Kefu Chai
56ac13ebd5
Merge pull request #47367 from tchaikov/wip-osd-capture-this
osd/PG: capture this explicitly

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-07-30 21:56:02 +08:00
Kefu Chai
f5fc9b869a osd/PG: capture variables explicitly
to silence warning if compiled with -std=c++20:

src/osd/PG.h:571:7: warning: implicit capture of ‘this’ via ‘[=]’ is
deprecated in C++20 [-Wdeprecated]
  571 |       [=](auto &history, auto &stats) {
      |       ^

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-30 19:47:14 +08:00
Ramana Raja
e436d27ff5
Merge pull request #47300 from kotreshhr/fips-md5-issue
mgr/volumes: Fix subvolume creation in FIPS enabled system.

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-30 07:40:41 -04:00
Kefu Chai
68a7a3289a
Merge pull request #47202 from SUSE/wip-fix-56658
cephfs-shell: move source to separate subdirectory

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-30 19:30:01 +08:00
Kefu Chai
bcdbd03ae1
Merge pull request #47246 from liu-chunmei/crimson-test-case
crimson/test: comment out EC test cases and some cases not supported now

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-30 14:44:35 +08:00
chunmei-liu
8f5f02c13b crimson/test: skip EC class SetUp
otherwise crimson will hang

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-29 20:26:33 -07:00
Kotresh HR
5a33f7e6f6 qa: Fix use of 'sudo' args
https://tracker.ceph.com/issues/56727
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-30 05:33:23 +05:30
Adam King
429561ccb7 mgr/cephadm: clear error message when resuming upgrade
the message field in the output of "ceph orch upgrade status"
will first take the value of the error field of the UpgradeState,
and if only if it blank/None, display an info string we periodically
update throughout the upgrade with useful info such as that
we're upgrading a daemon of a particular type or pulling an image
on a certain host. When an upgrade fails, we set the error field
of the UpgradeState, pause the upgrade and raise a health warning.
Sometimes, the user is able to resolve the issue and simply resume
the upgrade. The issue here is, in that case, the error field of
the UpgradeState is still set, so instead of seeing the useful info
messages, it will continue to display an error message that may
no longer be relevant. By emptying the error field of the UpgradeState
when upgrades are resumed, we return to normal behavior of
displaying the info string, and will only show another error message
if another error actually occurs.

Fixes: https://tracker.ceph.com/issues/56714

Signed-off-by: Adam King <adking@redhat.com>
2022-07-29 18:52:11 -04:00
J. Eric Ivancich
1ee0fd839c
Merge pull request #46248 from linuxbox2/wip-rgwlc-tryharder
rgwlc: try hard to get lc locks when saving policy

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2022-07-29 15:12:39 -04:00
Kefu Chai
41475848f5
Merge pull request #47363 from tchaikov/boost-phoenix
mgr/MgrCap: include <boost/phoenix.hpp>

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-07-30 01:33:40 +08:00
Kotresh HR
ced3fac48d mgr/volumes: Fix subvolume creation in FIPS enabled system.
The md5 checksum is used in the construction of legacy
subvolume config filename. It's not used for security reason.
Hence marking the 'usedforsecurity' flag to false to
make it FIPs compliant.

The usage of md5 was always in there. The commit 373a04cf73
made it to get exercised in 'open_subvol' which is pre-requisite
for all the subvolume operations and hence subvolume
creation has failed.

Fixes: https://tracker.ceph.com/issues/56727
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-29 22:07:17 +05:30
Matt Benjamin
ba410b3a36 rgwlc: define RGWLC::thr_name() and use it to name lc lock cookies
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-07-29 12:34:30 -04:00
Kefu Chai
b6cbffe047
Merge pull request #47336 from tchaikov/wip-ceph-dencoder-for-dev
tools/ceph-dencoder: register dencoders in "lib" in dev env

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2022-07-30 00:33:08 +08:00
Matt Benjamin
216b7f7f4c rgwlc: try hard to get lc locks when saving policy
During active lifecycle processing, there can be high contention for
lifecycle shard locks.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-07-29 12:31:07 -04:00
J. Eric Ivancich
2fd96b93b9
Merge pull request #47187 from cfsnyder/wip-cfsnyder-56646
rgw: optimizations for handling ECANCELED errors from within get_obj_state

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-07-29 12:16:22 -04:00
David Galloway
bb49238d7a
Merge pull request #47343 from ceph/ljflores-patch-1
doc/releases: write a note about the "invalid regex" mgr bug
2022-07-29 12:04:13 -04:00
Laura Flores
9da99242fb doc/releases: add release note about "invalid regex" bug in mgr
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-07-29 09:44:34 -05:00
Kefu Chai
03da55716c mgr/MgrCap: include <boost/phoenix.hpp>
instead of include `spirit/include/phoenix.hpp`, include
`<boost/phoenix.hpp>` to silence the warning from boost, like:

/opt/ceph/include/boost/spirit/include/phoenix.hpp:12:1: note: ‘#pragma
message: This header is deprecated. Use <boost/phoenix.hpp> instead.’
   12 | BOOST_HEADER_DEPRECATED("<boost/phoenix.hpp>")
      | ^~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-29 22:37:04 +08:00
Guillaume Abrioux
5a10e3e9e8 ceph-volume: fix simple scan
When the class `Device` is instantiated with a path instead of a
block device, it fails like following.

```
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.6/site-packages/ceph_volume/util/device.py", line 130, in __init__
    self._parse()
  File "/usr/lib/python3.6/site-packages/ceph_volume/util/device.py", line 233, in _parse
    self.ceph_device = disk.has_bluestore_label(self.path)
  File "/usr/lib/python3.6/site-packages/ceph_volume/util/disk.py", line 906, in has_bluestore_label
    with open(device_path, "rb") as fd:
IsADirectoryError: [Errno 21] Is a directory: '/var/lib/ceph/osd/ceph-0/'
```

passing a path instead of a block device is valid, `simple scan` needs it.

Fixes: https://tracker.ceph.com/issues/56969

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-29 16:15:08 +02:00
Daniel Gryniewicz
953eaefb65
Merge pull request #47190 from dang/wip-dang-zipper-filter
RGW - Zipper - Base filter implementation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-07-29 10:01:04 -04:00
zdover23
5515138425
Merge pull request #47347 from anthonyeleven/anthonyeleven/essthree
doc/radosgw: Uppercase s3

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-07-29 19:03:37 +10:00
Yingxin Cheng
a7e569c45e crimson/os/seastore: misc fixes and log adjustments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-29 15:56:32 +08:00
Yingxin Cheng
b422481e3b crimson/os/seastore: unify segment info formatting
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-29 15:56:32 +08:00
Yingxin Cheng
3b9386c75c crimson/os/seastore: collect stats during replay
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-29 15:56:04 +08:00
Laurent Barbe
bf0951353a cephadm: ceph.manual.gpg cleanup
Cleanup file /etc/apt/trusted.gpg.d/ceph.manual.gpg when repo is removed

Signed-off-by: Laurent Barbe <laurent@ksperis.com>
2022-07-29 09:33:36 +02:00
Anthony D'Atri
73f0d5707d doc/radosgw: Uppercase s3
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-07-29 00:11:22 -07:00
Nizamudeen A
1e46a223c1
Merge pull request #47260 from rhcs-dashboard/fix-frontend-monitor-port-fields
mgr/dashboard: add required validation for frontend and monitor port

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-07-29 12:37:01 +05:30
Anthony D'Atri
ac0e45656e
Merge pull request #47284 from anthonyeleven/anthonyeleven/prom-localrules-tweaks
monitoring/ceph-mixin: clean up prometheus_alerts.yml
2022-07-29 00:06:06 -07:00
Yingxin Cheng
cdf9db2398 crimson/os/seastore/async_cleaner: improve log gc status
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-29 14:57:13 +08:00
Yingxin Cheng
dd78132fa1 test/crimson/seastore/transaction_manager_test_state: improve logs
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-29 14:57:13 +08:00
Liu-Chunmei
e55f8fe637
Merge pull request #47328 from liu-chunmei/crimson-cmpext
crimson: for cmp_fail error, return -MAX_ERRNO-index

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-28 20:06:47 -07:00
chunmei-liu
15e4be7cc9 crimson/test: check env variable "CRIMSON_COMPAT"
when "CRIMSON_COMPAT" is set, to skip EC and some test cases.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-28 20:01:14 -07:00
Anthony D'Atri
9b65974468 monitoring/ceph-mixin: clean up prometheus_alerts.yml
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-07-28 19:17:51 -07:00
Yingxin
a73b295d6b
Merge pull request #47291 from cyx1231st/wip-seastore-journal-head
crimson/os/seastore: fixes to trimming

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-07-29 09:31:19 +08:00
Kefu Chai
8a0832701c
Merge pull request #47275 from myoungwon/wip-rbm-cleanup
seastore: RBM clean-ups

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-29 08:10:22 +08:00
chunmei-liu
895188987d crimson: for cmp_fail error, return -MAX_ERRNO-index
instead of cmp_fail error code.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-28 16:59:15 -07:00
Casey Bodley
c5975ce85b
Merge pull request #47308 from mdw-at-linuxbox/wip-master-implanon
rgw: better tenant id from the uri on anonymous access

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-28 17:38:28 -04:00
Guillaume Abrioux
483c7e22e6
Merge pull request #47170 from guits/dep-dev-inventory
ceph-volume: report slave devices in inventory
2022-07-28 22:19:31 +02:00
Guillaume Abrioux
1274ba34b4 ceph-volume/tests: migrate to pyfakefs
ceph-volume unit tests shouldn't actually create contents on the
filesystem from where it runs (even though they are written in a tmp
dir), let's use pyfakefs.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-28 20:14:06 +02:00
Guillaume Abrioux
7ab9d99420 ceph-volume/tests: fix test_path_is_valid()
When ceph-volume tests are run from a host where there's no `/dev/sda`
device, this test fails.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-07-28 20:14:06 +02:00