Commit Graph

135954 Commits

Author SHA1 Message Date
Venky Shankar
754799097d test: verify that snapshot items are accounted when deciding to split/merge a directory
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-12-22 20:01:36 +05:30
Venky Shankar
47cdb3eff5 mds: account for snapshot items when deciding to split or merge a directory
Its easy to "overload" a directory object with large number of omap entries by
doing the following (one shot or over and over again):

      - touch dir/file{0..11000} ; create 11000 files (> mds_bal_split_size)
      - mkdir dir/.snap/snap_a
      - rm -f dir/file{0..11000}

End result - the directory object would have 11000 omap entries since the MDS
does not fragment directory snapshots. If the number of such entries exceed
`osd_deep_scrub_large_omap_object_key_threshold` (default: 200000), a cluster
health warning is generated:

       Large Omap objects found in pool...

CDir::should_merge() does not take into account COW'd inodes and the frags
get merged.

Fixes: http://tracker.ceph.com/issues/55215
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-12-22 20:01:02 +05:30
Venky Shankar
9eb56d56b3 Merge PR #49098 into main
* refs/pull/49098/head:
	client/fuse: add support for 3.12 API of libfuse
	client/fuse: set max_idle_threads to the correct value

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-12-22 19:45:08 +05:30
dparmar18
b91aff831d qa/test_nfs: added testcase test_non_existent_cluster
Fixes: https://tracker.ceph.com/issues/58138
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-12-22 19:44:17 +05:30
dparmar18
cddaef44ea mgr/nfs: handle bad cluster name during info command
It should say the cluster does not exist

Fixes: https://tracker.ceph.com/issues/58138
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2022-12-22 19:44:17 +05:30
Venky Shankar
c20b57220c Merge PR #49423 into main
* refs/pull/49423/head:
	qa: remove qa/suites/marginal and restart task

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-12-22 19:35:27 +05:30
Ilya Dryomov
a5e69a0eb9
Merge pull request #49534 from idryomov/wip-rbd-qemu-xfstests-patchup
qa: switch back to git protocol for qemu-xfstests

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2022-12-22 12:51:11 +01:00
Daniel Gryniewicz
19d4aebace
Merge pull request #48794 from dang/wip-dang-bucket-policy
RGW - Make sure PostObj set bucket on s->object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
2022-12-21 14:59:16 -05:00
Ilya Dryomov
631899ffeb qa: switch back to git protocol for qemu-xfstests
As noted in commit 89177d65988c ("qa: switch to https protocol for
repos' server"), git.ceph.com mirror doesn't make git:// available
anymore.  However, run_xfstests-obsolete.sh has "obsolete" in its
name for a reason -- due to an ancient execution environment, git://
is the only viable option:

  $ git clone https://git.ceph.com/xfstests-dev.git
  Cloning into 'xfstests-dev'...
  error: gnutls_handshake() failed: A TLS fatal alert has been received. while accessing https://git.ceph.com/xfstests-dev.git/info/refs
  fatal: HTTP request failed

Ditch git.ceph.com mirror for now.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-21 19:27:15 +01:00
Anthony D'Atri
567a58e3f5
Merge pull request #49529 from zdover23/wip-doc-2022-12-21-rados-bluestore-config-ref-prompts
doc/rados: add prompts to bluestore-config-ref.rst
2022-12-21 11:51:45 -05:00
Kefu Chai
8b4db5d51c
Merge pull request #49403 from tchaikov/cmake-boost
cmake: pass cflags using compileflags in BuildBoost.cmake

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-12-21 21:18:04 +08:00
Lucian Petrut
5168ccce49
Merge pull request #49305 from petrutlucian94/dokan_subsys
dokan: use the right logging subsystem
2022-12-21 13:09:55 +02:00
Ilya Dryomov
00332ccbfa
Merge pull request #48929 from petrutlucian94/rbd_py_test
qa: fix test_rbd_wnbd.py

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-12-21 11:42:57 +01:00
Yuval Lifshitz
0d80c3400c rgw: fix signed to unsigned comparisson warning
warning:
rgw_rest_user_policy.cc:159:25: warning: comparison of integer expressions of different signedness:
‘std::map<std::__cxx11::basic_string<char>, std::__cxx11::basic_string<char> >::size_type’ {aka ‘long unsigned int’} and ‘int’

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-12-21 09:27:38 +00:00
Zac Dover
88087f7f66 doc/rados: add prompts to bluestore-config-ref.rst
Add unselectable prompts to
doc/rados/configuration/bluestore-config-ref.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-12-21 17:41:04 +10:00
Anthony D'Atri
bf0d756240
Merge pull request #49497 from BryceCao/wip-fix-mfa.rst-spelling-mistake
doc/radosgw: fix spelling mistake in mfa.rst
2022-12-20 22:28:49 -05:00
cao.leilc
31afe3943e rgw: fix result when user's mfas is null
Fixes: https://tracker.ceph.com/issues/58308
Signed-off-by: caolei <cao.leilc@inspur.com>
2022-12-21 10:59:24 +08:00
cao.leilc
86109954ea doc/radosgw: fix spelling mistake in mfa.rst
Signed-off-by: caolei <cao.leilc@inspur.com>
2022-12-21 10:44:41 +08:00
Casey Bodley
d1089b99f6
Merge pull request #49402 from BryceCao/wip-fix-usage-trim-cant-be-control-by-remove-all
rgw: fix problem that usage is trimmed when the remove-all parameter …

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-12-20 14:32:29 -05:00
Casey Bodley
95aea3f4e2
Merge pull request #49390 from cbodley/wip-qa-rgw-inline
qa/rgw: rgw/verify suite randomizes --placement-inline-data

Reviewed-by: Cory Snyder <csnyder@iland.com>
2022-12-20 14:32:16 -05:00
Casey Bodley
1e605ef982
Merge pull request #49387 from cfsnyder/wip-cfsnyder-58243
rgw: fix dereference of empty std::optional in RGWDeleteMultiObj::execute()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-12-20 14:31:54 -05:00
Casey Bodley
998ee313d4
Merge pull request #49362 from cbodley/wip-58231
rgw/sal: get_notification() takes optional_yield

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-12-20 14:31:37 -05:00
Casey Bodley
1aa2e8ce05
Merge pull request #49324 from BryceCao/wip-add-num-limit-for-user-policies
rgw : add num limit for IAM user policies

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-12-20 14:30:59 -05:00
Casey Bodley
72d7077b26
Merge pull request #49298 from BryceCao/wip-fix-the-inheriting-class-member-is-passed-to-base-ctor
rgw : fix the inheriting class member is passed to base ctor

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-12-20 14:30:20 -05:00
Casey Bodley
abe65c700b
Merge pull request #49194 from joke-lee/list-delimiter-encode
rgw: list with Delimiter should url encode when encoding-type=url

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-12-20 14:29:58 -05:00
Casey Bodley
bba125c34c
Merge pull request #49426 from BryceCao/wip-fix-ListOpenIDConnectProviders-XML-format
rgw: fix ListOpenIDConnectProviders XML format

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-12-20 14:29:36 -05:00
Patrick Donnelly
f1c523ac4d
Merge PR #49016 into main
* refs/pull/49016/head:
	doc/dev: remove release notes for major release branch
	doc: hard-code latest release link
	doc: remove rtd main checkout

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2022-12-20 13:19:17 -05:00
Ramana Raja
377840a746 mgr/rbd_support: remove localized schedule option during module startup
The localized schedule option was removed during every load of a
scheduler handler. This occured multiple times during a mgr process's
lifespan. Instead, remove the localized schedule module option when the
rbd_support module starts up.

Fixes: https://tracker.ceph.com/issues/57726
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-12-20 11:29:02 -05:00
Venky Shankar
824952067f Merge PR #48743 into main
* refs/pull/48743/head:
	mds: do not acquire xlock in xlockdone state

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-12-20 19:52:58 +05:30
Pere Diaz Bou
8e07fbd2ea
Merge pull request #48843 from rhcs-dashboard/expose_slow_ops
mgr/prometheus: expose daemon health metrics

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-12-20 12:25:32 +01:00
Pedro Gonzalez Gomez
c2ae7cb4b8
Merge pull request #47276 from rhcs-dashboard/mirror-pool-health
mgr/dashboard: display real health in rbd mirroring pools


Reviewed-by: Pegonzal <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-12-20 10:49:31 +01:00
Pere Diaz Bou
5a2b7c25b6 mgr/prometheus: expose daemon health metrics
Until now daemon health metrics were stored without being used. One of
the most helpful metrics there is SLOW_OPS with respect to OSDs and MONs
which this commit tries to expose to bring fine grained metrics to find
troublesome OSDs instead of having a lone healthcheck of slow ops in the
whole cluster.

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-12-20 09:44:49 +01:00
Yingxin
b69584cbbc
Merge pull request #49496 from cyx1231st/wip-seastore-fix-denc
crimson/os/seastore: fix denc device_spec_t, device_type_t and segment_type_t

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-12-20 13:27:07 +08:00
Kefu Chai
ead5a9a215
Merge pull request #49509 from rhcs-dashboard/fix-prometheus-module-blank-line
mgr/prometheus: Fix make check flake8 blank line missing

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
2022-12-20 12:03:34 +08:00
colemitchell
a4d5157845
Merge pull request #49514 from zdover23/wip-doc-2022-12-20-glossary-cephx-config-ref-link
doc/glossary: link to CephX Config ref

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-12-19 19:41:17 -05:00
colemitchell
4a31ae3282
Merge pull request #49513 from zdover23/wip-doc-2022-12-20-rados-auth-config-ref-prompts
doc/rados: add prompts to auth-config-ref.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2022-12-19 13:18:59 -05:00
Zac Dover
36a8f27e96 doc/glossary: link to CephX Config ref
Link to the CephX Configuration Reference in the "CephX" entry in the
glossary.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-12-20 04:16:19 +10:00
Zac Dover
208bc2323b doc/rados: add prompts to auth-config-ref.rst
Add unselectable prompts to doc/rados/configuration/auth-config-ref.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-12-20 04:00:59 +10:00
colemitchell
bc971e5e90
Merge pull request #49510 from zdover23/wip-doc-2022-12-20-rados-config-msgr2-prompts
doc/rados: add prompts to msgr2.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2022-12-19 12:50:46 -05:00
Zac Dover
239e7c0e68 doc/rados: add prompts to msgr2.rst
Add unselectable prompts to doc/rados/configuration/msgr2.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-12-20 03:41:22 +10:00
Pedro Gonzalez Gomez
4630da8a93 mgr/prometheus: add blank like previously wrongly deleted that was causing issues on makecheck due to flake8
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2022-12-19 16:16:57 +01:00
Venky Shankar
ab8fbe4e59 Merge PR #48473 into main
* refs/pull/48473/head:
	qa: fix _run_mount_cmd() and _get_mount_cmd() args in vstart_runner

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
2022-12-19 16:17:15 +05:30
Kefu Chai
4ffa58c889
Merge pull request #49490 from tchaikov/wip-pybind-mgr-tox-fixes
pybind/mgr: tox and test fixes

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-12-19 18:14:13 +08:00
Aashish Sharma
1c8cde77a1
Merge pull request #49049 from rhcs-dashboard/add-osd-blocklist-metric
mgr/dashboard: Add metric relative to osd blocklist
2022-12-19 13:37:12 +05:30
Aashish Sharma
1edef5576c
Merge pull request #49292 from rhcs-dashboard/rbd-mirror-improvements
mgr/dashboard: rbd-mirror improvements
2022-12-19 12:19:58 +05:30
Anthony D'Atri
d8986dd252
Merge pull request #49203 from ktdreyer/doc-simple-cephfs-create
doc/cephfs: simplify ceph fs volume create command
2022-12-19 01:46:06 -05:00
Paul Cuzner
166e0fb5d5 orchestrator: update docs for host ls
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2022-12-19 18:24:02 +13:00
Paul Cuzner
b0aaf02446 orchestrator: improve host ls output
This patch provides a --detail 'switch' to orch host ls to
show more host related data for cephadm based clusters.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2022-12-19 18:23:53 +13:00
Yingxin Cheng
181702913f crimson/os/seastore: fix denc device_spec_t, device_type_t and segment_type_t
* device_spec_t should not include denc and be packed at the same time
* the underlying type of enum:uint8_t should support denc_traits already

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: luo rixin <luorixin@huawei.com>
2022-12-19 10:47:46 +08:00
cao.leilc
3cd6f03b58 rgw: fix result when user's topics is null
Fixes: https://tracker.ceph.com/issues/53370
Signed-off-by: caolei <cao.leilc@inspur.com>
2022-12-19 10:31:05 +08:00