Commit Graph

137279 Commits

Author SHA1 Message Date
Rishabh Dave
96f4886dc6
Merge pull request #50687 from rishabh-d-dave/fs-qa-kernel-untar-tar
qa/workunit/fs: print commands for making debugging easier

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-30 14:43:49 +05:30
Anthony D'Atri
880b0fcca1
Merge pull request #50764 from zdover23/wip-doc-2023-03-230-start-documenting-ceph-squash-formatting
doc/start: format procedure in documenting-ceph
2023-03-30 00:59:11 -04:00
Patrick Donnelly
3c434884ce
Merge PR #50692 into main
* refs/pull/50692/head:
	tools/cephfs: include lost+found in scan_links

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-29 23:01:33 -04:00
Zac Dover
cb1e20f879 doc/rados/ops: edit health-checks.rst (1 of x)
Edit docs/rados/operations/health-checks.rst (1 of x).

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-30 11:28:33 +10:00
zdover23
8dacbe191b
Merge pull request #50742 from zdover23/wip-doc-2023-03-29-start-documenting-ceph-notify-us
doc/start: update "notify us" section

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-30 11:01:29 +10:00
Zac Dover
6f3cd78f61 doc/start: format procedure in documenting-ceph
Organize three steps in a procedure into one step with three sub-steps.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-30 10:54:52 +10:00
Anthony D'Atri
b6bf70a1cf
Merge pull request #50744 from zdover23/wip-doc-2023-03-29-rados-ops-health-checks
doc/rados: add link to ops/health-checks.rst
2023-03-29 17:53:29 -04:00
Patrick Donnelly
0c4d835148
Merge PR #49773 into main
* refs/pull/49773/head:
	mds: add config to decide whether to mark dentry bad
	qa: add missing scan_links step for data scan recovery
	qa/tasks/cephfs: test damage to dentry's first is caught
	qa/tasks/cephfs: use rank_asok and allow specifying rank
	qa/tasks: allow specifying timeout command prefix to ceph
	mds: provide test configs for creating first corruption
	mds: catch damage to dentry's first field
	mds: add debugging for pre_cow_old_inode
	mds: cleanup code

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2023-03-29 16:15:47 -04:00
Dhairya Parmar
1356992c1c mgr/nfs/utils: add helper func to check cephfs path
this helper instantiates CephfsClient, however this was
initially planned in ExportMgr class in export.py but
due to make check failure where main python thread
experienced a dead lock which after several efforts
pointed at instantiation of CephfsClient in ExportMgr
was problematic, it was decided in order to achieve
singleton behavior, func has been added inside this
helper func that restricts instantiation using functool's
lru_cache.

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2023-03-30 01:00:22 +05:30
zdover23
c3f1eeebbd
Merge pull request #50750 from Sainithin-bit/main
doc/rados/operations: Fix typo in erasure-code.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-30 05:09:15 +10:00
SAINITHIN.ARTHAM
3269fea2a2 doc/rados/operations: Fix typo in erasure-code.rst
Signed-off-by: Sainithin Artham <sai.artham.19cse@bmu.edu.in>
2023-03-30 00:05:43 +05:30
Casey Bodley
963c5a0575
Merge pull request #50633 from cbodley/wip-54102
qa/rgw: unpin centos for verify suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-03-29 14:16:15 -04:00
Patrick Donnelly
7ffa065a03
mds: add config to decide whether to mark dentry bad
So admin can restore access to files if necessary.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:56 -04:00
Patrick Donnelly
1b4d9077af
qa: add missing scan_links step for data scan recovery
Without, the first field remains corrupt (HEAD).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:56 -04:00
Patrick Donnelly
293b90fe63
qa/tasks/cephfs: test damage to dentry's first is caught
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:56 -04:00
Patrick Donnelly
3ba17390e9
qa/tasks/cephfs: use rank_asok and allow specifying rank
This will use the more efficient:

    ceph tell mds.<fsname>:<rank> ...

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:56 -04:00
Patrick Donnelly
dbf1a402c9
qa/tasks: allow specifying timeout command prefix to ceph
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:55 -04:00
Patrick Donnelly
fe258dc54b
mds: provide test configs for creating first corruption
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:55 -04:00
Patrick Donnelly
03407528f9
mds: catch damage to dentry's first field
When possible. Abort the MDS before it can be written to the
journal/directory.

This is part of a series to address corruption first observed in [1].
How the corruption is introduced is yet unknown.

[1] https://tracker.ceph.com/issues/38452#note-10

Fixes: http://tracker.ceph.com/issues/58482
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:55 -04:00
Patrick Donnelly
c9d36056c7
mds: add debugging for pre_cow_old_inode
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:33 -04:00
Patrick Donnelly
17d826551c
mds: cleanup code
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-03-29 13:02:33 -04:00
Laura Flores
6bf9ab46bc
Merge pull request #50553 from ljflores/wip-reef-crontab
qa/crontab: add reef upgrade tests and teuthology/nop
2023-03-29 11:59:21 -05:00
Rishabh Dave
a5a1c24952
Merge pull request #50686 from rishabh-d-dave/fs-qa-client-upgrade
qa/suites/fs: check if cluster is healthy after upgrade

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-29 22:19:35 +05:30
Rishabh Dave
29c1000ca9
Merge pull request #50307 from dparmar18/fix_pendingreleasenotes
PendingReleaseNotes: remove duplicate note and unwanted tracker link

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-03-29 21:42:14 +05:30
Ilya Dryomov
f5598a8c9e
Merge pull request #50735 from yangdongsheng/rbd_quiesce
librbd: fix wrong attribute for rbd_quiesce_complete api

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-03-29 17:19:02 +02:00
Casey Bodley
00f623e289 rgw: set init_check_compat when bucket sync status doesn't exist
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-03-29 10:57:04 -04:00
Rishabh Dave
d8aa577d15 qa/suites/fs: check if cluster is healthy after upgrade
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-03-29 20:17:54 +05:30
Zac Dover
1ddc2b4102 doc/rados: add link to ops/health-checks.rst
Add an internal navigation link to
doc/rados/operations/health-checks.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f2f968f65bd1f1a6975fd340c66703cea335dcf6)
2023-03-30 00:27:19 +10:00
Zac Dover
613ece2477 doc/start: update "notify us" section
Rewrite the "Notify Us" section in doc/start/documenting-ceph.rst so
that it is written in English sentences.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-29 23:47:38 +10:00
zdover23
714978806f
Merge pull request #50723 from zdover23/wip-doc-2023-03-28-documenting-ceph-squashing
doc/start: documenting-ceph - add squash procedure

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-29 22:54:58 +10:00
Rishabh Dave
877f6be743 qa/workunit/fs: print commands for making debugging easier
Print the commands and their arguments as they are being executed for
kernel_untar_tar.sh so that it's easier to debug when a teuthology
failure occurs due to it.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-03-29 18:06:58 +05:30
Dongsheng Yang
51a2b707a3 librbd: fix wrong attribute for rbd_quiesce_complete api
When we use rbd_quiesce_complete api, we got an error:
/usr/bin/ld: undefined reference to `rbd_quiesce_complete'

Then we found the problem is the symbol of rbd_quiesce_complete
in librbd.so is LOCAL. After some investigation, we found
the attribute of rbd_quiesce_complete api is CEPH_RADOS_API
rather than expected CEPH_RBD_API.

Fixes: https://tracker.ceph.com/issues/59208
Signed-off-by: Dongsheng Yang <dongsheng.yang.linux@gmail.com>
2023-03-29 11:49:55 +00:00
Avan
ef6b9ae3c7
Merge pull request #50718 from rhcs-dashboard/use-only-counter-dump-schema
exporter: user only counter dump/schema commands for extacting counters

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-03-29 14:22:51 +05:30
Mohan Sharma
7602a99f7a ceph-volume: fix drive-group issue
The drive-group expects the batch_args to be a string,
however in the current version it is passed as a list
of one element, thus calling the first item of the list solves the issue.

Fixes: https://tracker.ceph.com/issues/59203

Signed-off-by: Mohan Sharma <mohan7427@gmail.com>
2023-03-29 09:48:03 +02:00
Xiubo Li
579510dab5
Merge pull request #48183 from lxbsz/wip-57591
qa: enable kclient test for newop test
2023-03-29 12:44:07 +08:00
Xiubo Li
898316a72c qa: enable kclient test for newop test
The kclient have already fix this. This will only enable the upstream
kclient with the testing branch, the downstream ones may not include
the fixing yet, so skip them for now.

The nautilus will only support the syntax v1. And for kclient there
is not need to do the upgrade.

Fixes: https://tracker.ceph.com/issues/57591
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-29 09:18:18 +08:00
Xiubo Li
be9c8458ff qa: add one func to distiguish the mount syntax version
Fixes: https://tracker.ceph.com/issues/57591
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-29 09:08:20 +08:00
Xiubo Li
ede1afe91c qa: remove the FuseMount/KernelMount check in test_newops.py
Will use the postmerge fragment to check this.

Fixes: https://tracker.ceph.com/issues/57591
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-29 09:07:58 +08:00
Xiubo Li
ef2cdfdefa qa: introduce postmerge for fuse/kclient mounts
Suggested by Patrick and this will check mounter's type.

Fixes: https://tracker.ceph.com/issues/57591
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-29 09:07:58 +08:00
Xiubo Li
e123fcaadc qa: remove the '0-' prefix
Both the nautilus and pacific will be run in parallel.

Fixes: https://tracker.ceph.com/issues/57591
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-03-29 09:07:58 +08:00
Zac Dover
71ee225d7b doc/start: documenting-ceph - add squash procedure
Add a procedure to doc/start/documenting-ceph.rst that explains how to
perform an interactive rebase to squash commits.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-29 09:57:48 +10:00
Avan Thakkar
51a89906df exporter: user only counter dump/schema commands for extacting counters
Fixes: https://tracker.ceph.com/issues/59191
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Ceph exporter no more required the output of perf dump/schema, as the ``counter dump`` command
returns both labeled and unlabeled perf counters which exporter can fetch and export.
Removed the ``exporter_get_labeled_counters`` confiug option as exporter will now export
all the counters, labeled or unlabeled.
Also the fix includes the support for renaming the metrics name of rgw multi-site and
adding labels to it, similar to what is there in prometheus module.
2023-03-28 23:42:09 +05:30
Anthony D'Atri
cec15a5992
Merge pull request #50713 from zdover23/wip-doc-2023-03-28-glossary-cephx
doc/glossary: improve "CephX" entry
2023-03-28 08:28:49 -04:00
Aashish Sharma
9a28ba2a89
Merge pull request #50529 from rhcs-dashboard/dashboard-edit-rgw-multisite
mgr/dashboard: edit realm in rgw-multisite


Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-03-28 17:08:17 +05:30
Pere Diaz Bou
bd0eb20c67 mgr/dashboard: rgw role creation form
Fixes: https://tracker.ceph.com/issues/59187
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-03-28 11:19:10 +02:00
Zac Dover
02e3a5cb76 doc/glossary: improve "CephX" entry
Improve the glossary entry for "CephX".

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-03-28 18:54:07 +10:00
Aashish Sharma
eb56f2680c mgr/dashboard: Add unit test for realm
Fixes: https://tracker.ceph.com/issues/59171
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2023-03-28 12:26:17 +05:30
Yingxin
0793495b9d
Merge pull request #50653 from xxhdx1985126/wip-exist-clean
crimson/os/seastore/cache: consider EXIST_CLEAN extents as pending ones

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-03-28 14:07:43 +08:00
Yingxin Cheng
865285a53c crimson/os/seastore/cache: use CachedExtent::is_mutable() where appropriate
CachedExtent::is_mutable() should only be used to check whether need to
call duplicate_for_write(extent).

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-03-28 09:41:55 +08:00
zdover23
6a4088a9c8
Merge pull request #50697 from zdover23/wip-doc-2023-03-28-glossary-scrubbing
doc/glossary: add "Scrubbing"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-28 10:39:16 +10:00