Commit Graph

134664 Commits

Author SHA1 Message Date
Ilya Dryomov
861f504a88
Merge pull request #48471 from SUSE/wip-fix-57860
ceph.spec.in: disable system_pmdk on s390x for SUSE distros

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-10-18 10:41:01 +02:00
myoungwon oh
72c695780c doc/dev: add explanation of how to use deduplication
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-18 15:46:14 +09:00
myoungwon oh
25f6b0f23a crimson/os/seastore/cbj: remove duplicate configs in cbj_header_t
Also, this commits remove cbj::mkfs_config_t and use device's
information.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-18 11:33:13 +09:00
myoungwon oh
fb3a1bd5d3 crimson/os/seastore/rbm: add stat to get device info. at mkfs time
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-18 11:33:08 +09:00
myoungwon oh
afeaf166a5 crimson/os/seastore/rbm: remove start and start_data_area
remove start and start_data_area in rbm header and
use RBM_START_ADDRESS and journal_size instead.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-18 11:33:01 +09:00
myoungwon oh
18f11466ad crimson/os/seastore/rbm: remove block_size and size in RBMDevice
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-18 11:32:45 +09:00
myoungwon oh
8c692df588 crimson/os/seastore/rbm: use device_config_t in rbm_metadata_header_t
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-18 11:32:38 +09:00
myoungwon oh
5fa8598c5c crimson/os/seastore/rbm: move mkfs to RBMDevice
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-18 11:32:24 +09:00
Ernesto Puerta
f846400652
.github/pr-triage: switch from old to new project
The old (classic) Dashboard project (https://github.com/ceph/ceph/projects/6) has been migrated to a new-style one (https://github.com/orgs/ceph/projects/2/views/1).

This also requires updating the GH Action that automatically assigned `dashboard`-labeled PRs to the Dashboard project.

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
2022-10-17 17:50:41 +02:00
zdover23
73bc835bb1
Merge pull request #48512 from zdover23/wip-doc-2022-10-18-radosgw-notifications-prompts
doc/radowsgw: add prompts to notifications.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-10-18 01:49:32 +10:00
Pedro Gonzalez Gomez
911af4f0e0 mailmap: add Pedro Gonzalez Gomez
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2022-10-17 15:59:36 +02:00
Zac Dover
075ec4cd14 doc/radowsgw: add prompts to notifications.rst
This PR adds unselectable prompts to doc/radosgw/notifications.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-10-17 23:46:39 +10:00
Venky Shankar
9f56295fcf
Merge pull request #48241 from ajarr/fix-57210
src/mds: increment directory inode's change attr by one

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-10-17 17:26:46 +05:30
Zhang Song
41c6456a43 crimson/osd: fix use after free error in FuturizedStoreLogReader::read
Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2022-10-17 14:40:41 +08:00
Kefu Chai
4193b64562
Merge pull request #48425 from phlogistonjohn/jjm-shell-fixups
build: minor build script cleanups

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-10-17 11:44:14 +08:00
zdover23
3c8caf0224
Merge pull request #48501 from zdover23/wip-doc-2022-10-17-radosgw-notifications
doc/radosgw: refine notifications.rst - top part

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2022-10-17 04:14:38 +10:00
Zac Dover
840a2fe3e3 doc/radosgw: refine notifications.rst - top part
This commit refines the English in the first part of the
notifications.rst page (the "Bucket Notifications" page).

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-10-17 04:04:41 +10:00
John Mulligan
cd1cd1bd33 install-deps: switch to C.UTF-8 locale
The en_US.UTF-8 locale is not always going to present on all systems.
Specifically, setting en_US.UTF-8 causes numerous warnings when running
this script on a CentOS Stream 8 container. Rather than install
additional packages to suppress the warning, use the C.UTF-8 locale.

Additionally, try to update the comment explaining the line to something
based on the commit history rather than the confusing term "vulnerable".

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-10-16 11:50:50 -04:00
John Mulligan
b16f3a45c5 script/run-make: convert a tab to spaces
There was a single line using a hard tab to indent, convert the tab
and reformat the spacing of the line near it.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-10-16 11:50:50 -04:00
John Mulligan
8c1281965e install-deps: for consistency, reformat tabs to spaces
The majority of the install-deps.sh file was already using spaces to
indent, convert the remaining hard tabs to 8 spaces.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-10-16 11:50:50 -04:00
John Mulligan
e8b20c0d1f install-deps: remove emacs modeline from script
The majority of the lines in this shell script uses spaces to indent,
but I *think* this modeline tells emacs to indent with tabs. In a very
near future change I'm going to make all indents use spaces. So we first
remove the emacs modeline that tells it to use the opposite.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-10-16 11:50:50 -04:00
Venky Shankar
ddea3af89e
Merge pull request #48086 from vshankar/wip-57084
client: use parent directory POSIX ACLs for snapshot dir

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2022-10-16 20:16:17 +05:30
Liu-Chunmei
694c9b254b
Merge pull request #48497 from liu-chunmei/fix-variable-usage-after-move
crimson/osd: not use a moved variable

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-10-15 23:19:08 -07:00
zdover23
440399171f
Merge pull request #48498 from zdover23/wip-doc-2022-10-16-radosgw-notifications-wording
doc/radosgw: update notifications.rst - grammar

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2022-10-16 13:41:41 +10:00
Zac Dover
43c37c6721 doc/radosgw: update notifications.rst - grammar
This commit rewrites a sentence, as requested by
C. Mitchell here:
https://github.com/ceph/ceph/pull/48493/files#r996003812

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-10-16 13:09:35 +10:00
chunmei-liu
9a7f4e74b3 crimson/osd: not use a moved variable
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-10-15 17:52:36 -07:00
Ramana Raja
f02b77787e cephfs: add additional logging to track change_attr of inodes
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-10-14 19:25:40 -04:00
Ramana Raja
05fdd6c800 src/mds: increment directory inode's change attr by one
... whenever the mtime or ctime of the directory inode is modified.

In CephFS subvolume clones exported using NFS-Ganesha, newly created
files using `touch` were not being listed. It was identified that the
create request sent to the Ceph MDS via NFS-Ganesha's libcephfs client
modified the mtime and ctime of the parent directory, but did not modify
the change_attr of the parent directory. Since the NFS client
didn't see a modification of the change attribute in the reply, it
didn't invalidate its readdir cache. The subsequent directory `ls` was
satisfied from the NFS client's stale readdir cache.

Whenever parent directory inode's  mtime was modified in
MDCache::predirty_journal_parents(), the parent inode's change_attr
was set to its dirstat->change_attr. The parent inode's
dirstat->change_attr doesn't track changes to parent's *ctime only*
changes such as setattr, setvxattr, etc. on the parent
directory. See commit 0d441dcd6a for more
details. This caused the directory inode's change_attr to not be updated
when an operation to change only its ctime was followed by an operation
to change its mtime and ctime.

Fix this by making changes to MDCache::predirty_journal_parents() and
CInode::finish_scatter_gather_update() to increment the directory
inode's change_attr by one instead of setting it to its
dirstat->change_attr.

Fixes: https://tracker.ceph.com/issues/57210
Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-10-14 19:25:40 -04:00
Ramana Raja
d597100ed5 test/libcephfs: enhance directory's change_attr testing
Alternate operations that only change directory's ctime
(setattr/setxattr/removexattr on directory) with those that change
directory's mtime and ctime (create/rename/remove a file within
directory). Check that directory's change_attr is updated everytime
ctime changes.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-10-14 19:25:19 -04:00
Adam King
4367dc6309
Merge pull request #48227 from phlogistonjohn/jjm-cephadm-test-nfsg
cephadm: add test coverage for NFSGanesha, HAproxy, & Keepalived classes

Reviewed-by: Adam King <adking@redhat.com>
2022-10-14 16:10:57 -04:00
zdover23
e3795cb552
Merge pull request #48493 from zdover23/wip-doc-2022-10-15-radosgw-notifications-cleanup
doc/radosgw: improve grammar - notifications.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-10-15 04:02:21 +10:00
Zac Dover
98a4d938e5 doc/radosgw: improve grammar - notifications.rst
This commit makes the changes suggested by C. Mitchell in
https://github.com/ceph/ceph/pull/48486.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-10-15 03:48:44 +10:00
Kefu Chai
3313f1c894
Merge pull request #48422 from aravind-wdc/refactor
crimson/zns: refactor zone operations

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-10-14 20:06:52 +08:00
zdover23
de869edd53
Merge pull request #48486 from zdover23/wip-doc-2022-10-14-radosgw-push_endpoint
doc/radosgw: add push_endpoint for rabbitmq

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2022-10-14 16:49:49 +10:00
Aravind Ramesh
0eb835a53e crimson/zns: refactor zone operation
Moved all zone operations into one routine.

Signed-off-by: Aravind Ramesh <Aravind.Ramesh@wdc.com>
2022-10-14 06:33:59 +00:00
Zac Dover
ddf8295438 doc/radosgw: add push_endpoint for rabbitmq
This commit directs users of rabbitmq to use "push_endpoint"
(with an underscore) instead of "push-endpoint" (with a hy-
phen). This commit adds a note that contains such a direct-
ive. It does not alter the examples already present in the
text.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-10-14 16:17:12 +10:00
Venky Shankar
bfa5da4b2f qa: fs:upgrade featureful_client test upgrades to quincy
Reef cycle will not allow upgrades from octopus. However, the featureful
client tests still needs to be testes, therefore, upgrade to quincy (from
octopus) rather to the current cycle (reef).

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-10-14 11:24:34 +05:30
Samuel Just
84fba09704
Merge pull request #48475 from rzarzynski/wip-crimson-resolve_oid-clone_snaps-fix-search
crimson/osd: resolve_oid() looks in clone_snaps by requested snap ID

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-10-13 13:56:07 -07:00
Samuel Just
a8a5ee47c3
Merge pull request #48405 from athanatos/sjust/wip-57759
crimson: tmap support, list_snaps support, fixes for zero and cmpext

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2022-10-13 13:01:25 -07:00
Avan Thakkar
06077827fe mgr/prometheus: avoid duplicates and deleted entries for rbd_stats_pool
Fixes: https://tracker.ceph.com/issues/57797
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Avoid duplicate entries (pool[/namespace]) for rbd_stats_pools config and also avoid deleted pools.
2022-10-13 22:30:06 +05:30
Radoslaw Zarzynski
2d33a07afa crimson/osd: resolve_oid() looks in clone_snaps by requested snap ID
Before the patch the method was looking for `lower_bound(oid.snap)`
from `SnapSet::clones` which leads to reading from head instead of
returning the `ENOENT` expected in `TestLibRBD.TestIOToSnapshot`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-10-13 11:30:31 +00:00
Yingxin Cheng
9406c1ced6 crimson/net: hide peer_global_id from Connection class
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-10-13 17:51:52 +08:00
Yingxin Cheng
7c932c10a6 crimson/net: replace unnecessary ConnectionRef/AuthConnectionMetaRef
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-10-13 17:38:09 +08:00
Yingxin Cheng
7186dda8f2 crimson/net: drop Connection::get_messenger()
Simplify Connection interface for multi-core support.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-10-13 16:17:00 +08:00
Yingxin Cheng
a6089a49c3 crimson/net: drop require_authorizer feature
There is no need to consider the pre-nautilus scenario.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-10-13 16:11:54 +08:00
Yingxin Cheng
edd6504d87 crimson/net: drop the unused ProtocolV1
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-10-13 16:03:29 +08:00
myoungwon oh
51e6a8a67f crimson/os/seastore/rbm: remove bitmap related layout
Before introduceing new layout for metadatas to store existing btrees
(e.g., backrefs), this commit cleans bitmap related layout up.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-10-13 15:27:21 +09:00
Yongseok Oh
a1a14edd50 doc: describe bal_rank_mask configuration
Signed-off-by: Yongseok Oh <yongseok.oh@linecorp.com>
2022-10-13 05:40:22 +00:00
Tim Serong
6c2fd4267e ceph.spec.in: disable system_pmdk on s390x for SUSE distros
Fixes: https://tracker.ceph.com/issues/57860
Signed-off-by: Tim Serong <tserong@suse.com>
2022-10-13 15:30:19 +11:00
Yongseok Oh
10fb8f1377 qa/cephfs: add bal_rank_mask test cases
Signed-off-by: Yongseok Oh <yongseok.oh@linecorp.com>
2022-10-13 01:39:34 +00:00