Commit Graph

139234 Commits

Author SHA1 Message Date
Venky Shankar
bdde984397 Merge PR #52176 into main
* refs/pull/52176/head:
	mds: remove calculating caps after adding revokes back

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-27 16:37:55 +05:30
Venky Shankar
d3f9d14022 Merge PR #51536 into main
* refs/pull/51536/head:
	mds: do not send split_realms for CEPH_SNAP_OP_UPDATE msg

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2023-07-27 13:38:54 +05:30
Venky Shankar
edd0eb1592 Merge PR #52275 into main
* refs/pull/52275/head:
	mds: update mdlog perf counters during replay

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-27 13:37:29 +05:30
Aashish Sharma
6a21d60123 mgr/dashboard: Add inventory card and two single stat panels to rgw
overview dashboard

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2023-07-27 11:31:43 +05:30
Ilya Dryomov
a0d126376c
Merge pull request #52624 from idryomov/wip-61565
qa/workunits/rbd: use jammy version of qemu-iotests for centos 9

Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-07-26 18:23:29 +02:00
Nizamudeen A
0033dcb2dd
Merge pull request #52546 from rhcs-dashboard/node-16-main
deps: increase the node version to 16

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2023-07-26 19:32:24 +05:30
Casey Bodley
47e8b1e518
Merge pull request #49810 from baergj/fix-create_time_event-header
async: Fix units in the create_time_event() declaration.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-07-26 08:24:55 -04:00
Aashish Sharma
d88b456512
Merge pull request #52644 from rhcs-dashboard/fix-62124-main
mgr/dashboard: add validations to zone access/secret key in zone creation/edit form


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-07-26 17:16:10 +05:30
mengxiangrui
e0bb8313fd rgw: fix the Content-Length in response header is inconsistent with response body size when rgw returns default html error page in static website
The default html error page as response body should be built completely include three ending html symbols(/ul, /body and /html) before rgw computes Content-Length in response header. The Content-Length in response header will be consistent with response body size. Client can get complete page.

Fixes: https://tracker.ceph.com/issues/52363

(cherry picked from commit cbeaef9fbe)

Co-authored-by: aicun hu <huaicun@chinatelecom.cn>
Co-authored-by: yupeng chen <chenyupeng@chinatelecom.cn>
Signed-off-by: xiangrui meng <mengxr@chinatelecom.cn>
2023-07-26 11:41:09 +00:00
Aashish Sharma
2d12a7cfd2
Merge pull request #52570 from rhcs-dashboard/fix-62110-main
mgr/dashboard: fix removal of non-master zone from the zone group via dashboard


Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-07-26 17:08:41 +05:30
Venky Shankar
2496406038 Merge PR #52600 into main
* refs/pull/52600/head:
	qa: fix cephfs-mirror unwinding and 'fs volume create/rm' order

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-26 16:01:05 +05:30
Aashish Sharma
f85d83125d mgr/dashboard: add validations to zone access/secret key in zone creation/edit form
Fixes: https://tracker.ceph.com/issues/62124

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2023-07-26 11:30:32 +05:30
Jos Collin
b9a1a3cdf9
qa: fix cephfs-mirror unwinding and 'fs volume create/rm' order
* Fixes the 'fs volume create' happens before the cephfs-mirror daemon start.
* Fixes the 'fs volume rm' happen only after the cephfs-mirror daemon unwinding.
  - This prevents the issue of mirror-daemon not returning from a libcephfs call, as
    the volumes were deleted during the cephfs_mirror_thrash ing.

Fixes: https://tracker.ceph.com/issues/61182
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-07-26 10:00:41 +05:30
zdover23
38dea7dc21
Merge pull request #52630 from zdover23/wip-doc-2023-07-25-readmemd-1-of-x
doc: update README.md

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-07-26 09:07:40 +10:00
Yuval Lifshitz
f82b9942d6
Merge pull request #52596 from yuvalif/wip-yuval-fix-61868-new
rgw/lua: allow passing tenant without uid to manage lua scripts
2023-07-25 21:59:23 +03:00
Joshua Baergen
100a176d3a async: Fix units in the create_time_event() declaration.
Commit 19a9d9531f changed the definition
to microseconds but neglected to update the header.

Signed-off-by: Joshua Baergen <jbaergen@digitalocean.com>
2023-07-25 10:37:18 -06:00
Matan Breizman
86b36a132d
Merge pull request #52592 from xxhdx1985126/wip-62098
crimson/net: set TCP_NODELAY according to ms_tcp_nodelay

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kefu.chai@scylladb.com>
2023-07-25 17:53:22 +03:00
Zac Dover
ad1202be68 doc: update README.md
Correct and improve ceph/README.md.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-25 23:15:09 +10:00
Redouane Kachach
519da2499a using json file to get alertmanager/prometheus credentials
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-07-25 09:01:56 -04:00
Redouane Kachach
7cfa21dd49 mgr/cephadm: storing prometheus/alertmanager credentials in monstore
Fixes: https://tracker.ceph.com/issues/61628

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-07-25 09:01:50 -04:00
Adam King
19b6eafb9f
Merge pull request #50423 from rkachach/fix_issue_nmveof
mgr/cephadm: adding support for nvmeof

Reviewed-by: Adam King <adking@redhat.com>
2023-07-25 08:56:31 -04:00
Adam Kupczyk
6217a62438
Merge pull request #51933 from aclamk/wip-aclamk-bs-onode-doc
os/bluestore: Some in-code documentation for Onode / blob
2023-07-25 14:06:02 +02:00
Nizamudeen A
7f2659615c
Merge pull request #52218 from YiteGu/cephfs-get-statfs
mgr/dashboard: CephFS statfs REST API

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-07-25 17:30:11 +05:30
Ilya Dryomov
d49df8d74c qa/workunits/rbd: use jammy version of qemu-iotests for centos 9
It's the one we are using for all recent distros.

While at it, get rid of custom bin directory -- it appears that both
v2.3.0 and v2.11.0 tests are happy with just symlinks in the current
directory.

Fixes: https://tracker.ceph.com/issues/61565
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-07-25 14:00:04 +02:00
Venky Shankar
6eb1276ce1 Merge PR #52523 into main
* refs/pull/52523/head:
	mds: remove dead method

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-07-25 16:23:23 +05:30
Guillaume Abrioux
8392e7dff7
Merge pull request #52429 from guits/fix-raw-list
ceph-volume: fix raw list for lvm devices
2023-07-25 10:22:26 +02:00
Venky Shankar
cb485d6f04 Merge PR #52597 into main
* refs/pull/52597/head:
	qa: use centos 8.stream for fs:upgrade tests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-07-25 12:53:45 +05:30
Matan Breizman
45c6c5474d
Merge pull request #52599 from Matan-B/wip-matanb-crimson-cbt-fix
qa: Fix cbt usage with Crimson

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-25 09:58:58 +03:00
Matan Breizman
f3b4c1deb8
Merge pull request #52598 from Matan-B/wip-matanb-crimson-centos-8
qa/suites/crimson-rados: Use centos8 for testing

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-07-25 09:57:01 +03:00
Venky Shankar
b5756b98f9 qa: use centos 8.stream for fs:upgrade tests
fs:upgrade tests use n/o/p release packages which aren't
available for centos 9.stream - switch using 8.stream instead.

Fixes: http://tracker.ceph.com/issues/62146
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-07-25 09:49:16 +05:30
Venky Shankar
e99c17f271 Merge PR #48038 into main
* refs/pull/48038/head:
	client test: Add fsync to ll_preadv_pwritev test
	libcephfs: Option to write + fsync via ceph_ll_nonblocking_readv_writev
	Client: Hook nonblocking fsync into the write path of ll_preadv_pwritev
	Client: Add non-blocking fsync
	Client/Inode: wait_for_caps fixups
	Client: change several waitfor_* to use Context list
	test: Add nonblocking I/O client test
	libcephfs: Add nonblocking readv/writev I/O interface
	Client: Add ll_preadv_pwritev to expose non-blocking I/O to libcephfs
	Client: Add non-blocking helper classes
	Client: Break some code into new methods in prep for non-blocking I/O
	Buffers: Add function to buffer.h to copy bufferlist to an iovec
	ObjectCacher: Prepare file_write path for non-blocking I/O

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2023-07-25 09:34:36 +05:30
Ilya Dryomov
f3a659f33d
Merge pull request #52607 from zap51/patch-1
doc/rbd/rbd-cloudstack.rst: include support for multiple monitors

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-07-25 04:49:40 +02:00
Anthony D'Atri
591e698803
Merge pull request #49889 from bluikko/bluikko-doc-srv-lookup-link
doc/rados/configuration: add links to MON DNS
2023-07-24 18:39:53 -04:00
Jayanth Reddy
5bce61ecf3 doc/rbd/rbd-cloudstack.rst: include support for multiple monitors
Signed-off-by: Jayanth Reddy <45934027+zap51@users.noreply.github.com>
2023-07-24 23:02:53 +02:00
Frank S. Filz
13162f6ecc client test: Add fsync to ll_preadv_pwritev test
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:05 -07:00
Frank S. Filz
201a355f36 libcephfs: Option to write + fsync via ceph_ll_nonblocking_readv_writev
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:05 -07:00
Frank S. Filz
6809ff8c12 Client: Hook nonblocking fsync into the write path of ll_preadv_pwritev
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:04 -07:00
Frank S. Filz
a181c1a0db Client: Add non-blocking fsync
We will need the ability to do an non-blocking write that finishes with
fsync so we need non-blocking fsync.

Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:04 -07:00
Frank S. Filz
a8d0158d0d Client/Inode: wait_for_caps fixups
The non-blocking flush requires us to be able to re-add to
wait_for_caps but if we simply add to the list, we get stuck in an
infinite loop. Add a wait_for_caps_pending list to add to, and then
when done signalling, we move the wait_for_caps_pending items onto the
wait_for_caps list.

Also in handle_cap_flush_ack(), we need to complete the caps flushing
before signalling since with non-blocking flush, we will be actually
examining the caps from the completion rather than signalling a
condition variable in the completion.

Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:04 -07:00
Frank S. Filz
bff94987bb Client: change several waitfor_* to use Context list
Change waitfor_caps, waitfor_safe and waitfor_commit to Context list.

To make a non-blocking version of fsync (to be used for non-blocking write
and commit), we need to be able to signal an arbitrary Context on completion
of either of these lists.

add_nonblocking_onfinish_to_context_list Adds such a Context to the list.

Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:04 -07:00
Frank S. Filz
6b50da636d test: Add nonblocking I/O client test
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:04 -07:00
Frank S. Filz
b4e39f3ecc libcephfs: Add nonblocking readv/writev I/O interface
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
94b55cbb99 Client: Add ll_preadv_pwritev to expose non-blocking I/O to libcephfs
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
1210ddf7a1 Client: Add non-blocking helper classes
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
162935c036 Client: Break some code into new methods in prep for non-blocking I/O
These bits of code need to be invoked from a separate spot when we
introduce non-blocking I/O, so break them out now.

Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
d3c3bf5b77 Buffers: Add function to buffer.h to copy bufferlist to an iovec
Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:03 -07:00
Frank S. Filz
bf98aec6d3 ObjectCacher: Prepare file_write path for non-blocking I/O
For non-blocking I/O, we will want to be able to override
block_writes_upfront so rename the member cfg_block_writes_upfront and add
an option to pass block_writes_upfront as a parameter along with a member
access method so caller can pass cfg_block_writes_upfront.

Signed-off-by: Frank S. Filz <ffilzlnx@mindspring.com>
2023-07-24 11:49:02 -07:00
Casey Bodley
3f09d56bed
Merge pull request #52521 from cbodley/wip-62059
valgrind: update suppression for SyscallParam under call_init

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2023-07-24 14:06:01 -04:00
Neha Ojha
7cb0e36fc4
Merge pull request #52601 from idryomov/wip-doc-redundant-tiering-note
doc/rados: remove redundant cache tiering deprecation note

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-07-24 10:06:23 -07:00
Vedansh Bhartia
51e076cecb rgw: typecast long long to int when passing length to format string
Signed-off-by: Vedansh Bhartia <vedanshbhartia@gmail.com>
2023-07-24 22:36:00 +05:30