Commit Graph

143953 Commits

Author SHA1 Message Date
Anthony D'Atri
6246da8ed5
Merge pull request #56010 from zdover23/wip-doc-2024-03-07-start-get-involved
doc/start: add Slack invite link
2024-03-07 10:31:55 -05:00
Casey Bodley
1b1c162bd7
Merge pull request #55390 from qiuxinyidian/rgw-admin
rgw: add help info for radosgw-admin list object in bucket

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2024-03-07 15:12:07 +00:00
Matan Breizman
3a6d793ef3
Merge pull request #56027 from Matan-B/wip-matanb-crimson-docs-walkthrough
doc/dev/crimson: add Code Walkthroughs

Reviewed-by: Rongqi Sun <sunrongqi@huawei.com>
Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2024-03-07 15:29:29 +02:00
Pedro Gonzalez Gomez
77fa1c365a
Merge pull request #55226 from rhcs-dashboard/fix-64080-main
mgr/dashboard: Allow the user to add the access/secret key on zone edit and not on zone creation


Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-03-07 14:06:38 +01:00
Kotresh HR
d16480c364 tools/cephfs: Fix first-damage to include missing dirs
Don't skip root and lost+found directories while
checking for damaged metadata.

Fixes: https://tracker.ceph.com/issues/64615
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2024-03-07 17:18:05 +05:30
Yuval Lifshitz
1c13850f24 rgw/kafka: set message timeout to 5 seconds
also increase the idle timeout to 30 seconds.
test instructions:
https://gist.github.com/yuvalif/33487bff19883e3409caa8a843a0b353

Fixes: https://tracker.ceph.com/issues/64710

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2024-03-07 10:46:34 +00:00
Yingxin Cheng
05c916ba46 crimson/os/cache: cleanup get_extent(_by_type)
Distinguish caching vs absent get_extent interfaces, and misc related
cleanups.

After the lba parent-child pointer optimization, the absent path should
be used.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 17:18:48 +08:00
Yingxin Cheng
785634262b crimson/os/seastore: remove unecessary public interfaces
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 17:18:42 +08:00
Matan Breizman
13a771931b doc/dev/crimson: add Code Walkthroughs
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-03-07 09:15:49 +00:00
Xuehan Xu
e8b9ab73f4 crimson/os/seastore/collection_manager: allow empty-delta-buffer
collection nodes

Fixes: https://tracker.ceph.com/issues/64728
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-03-07 17:03:30 +08:00
Nizamudeen A
09c50063a3 mgr/dashboard: disable applitools e2e
Temporarily disabling this so the CI could turn green. Meanwhile I'll
research for a proper way to handle the applitools e2es which I'll track
on https://tracker.ceph.com/issues/64783

Signed-off-by: Nizamudeen A <nia@redhat.com>
2024-03-07 14:13:54 +05:30
Yingxin Cheng
0558ef8b1a crimson/os/seastore/cache: drop the unnecessary friend fixed_kv_btree
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 13:44:15 +08:00
Nizamudeen A
57106cefdf
Merge pull request #55804 from rhcs-dashboard/nvmf-traddr-fix
mgr/dashboard: listener addr is always none

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2024-03-07 10:57:17 +05:30
zdover23
d0fcaf0ced
Merge pull request #55995 from zdover23/wip-doc-2024-03-06-architecture
doc/architecture: correct typo

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-03-07 13:17:53 +10:00
Zac Dover
dee319e612 doc/start: add Slack invite link
Add a link to the ceph-storage Slack invitation page. Previously the
link went to a plain old "this is the ceph-storage Slack" page that did
not direct the reader to sign up.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-03-07 13:01:47 +10:00
Xuehan Xu
6ec3fd9c62 test/cls_rbd/test_cls_rbd: change to check for 4KB-aligned sparse read
SeaStore::fiemap() can only supported 4096-aligned sparse read.

Co-authored-by: Ilya Dryomov <idryomov@gmail.com>
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-03-07 09:53:50 +08:00
J. Eric Ivancich
ac30ee6cd9
Merge pull request #55967 from mkogan1/wip-rgw-ssl-ses-id-reuse
rgw/beast: Enable SSL session-id reuse speedup mechanism

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 20:53:13 -05:00
J. Eric Ivancich
d79a95de28
Merge pull request #55895 from linuxbox2/wip-sigv4-boundary
rgw_sigv4: handle '0;' as trailer-chunk boundary

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 20:52:59 -05:00
J. Eric Ivancich
185de7c13d
Merge pull request #55885 from ivancich/wip-enhance-restore-bi
rgw: make rgw-restore-bucket-index more robust

Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
2024-03-06 20:52:31 -05:00
Yingxin
241d2c5297
Merge pull request #55977 from myoungwon/wip-allow-dirty-remap
crimson/os/seastore: allow to remap the dirty extent

Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-03-07 09:39:02 +08:00
Venky Shankar
0f82aa5a6b Merge PR #55909 into main
* refs/pull/55909/head:
	qa/cephfs: add `MON_DOWN' and `deprecated feature inline_data' to ignorelist

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-03-07 07:06:39 +05:30
Venky Shankar
0b992b7fd1 Merge PR #55908 into main
* refs/pull/55908/head:
	qa: ignore container checkpoint/restore related selinux denials for centos9
	qa: use allowlist instead of whitelist for selinux denials

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-03-07 07:05:20 +05:30
Venky Shankar
e587dcd970 Merge PR #55639 into main
* refs/pull/55639/head:
	mds: relax certain asserts in mdlog replay thread

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2024-03-07 07:03:51 +05:30
Casey Bodley
4ac0b7df3c qa/rgw: teach rgw.py to create an optional realm
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 18:00:11 -05:00
Bernard Landon
a9662eee86 mgr/cephadm/services/ingress make HAProxy to listen on IPv4 and IPv6 by default
By default, HAProxy will only bind to IPv4 addresses preventing the ingress
service to be used in dual stack or mixed IPv4/IPv6 environments.
This patch changes the default so HAProxy would bind both on IPv4 and IPv6 addresses.

Signed-off-by: Bernard Landon <bernard@lndn.ch>
2024-03-06 22:44:27 +01:00
Casey Bodley
28d56124e9
Merge pull request #56000 from cbodley/wip-64678
rpm: disable system_qat for non-x86_64 arch

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-03-06 21:07:11 +00:00
Leonid Usov
8b896a9e14 mds/quiesce-db: keep the db thread alive until shutdown
With the change we can now avoid having to join it during the membership update, preventing potential deadlocks

Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
2024-03-06 18:07:19 +02:00
Daniel Gryniewicz
2d4a3ca5c9 RGW - Swift retarget needs bucket set on object
When a bucket list is retargeted to an object get, then the object may
not yet have it's bucket set.  Ensure the bucket is set on the object.

Fixes: https://tracker.ceph.com/issues/56029
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2024-03-06 19:41:23 +04:00
Casey Bodley
25ce4845f5 rpm: disable system_qat for non-x86_64 arch
Fixes: https://tracker.ceph.com/issues/64678

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-03-06 09:25:23 -05:00
Patrick Donnelly
ea9a5688d9
Merge PR #55820 into main
* refs/pull/55820/head:
	qa/crontab: bring back nightlies of release branches
	qa/crontab: update upgrade runs for squid/main
	qa/crontab: update reef upgrade tests
	qa/crontab: update quincy upgrade tests
	qa/crontab: remove EOL branches
	qa/crontab: add spacing
	qa/crontab: update smoke tests for releases

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2024-03-06 08:58:43 -05:00
Adam King
576cf45b75
Merge pull request #55955 from guits/node-proxy-fixes-7.1-blockers-1
mgr/node-proxy: handle 'None' statuses returned by RedFish

Reviewed-by: Adam King <adking@redhat.com>
2024-03-06 08:37:45 -05:00
Matan Breizman
602578935b
Merge pull request #55536 from Matan-B/wip-crimson-snapmapper-get_next
osd/SnapMapper: Crimson - fix OSDriver::get_next

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
2024-03-06 15:19:40 +02:00
Zhipeng Li
e0a25e59d0 rgw: add help info for radosgw-admin list object in bucket
Fixes:https://tracker.ceph.com/issues/64264

Signed-off-by: Zhipeng Li <qiuxinyidian@gmail.com>
2024-03-06 21:06:51 +08:00
Zac Dover
ae08855cf8 doc/architecture: correct typo
s/client/clients/ where necessary, and add a link to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-03-06 21:40:10 +10:00
Jos Collin
59dbbb218c
cephfs_mirror, qa: fix typo in current_syncing_snap status
Signed-off-by: Jos Collin <jcollin@redhat.com>
2024-03-06 16:33:45 +05:30
Anthony D'Atri
1c7f8b2488
Merge pull request #55982 from zdover23/wip-doc-2024-03-06-dev-developer-guide-testing-integration-tests-workflow
doc/dev: edit teuthology workflow
2024-03-06 05:51:46 -05:00
Venky Shankar
f5a23d5811 qa/cephfs: add MON_DOWN' and deprecated feature inline_data' to ignorelist
Fixes: http://tracker.ceph.com/issues/64746
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-03-06 15:19:08 +05:30
Venky Shankar
7a6389272a qa: ignore container checkpoint/restore related selinux denials for centos9
Fixes: http://tracker.ceph.com/issues/64616
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-03-06 14:58:32 +05:30
Venky Shankar
71c9fe55d6 qa: use allowlist instead of whitelist for selinux denials
https://github.com/ceph/teuthology/pull/1757 introduced this change,
however, qa/distros continued to use `whitelist' keyword.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2024-03-06 14:58:31 +05:30
Guillaume Abrioux
cc279a3dd2 mgr/node-proxy: handle 'None' statuses returned by RedFish
Looks like RedFish might return 'None' values for some attributes.

for instance:

```
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/AHCI.SL.6-1/Drives/Disk.Direct.0-0:AHCI.SL.6-1 -H "X-Auth-Token: 3264251c28191fa5e7c9ebec49ef90fc"  | jq .Status
{
  "Health": "OK",
  "HealthRollup": "OK",
  "State": "Enabled"
}
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/NonRAID.Slot.2-1/Drives/Disk.Bay.0:Enclosure.Internal.0-1:NonRAID.Slot.2-1 -H "X-Auth-Token: 3264251c28191fa5e7c9ebec49ef90fc" | jq .Status
{
  "Health": null,
  "HealthRollup": null,
  "State": "Enabled"
}
[root@ceph-node-01 ~]#
```

Although this seems to be a bug from RedFish, we need to handle
the case when it happens otherwise it makes the mgr orchestrator module
throw an error.

The idea here is to create a new status "unknown" when we can't fetch the
real status of a component.

Fixes: https://tracker.ceph.com/issues/64712

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
2024-03-06 09:09:34 +00:00
Matan Breizman
b420380bda
Merge pull request #52267 from xxhdx1985126/wip-crimson-pg-snapmapper-obj
crimson/osd: put snapmapper's key-value pairs into dedicated objs

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-03-06 11:00:59 +02:00
Matan Breizman
f2af81369d
Merge pull request #55910 from zhscn/fix-int-string
osd/SnapManager: Crimson - fix std::string constructed from 0

Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2024-03-06 10:56:13 +02:00
Matan Breizman
e025295f27
Merge pull request #55801 from xxhdx1985126/wip-counting-semaphore
crimson/os/alienstore: use homebrew counting_semaphore

Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kefu.chai@scylladb.com>
2024-03-06 10:54:49 +02:00
Venky Shankar
6dc5a60109 Merge PR #54202 into main
* refs/pull/54202/head:
	mds: fix `dump dir` indicate dir is not cached

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-03-06 14:14:22 +05:30
Venky Shankar
9fd7ad53cd Merge PR #55457 into main
* refs/pull/55457/head:
	client: check for bad file handle in low level I/O APIs
	client: check for bad file handle in ll_preadv_pwritev
	client: add function to check if file handle exists
	src/test: test async I/O with invalid/closed file handle

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-03-06 14:11:12 +05:30
Venky Shankar
55ac8d6d0b Merge PR #55619 into main
* refs/pull/55619/head:
	client: fix leak of file handles

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2024-03-06 14:09:23 +05:30
Aashish Sharma
d96a1805f3 mgr/dashboard: Allow the user to add the access/secret key on zone edit
and not on zone creation

Fixes: https://tracker.ceph.com/issues/64080

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2024-03-06 13:49:08 +05:30
Shinya Hayashi
32cbe079c6 systemd: add systemd unit file for ceph-exporter
Signed-off-by: Shinya Hayashi <shinya-hayashi@cybozu.co.jp>
2024-03-06 07:24:15 +00:00
Zac Dover
51796e80f3 doc/dev: edit teuthology workflow
Improve a couple of sentences in
doc/dev/developer_guide_testing_integration_tests/tests-integration-testing-teutology-workflow.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-03-06 17:15:20 +10:00
Nizamudeen A
ea0bdc2b1e
Merge pull request #55954 from ivoalmeida/fix-cephfs-attach-command
mgr/dashboard: fixed cephfs mount command

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2024-03-06 12:11:30 +05:30