Commit Graph

139381 Commits

Author SHA1 Message Date
Zac Dover
4e790603d9 doc/rados: edit operations/add-or-rm-mons (2 of x)
Edit the second part of doc/rados/operations/add-or-rm-mons.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-05 14:46:45 +10:00
Anthony D'Atri
5888359a0b
Merge pull request #52802 from dvanders/support_the_foundation
doc: Add a Ceph Foundation footer to docs.ceph.com
2023-08-04 16:59:41 -04:00
Anthony D'Atri
2fabdc82d1
Merge pull request #52814 from cbodley/wip-doc-rgw-zonegroup-feature-default
doc/rgw: correct statement about default zone features
2023-08-04 16:52:39 -04:00
Nizamudeen A
911c87c8e8
Merge pull request #52787 from rhcs-dashboard/fix-rgw-average-object-size
mgr/dashboard: fix average object size calculation in rgw overview dashboard

Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-04 23:21:17 +05:30
Nizamudeen A
7dcb06d368 mgr/dashboard: update the upgrade layout by introducing new items
Shows Cluster Health
Shows the count of mgr daemons
Shows a table with all the daemon versions
Display the cluster logs

Fixes: https://tracker.ceph.com/issues/62016
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-04 23:05:28 +05:30
Casey Bodley
bb5ad067ed doc/rgw: correct statement about default zone features
this sentence wasn't updated when we added the Default column to the
table below

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-04 13:00:59 -04:00
Ali Maredia
863f8d789d qa: pin rgw/crypt suite temporarily to ubuntu_latest
barbican tests are only passing on ubunutu latest,
this commit allows us to have a green crypt suite.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-08-04 12:52:07 -04:00
Ali Maredia
43069394c5 qa: change admin_host to admin_url in barbican.py
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-08-04 12:51:48 -04:00
Ali Maredia
fc12be0fcf qa: bump keystone version in barbican.yaml
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-08-04 12:51:48 -04:00
Casey Bodley
fb13353bf7
Merge pull request #52248 from cbodley/wip-46062
rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-08-04 08:55:52 -04:00
Aashish Sharma
eae1c0e505 mgr/dashboard: fix average object size calculation in rgw overview
dashboard

Fixes: https://tracker.ceph.com/issues/62318

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2023-08-04 13:15:53 +05:30
Casey Bodley
800e716530
Merge pull request #52274 from cbodley/wip-61862
qa/rgw: specify cluster name in 'radosgw-admin gc process'

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-08-03 21:00:46 -04:00
zdover23
32f728abca
Merge pull request #52800 from cbodley/wip-62312
doc/rgw: several response headers are supported

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-08-04 09:38:37 +10:00
Dan van der Ster
ac259500cf doc: Add a Ceph Foundation footer to docs.ceph.com
Add an info box to the footer of every docs page inviting visitors
to support the Ceph Foundation.

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
2023-08-03 16:28:42 -07:00
Casey Bodley
ab6ec66a2f doc/rgw: several response headers are supported
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 17:31:31 -04:00
Casey Bodley
61cf6eec7b ReleaseNotes: document recovery of encrypted multipart objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 17:21:03 -04:00
Casey Bodley
e90bfba99c radosgw-admin: add command to resync encrypted multipart objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 16:56:49 -04:00
Casey Bodley
237fa27710 rgw: RGWRados::set_attrs() takes optional mtime
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 16:56:49 -04:00
Casey Bodley
07d28bac15 rgw: expose part id in RGWObjManifest iterator
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 16:56:49 -04:00
Casey Bodley
43ad8a4ccd
Merge pull request #51786 from cbodley/wip-61473
rgw/crypt: apply rgw_crypt_default_encryption_key by default

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-08-03 16:24:45 -04:00
Leonid Usov
7d09154ce8 mon/MDSMonitor: print a note when adding data pool to a file system that doesn't have 'bulk' flag set
The note will only be printed if the pool has pg_autoscale_mode set to ON and the bulk flag is missing

Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
2023-08-03 19:47:31 +03:00
Leonid Usov
9a8219cc2b mgr/volumes: set the 'bulk' flag for data pools created automatically for a new volume
Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
Fixes: https://tracker.ceph.com/issues/61595
2023-08-03 19:41:12 +03:00
Nizamudeen A
0243a955b8 mgr/dashboard: make the logs component configurable and reusable
This will make the logs component easier to reuse for now in upgrade
component and later, wherever we want

Fixes: https://tracker.ceph.com/issues/62016
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-03 21:55:09 +05:30
Casey Bodley
c08eb228b1
Merge pull request #52447 from liumiaomiaoIntel/qatzip_update
common/compressor: update the interfaces and data structures

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 11:11:02 -04:00
Ali Masarwa
c62a170718
Merge pull request #52634 from AliMasarweh/wip-alimasa-persistant-q-enhance
RGW: control the persistency of the notification
2023-08-03 17:28:18 +03:00
Nizamudeen A
917c3fe2ad
Merge pull request #52405 from rhcs-dashboard/rgw-overview-dashboard-graphs
mgr/dashboard: add graphs to rgw overview dashboard

Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-03 19:17:30 +05:30
Xiubo Li
15dafc3244 mds: remove unused C_MDC_OpenSnapRealms
This was just left and forgot to be removed.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2023-08-03 21:07:08 +08:00
Casey Bodley
b6383e9e0b
Merge pull request #52711 from cbodley/wip-62250
rgw: retry metadata cache notifications with INVALIDATE_OBJ

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2023-08-03 09:04:05 -04:00
Casey Bodley
902d07499d rgw: preserve RGW_ATTR_CRYPT_PARTS of already-replicated objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 09:01:11 -04:00
Casey Bodley
e7d98fb369 rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt
because multisite replicates multipart objects as a single part, we lose
information about the part sizes from the original manifest that is
necessary to correctly decrypt across those part boundaries

on replication, parse the part lengths out of the source object's
manifest, and store them in a separate RGW_ATTR_CRYPT_PARTS for use on
decryption

Fixes: https://tracker.ceph.com/issues/46062

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 09:01:11 -04:00
Casey Bodley
d8a82f5aaa rgw: BlockDecrypt filter parses manifest parts before construction
users now call a static read_manifest_parts() function, and pass the
resulting vector into the BlockDecrypt constructor

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 09:01:01 -04:00
Nizamudeen A
f363c6db4a
Merge pull request #52657 from rhcs-dashboard/fs-subvolumes
mgr/dashboard: cephfs subvolume list

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-08-03 18:12:18 +05:30
Nizamudeen A
43114f9eb2 mgr/dashboard: cephfs subvolume list
Fixes: https://tracker.ceph.com/issues/62182
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-03 14:54:33 +05:30
Matan Breizman
757193a4e1 qa/suites/crimson-rados: use crimson-supported-all-distro
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-08-03 08:06:45 +00:00
Matan Breizman
3b591f33ea qa/distros: add crimson-supported-all-distro
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-08-03 08:05:41 +00:00
Aashish Sharma
16c27b34e3 add graphs to rgw overview dashboard
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit a63026348cb4fcb287046c6dc5432d5709d5dff8)
2023-08-03 11:15:23 +05:30
Yingxin
076e9a750a
Merge pull request #52757 from aisakaki/wip-retire-cp
crimson/os/seastore: retire_extent_addr clean up

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-08-03 11:12:01 +08:00
Anthony D'Atri
61b8c05fcb
Merge pull request #52775 from dvanders/kplus1
doc/rados/operations: Correct EC min_size recommendation to K+1 in erasure-code.rst
2023-08-02 20:05:55 -04:00
Casey Bodley
8dd646d9e8
Merge pull request #52719 from cbodley/wip-rgw-get_ws_listing_op
rgw/swift: remove redundant moves of object name

Reviewed-by:  Jiffin Tony Thottan <jthottan@redhat.com>
2023-08-02 18:43:32 -04:00
Casey Bodley
51a2343187
Merge pull request #52714 from cbodley/wip-ec-clay-unit
ec: initialize lost_chunk in ErasureCodeClay

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-08-02 18:43:06 -04:00
Dan van der Ster
68faf88e6b doc: for EC we recommend K+1
Update the doc to match the reality in the code. I don't know where
the recommendation to have min_size = k+2 came from, but for awhile
now we've defaulted to K+1. See PR #8008.

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
2023-08-02 14:31:07 -07:00
Casey Bodley
7d7218ee3c
Merge pull request #52007 from tcoldrick-bb/fix-invalid-json
rgw/rgw_admin.cc: Handle pg_ver and source_zone explicitly

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-08-02 13:42:22 -04:00
Venky Shankar
cd18c51548 Merge PR #48732 into main
* refs/pull/48732/head:
	doc: add MDS treatise on segments
	pybind/mgr/dashboard: bump teuthology version
	qa/tasks/vstart_runner: stop overriding _run_python
	qa: stop overriding ceph_w prefix in vstart_runner
	qa/tasks/vstart_runner: update teuthology helper tool paths
	qa/tasks/vstart_runner: allow writing to command's stdin
	vstart.sh: always add CEPH_CONF to vstart_environment.sh
	qa: use stdin-killer for python3 command
	qa: add killpoint testing for mds shutdown
	qa: fix background exit condition
	qa: add filesystem helper for setting transient config
	qa: add helper for waiting for a rank to fail
	mds: add incompat feature for minor log segments
	mds: introduce ELid event to create/close log
	mds: change EResetJournal to major segment boundary
	mds: add killpoints for MDS shutdown
	qa: add numerous subtree test
	mds: track larger log events in perf dump
	mds: add minor LogSegment boundaries
	mds: obviate MDLog::start_entry
	mds: retype to properly sized unsigned ints
	mds: use unsigned type for event count
	mds: use base Context class for generalization
	mds: optimize segment lookup
	mds: add stream dump for LogSegment
	mds: handle conf changes in mdlog
	mds: remove redundant comment
	mds: remove unused method
	mds: set a reasonable minimum number of segments
	mds: sort configs

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-08-02 22:07:58 +05:30
Venky Shankar
7e60d477a8 Merge PR #52754 into main
* refs/pull/52754/head:
	test: explicitly link to ceph-common for some libcephfs tests

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-08-02 22:06:09 +05:30
Anthony D'Atri
3dd7e5248d
Merge pull request #52761 from bluikko/patch-18
doc/rados/configuration: Avoid repeating "support" in msgr2.rst
2023-08-02 10:36:06 -04:00
Rishabh Dave
0584cd34b6
Merge pull request #52709 from rishabh-d-dave/cephfs-test_snapshots
qa/cephfs: fix test_disallow_monitor_managed_snaps_for_fs_pools

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-08-02 19:18:07 +05:30
Casey Bodley
dd4baa9b64
Merge pull request #52762 from yuvalif/wip-yuval-62264
rgw/amqp: skip idleness tests since it needs to sleep longer than 30s

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-08-02 09:41:36 -04:00
Ali Masarwa
c583f69e0c RGW: control the persistency of the notification
via adding expiry by number of retries and time
and controling the frequency of retries by sleep duration (in the options of vstart)

Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>
2023-08-02 16:40:41 +03:00
Ilya Dryomov
81acc943c9
Merge pull request #52559 from adamemerson/wip-62097
build: Remove ceph-libboost* packages in install-deps

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-08-02 13:36:17 +02:00
Yuval Lifshitz
11439ecd89 rgw/amqp: skip idleness tests since it needs to sleep longer than 30s
current idle timeout is 30s, so, making the test sleep for 30s may not
be enough. setting sleep time to be longer, and skippign the test so it
won't take too long.

Fixes: https://tracker.ceph.com/issues/62264

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-08-02 10:27:40 +00:00