Commit Graph

139330 Commits

Author SHA1 Message Date
dpandit
c6857988d2 mgr/dashboard: exposed the open api documentations to details card
Fixes: https://tracker.ceph.com/issues/62296
Signed-off-by: dpandit <dpandit@li-6f946d4c-287f-11b2-a85c-b0cb07ed936d.ibm.com>
2023-08-07 13:25:34 +05:30
Nizamudeen A
3b6779f7ea
Merge pull request #52395 from rhcs-dashboard/upgrade-ui-enhancements
mgr/dashboard: add logs and daemon version to upgrade UI

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2023-08-07 10:30:41 +05:30
Nizamudeen A
e2d71466fa
Merge pull request #52647 from rhcs-dashboard/rbd-typing
mgr/dashboard: rbd type status

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-07 09:34:48 +05:30
zdover23
3d3da4351d
Merge pull request #52703 from zdover23/wip-doc-2023-07-31-documenting-ceph-linking-customs-2
doc/start: update linking conventions

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-08-07 09:27:22 +10:00
zdover23
a3acde7dad
Merge pull request #52827 from zdover23/wip-doc-2023-08-05-troubleshooting-troubleshooting-mon-2-of-x
doc/rados: edit troubleshooting-mon.rst (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-08-07 08:17:15 +10:00
Matan Breizman
bd8af9498d
Merge pull request #52785 from Matan-B/wip-matanb-crimson-add-asan-req
ceph.spec.in: add libasan to seastar requires

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-08-06 14:49:01 +03:00
Zac Dover
9938955c09 doc/rados: edit troubleshooting-mon.rst (2 of x)
Edit the second part of
doc/rados/troubleshooting/troubleshooting-mon.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-06 21:46:16 +10:00
zdover23
3f6aac1f22
Merge pull request #52824 from bluikko/bluikko-doc-radosgw-config-language
doc/radosgw: Improve language and formatting in config-ref.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-08-06 21:29:03 +10:00
Ville Ojamo
9dd86773b3 doc/radosgw: Improve language and formatting in config-ref.rst
The "Topic persistency settings" section includes convoluted
and incomplete sentences so attempt to improve the
language. The section lacks context so add a link to the
relevant documentation about Notifications.

The "Garbage Collection settings" note includes a sentence
that looks incomplete so try to improve the language.

Don't capitalize "Ops" in "RGW Ops" especially when the
same sentence talks about "op queue" with lower case "o".

Also improve formatting: indentation of a note and wrap
several very long lines.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2023-08-06 16:48:36 +07:00
Matan Breizman
e6d2ec65bd ceph.spec.in: add sanitizers to seastar requires
```
CMake Error at src/seastar/CMakeLists.txt:782 (message):
  Sanitizers not found!
```

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-08-06 09:45:42 +00:00
Matan Breizman
4080ace23e
Merge pull request #52784 from Matan-B/wip-matanb-crimson-only-centos-9
qa/suites/crimson-rados: add centos9 to supported distros

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-08-06 10:40:07 +03:00
zdover23
ededb5924e
Merge pull request #52778 from zdover23/wip-doc-2023-08-03-rados-operations-add-or-rm-mons-2-of-x
doc/rados: edit operations/add-or-rm-mons (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-08-05 21:46:34 +10:00
Zac Dover
4e790603d9 doc/rados: edit operations/add-or-rm-mons (2 of x)
Edit the second part of doc/rados/operations/add-or-rm-mons.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-05 14:46:45 +10:00
Anthony D'Atri
5888359a0b
Merge pull request #52802 from dvanders/support_the_foundation
doc: Add a Ceph Foundation footer to docs.ceph.com
2023-08-04 16:59:41 -04:00
Anthony D'Atri
2fabdc82d1
Merge pull request #52814 from cbodley/wip-doc-rgw-zonegroup-feature-default
doc/rgw: correct statement about default zone features
2023-08-04 16:52:39 -04:00
Nizamudeen A
911c87c8e8
Merge pull request #52787 from rhcs-dashboard/fix-rgw-average-object-size
mgr/dashboard: fix average object size calculation in rgw overview dashboard

Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-04 23:21:17 +05:30
Nizamudeen A
7dcb06d368 mgr/dashboard: update the upgrade layout by introducing new items
Shows Cluster Health
Shows the count of mgr daemons
Shows a table with all the daemon versions
Display the cluster logs

Fixes: https://tracker.ceph.com/issues/62016
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-04 23:05:28 +05:30
Casey Bodley
bb5ad067ed doc/rgw: correct statement about default zone features
this sentence wasn't updated when we added the Default column to the
table below

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-04 13:00:59 -04:00
Casey Bodley
fb13353bf7
Merge pull request #52248 from cbodley/wip-46062
rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-08-04 08:55:52 -04:00
Aashish Sharma
eae1c0e505 mgr/dashboard: fix average object size calculation in rgw overview
dashboard

Fixes: https://tracker.ceph.com/issues/62318

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2023-08-04 13:15:53 +05:30
Casey Bodley
800e716530
Merge pull request #52274 from cbodley/wip-61862
qa/rgw: specify cluster name in 'radosgw-admin gc process'

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-08-03 21:00:46 -04:00
zdover23
32f728abca
Merge pull request #52800 from cbodley/wip-62312
doc/rgw: several response headers are supported

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-08-04 09:38:37 +10:00
Dan van der Ster
ac259500cf doc: Add a Ceph Foundation footer to docs.ceph.com
Add an info box to the footer of every docs page inviting visitors
to support the Ceph Foundation.

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
2023-08-03 16:28:42 -07:00
Casey Bodley
ab6ec66a2f doc/rgw: several response headers are supported
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 17:31:31 -04:00
Casey Bodley
61cf6eec7b ReleaseNotes: document recovery of encrypted multipart objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 17:21:03 -04:00
Casey Bodley
e90bfba99c radosgw-admin: add command to resync encrypted multipart objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 16:56:49 -04:00
Casey Bodley
237fa27710 rgw: RGWRados::set_attrs() takes optional mtime
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 16:56:49 -04:00
Casey Bodley
07d28bac15 rgw: expose part id in RGWObjManifest iterator
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 16:56:49 -04:00
Casey Bodley
43ad8a4ccd
Merge pull request #51786 from cbodley/wip-61473
rgw/crypt: apply rgw_crypt_default_encryption_key by default

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-08-03 16:24:45 -04:00
Nizamudeen A
0243a955b8 mgr/dashboard: make the logs component configurable and reusable
This will make the logs component easier to reuse for now in upgrade
component and later, wherever we want

Fixes: https://tracker.ceph.com/issues/62016
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-03 21:55:09 +05:30
Casey Bodley
c08eb228b1
Merge pull request #52447 from liumiaomiaoIntel/qatzip_update
common/compressor: update the interfaces and data structures

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 11:11:02 -04:00
Ali Masarwa
c62a170718
Merge pull request #52634 from AliMasarweh/wip-alimasa-persistant-q-enhance
RGW: control the persistency of the notification
2023-08-03 17:28:18 +03:00
Nizamudeen A
917c3fe2ad
Merge pull request #52405 from rhcs-dashboard/rgw-overview-dashboard-graphs
mgr/dashboard: add graphs to rgw overview dashboard

Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-03 19:17:30 +05:30
Casey Bodley
b6383e9e0b
Merge pull request #52711 from cbodley/wip-62250
rgw: retry metadata cache notifications with INVALIDATE_OBJ

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2023-08-03 09:04:05 -04:00
Casey Bodley
902d07499d rgw: preserve RGW_ATTR_CRYPT_PARTS of already-replicated objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 09:01:11 -04:00
Casey Bodley
e7d98fb369 rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt
because multisite replicates multipart objects as a single part, we lose
information about the part sizes from the original manifest that is
necessary to correctly decrypt across those part boundaries

on replication, parse the part lengths out of the source object's
manifest, and store them in a separate RGW_ATTR_CRYPT_PARTS for use on
decryption

Fixes: https://tracker.ceph.com/issues/46062

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 09:01:11 -04:00
Casey Bodley
d8a82f5aaa rgw: BlockDecrypt filter parses manifest parts before construction
users now call a static read_manifest_parts() function, and pass the
resulting vector into the BlockDecrypt constructor

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-08-03 09:01:01 -04:00
Nizamudeen A
f363c6db4a
Merge pull request #52657 from rhcs-dashboard/fs-subvolumes
mgr/dashboard: cephfs subvolume list

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-08-03 18:12:18 +05:30
Nizamudeen A
43114f9eb2 mgr/dashboard: cephfs subvolume list
Fixes: https://tracker.ceph.com/issues/62182
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-03 14:54:33 +05:30
Matan Breizman
757193a4e1 qa/suites/crimson-rados: use crimson-supported-all-distro
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-08-03 08:06:45 +00:00
Matan Breizman
3b591f33ea qa/distros: add crimson-supported-all-distro
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-08-03 08:05:41 +00:00
Aashish Sharma
16c27b34e3 add graphs to rgw overview dashboard
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit a63026348cb4fcb287046c6dc5432d5709d5dff8)
2023-08-03 11:15:23 +05:30
Yingxin
076e9a750a
Merge pull request #52757 from aisakaki/wip-retire-cp
crimson/os/seastore: retire_extent_addr clean up

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-08-03 11:12:01 +08:00
Anthony D'Atri
61b8c05fcb
Merge pull request #52775 from dvanders/kplus1
doc/rados/operations: Correct EC min_size recommendation to K+1 in erasure-code.rst
2023-08-02 20:05:55 -04:00
Casey Bodley
8dd646d9e8
Merge pull request #52719 from cbodley/wip-rgw-get_ws_listing_op
rgw/swift: remove redundant moves of object name

Reviewed-by:  Jiffin Tony Thottan <jthottan@redhat.com>
2023-08-02 18:43:32 -04:00
Casey Bodley
51a2343187
Merge pull request #52714 from cbodley/wip-ec-clay-unit
ec: initialize lost_chunk in ErasureCodeClay

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-08-02 18:43:06 -04:00
Dan van der Ster
68faf88e6b doc: for EC we recommend K+1
Update the doc to match the reality in the code. I don't know where
the recommendation to have min_size = k+2 came from, but for awhile
now we've defaulted to K+1. See PR #8008.

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
2023-08-02 14:31:07 -07:00
Casey Bodley
7d7218ee3c
Merge pull request #52007 from tcoldrick-bb/fix-invalid-json
rgw/rgw_admin.cc: Handle pg_ver and source_zone explicitly

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-08-02 13:42:22 -04:00
Venky Shankar
cd18c51548 Merge PR #48732 into main
* refs/pull/48732/head:
	doc: add MDS treatise on segments
	pybind/mgr/dashboard: bump teuthology version
	qa/tasks/vstart_runner: stop overriding _run_python
	qa: stop overriding ceph_w prefix in vstart_runner
	qa/tasks/vstart_runner: update teuthology helper tool paths
	qa/tasks/vstart_runner: allow writing to command's stdin
	vstart.sh: always add CEPH_CONF to vstart_environment.sh
	qa: use stdin-killer for python3 command
	qa: add killpoint testing for mds shutdown
	qa: fix background exit condition
	qa: add filesystem helper for setting transient config
	qa: add helper for waiting for a rank to fail
	mds: add incompat feature for minor log segments
	mds: introduce ELid event to create/close log
	mds: change EResetJournal to major segment boundary
	mds: add killpoints for MDS shutdown
	qa: add numerous subtree test
	mds: track larger log events in perf dump
	mds: add minor LogSegment boundaries
	mds: obviate MDLog::start_entry
	mds: retype to properly sized unsigned ints
	mds: use unsigned type for event count
	mds: use base Context class for generalization
	mds: optimize segment lookup
	mds: add stream dump for LogSegment
	mds: handle conf changes in mdlog
	mds: remove redundant comment
	mds: remove unused method
	mds: set a reasonable minimum number of segments
	mds: sort configs

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-08-02 22:07:58 +05:30
Venky Shankar
7e60d477a8 Merge PR #52754 into main
* refs/pull/52754/head:
	test: explicitly link to ceph-common for some libcephfs tests

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-08-02 22:06:09 +05:30