RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-02-23 11:07:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
139,307 Commits 216 Branches 395 Tags 1.4 GiB
43069394c5
Commit Graph

139307 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ali Maredia
43069394c5 qa: change admin_host to admin_url in barbican.py 
Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2023-08-04 12:51:48 -04:00
Ali Maredia
fc12be0fcf qa: bump keystone version in barbican.yaml 
Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2023-08-04 12:51:48 -04:00
Casey Bodley
fb13353bf7
Merge pull request #52248 from cbodley/wip-46062 
rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
 2023-08-04 08:55:52 -04:00
Casey Bodley
800e716530
Merge pull request #52274 from cbodley/wip-61862 
qa/rgw: specify cluster name in 'radosgw-admin gc process'

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
 2023-08-03 21:00:46 -04:00
zdover23
32f728abca
Merge pull request #52800 from cbodley/wip-62312 
doc/rgw: several response headers are supported

Reviewed-by: Zac Dover <zac.dover@proton.me>
 2023-08-04 09:38:37 +10:00
Casey Bodley
ab6ec66a2f doc/rgw: several response headers are supported 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 17:31:31 -04:00
Casey Bodley
61cf6eec7b ReleaseNotes: document recovery of encrypted multipart objects 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 17:21:03 -04:00
Casey Bodley
e90bfba99c radosgw-admin: add command to resync encrypted multipart objects 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 16:56:49 -04:00
Casey Bodley
237fa27710 rgw: RGWRados::set_attrs() takes optional mtime 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 16:56:49 -04:00
Casey Bodley
07d28bac15 rgw: expose part id in RGWObjManifest iterator 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 16:56:49 -04:00
Casey Bodley
43ad8a4ccd
Merge pull request #51786 from cbodley/wip-61473 
rgw/crypt: apply rgw_crypt_default_encryption_key by default

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
 2023-08-03 16:24:45 -04:00
Casey Bodley
c08eb228b1
Merge pull request #52447 from liumiaomiaoIntel/qatzip_update 
common/compressor: update the interfaces and data structures

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 11:11:02 -04:00
Ali Masarwa
c62a170718
Merge pull request #52634 from AliMasarweh/wip-alimasa-persistant-q-enhance 
RGW: control the persistency of the notification
 2023-08-03 17:28:18 +03:00
Nizamudeen A
917c3fe2ad
Merge pull request #52405 from rhcs-dashboard/rgw-overview-dashboard-graphs 
mgr/dashboard: add graphs to rgw overview dashboard

Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
 2023-08-03 19:17:30 +05:30
Casey Bodley
b6383e9e0b
Merge pull request #52711 from cbodley/wip-62250 
rgw: retry metadata cache notifications with INVALIDATE_OBJ

Reviewed-by: Adam Emerson <aemerson@redhat.com>
 2023-08-03 09:04:05 -04:00
Casey Bodley
902d07499d rgw: preserve RGW_ATTR_CRYPT_PARTS of already-replicated objects 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 09:01:11 -04:00
Casey Bodley
e7d98fb369 rgw: fetch_remote_obj() preserves original part lengths for BlockDecrypt 
because multisite replicates multipart objects as a single part, we lose
information about the part sizes from the original manifest that is
necessary to correctly decrypt across those part boundaries

on replication, parse the part lengths out of the source object's
manifest, and store them in a separate RGW_ATTR_CRYPT_PARTS for use on
decryption

Fixes: https://tracker.ceph.com/issues/46062

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 09:01:11 -04:00
Casey Bodley
d8a82f5aaa rgw: BlockDecrypt filter parses manifest parts before construction 
users now call a static read_manifest_parts() function, and pass the
resulting vector into the BlockDecrypt constructor

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-03 09:01:01 -04:00
Nizamudeen A
f363c6db4a
Merge pull request #52657 from rhcs-dashboard/fs-subvolumes 
mgr/dashboard: cephfs subvolume list

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
 2023-08-03 18:12:18 +05:30
Nizamudeen A
43114f9eb2 mgr/dashboard: cephfs subvolume list 
Fixes: https://tracker.ceph.com/issues/62182
Signed-off-by: Nizamudeen A <nia@redhat.com>
 2023-08-03 14:54:33 +05:30
Aashish Sharma
16c27b34e3 add graphs to rgw overview dashboard 
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit a63026348cb4fcb287046c6dc5432d5709d5dff8)
 2023-08-03 11:15:23 +05:30
Yingxin
076e9a750a
Merge pull request #52757 from aisakaki/wip-retire-cp 
crimson/os/seastore: retire_extent_addr clean up

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
 2023-08-03 11:12:01 +08:00
Anthony D'Atri
61b8c05fcb
Merge pull request #52775 from dvanders/kplus1 
doc/rados/operations: Correct EC min_size recommendation to K+1 in erasure-code.rst
 2023-08-02 20:05:55 -04:00
Casey Bodley
8dd646d9e8
Merge pull request #52719 from cbodley/wip-rgw-get_ws_listing_op 
rgw/swift: remove redundant moves of object name

Reviewed-by:  Jiffin Tony Thottan <jthottan@redhat.com>
 2023-08-02 18:43:32 -04:00
Casey Bodley
51a2343187
Merge pull request #52714 from cbodley/wip-ec-clay-unit 
ec: initialize lost_chunk in ErasureCodeClay

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2023-08-02 18:43:06 -04:00
Dan van der Ster
68faf88e6b doc: for EC we recommend K+1 
Update the doc to match the reality in the code. I don't know where
the recommendation to have min_size = k+2 came from, but for awhile
now we've defaulted to K+1. See PR #8008.

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
 2023-08-02 14:31:07 -07:00
Casey Bodley
7d7218ee3c
Merge pull request #52007 from tcoldrick-bb/fix-invalid-json 
rgw/rgw_admin.cc: Handle pg_ver and source_zone explicitly

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2023-08-02 13:42:22 -04:00
Venky Shankar
cd18c51548 Merge PR #48732 into main 
* refs/pull/48732/head:
	doc: add MDS treatise on segments
	pybind/mgr/dashboard: bump teuthology version
	qa/tasks/vstart_runner: stop overriding _run_python
	qa: stop overriding ceph_w prefix in vstart_runner
	qa/tasks/vstart_runner: update teuthology helper tool paths
	qa/tasks/vstart_runner: allow writing to command's stdin
	vstart.sh: always add CEPH_CONF to vstart_environment.sh
	qa: use stdin-killer for python3 command
	qa: add killpoint testing for mds shutdown
	qa: fix background exit condition
	qa: add filesystem helper for setting transient config
	qa: add helper for waiting for a rank to fail
	mds: add incompat feature for minor log segments
	mds: introduce ELid event to create/close log
	mds: change EResetJournal to major segment boundary
	mds: add killpoints for MDS shutdown
	qa: add numerous subtree test
	mds: track larger log events in perf dump
	mds: add minor LogSegment boundaries
	mds: obviate MDLog::start_entry
	mds: retype to properly sized unsigned ints
	mds: use unsigned type for event count
	mds: use base Context class for generalization
	mds: optimize segment lookup
	mds: add stream dump for LogSegment
	mds: handle conf changes in mdlog
	mds: remove redundant comment
	mds: remove unused method
	mds: set a reasonable minimum number of segments
	mds: sort configs

Reviewed-by: Venky Shankar <vshankar@redhat.com>
 2023-08-02 22:07:58 +05:30
Venky Shankar
7e60d477a8 Merge PR #52754 into main 
* refs/pull/52754/head:
	test: explicitly link to ceph-common for some libcephfs tests

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
 2023-08-02 22:06:09 +05:30
Anthony D'Atri
3dd7e5248d
Merge pull request #52761 from bluikko/patch-18 
doc/rados/configuration: Avoid repeating "support" in msgr2.rst
 2023-08-02 10:36:06 -04:00
Rishabh Dave
0584cd34b6
Merge pull request #52709 from rishabh-d-dave/cephfs-test_snapshots 
qa/cephfs: fix test_disallow_monitor_managed_snaps_for_fs_pools

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
 2023-08-02 19:18:07 +05:30
Casey Bodley
dd4baa9b64
Merge pull request #52762 from yuvalif/wip-yuval-62264 
rgw/amqp: skip idleness tests since it needs to sleep longer than 30s

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2023-08-02 09:41:36 -04:00
Ali Masarwa
c583f69e0c RGW: control the persistency of the notification 
via adding expiry by number of retries and time
and controling the frequency of retries by sleep duration (in the options of vstart)

Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>
 2023-08-02 16:40:41 +03:00
Ilya Dryomov
81acc943c9
Merge pull request #52559 from adamemerson/wip-62097 
build: Remove ceph-libboost* packages in install-deps

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
 2023-08-02 13:36:17 +02:00
Yuval Lifshitz
11439ecd89 rgw/amqp: skip idleness tests since it needs to sleep longer than 30s 
current idle timeout is 30s, so, making the test sleep for 30s may not
be enough. setting sleep time to be longer, and skippign the test so it
won't take too long.

Fixes: https://tracker.ceph.com/issues/62264

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
 2023-08-02 10:27:40 +00:00
Avan
bab9535757
Merge pull request #52698 from rhcs-dashboard/fix-instance-id-exporter 
exporter: fix instance_id labeld value for rgw in exporter

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
 2023-08-02 14:26:47 +05:30
zdover23
7931020f09
Merge pull request #51960 from rzarzynski/wip-doc-encoding 
doc: improve doc/dev/encoding.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Neha Ojha <nohja@redhat.com>
 2023-08-02 17:45:51 +10:00
Venky Shankar
3c98adbf74 test: explicitly link to ceph-common for some libcephfs tests 
Fixes: http://tracker.ceph.com/issues/57206
Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2023-08-02 12:13:57 +05:30
Venky Shankar
a920634317 Merge PR #52569 into main 
* refs/pull/52569/head:
	test/libcephfs: update delegation test assertions

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
 2023-08-02 11:00:37 +05:30
Ville Ojamo
df43ab5ba6
doc/rados/configuration: Avoid repeating "support" in msgr2.rst 
Instead of saying "[...] support is not supported"
change the first "support" to "operation".

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
 2023-08-02 11:31:50 +07:00
Xinyu Huang
b99a1956bd crimson/os/seastore: retire_extent_addr clean up 
Signed-off-by: Xinyu Huang <xinyu.huang@intel.com>
 2023-08-02 10:09:52 +08:00
Adam King
ae3df0adde
Merge pull request #47573 from phlogistonjohn/jjm-cpatch-py 
cpatch.py:  a python based cpatch script

Reviewed-by: Adam King <adking@redhat.com>
 2023-08-01 17:51:32 -04:00
Casey Bodley
4b912b79c9
Merge pull request #52732 from cbodley/wip-qa-cephfs-flake8-random 
qa/cephfs: redefinition of unused 'random' from line 7

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
 2023-08-01 16:26:23 -04:00
Patrick Donnelly
468a193389
Merge PR #52675 into main 
* refs/pull/52675/head:
	test/TestOSDMap: don't use the deprecated std::random_shuffle method

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2023-08-01 14:56:32 -04:00
Casey Bodley
568a21d83c qa/cephfs: redefinition of unused 'random' from line 7 
seeing this run-tox-qa failure about tasks/cephfs/test_client_recovery.py:

246/285 Test #264: run-tox-qa ................................***Failed   58.54 sec
Requirement already satisfied: tox in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (4.6.4)
Requirement already satisfied: cachetools>=5.3.1 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (5.3.1)
Requirement already satisfied: chardet>=5.1 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (5.1.0)
Requirement already satisfied: colorama>=0.4.6 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (0.4.6)
Requirement already satisfied: filelock>=3.12.2 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (3.12.2)
Requirement already satisfied: packaging>=23.1 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (23.1)
Requirement already satisfied: platformdirs>=3.8 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (3.10.0)
Requirement already satisfied: pluggy>=1.2 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (1.2.0)
Requirement already satisfied: pyproject-api>=1.5.2 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (1.5.3)
Requirement already satisfied: tomli>=2.0.1 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (2.0.1)
Requirement already satisfied: virtualenv>=20.23.1 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from tox) (20.24.2)
Requirement already satisfied: distlib<1,>=0.3.7 in /home/jenkins-build/build/workspace/ceph-pull-requests/build/qa-virtualenv/lib/python3.10/site-packages (from virtualenv>=20.23.1->tox) (0.3.7)
flake8: install_deps /home/jenkins-build/build/workspace/ceph-pull-requests/qa> python -I -m pip install flake8
flake8: freeze /home/jenkins-build/build/workspace/ceph-pull-requests/qa> python -m pip freeze --all
flake8: flake8==6.1.0,mccabe==0.7.0,pip==22.3.1,pycodestyle==2.11.0,pyflakes==3.1.0,setuptools==65.6.3,wheel==0.38.4
flake8: commands[0] /home/jenkins-build/build/workspace/ceph-pull-requests/qa> flake8 --select=F,E9 --exclude=venv,.tox
./tasks/cephfs/test_client_recovery.py:12:1: F811 redefinition of unused 'random' from line 7
flake8: exit 1 (3.72 seconds) /home/jenkins-build/build/workspace/ceph-pull-requests/qa> flake8 --select=F,E9 --exclude=venv,.tox pid=706315
flake8: FAIL ✖ in 15.42 seconds

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-08-01 12:31:44 -04:00
Patrick Donnelly
bc75366b9c
doc: add MDS treatise on segments 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2023-08-01 11:16:28 -04:00
Patrick Donnelly
5dae704daf
pybind/mgr/dashboard: bump teuthology version 
So stdin-killer and other utilities are installed in the bin directory.
vstart_runner.py now relies on their presence.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2023-08-01 11:16:28 -04:00
Patrick Donnelly
95e61803e0
qa/tasks/vstart_runner: stop overriding _run_python 
Now that the teuthology tools can be run in vstart_runner, there's no
reason to override this method.

Importantly, this enables the use of the new stdin-killer tool [1].

[1] https://github.com/ceph/teuthology/pull/1846

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2023-08-01 11:16:28 -04:00
Patrick Donnelly
77bf36fa5a
qa: stop overriding ceph_w prefix in vstart_runner 
These tools are now available in the $PATH so it's no longer necessary
to remove them.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2023-08-01 11:16:28 -04:00
Patrick Donnelly
7db0e669c6
qa/tasks/vstart_runner: update teuthology helper tool paths 
With [1], these tools are now installed in the teuthology virtualenv.
Update the path in the command arguments so these tools can be run via
sudo.

[1] https://github.com/ceph/teuthology/pull/1846

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2023-08-01 11:16:27 -04:00