RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-20 10:01:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
131,404 Commits 216 Branches 394 Tags 1.8 GiB
d7b6b49b6c
Commit Graph

131404 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Casey Bodley
d7b6b49b6c rgw: remove rgw_bucket_shard_sync_info::full_marker 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
e66dd889b3 rgw: disable backoff on data sync error_retry_time 
this backoff is triggered often by the per-bucket lease for full sync,
and causes tests to fail with checkpoint timeouts

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Adam C. Emerson
e432f4a4be qa/rgw: rgw_multisite_tests task loads default plugins 
the ability to filter tests by attribute is provided by the
nose.plugins.attrib plugin, which wasn't being loaded by default

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
e7f3ac92a7 qa/rgw: disable multisite tests for 'bucket sync disable' 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
ecad0e388a qa/rgw: add missing meta checkpoint to test_multipart_object_sync 
if metadata sync hasn't finished, the 'bucket checkpoint' commands may
not find its bucket info

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
5e58ef856c rgw: RGWSyncBucketCR holds lease over Init state too 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
3184aa7b18 rgw: fix up BucketShardIncrementalSync log message 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
799bd1bcac rgw: move full sync from SyncBucketShard to SyncBucket 
renamed ListBucketShardCR to ListRemoteBucketCR and removed the shard-id
parameter

renamed BucketFullSyncShardMarkerTrack to BucketFullSyncMarkerTrack,
which now updates the bucket-level rgw_bucket_sync_status

renamed BucketShardFullSyncCR to BucketFullSyncCR

BucketSyncCR now takes a bucket-wide lease during full sync

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
d78907825f radosgw-admin: 'bucket sync checkpoint' waits for full sync 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
1e90a3e753 radosgw-admin: 'bucket sync status' displays new full sync status 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
50e6b3a5e4 rgw: add rgw_read_bucket_full_sync_status() 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
cce09513a5 rgw: InitBucketShardSyncStatus always sets state to Incremental 
full sync happens as the bucket level, so the shards will always start
in StateIncrementalSync

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
6bf0a9e250 rgw: split SyncBucket from SyncBucketShard 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
06c30057f4 rgw: add InitBucketFullSyncStatusCR 
a coroutine to initialize a bucket for full sync using a new bucket-wide
sync status object

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
d9946514f0 rgw: RGWSimpleRadosWriteAttrsCR supports exclusive create 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
5403c85ae5 rgw: system objects can set exclusive on set_attrs() 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
444c5fff47 rgw: add exclusive flag to RGWSimpleRadosWriteCR 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
aa1aca4ebe rgw: generalize error handling in RGWShardCollectCR 
RGWShardCollectCR was hard-coded to ignore ENOENT errors and print a
'failed to fetch log status' error message. this moves that logic into a
handle_result() virtual function. it also exposes the member variables
'status' and 'max_concurrent' as protected, so they can be consulted or
modified by overrides of handle_result() and spawn_next()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
293f6612e6 rgw: add sync_bucket_shard_cr() factory function 
allows other code to spawn this coroutine without having the class
definition

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:31 -04:00
Casey Bodley
5e28b332a1 rgw: rename to RGWSyncBucketShardCR 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Casey Bodley
3065c9e3b7 rgw: add full_status_oid() for buckets 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Casey Bodley
e2e131242f rgw: use const for string constants in rgw_data_sync.cc 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Casey Bodley
df444852fc rgw: rename to inc_status_oid 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Casey Bodley
89d69d4900 rgw: add data structures for bucket sync status 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Casey Bodley
1708360b39 rgw: rename to rgw_read_bucket_inc_sync_status 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Casey Bodley
f2a6a164d7 rgw: remove unused RGWRunBucketsSyncBySourceCR 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Casey Bodley
5868ceb901 rgw: RGWSimpleRadosReadCR copies out objv_tracker 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2022-05-27 15:47:30 -04:00
Adam King
86959381a6
Merge pull request #46404 from phlogistonjohn/jjm-obj-format-pkg-fix 
debian: include the new object_format.py file

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
 2022-05-27 08:14:58 -04:00
Yingxin
ca5eaaae9c
Merge pull request #46356 from xxhdx1985126/wip-backref-gc-opt 
crimson/os/seastore/segment_cleaner: add dedicated backref trimming process

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
 2022-05-27 16:23:22 +08:00
Venky Shankar
491190fb75
Merge pull request #45544 from wxypro/fix-typos-cephfs 
common/options: fix typo

Reviewed-by: Venky Shankar <vshankar@redhat.com>
 2022-05-27 11:13:43 +05:30
John Mulligan
b66ec81595 debian: include the new object_format.py file 
This was missed when adding object_format.py to the RPM packaging.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
 2022-05-26 10:56:44 -04:00
Xuehan Xu
2da036b738 crimson/os/seastore/segment_cleaner: add dedicated backref trimming process 
Space reclamation needs to merge backrefs up to the point where the latest
release of extents within the scope of the reclamation process happened.
When the journal size is large, that merge may generate a transaction
record with size exceeds the max record size threshold. So we need have a
backref trimming process that merge most of the backrefs before the space
reclamation happens.

This commit also fixes issue: https://tracker.ceph.com/issues/55692, by
repeating the inflight backrefs trimming transaction when it's
invalidated by other trans on the ROOT block

Fixes: https://tracker.ceph.com/issues/55692
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
 2022-05-26 17:16:55 +08:00
Yingxin
a74fa9a66f
Merge pull request #46271 from xxhdx1985126/wip-backref-new_mapping-opt 
crimson/os/seastore: backref related clean ups

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
 2022-05-26 10:24:37 +08:00
Patrick Donnelly
6606d91ace
Merge commit 'b76b6ea16899861d6c266797b3c11d9f68f924d7' into main 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2022-05-25 16:02:14 -04:00
David Galloway
15c1109cb5
Merge pull request #46390 from gabriellasroman/inclusive-lang 
teuthology-cronjobs: master->main
 2022-05-25 15:47:07 -04:00
Gabriella
99c4e068c0
teuthology-cronjobs: master->main 
Signed-off-by: Gabriella Roman <gsroman@bu.edu>
 2022-05-25 08:01:11 -04:00
Venky Shankar
b76b6ea168
Merge pull request #44486 from batrick/fs-workload-kclient-switches 
qa: reduce fs:workload use of random selection

Reviewed-by: Venky Shankar <vshankar@redhat.com>
 2022-05-25 06:54:53 +05:30
David Galloway
805d2320b3
Merge pull request #46385 from ceph/inclusive-rename-yaml 
Rename/re-symlink whitelist_*.yaml
 2022-05-24 17:04:50 -04:00
Zack Cerza
0666dd34cf Rename/re-symlink whitelist_*.yaml 
whitelist_health.yaml -> ignorelist_health.yaml
whitelist_wrongly_marked_down.yaml -> ignore_wrongly_marked_down.yaml

This was mostly addressed in
2ee9365d0b,
but the rename wasn't done there.

Signed-off-by: Zack Cerza <zack@cerza.org>
 2022-05-24 14:14:04 -06:00
Zack Cerza
6fee777d60
Merge pull request #44967 from batrick/nested-subset-doc 
doc/dev: document nested subsets in teuthology
 2022-05-24 10:23:48 -06:00
Yuri Weinstein
123c57400e
Merge pull request #46099 from NitzanMordhai/wip-nitzan-rados-test-delete-pools-parallel 
systest: fix race with pool delete after socket injection

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2022-05-24 08:02:26 -07:00
Yuri Weinstein
5442a42857
Merge pull request #45825 from NitzanMordhai/wip-nitzan-watch-notify-reconnect-107 
librados/watch_notify: reconnect after socket injection

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
 2022-05-24 08:01:45 -07:00
Yuri Weinstein
714cdc4e87
Merge pull request #45805 from ifed01/wip-ifed-more-stats 
os/bluestore: more debug information from BlueStore

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
 2022-05-24 08:01:19 -07:00
Yuri Weinstein
bc02a55d3a
Merge pull request #45409 from NUABO/tancz 
mon: add proxy to cache tier options

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2022-05-24 07:59:36 -07:00
Adam King
7dbddc008c
Merge pull request #46324 from ceph/dgalloway-nodockerio 
qa: Pull from quay.io not docker.io

Reviewed-by: Adam King <adking@redhat.com>
 2022-05-24 10:27:03 -04:00
kalebskeithley
77e3e0d39d
Merge pull request #46366 from kalebskeithley/rocksdb 
rocksdb: build with rocksdb-7.y.z
 2022-05-24 07:06:50 -04:00
Rishabh Dave
d4ff8e3a2f
Merge pull request #46185 from dparmar18/fix_rm_error_output 
cephfs-shell: fix rm cmd's error output

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
 2022-05-24 16:13:48 +05:30
Rishabh Dave
9368f4fe6c
Merge pull request #46160 from dparmar18/fix_tracker_40860 
cephfs-shell: fix rmdir cmd

Reviewed-by: Rishabh Dave <ridave@redhat.com>
 2022-05-24 16:10:26 +05:30
Ernesto Puerta
0ec4ba41ad
Merge pull request #46249 from rhcs-dashboard/rbd-mirroring-commands 
mgr/dashboard: enable/disable/promote/demote/resync mirroring images

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
 2022-05-24 12:38:14 +02:00
Xuehan Xu
0e1d43eea0 crimson/os/seastore/segment_cleaner: downgrade the level of unnecessary logs to DEBUG 
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
 2022-05-24 12:17:47 +08:00