Commit Graph

129286 Commits

Author SHA1 Message Date
Ilya Dryomov
82219b3bea
Merge pull request #44282 from orozery/qa-qemu-nbd-ide-interface
qa/tasks/qemu: switch nbd devices from virtio to ide

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-25 15:06:14 +01:00
Guillaume Abrioux
6083d77638
Merge pull request #44066 from guits/guits-fix-rollback-osd
ceph-volume: zap osds in rollback_osd()
2022-01-25 11:03:35 +01:00
Ronen Friedman
186d24bb83
Merge pull request #44755 from ronen-fr/wip-rf-be2-clang1
osd/scrub: fix ceph::mutex usage

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2022-01-25 10:19:33 +02:00
Yingxin
4498457c9f
Merge pull request #44740 from liu-chunmei/crimson-fix-remove_from_lru-assert
crimson: fix remove_from_lru assert

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-01-25 14:52:24 +08:00
Yingxin
8406028e33
Merge pull request #44653 from cyx1231st/wip-crimson-osd-empty-transaction
crimson/osd: ShardServices::dispatch_context_transaction to flush

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-01-25 13:02:37 +08:00
Adam King
5c5ae58069
Merge pull request #44761 from mgfritch/cephadm-asyncssh-2_8
mgr/cephadm: require asyncssh 2.8

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Melissa Li <melissali@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-01-24 17:40:06 -05:00
Michael Fritch
5af45ef068
mgr/cephadm: require asyncssh 2.8
Fixes: https://tracker.ceph.com/issues/54003
Signed-off-by: Michael Fritch <mfritch@suse.com>
2022-01-24 12:58:17 -07:00
Ronen Friedman
4c86c2c858 osd/scrub: fix clang compilation issues
Issues created by the scrub-backend refactoring PR.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-24 18:22:44 +00:00
Adam C. Emerson
e8791ca367
Merge pull request #44737 from adamemerson/wip-wrong-modelines
cleanup: Change incorrect modelines

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-01-24 12:26:03 -05:00
chunmei-liu
3cdc82cf98 crimson: fix remove_from_lru assert
RETIRED_PLACEHOLDER extent also put into retired set, when do
commit_retire_extent need check if it is RETIRED_PLACEHOLDER,
otherwise will cause remove_from_lru assert.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-01-24 09:12:00 -08:00
Patrick Donnelly
f7c931108a
Merge PR #44574 into master
* refs/pull/44574/head:
	qa: Add syslog ignore list

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-01-24 09:32:48 -05:00
Ilya Dryomov
315e186124
Merge pull request #44714 from idryomov/wip-rbd-mirror-delprop-races
rbd-mirror: fix races in snapshot-based mirroring deletion propagation

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-01-24 11:43:56 +01:00
Ronen Friedman
0c2dfd9bd3
Merge pull request #42993 from ronen-fr/wip-ronenf-scrub-be2
osd/scrub: extracting scrub "backend" functionality

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-01-24 11:07:31 +02:00
Ronen Friedman
c9e706e627
Merge pull request #44744 from ronen-fr/wip-rf-lost-update
scrub/osd: add a missing 'publish stats to osd'

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-01-24 10:57:04 +02:00
Yingxin
375503e5df
Merge pull request #44649 from cyx1231st/wip-crimson-improve-log-cache
crimson/os/seastore: consolidate seastore_t and seastore_cache logs

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-01-24 09:37:01 +08:00
Ilya Dryomov
b274bca1b2 qa/run_xfstests_qemu.sh: disable 251, 260 and 288
All three are skipped with virtio disks:

251	 [not run] FITRIM not supported on /dev/vdc
260	 [not run] FITRIM not supported on /dev/vdc
288	 [not run] FITRIM not supported on /dev/vdc

But 260 and 288 fail with ide disks, where discard defaults to on.  The
ancient kernel in our ubuntu-12.04.qcow2 doesn't support virtio discard
anyway so let's just disable them for consistency.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-23 20:16:29 +01:00
Ronen Friedman
ab032e9ac5 scrub/osd: add a missing 'publish stats to osd'
to publish the last scrub status report.
The change is needed following the merge of
PR #42735.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-23 08:54:58 +02:00
Kefu Chai
0f448714c2
Merge pull request #44572 from 5cs/fix-spdk-cmake
cmake/modules/BuildSPDK.cmake: link whole-archive

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-01-22 19:51:58 +08:00
Ilya Dryomov
1f07820579 qa/run_xfstests_qemu.sh: fall back to ide disks if needed
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-22 12:32:02 +01:00
Ronen Friedman
a007b29859 osd/scrub: change missing_digest fix-list type
...allowing for efficient creation and, more important,
direct consumption by the function performing the
actual I/O.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-22 10:37:06 +00:00
Ronen Friedman
d3283fdf2c osd/scrub: scrub components embedded documentation
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-22 10:37:05 +00:00
Ronen Friedman
2a3483f7d3 osd/scrub: add to PgScrubber a local ref to next-scrub's details
The owner is still the PG.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

osd/scrub: removing PgScrubber's ref to the primary scrub map

as caching this reference (to an object that is owned by the
scrubber backend) creates a dangling-pointer risk.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-22 10:37:05 +00:00
Ilya Dryomov
e1793ebbf0
Merge pull request #44669 from idryomov/wip-rbd-switch-arguments-fix
rbd: add missing switch arguments for recognition by get_command_spec()

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-01-22 10:37:20 +01:00
Ronen Friedman
7b1c239ccf osd/scrub: minor fixes split from main "scrub backend" commit
Reformatting, minor compiler warnings, etc.
Split from "osd/scrub: extract scrub backend code into separate classes"

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-22 08:59:59 +00:00
Ronen Friedman
1fdf23b4bc osd/scrub: extract scrub backend code into separate classes
A refactoring of the scrub backend code (all Scrub related code
that checks/manipulates objects' (meta)data).

Part of the refactoring was breaking long chunks of code into
separate functions. In order to avoid passing endless lists
of state parameters from/to these new methods, the scrub backend
state is now maintained within its own objects.

a change to note:
Instead of two scrub-map collections - one that holds all
incoming maps, and one that holds pointers to all of those incoming
plus the one we (the Primary) manage - just use one collection
for both incoming and our own.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

Split from "osd/scrub: minor fixes split from main "scrub backend" commit"

Split from "osd/scrub: scrub components embedded documentation"

fix

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

osd/scrub: fix the scrubber backend to include all PR #42735

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-01-22 08:59:59 +00:00
Kefu Chai
67ee1fba6c
Merge pull request #44736 from adamemerson/wip-no-using-namespace-std
src: Remove some 'using namespace std' lines that crept back into headers

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-01-22 14:30:38 +08:00
Adam C. Emerson
636ea2382e neorados: Remove using namespace std::literals from header
We don't actually need it.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-01-21 22:28:45 -05:00
Adam C. Emerson
0878150f8b mgr: Remove straggling using namespace std from headers
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-01-21 22:28:35 -05:00
Adam C. Emerson
ae07ccb152 test: Remove straggling using namespace std from headers
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-01-21 22:28:28 -05:00
Adam C. Emerson
6bb7dce6a5 {osd,crimson}: Remove straggling using namespace std from headers
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-01-21 22:28:28 -05:00
Adam C. Emerson
3c02841a56 rgw: Remove straggling using namespace std from headers
A few crept back in.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-01-21 22:28:18 -05:00
Adam C. Emerson
f8b9d3f52b cleanup: Change incorrect modelines
Change C modelines to C++ for C++ files.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-01-21 22:27:36 -05:00
zdover23
dd917a54bc
Merge pull request #44734 from anthonyeleven/anthonyeleven/cephfs-pool-recs
doc/cephfs: Clarify CephFS pool guidance

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-01-22 12:35:04 +10:00
Kefu Chai
4ff206fc1f
Merge pull request #44509 from rzarzynski/wip-crimson-alienstore-drop-constant
crimson/alienstore: drop unused constant from AlienStore.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-01-22 08:41:01 +08:00
Neha Ojha
427d9c0407
Merge pull request #44646 from neha-ojha/wip-backport-q
script: backport updates for quincy

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-01-21 15:04:41 -08:00
Igor Fedotov
87a30bdb73
Merge pull request #44265 from KellenRenshaw/WIP-replay_alloc
test/allocator_replay_test: Add replay_alloc option

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2022-01-21 23:52:32 +03:00
Ilya Dryomov
4583c63dba
Merge pull request #44705 from ceph/wip-yuriw-build-script
script/build-integration-branch: add quincy to the list of releases

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-21 21:43:27 +01:00
Anthony D'Atri
822cc71b56 doc/cephfs: Clarify CephFS pool guidance
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-01-21 12:28:05 -08:00
Adam C. Emerson
485d85cd3e
Merge pull request #44674 from adamemerson/wip-53941
rgw: Report empty endpoints as error instead of crashing

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2022-01-21 15:14:42 -05:00
Neha Ojha
87a490d7b0
Merge pull request #44706 from rzarzynski/wip-tests-bl-fix-rebuild
test/bufferlist: ensure rebuild_aligned_size_and_memory() always rebuilds.

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-21 11:22:07 -08:00
Casey Bodley
a9b3e2f801
Merge pull request #44717 from zdover23/wip-doc-2021-01-22-man-page-radosgw-admin-missing-apostrophe
doc/man: radosgw-admin.rst: missing apostrophe

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-21 13:22:44 -05:00
Zac Dover
9f65f42d9e doc/man: radosgw-admin.rst: missing apostrophe
This commit adds two missing apostrophes to two
different strings.

Hat tip to IcePic.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-01-22 02:57:28 +10:00
Ali Maredia
262286776d
Merge pull request #44694 from alimaredia/wip-rgw-kmip-teuthology-test
qa: move certificates for kmip task into /etc/ceph

Reviewed-by: Al Maredia <amaredia@redhat.com>
2022-01-21 11:56:45 -05:00
Ilya Dryomov
303d3ede48 test/rbd_mirror: drop redundant MockJournaler instances
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-21 17:32:40 +01:00
Ilya Dryomov
d634a1df5b rbd-mirror: fix races in snapshot-based mirroring deletion propagation
When remote image is deleted, rbd-mirror can encounter three cases:

  1) no remote image id
  2) no remote mirror metadata
  3) MIRROR_IMAGE_STATE_DISABLING in remote mirror metadata

Commit d4c66ac5c6 ("rbd-mirror: fix issue with snapshot-based
mirroring deletion propagation") fixed case 1.  Cases 2 and 3 remained
broken because for both of them finalize_snapshot_state_builder() would
populate not only remote_mirror_peer_uuid but also remote_image_id,
thus disabling ENOLINK logic in handle_prepare_remote_image() and
handle_bootstrap().  Commit ff60aec2d9 ("rbd-mirror: fix bootstrap
sequence while the image is removed") touched on case 3, but it made
a difference only for journal-based mirroring.

Stop calling finalize_snapshot_state_builder() on errors.  Instead,
align with journal-based mirroring by filling remote_mirror_peer_uuid
together with remote_mirror_uuid.

Fixes: https://tracker.ceph.com/issues/53963
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-21 17:32:36 +01:00
Pete Zaitcev
06e1ef35a8
Merge pull request #44112 from zaitcev/wip-py_ssize_t_clean
mgr: Define PY_SSIZE_T_CLEAN ahead of every Python.h
2022-01-21 09:05:16 -06:00
Ilya Dryomov
ccfbf3e97e rbd-mirror: don't default replay_requires_remote_image() implementation
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-21 14:31:07 +01:00
Ilya Dryomov
f49fa483ec rbd-mirror: untangle StateBuilder::is_linked() overloads
Make it clear that the local image non-primariness is asserted
independent of the mode; avoid the default implementation being
overridden but still relied on by both modes.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-21 14:31:07 +01:00
Ilya Dryomov
baf57925ab rbd-mirror: drop redundant initialization of StateBuilder members
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-21 14:31:07 +01:00
Guillaume Abrioux
f23e1ba25f
Merge pull request #44604 from mgfritch/c-v-skip-rbd-devs
ceph-volume: show RBD devices as not available
2022-01-21 13:37:25 +01:00