Commit Graph

131653 Commits

Author SHA1 Message Date
Ilya Dryomov
4d956d1e4a
Merge pull request #46434 from idryomov/wip-rbd-preserve-non-primary-snap
rbd-mirror: don't prune non-primary snapshot when restarting delta sync

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-06-03 11:50:41 +02:00
Adam King
80de4f102b
Merge pull request #46411 from pcuzner/add-serial-numbers
cephadm: Add server serial info to gather-facts

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 19:01:01 -04:00
Adam King
acc573c701
Merge pull request #46444 from rkachach/fix_issue_55800
mgr/cephadm: check if a service exists before trying to restart it

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-06-02 19:00:17 -04:00
Adam King
a0486d6b4c
Merge pull request #46445 from rkachach/fix_issue_55801
mgr/cephadm: capture exception when not able to list upgrade tags

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 18:59:02 -04:00
Adam King
45cd4f9c8a
Merge pull request #46481 from guits/cephadm-custom-names-osd-adoption
cephadm: fix osd adoption with custom cluster name

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 18:58:24 -04:00
Casey Bodley
63f84c50e0
Merge pull request #39002 from ceph/wip-rgw-multisite-reshard
rgw multisite: bucket reshard work in progress

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-02 16:04:30 -04:00
Ernesto Puerta
5e10cf0f61
Merge pull request #45470 from ceph/wip-setx
run-backend-api-tests.sh: set -x for Jenkins job debugging

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 19:22:59 +02:00
Yuval Lifshitz
042f3c7978
Merge pull request #44684 from zenomri/wip-omri-tracing-compiled
tracer: set tracing compiled in by default
2022-06-02 20:22:17 +03:00
Anthony D'Atri
766c5d3590
Merge pull request #43216 from k0ste/fix_47537
doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces
2022-06-02 08:41:25 -07:00
Casey Bodley
92c46b782a
Merge pull request #46019 from yushu20171007/fix_issue_55422
common: notify all when max backlog reached in OutputDataSocket

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-02 10:47:22 -04:00
Ernesto Puerta
14541a8900
Merge pull request #46501 from rhcs-dashboard/fix-55826-master
qa: fix teuthology master branch ref

Reviewed-by: amathuria <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2022-06-02 14:13:26 +02:00
Ernesto Puerta
e91773df68
qa: fix teuthology master branch ref
Fixes: https://tracker.ceph.com/issues/55826
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 12:27:02 +02:00
Konstantin Shalygin
4512270736 doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces
Fixes: https://tracker.ceph.com/issues/47537

Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2022-06-02 14:23:38 +07:00
Adam King
832457a4ac
Merge pull request #46272 from sshambar/bug-55664
cephadm: preserve cephadm user during RPM upgrade

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-06-01 17:44:54 -04:00
David Galloway
539194afee
Merge pull request #46488 from jtlayton/teuth-branch-fix
qa: remove .teuthology_branch file
2022-06-01 15:17:03 -04:00
Jeff Layton
81430de9b7 qa: remove .teuthology_branch file
This was originally added to help support the py2 -> py3 conversion.
That's long since complete so we should be able to just remove this file
now.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:26:33 -04:00
David Galloway
be98b0d4c4
Merge pull request #46487 from jtlayton/teuth-branch-fix
qa: fix .teuthology_branch file in qa/
2022-06-01 14:18:00 -04:00
Casey Bodley
8e51eb8c05 test/rgw/multisite: enable zonegroup resharding feature
qa/tasks/rgw_multisite.py uses 'zonegroup set' to create zonegroups from
their json format. this doesn't enable any of the supported zonegroup
features by default, so this adds the 'enabled_features' field to the
json representations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-01 14:10:26 -04:00
Jeff Layton
b5dd80883e qa: fix .teuthology_branch file in qa/
According to teuthology-suite:

  -t <branch>, --teuthology-branch <branch>
                              The teuthology branch to run against.
                              Default value is determined in the next order.
                              There is TEUTH_BRANCH environment variable set.
                              There is `qa/.teuthology_branch` present in
                              the suite repo and contains non-empty string.
                              There is `teuthology_branch` present in one of
                              the user or system `teuthology.yaml` configuration
                              files respectively, otherwise use `main`.

The .teuthology_branch file in the qa/ dir currently points at "master".
Change it to point to "main".

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:04:39 -04:00
Guillaume Abrioux
e720a658d6 cephadm: fix osd adoption with custom cluster name
When adopting Ceph OSD containers from a Ceph cluster with a custom name, it fails
because the name isn't propagated in unit.run.
The idea here is to change the lvm metadata and enforce 'ceph.cluster_name=ceph'
given that cephadm doesn't support custom names anyway.

Fixes: https://tracker.ceph.com/issues/55654

Signed-off-by: Adam King <adking@redhat.com>
Co-authored-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-06-01 18:48:46 +02:00
Ilya Dryomov
04567650ca
Merge pull request #46474 from idryomov/wip-rbd-codeowners
CODEOWNERS: add RBD team

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-06-01 18:29:38 +02:00
Ilya Dryomov
00a44f1c6b CODEOWNERS: add RBD team
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-06-01 13:37:21 +02:00
Redouane Kachach
0e7a4366c0
mgr/cephadm: capture exception when not able to list upgrade tags
Fixes: https://tracker.ceph.com/issues/55801

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-06-01 10:19:38 +02:00
Samuel Just
9e3d8521cf
Merge pull request #46382 from rzarzynski/wip-crimson-op-tracking-3
crimson/osd: add support for historic & slow op tracking

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-31 16:48:52 -07:00
Samuel Just
8e2719d7d7
Merge pull request #46437 from cyx1231st/wip-seastore-tune-and-fixes
crimson/os/seastore/segment_cleaner: tune and fixes around reclaiming

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-31 16:37:11 -07:00
Laura Flores
19f6446e98
Merge pull request #46193 from ljflores/wip-zero-detection-off-by-default
os/bluestore: turn bluestore zero block detection off by default
2022-05-31 16:55:51 -05:00
Casey Bodley
bed7051383 rgw: restore check for empty olh name on reshard
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-31 17:29:59 -04:00
Casey Bodley
47913cb7f1 test/rgw: fix test case for empty-OLH-name cleanup
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-31 17:29:18 -04:00
Soumya Koduri
52f341b00a
Merge pull request #46367 from 0xavi0/dbstore-default-dbdir-rgw-data
rgw/dbstore: change default value of dbstore_db_dir to /var/lib/ceph/radosgw

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2022-05-31 21:27:28 +05:30
Casey Bodley
266da4a919
Merge pull request #46395 from cbodley/wip-backport-create-issue-assigned-to
backport-create-issue: copy 'Assignee' of original issue to backports

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-05-31 11:17:12 -04:00
Neha Ojha
914c99da13
Merge pull request #46415 from neha-ojha/wip-cw-core
.github/CODEOWNERS: tag core devs on core PRs

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-05-31 07:16:18 -07:00
Redouane Kachach
6b76753c3c
mgr/cephadm: check if a service exists before trying to restart it
Fixes: https://tracker.ceph.com/issues/55800

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-05-31 12:11:03 +02:00
zdover23
b4376cfe57
Merge pull request #46430 from zdover23/wip-doc-2022-05-30-hw-recs-memory-section
doc/start: update "memory" in hardware-recs.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-05-31 17:07:40 +10:00
0xavi0
895ee7921c
rgw/dbstore: change default value of dbstore_db_dir to /var/lib/ceph/radosgw
Changes a few NULL to nullptr.

Adds std::filesystem for path building so they're platform independant.

Fixes a bug for DBStoreManager's second constructor not creating the DB.

Adds unit tests to test DB path and prefix.

Fixes: https://tracker.ceph.com/issues/55731

Signed-off-by: 0xavi0 <xavi.garcia@suse.com>
2022-05-31 09:01:56 +02:00
Zac Dover
429bbdea65 doc/start: update "memory" in hardware-recs.rst
This PR corrects some usage errors in the "Memory" section
of the hardware-recommendations.rst file. It also closes
some opened but never closed parentheses.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-05-31 15:51:23 +10:00
Venky Shankar
2e4a777242
Merge pull request #46086 from nmshelke/feature-55401
mgr/volumes: set, get, list and remove metadata of snapshot

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-31 10:30:56 +05:30
Yingxin Cheng
377ef0e2b8 crimson/os/seastore/segment_cleaner: add info logs to reveal trim activities
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-31 12:23:01 +08:00
Yingxin Cheng
bb0e35bf54 crimson/os/seastore/transaction_manager: set to test mode under debug build
* force to test mode under debug build.
* make reclaim to happen and validated as early as possible.
* do not block user transaction when reclaim-ratio (unalive/unavailable)
  is high, especially in the beginning.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-31 12:23:01 +08:00
Yingxin Cheng
ba1227e547 crimson/os/seastore/segment_cleaner: cleanup reclaim logic
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-31 12:22:09 +08:00
Yingxin Cheng
a3afe706bc crimson/os/seastore/seastore_types: include backref as physical extents
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-31 10:51:03 +08:00
Yingxin Cheng
21306e492c crimson/os/seastore/cache: assert dirty
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-31 10:51:03 +08:00
Yingxin Cheng
bbfa540da8 crimson/os/seastore: cleanup rewrite_extent()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-31 10:51:03 +08:00
Yingxin Cheng
b584e6a6d1 crimson/os/seastore/segment_cleaner: delay reclaim until near full
It should be generically better to delay reclaim as much as possible, so
that:
* unalive/unavailable can higher to reduce reclaim efforts;
* less conflicts between mutate and reclaim transactions;

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-31 10:51:03 +08:00
Samuel Just
03d805c7ec
Merge pull request #46296 from ceph/wip-nitzan-osd-log-to-correct-sufix
crimson/osd: logger into log_file

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-30 16:37:41 -07:00
Samuel Just
7cfe74d266
Merge pull request #46388 from rzarzynski/wip-crimson-reindent-main-trace
crimson/osd: reindent the trace-related fragment of main()

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-30 16:33:25 -07:00
Ilya Dryomov
3ba82f2aa7 rbd-mirror: don't prune non-primary snapshot when restarting delta sync
When restarting interrupted sync (signified by the "end" non-primary
snapshot with last_copied_object_number > 0), preserve the "start"
non-primary snapshot until the sync is completed, like it would have
been done had the sync not been interrupted.  This ensures that the
same m_local_snap_id_start is passed to scan_remote_mirror_snapshots()
and ultimately ImageCopyRequest state machine on restart as on initial
start.

This ends up being yet another fixup for 281af0de86 ("rbd-mirror:
prune unnecessary non-primary mirror snapshots"), following earlier
7ba9214ea5 ("rbd-mirror: don't prune older mirror snapshots when
pruning incomplete snapshot") and ecd3778a6f ("rbd-mirror: ensure
that the last non-primary snapshot cannot be pruned").

Fixes: https://tracker.ceph.com/issues/55796
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-05-30 21:57:14 +02:00
Ilya Dryomov
8ddce107d0 cls/rbd: fix operator<< for MirrorSnapshotNamespace
Commit 50702eece0 ("cls/rbd: added clean_since_snap_id to
MirrorSnapshotNamespace") updated dump() but missed operator<<
overload.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-05-30 21:57:14 +02:00
Ronen Friedman
2469ae8b31
Merge pull request #46320 from ronen-fr/wip-rf-snaps-onerr
osd/scrub: restart snap trimming after a failed scrub

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-05-30 20:36:41 +03:00
Radosław Zarzyński
98064037f9 crimson/osd: add support for slowest historic op tracking
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2022-05-30 16:37:19 +02:00
Radosław Zarzyński
ff5757c7d1 crimson/osd: make OSDOperationRegistry responsible for historic ops
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2022-05-30 16:37:19 +02:00