Commit Graph

131691 Commits

Author SHA1 Message Date
Kotresh HR
9e1b7ed39e mgr/volumes: Add subvolumegroup info cmd
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
06a869cb8a mgr/volumes: Support subvolumegroup quota
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Venky Shankar
2ab2777722
Merge pull request #46165 from rishabh-d-dave/qa-omit-sudo
qa/cephfs: set omit_sudo False when sudo is set to True

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-06-06 11:23:11 +05:30
Venky Shankar
86b8df6756
Merge pull request #46168 from rishabh-d-dave/fix-caps-helper
qa/cephfs: fix minor bug in caps_helper.py's run_mon_cap_tests()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-06 11:20:58 +05:30
Venky Shankar
9440f79d72
Merge pull request #40434 from rishabh-d-dave/fs-refactor-method-in-mount
qa/cephfs: modify get_key_from_keyfile() in mount.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-06-06 11:19:54 +05:30
Kefu Chai
f93edc4b0a
Merge pull request #46522 from tchaikov/wip-crimson-logging
crimson/osd: reset logger before exit

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-06-06 08:30:46 +08:00
Kefu Chai
6726fe7304
Merge pull request #46416 from tchaikov/wip-debian-dh-python3
debian: python3 related cleanups

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-05 21:44:41 +08:00
Kefu Chai
66c923d703 crimson/osd: reset logger before exit
* extract the code to set logging fstream into a dedicated function
* do not reset logging until the end of the seastar application.

before this change, `reset_logger` is created in the
`if (auto log_file = local_conf()->log_file; !log_file.empty())` branch,
so its life cycle ends when the `if` block ends. in other words,
the cerr fstream is used for logging after the `if` block ends.
this is not the expected behavior.

after this changge, `reset_logger` is created out of the `if` block.
so we won't reset the logger back to `cerr` until the lambda passed to
`seastar::async()` exits.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-06-05 18:36:03 +08:00
Neha Ojha
2a2340d9d1
Merge pull request #46483 from yaarith/rook-telemetry
mgr/telemetry: add Rook data

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-06-03 13:12:48 -07:00
Samuel Just
97f5519c10
Merge pull request #46417 from xxhdx1985126/wip-gc-parallel-live_extent_retrieval
crimson/os/seastore/segment_cleaner: parallel live extents retrieval

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-06-03 12:06:35 -07:00
Adam King
5336ce8327
Merge pull request #46480 from cfsnyder/wip-cfsnyder-device-classes-in-service-spec
python-common: allow crush device class to be set from osd service spec

Reviewed-by: Adam King <adking@redhat.com>
2022-06-03 11:46:54 -04:00
Xuehan Xu
5da91238c3 test/crimson/seastore: add test case for parallel extent retrieval
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-06-03 20:51:58 +08:00
Xuehan Xu
89b904f7c8 crimson/os/seastore/cache: make access to Transaction::read_set atomic
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-06-03 20:51:52 +08:00
Ernesto Puerta
8a5394cf10
Merge pull request #46505 from rhcs-dashboard/fix-backports_main-main
script/ceph-backport.sh: deal with main branch

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: nmshelke <NOT@FOUND>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-06-03 14:02:55 +02:00
Ernesto Puerta
e5d773facd
Merge pull request #46186 from rhcs-dashboard/add-daemon-logs
mgr/dashboard: Add daemon logs tab to Logs component

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2022-06-03 12:09:56 +02:00
Ernesto Puerta
fc29791eec
Merge pull request #46283 from MrFreezeex/mixin-config
ceph-mixin: fix linting issue and add cluster template support

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-06-03 12:05:58 +02:00
Ilya Dryomov
b6ea8b3a35
Merge pull request #46454 from idryomov/wip-rbd-unlink-newest-snap-at-capacity
librbd: unlink newest mirror snapshot when at capacity, bump capacity

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-06-03 11:51:41 +02:00
Ilya Dryomov
4d956d1e4a
Merge pull request #46434 from idryomov/wip-rbd-preserve-non-primary-snap
rbd-mirror: don't prune non-primary snapshot when restarting delta sync

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-06-03 11:50:41 +02:00
Rishabh Dave
f58bcac7cb qa/cephfs: modify get_key_from_keyfile() in mount.py
CephFSMount.get_key_from_keyfile() should raise an exception instead of
returning None if key is not found in keyring file.

Fixes: https://tracker.ceph.com/issues/50010
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-06-03 09:40:28 +05:30
Adam King
80de4f102b
Merge pull request #46411 from pcuzner/add-serial-numbers
cephadm: Add server serial info to gather-facts

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 19:01:01 -04:00
Adam King
acc573c701
Merge pull request #46444 from rkachach/fix_issue_55800
mgr/cephadm: check if a service exists before trying to restart it

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-06-02 19:00:17 -04:00
Adam King
a0486d6b4c
Merge pull request #46445 from rkachach/fix_issue_55801
mgr/cephadm: capture exception when not able to list upgrade tags

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 18:59:02 -04:00
Adam King
45cd4f9c8a
Merge pull request #46481 from guits/cephadm-custom-names-osd-adoption
cephadm: fix osd adoption with custom cluster name

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 18:58:24 -04:00
Casey Bodley
63f84c50e0
Merge pull request #39002 from ceph/wip-rgw-multisite-reshard
rgw multisite: bucket reshard work in progress

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-02 16:04:30 -04:00
Ernesto Puerta
5e10cf0f61
Merge pull request #45470 from ceph/wip-setx
run-backend-api-tests.sh: set -x for Jenkins job debugging

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 19:22:59 +02:00
Yuval Lifshitz
042f3c7978
Merge pull request #44684 from zenomri/wip-omri-tracing-compiled
tracer: set tracing compiled in by default
2022-06-02 20:22:17 +03:00
Ernesto Puerta
3de96757c0
script/ceph-backport.sh: deal with main branch
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 19:14:03 +02:00
Anthony D'Atri
766c5d3590
Merge pull request #43216 from k0ste/fix_47537
doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces
2022-06-02 08:41:25 -07:00
Cory Snyder
c2f314ab8c python-common: allow crush device class to be set from osd service spec
Adds crush_device_class parameter to DriveGroupSpec so that device class
can be set via service specs with cephadm.

Fixes: https://tracker.ceph.com/issues/55813
Signed-off-by: Cory Snyder <csnyder@iland.com>
2022-06-02 10:59:53 -04:00
Casey Bodley
92c46b782a
Merge pull request #46019 from yushu20171007/fix_issue_55422
common: notify all when max backlog reached in OutputDataSocket

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-02 10:47:22 -04:00
Ernesto Puerta
14541a8900
Merge pull request #46501 from rhcs-dashboard/fix-55826-master
qa: fix teuthology master branch ref

Reviewed-by: amathuria <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2022-06-02 14:13:26 +02:00
Ernesto Puerta
e91773df68
qa: fix teuthology master branch ref
Fixes: https://tracker.ceph.com/issues/55826
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 12:27:02 +02:00
Konstantin Shalygin
4512270736 doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces
Fixes: https://tracker.ceph.com/issues/47537

Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2022-06-02 14:23:38 +07:00
Adam King
832457a4ac
Merge pull request #46272 from sshambar/bug-55664
cephadm: preserve cephadm user during RPM upgrade

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-06-01 17:44:54 -04:00
David Galloway
539194afee
Merge pull request #46488 from jtlayton/teuth-branch-fix
qa: remove .teuthology_branch file
2022-06-01 15:17:03 -04:00
Jeff Layton
81430de9b7 qa: remove .teuthology_branch file
This was originally added to help support the py2 -> py3 conversion.
That's long since complete so we should be able to just remove this file
now.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:26:33 -04:00
David Galloway
be98b0d4c4
Merge pull request #46487 from jtlayton/teuth-branch-fix
qa: fix .teuthology_branch file in qa/
2022-06-01 14:18:00 -04:00
Casey Bodley
8e51eb8c05 test/rgw/multisite: enable zonegroup resharding feature
qa/tasks/rgw_multisite.py uses 'zonegroup set' to create zonegroups from
their json format. this doesn't enable any of the supported zonegroup
features by default, so this adds the 'enabled_features' field to the
json representations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-01 14:10:26 -04:00
Jeff Layton
b5dd80883e qa: fix .teuthology_branch file in qa/
According to teuthology-suite:

  -t <branch>, --teuthology-branch <branch>
                              The teuthology branch to run against.
                              Default value is determined in the next order.
                              There is TEUTH_BRANCH environment variable set.
                              There is `qa/.teuthology_branch` present in
                              the suite repo and contains non-empty string.
                              There is `teuthology_branch` present in one of
                              the user or system `teuthology.yaml` configuration
                              files respectively, otherwise use `main`.

The .teuthology_branch file in the qa/ dir currently points at "master".
Change it to point to "main".

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:04:39 -04:00
Guillaume Abrioux
e720a658d6 cephadm: fix osd adoption with custom cluster name
When adopting Ceph OSD containers from a Ceph cluster with a custom name, it fails
because the name isn't propagated in unit.run.
The idea here is to change the lvm metadata and enforce 'ceph.cluster_name=ceph'
given that cephadm doesn't support custom names anyway.

Fixes: https://tracker.ceph.com/issues/55654

Signed-off-by: Adam King <adking@redhat.com>
Co-authored-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-06-01 18:48:46 +02:00
Ilya Dryomov
04567650ca
Merge pull request #46474 from idryomov/wip-rbd-codeowners
CODEOWNERS: add RBD team

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-06-01 18:29:38 +02:00
Ilya Dryomov
00a44f1c6b CODEOWNERS: add RBD team
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-06-01 13:37:21 +02:00
Xuehan Xu
bf2213f89d crimson/os/seastore/segment_cleaner: retrieve different live extents in parallel
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-06-01 16:28:58 +08:00
Redouane Kachach
0e7a4366c0
mgr/cephadm: capture exception when not able to list upgrade tags
Fixes: https://tracker.ceph.com/issues/55801

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-06-01 10:19:38 +02:00
Yaarit Hatuka
63f5dcdb52 mgr/telemetry: add Rook data
Add the first Rook data collection to telemetry's basic channel.

We choose to nag with this collection since we wish to know the volume
of Rook deployments in the wild.

The next Rook collections should have consecutive numbers (basic_rook_v02,
basic_rook_v03, ...).

See tracker below for more details.

Fixes: https://tracker.ceph.com/issues/55740
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-06-01 04:46:17 +00:00
Samuel Just
9e3d8521cf
Merge pull request #46382 from rzarzynski/wip-crimson-op-tracking-3
crimson/osd: add support for historic & slow op tracking

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-31 16:48:52 -07:00
Samuel Just
8e2719d7d7
Merge pull request #46437 from cyx1231st/wip-seastore-tune-and-fixes
crimson/os/seastore/segment_cleaner: tune and fixes around reclaiming

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-31 16:37:11 -07:00
Laura Flores
19f6446e98
Merge pull request #46193 from ljflores/wip-zero-detection-off-by-default
os/bluestore: turn bluestore zero block detection off by default
2022-05-31 16:55:51 -05:00
Casey Bodley
bed7051383 rgw: restore check for empty olh name on reshard
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-31 17:29:59 -04:00
Casey Bodley
47913cb7f1 test/rgw: fix test case for empty-OLH-name cleanup
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-31 17:29:18 -04:00