Commit Graph

131699 Commits

Author SHA1 Message Date
Kotresh HR
e9fe37b8e1 qa: Add subvolume removal tests when it's group quota exceeds
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
12e003f980 qa: Add tests for subvolumegroup idempotence creation
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
c006181803 qa: Add tests for subvolume removal on group quota set
Validates the subvolume removal is successful if the
corresponding group's quota is set.

Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
dbe8cf1792 qa: Add tests for subvolumegroup resize
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
085700bf19 qa: Add subvolume group quota tests
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
3cfcbef284 mgr/volumes: Disable quota for mgr libcephfs connection
This is done to give 'mgr' libcephfs connection right to bypass
quota. The mgr/volumes plugin maintains configuration files
with in the directory where the user has enforced quota. So
when the quota is met, certain mgr/volumes apis don't work as
intended. e.g., When subvolumegroup quota is met, the group's
subvolume removal with '--retain-snapshots' fails.

Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
f365a9a5fe client: Makes quota optional
Make quota optional. This commit basically reverts the
commit da9f1d8294

This is done to give 'mgr' libcephfs connection right to bypass
quota. The mgr/volumes plugin maintains configuration files
with in the directory where the user has enforced quota. So
when the quota is met, certain mgr/volumes apis don't work as
intended. e.g., When subvolumegroup quota is met, the group's
subvolume removal with '--retain-snapshots' fails.

Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
346964a89c mgr/volumes: Add subvolumegroup resize cmd
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
9e1b7ed39e mgr/volumes: Add subvolumegroup info cmd
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
06a869cb8a mgr/volumes: Support subvolumegroup quota
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Venky Shankar
2ab2777722
Merge pull request #46165 from rishabh-d-dave/qa-omit-sudo
qa/cephfs: set omit_sudo False when sudo is set to True

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-06-06 11:23:11 +05:30
Venky Shankar
86b8df6756
Merge pull request #46168 from rishabh-d-dave/fix-caps-helper
qa/cephfs: fix minor bug in caps_helper.py's run_mon_cap_tests()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-06 11:20:58 +05:30
Venky Shankar
9440f79d72
Merge pull request #40434 from rishabh-d-dave/fs-refactor-method-in-mount
qa/cephfs: modify get_key_from_keyfile() in mount.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-06-06 11:19:54 +05:30
Kefu Chai
f93edc4b0a
Merge pull request #46522 from tchaikov/wip-crimson-logging
crimson/osd: reset logger before exit

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-06-06 08:30:46 +08:00
Kefu Chai
6726fe7304
Merge pull request #46416 from tchaikov/wip-debian-dh-python3
debian: python3 related cleanups

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-05 21:44:41 +08:00
Kefu Chai
66c923d703 crimson/osd: reset logger before exit
* extract the code to set logging fstream into a dedicated function
* do not reset logging until the end of the seastar application.

before this change, `reset_logger` is created in the
`if (auto log_file = local_conf()->log_file; !log_file.empty())` branch,
so its life cycle ends when the `if` block ends. in other words,
the cerr fstream is used for logging after the `if` block ends.
this is not the expected behavior.

after this changge, `reset_logger` is created out of the `if` block.
so we won't reset the logger back to `cerr` until the lambda passed to
`seastar::async()` exits.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-06-05 18:36:03 +08:00
Neha Ojha
2a2340d9d1
Merge pull request #46483 from yaarith/rook-telemetry
mgr/telemetry: add Rook data

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-06-03 13:12:48 -07:00
Samuel Just
97f5519c10
Merge pull request #46417 from xxhdx1985126/wip-gc-parallel-live_extent_retrieval
crimson/os/seastore/segment_cleaner: parallel live extents retrieval

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-06-03 12:06:35 -07:00
Adam King
5336ce8327
Merge pull request #46480 from cfsnyder/wip-cfsnyder-device-classes-in-service-spec
python-common: allow crush device class to be set from osd service spec

Reviewed-by: Adam King <adking@redhat.com>
2022-06-03 11:46:54 -04:00
Xuehan Xu
5da91238c3 test/crimson/seastore: add test case for parallel extent retrieval
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-06-03 20:51:58 +08:00
Xuehan Xu
89b904f7c8 crimson/os/seastore/cache: make access to Transaction::read_set atomic
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-06-03 20:51:52 +08:00
Ernesto Puerta
8a5394cf10
Merge pull request #46505 from rhcs-dashboard/fix-backports_main-main
script/ceph-backport.sh: deal with main branch

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: nmshelke <NOT@FOUND>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-06-03 14:02:55 +02:00
Ernesto Puerta
e5d773facd
Merge pull request #46186 from rhcs-dashboard/add-daemon-logs
mgr/dashboard: Add daemon logs tab to Logs component

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2022-06-03 12:09:56 +02:00
Ernesto Puerta
fc29791eec
Merge pull request #46283 from MrFreezeex/mixin-config
ceph-mixin: fix linting issue and add cluster template support

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-06-03 12:05:58 +02:00
Ilya Dryomov
b6ea8b3a35
Merge pull request #46454 from idryomov/wip-rbd-unlink-newest-snap-at-capacity
librbd: unlink newest mirror snapshot when at capacity, bump capacity

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-06-03 11:51:41 +02:00
Ilya Dryomov
4d956d1e4a
Merge pull request #46434 from idryomov/wip-rbd-preserve-non-primary-snap
rbd-mirror: don't prune non-primary snapshot when restarting delta sync

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-06-03 11:50:41 +02:00
Rishabh Dave
f58bcac7cb qa/cephfs: modify get_key_from_keyfile() in mount.py
CephFSMount.get_key_from_keyfile() should raise an exception instead of
returning None if key is not found in keyring file.

Fixes: https://tracker.ceph.com/issues/50010
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-06-03 09:40:28 +05:30
Adam King
80de4f102b
Merge pull request #46411 from pcuzner/add-serial-numbers
cephadm: Add server serial info to gather-facts

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 19:01:01 -04:00
Adam King
acc573c701
Merge pull request #46444 from rkachach/fix_issue_55800
mgr/cephadm: check if a service exists before trying to restart it

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-06-02 19:00:17 -04:00
Adam King
a0486d6b4c
Merge pull request #46445 from rkachach/fix_issue_55801
mgr/cephadm: capture exception when not able to list upgrade tags

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 18:59:02 -04:00
Adam King
45cd4f9c8a
Merge pull request #46481 from guits/cephadm-custom-names-osd-adoption
cephadm: fix osd adoption with custom cluster name

Reviewed-by: Adam King <adking@redhat.com>
2022-06-02 18:58:24 -04:00
Casey Bodley
63f84c50e0
Merge pull request #39002 from ceph/wip-rgw-multisite-reshard
rgw multisite: bucket reshard work in progress

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-02 16:04:30 -04:00
Ernesto Puerta
5e10cf0f61
Merge pull request #45470 from ceph/wip-setx
run-backend-api-tests.sh: set -x for Jenkins job debugging

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 19:22:59 +02:00
Yuval Lifshitz
042f3c7978
Merge pull request #44684 from zenomri/wip-omri-tracing-compiled
tracer: set tracing compiled in by default
2022-06-02 20:22:17 +03:00
Ernesto Puerta
3de96757c0
script/ceph-backport.sh: deal with main branch
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 19:14:03 +02:00
Anthony D'Atri
766c5d3590
Merge pull request #43216 from k0ste/fix_47537
doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces
2022-06-02 08:41:25 -07:00
Cory Snyder
c2f314ab8c python-common: allow crush device class to be set from osd service spec
Adds crush_device_class parameter to DriveGroupSpec so that device class
can be set via service specs with cephadm.

Fixes: https://tracker.ceph.com/issues/55813
Signed-off-by: Cory Snyder <csnyder@iland.com>
2022-06-02 10:59:53 -04:00
Casey Bodley
92c46b782a
Merge pull request #46019 from yushu20171007/fix_issue_55422
common: notify all when max backlog reached in OutputDataSocket

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-02 10:47:22 -04:00
Ernesto Puerta
14541a8900
Merge pull request #46501 from rhcs-dashboard/fix-55826-master
qa: fix teuthology master branch ref

Reviewed-by: amathuria <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2022-06-02 14:13:26 +02:00
Ernesto Puerta
e91773df68
qa: fix teuthology master branch ref
Fixes: https://tracker.ceph.com/issues/55826
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 12:27:02 +02:00
Konstantin Shalygin
4512270736 doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces
Fixes: https://tracker.ceph.com/issues/47537

Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
2022-06-02 14:23:38 +07:00
Adam King
832457a4ac
Merge pull request #46272 from sshambar/bug-55664
cephadm: preserve cephadm user during RPM upgrade

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-06-01 17:44:54 -04:00
David Galloway
539194afee
Merge pull request #46488 from jtlayton/teuth-branch-fix
qa: remove .teuthology_branch file
2022-06-01 15:17:03 -04:00
Jeff Layton
81430de9b7 qa: remove .teuthology_branch file
This was originally added to help support the py2 -> py3 conversion.
That's long since complete so we should be able to just remove this file
now.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:26:33 -04:00
David Galloway
be98b0d4c4
Merge pull request #46487 from jtlayton/teuth-branch-fix
qa: fix .teuthology_branch file in qa/
2022-06-01 14:18:00 -04:00
Casey Bodley
8e51eb8c05 test/rgw/multisite: enable zonegroup resharding feature
qa/tasks/rgw_multisite.py uses 'zonegroup set' to create zonegroups from
their json format. this doesn't enable any of the supported zonegroup
features by default, so this adds the 'enabled_features' field to the
json representations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-01 14:10:26 -04:00
Jeff Layton
b5dd80883e qa: fix .teuthology_branch file in qa/
According to teuthology-suite:

  -t <branch>, --teuthology-branch <branch>
                              The teuthology branch to run against.
                              Default value is determined in the next order.
                              There is TEUTH_BRANCH environment variable set.
                              There is `qa/.teuthology_branch` present in
                              the suite repo and contains non-empty string.
                              There is `teuthology_branch` present in one of
                              the user or system `teuthology.yaml` configuration
                              files respectively, otherwise use `main`.

The .teuthology_branch file in the qa/ dir currently points at "master".
Change it to point to "main".

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:04:39 -04:00
Guillaume Abrioux
e720a658d6 cephadm: fix osd adoption with custom cluster name
When adopting Ceph OSD containers from a Ceph cluster with a custom name, it fails
because the name isn't propagated in unit.run.
The idea here is to change the lvm metadata and enforce 'ceph.cluster_name=ceph'
given that cephadm doesn't support custom names anyway.

Fixes: https://tracker.ceph.com/issues/55654

Signed-off-by: Adam King <adking@redhat.com>
Co-authored-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-06-01 18:48:46 +02:00
Ilya Dryomov
04567650ca
Merge pull request #46474 from idryomov/wip-rbd-codeowners
CODEOWNERS: add RBD team

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-06-01 18:29:38 +02:00
Ilya Dryomov
00a44f1c6b CODEOWNERS: add RBD team
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-06-01 13:37:21 +02:00