Commit Graph

9291 Commits

Author SHA1 Message Date
Casey Bodley
6f765e25ab
Merge pull request #43597 from pritha-srivastava/wip-rgw-sts-role-multisite
rgw multisite: replicate metadata for iam roles

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-06-13 12:04:12 -04:00
Venky Shankar
27f4729256
Merge pull request #45556 from mchangir/qa-add-subvolume-option-flavors
qa: add subvolume option flavors

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-06-13 12:29:43 +05:30
Venky Shankar
f7bc95c2f7
Merge pull request #44347 from kotreshhr/subvolumegroup-quotas
mgr/volumes: subvolumegroup quotas

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-13 12:26:59 +05:30
Venky Shankar
67371c1ab4
Merge pull request #46332 from lxbsz/qa-snap
qa: enlarge the tag number and test more for the snapshot

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-06-13 12:25:44 +05:30
David Galloway
c6acb44ff7 schedule_subset.sh: Default to ceph.git
https://github.com/ceph/teuthology/pull/999 never got overridden in ceph.git.  We've been using a years-old checkout of teuthology for the `teuthology` user.

With the master->main change, that checkout needed to go.  Then when trying to schedule new nightlies, teuthology-suite was defaulting to ceph-ci.git which either has very old versions of the release branches (octopus, pacific, etc.) or they don't exist at all.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-06-08 16:13:29 -04:00
Pritha Srivastava
7140e822d6 rgw: adding a test to check if role metadata syncs fine.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2022-06-08 10:31:15 +05:30
Adam King
cf2fdca093
Merge pull request #46539 from adk3798/master-main-cleanup2
mgr/cephadm: some master -> main cleanup

Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-06-07 20:51:06 -04:00
Venky Shankar
375c8a6006
Merge pull request #44335 from SMIL-Infra/export-unlinked-dir
mds: fix crash when exporting unlinked dir

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2022-06-07 22:47:36 +05:30
Venky Shankar
45c9fd6187
Merge pull request #46078 from kotreshhr/fuse-directory-dacs-issue
client/fuse: Fix directory DACs overriding for root

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-07 22:45:05 +05:30
Ernesto Puerta
65acb3e124
Merge pull request #46263 from rhcs-dashboard/rbd-mirroring-snapshot
mgr/dashboard: rbd mirroring snapshot support

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-06-07 16:25:57 +02:00
Pere Diaz Bou
e3062db270
Merge pull request #46479 from rhcs-dashboard/rbd-mirroring-list-primary
mgr/dashboard: add rbd primary info

Reviewed-by: Sarthak Gupta <sarthak.dev.0702@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-07 11:32:48 +02:00
Ilya Dryomov
9324b49ebb
Merge pull request #46045 from idryomov/wip-qa-rwl-on-tmpfs
qa/suites/rbd: place cache file on tmpfs for xfstests

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-06-07 10:39:31 +02:00
Adam King
7c6c715aa5 mgr/cephadm: some master -> main cleanup
Signed-off-by: Adam King <adking@redhat.com>
2022-06-06 15:18:08 -04:00
Pere Diaz Bou
489a385a95 mgr/dashboard: snapshot mirroring from dashboard
Enable snapshot mirroring from the Pools -> Image

Also show the mirror-snapshot in the image where snapshot is enabled

When parsing images if an image has the snapshot mode enabled, it will
try to  run commands that don't work with that mode. The solution was
not running those for now and appending the mode in the get call.

Fixes: https://tracker.ceph.com/issues/55648

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2022-06-06 17:56:47 +02:00
Kotresh HR
256c75e260 qa: Add tests which validates quota limitation for subvolumegroup quota
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
e9fe37b8e1 qa: Add subvolume removal tests when it's group quota exceeds
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
12e003f980 qa: Add tests for subvolumegroup idempotence creation
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
c006181803 qa: Add tests for subvolume removal on group quota set
Validates the subvolume removal is successful if the
corresponding group's quota is set.

Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
dbe8cf1792 qa: Add tests for subvolumegroup resize
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Kotresh HR
085700bf19 qa: Add subvolume group quota tests
Fixes: https://tracker.ceph.com/issues/53509
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-06-06 12:40:46 +05:30
Venky Shankar
2ab2777722
Merge pull request #46165 from rishabh-d-dave/qa-omit-sudo
qa/cephfs: set omit_sudo False when sudo is set to True

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-06-06 11:23:11 +05:30
Venky Shankar
86b8df6756
Merge pull request #46168 from rishabh-d-dave/fix-caps-helper
qa/cephfs: fix minor bug in caps_helper.py's run_mon_cap_tests()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-06 11:20:58 +05:30
Venky Shankar
9440f79d72
Merge pull request #40434 from rishabh-d-dave/fs-refactor-method-in-mount
qa/cephfs: modify get_key_from_keyfile() in mount.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-06-06 11:19:54 +05:30
Pere Diaz Bou
578ee21f59 mgr/dashboard: add rbd primary info
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-06-06 06:43:07 +02:00
Ilya Dryomov
23759e0034 qa/suites/rbd: place cache file on tmpfs for xfstests
The RWL mode needs DAX and is dog slow otherwise -- qemu_xfstests.yaml
job always hits the 6 hour max_job_time limit.

As our tmpfs instance is limited and qemu_xfstests.yaml opens three
images at the same time, reduce the "big cache" size to 5G.  This facet
was added to iron out 32-bit head/tail pointer issues and 5G still does
the job there.

Going through the loop device is needed because tmpfs doesn't support
O_DIRECT.

Fixes: https://tracker.ceph.com/issues/55400
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-06-03 19:20:37 +02:00
Rishabh Dave
f58bcac7cb qa/cephfs: modify get_key_from_keyfile() in mount.py
CephFSMount.get_key_from_keyfile() should raise an exception instead of
returning None if key is not found in keyring file.

Fixes: https://tracker.ceph.com/issues/50010
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-06-03 09:40:28 +05:30
Ilya Dryomov
3475f9ef07 qa/suites/rbd: refactor persistent-writeback-cache suite
Rename to pwl-cache, introduce home subdirectory and 4-cache-path.yaml.
No functional changes.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-06-03 00:06:35 +02:00
Casey Bodley
63f84c50e0
Merge pull request #39002 from ceph/wip-rgw-multisite-reshard
rgw multisite: bucket reshard work in progress

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-06-02 16:04:30 -04:00
Ernesto Puerta
e91773df68
qa: fix teuthology master branch ref
Fixes: https://tracker.ceph.com/issues/55826
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-06-02 12:27:02 +02:00
Jeff Layton
81430de9b7 qa: remove .teuthology_branch file
This was originally added to help support the py2 -> py3 conversion.
That's long since complete so we should be able to just remove this file
now.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:26:33 -04:00
Casey Bodley
8e51eb8c05 test/rgw/multisite: enable zonegroup resharding feature
qa/tasks/rgw_multisite.py uses 'zonegroup set' to create zonegroups from
their json format. this doesn't enable any of the supported zonegroup
features by default, so this adds the 'enabled_features' field to the
json representations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-06-01 14:10:26 -04:00
Jeff Layton
b5dd80883e qa: fix .teuthology_branch file in qa/
According to teuthology-suite:

  -t <branch>, --teuthology-branch <branch>
                              The teuthology branch to run against.
                              Default value is determined in the next order.
                              There is TEUTH_BRANCH environment variable set.
                              There is `qa/.teuthology_branch` present in
                              the suite repo and contains non-empty string.
                              There is `teuthology_branch` present in one of
                              the user or system `teuthology.yaml` configuration
                              files respectively, otherwise use `main`.

The .teuthology_branch file in the qa/ dir currently points at "master".
Change it to point to "main".

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2022-06-01 14:04:39 -04:00
Laura Flores
19f6446e98
Merge pull request #46193 from ljflores/wip-zero-detection-off-by-default
os/bluestore: turn bluestore zero block detection off by default
2022-05-31 16:55:51 -05:00
Casey Bodley
47913cb7f1 test/rgw: fix test case for empty-OLH-name cleanup
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-31 17:29:18 -04:00
Soumya Koduri
52f341b00a
Merge pull request #46367 from 0xavi0/dbstore-default-dbdir-rgw-data
rgw/dbstore: change default value of dbstore_db_dir to /var/lib/ceph/radosgw

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2022-05-31 21:27:28 +05:30
0xavi0
895ee7921c
rgw/dbstore: change default value of dbstore_db_dir to /var/lib/ceph/radosgw
Changes a few NULL to nullptr.

Adds std::filesystem for path building so they're platform independant.

Fixes a bug for DBStoreManager's second constructor not creating the DB.

Adds unit tests to test DB path and prefix.

Fixes: https://tracker.ceph.com/issues/55731

Signed-off-by: 0xavi0 <xavi.garcia@suse.com>
2022-05-31 09:01:56 +02:00
Venky Shankar
2e4a777242
Merge pull request #46086 from nmshelke/feature-55401
mgr/volumes: set, get, list and remove metadata of snapshot

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-31 10:30:56 +05:30
Casey Bodley
ede6a85385 qa/rgw: fix flake8 errors in test_rgw_reshard.py
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:34 -04:00
Casey Bodley
87efd66db0 test/rgw: test_rgw_reshard.py injects ECANCELED on set_target_layout/commit_target_layout
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:33 -04:00
Casey Bodley
c3ccb1adb4 test/rgw: test_bucket_reshard verifies that ACLs are preserved
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:33 -04:00
Casey Bodley
8521fb2be0 qa/rgw: temporarily disable multisite reshard tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:32 -04:00
Casey Bodley
6e6f59b945 qa/rgw: disable coredumps for reshard fault injection
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:31 -04:00
Casey Bodley
2a51bc6ce1 test/rgw: add test_bucket_reshard() for fault injection testing
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:31 -04:00
Casey Bodley
8c2bac38f8 test/rgw: test_rgw_reshard.py exec_cmd() can return error code
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:31 -04:00
Shilpa Jagannath
eb304f4bc5 rgw: reshard tests with fault injection
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2022-05-27 15:47:31 -04:00
Adam C. Emerson
e432f4a4be qa/rgw: rgw_multisite_tests task loads default plugins
the ability to filter tests by attribute is provided by the
nose.plugins.attrib plugin, which wasn't being loaded by default

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:31 -04:00
Casey Bodley
e7f3ac92a7 qa/rgw: disable multisite tests for 'bucket sync disable'
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-05-27 15:47:31 -04:00
Laura Flores
20bbfd62a7 qa/config: override bluestore_zero_block_detection default for rados suite tests
By default, `bluestore_zero_block_detection` is false since it interacts
negatively with some RBD and CephFS features. We still want this enabled
for rados teuthology tests though so we can use it for large-scale testing.
Adding this setting to the rados teuthology config file will override the global
config setting and enable `bluestore_zero_block_detection` only for tests in
the teuthology rados suite.

Signed-off-by: Laura Flores <lflores@redhat.com>
2022-05-27 13:36:18 -05:00
Rishabh Dave
f01188d72a qa/cephfs: fix minor bug in caps_helper.py's run_mon_cap_tests()
When an entity's MON cap contains no FS name in it, the entity has the
access to all the FSs on cluster and not just to the default FS of the
cluster.

Fixes: https://tracker.ceph.com/issues/55558
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-05-27 15:19:38 +05:30
Patrick Donnelly
6606d91ace
Merge commit 'b76b6ea16899861d6c266797b3c11d9f68f924d7' into main
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-05-25 16:02:14 -04:00