Commit Graph

7874 Commits

Author SHA1 Message Date
Ilya Dryomov
0357c0215b qa/tasks/rbd: dev_create() expects a properties dict
In order to add encryption_format property, commit 3754c665a1
(":qa/tasks/rbd: test qemu on top of rbd encryption") changed the
dev_create() contract.  It now expects a properties dict, but the
main task routine wasn't updated and still passes role_images.

On top of that, role_images itself got broken.  It is supposed
to be a mapping from role to a corresponding image name, not to
a dict with an image_name key.  This affected generic_mount().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-02-01 17:05:47 +01:00
Kefu Chai
0b5d8e1928
Merge pull request #39187 from tchaikov/wip-standalone-mon-misc.sh
qa/standalone/mon/misc: verify that len(monmap.features.persistent) == 9

Reviewed-by: Sage Weil <sage@redhat.com>
2021-01-31 10:09:27 +08:00
Sage Weil
b2651236b9 Merge PR #39097 into master
* refs/pull/39097/head:
	qa/workunits/cephadm/test_cephadm: fix argument
	qa/workunits/cephadm/test_cephadm: show exporter output
	qa/workunits/cephadm/test_cephadm: don't bother pulling octopus
	qa/workunits/cephadm/test_cephadm: behave on terminal
	qa/workunits/cepham/test_cephadm: pull only recent images, from quay.ceph.io
	qa/workunits/cephadm/test_cephadm: don't respawn for python versions

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-01-30 10:14:43 -06:00
Kefu Chai
8dc097ff46 qa/standalone/mon/misc: verify that len(monmap.features.persistent) == 9
in beb62c029a, FEATURE_QUINCY was added to
ceph::features::mon::get_persistent(), so update the test accordingly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-30 22:45:20 +08:00
Matt Benjamin
c26eaed15a
Merge pull request #38892 from ceph/update_s3select_add_zero_segment_log
s3select: update s3select submodule to last commit ; add zero segment log
2021-01-29 15:50:18 -05:00
Sage Weil
713f79fdf4 Merge PR #39039 into master
* refs/pull/39039/head:
	src/test/cli/monmaptool: adjust for new monmap features
	qa/tasks/cephadm: allow custom git_url for cephadm_branch pull
	qa/suites/rados/upgrade: include pacific-x
	qa/suites/upgrade/pacific-x/parallel
	qa/suites: some clean up for quincy
	mon: updates for quincy
	mon: update for quincy ondisk features
	script: add pacific
	doc/dev/release-checklist: we tagged v17.0.0
	ceph-volume: change to quincy
	include/ceph_features: retire MON_SINGLE_PAXOS
	include/ceph_features: define FEATURE_SERVER_QUINCY
	mon/MgrMonitor: add always_on_modules for quincy
	add feature/release name quincy
	kickoff v17 quincy
	doc/dev/release-checklists: uncheck everything!

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-01-29 14:01:26 -06:00
Sage Weil
8c625c077b qa/workunits/cephadm/test_cephadm: fix argument
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 13:34:44 -06:00
Sage Weil
5842058d12 qa/tasks/cephadm: allow custom git_url for cephadm_branch pull
Normally the git_url is git://git.ceph.com/ceph-ci.git, which mirrors
upstream ceph-ci.git.  However, the release branches aren't present there.
Allow a custom git_url so we can pull these from the main ceph.git.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 11:45:02 -06:00
Neha Ojha
07f7e3647e
Merge pull request #39152 from neha-ojha/wip-46323
qa/*/thrash_cache_writeback_proxy_none.yaml: disable writeback overlay tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-29 07:37:52 -08:00
galsalomon66
b73c6c40bf diagnose zero segment while s3select
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

using s3-test with the fix fix_test_file_permission_add_attrib

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

update s3select{1ea37ae459f957786b9d198510637dfa12f83350} ; add log tracing zero segments locations

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

s3select submodule update

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

fix comments

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

updating the s3select new features; covering the gap between latest documentation and latest faetures update

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

add some more examples; fixes

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

add between expression to doc; typo

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

typo

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

skipping empty segments

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

skip empty segments to the next segments

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2021-01-29 08:15:01 +02:00
Neha Ojha
be710cdf39 qa/*/thrash_cache_writeback_proxy_none.yaml: disable writeback overlay tests
thrash_cache_writeback_proxy_none tests have been failing consistently. Some investigation
shows that the writeback overlay tests are reponsible for it. Instead of removing these
cache tiering tests entirely, we'll disable them for now.

Related to: https://tracker.ceph.com/issues/46323
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-01-28 23:12:03 +00:00
Sage Weil
a78dab9e53 qa/workunits/cephadm/test_cephadm: show exporter output
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 15:15:02 -06:00
Sage Weil
5b437f334d qa/suites/rados/upgrade: include pacific-x
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
0c3462e938 qa/suites/upgrade/pacific-x/parallel
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
a9c4d1f1e7 qa/suites: some clean up for quincy
- remove upgrades from nautilus
- stubs for completing upgrade to quincy

Still missing the pacific-x upgrade tests.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
7bbc92eda3 mon: updates for quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
ebee47e06f qa/suites/rados/cephadm/*/distro: drop rhel_8.0 targets
We still have centos 8.0.  We're missing an 8.0 image for the gibba.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-27 16:04:58 -06:00
Yuri Weinstein
5795442fd5 qa/tests: changed priority - master 100, pacific 80
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-01-27 08:45:19 -08:00
Yuri Weinstein
300c7312de qa/tests: reduced octopus, nautilus, master frequency
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-01-27 08:31:19 -08:00
Ramana Raja
23f0c5b2dd
Merge pull request #38786 from kotreshhr/evict-clients-of-deauthorized-authids
mgr/volumes: Evict clients based on auth-IDs and subvolume path

Reviewed-by: Victoria Martinez de la Cruz <victoria@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-01-27 19:44:17 +05:30
Sage Weil
74e188d826 Merge PR #39087 into master
* refs/pull/39087/head:
	qa/suites/rados/cephadm: drop 20.04 podman
	qa/suites/rados/cephadm: stop testing 18.04 + podman

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-01-26 21:47:43 -06:00
Sage Weil
f394eafd64 qa/workunits/cephadm/test_cephadm: don't bother pulling octopus
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 21:46:24 -06:00
Sage Weil
c82770f77c qa/workunits/cephadm/test_cephadm: behave on terminal
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 21:46:09 -06:00
Jason Dillaman
e6ac5f0e63
Merge pull request #39086 from orozery/qa-rbd-delete-passphrase-file
qa/tasks/rbd: cleanup passphrase file

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-26 15:42:08 -05:00
Jason Dillaman
f8862cff1b
Merge pull request #39089 from orozery/librbd-luks-cli-test
test/librbd: fix luks encryption cli test on unsupported runs

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-26 15:17:12 -05:00
Sage Weil
8aba5ebcc6 Merge PR #39028 into master
* refs/pull/39028/head:
	cephadm: retry for 30s instead of 10s
	cephadm: try 'mgr stat' before 'mgr dump' to get the epoch
	mon: add 'mgr stat' command

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-01-26 11:22:50 -06:00
Or Ozeri
2f1eb8eba0 test/librbd: fix luks encryption cli test on unsupported runs
This commit changes the luks encryption cli test to return success instead of failure when not supported.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2021-01-26 18:54:05 +02:00
Sage Weil
1dccdd2fa1 qa/workunits/cepham/test_cephadm: pull only recent images, from quay.ceph.io
No reason to pull nautilus/mimic, which don't even support cephadm.

This test will mostly run in the sepia lab, so pull from there.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 10:19:53 -06:00
Sage Weil
90676eb9b1 qa/workunits/cephadm/test_cephadm: don't respawn for python versions
We aren't supporting python2 anymore.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 10:19:20 -06:00
Sage Weil
dccd586173 qa/suites/rados/cephadm: drop 20.04 podman
This version is also affected

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 09:14:09 -06:00
Or Ozeri
8498da2aca qa/tasks/rbd: cleanup passphrase file
This commit adds a cleanup for the passphrase file used to create/mount encrypted rbd images.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2021-01-26 17:02:37 +02:00
Jason Dillaman
988a6ac8d3
Merge pull request #39006 from orozery/librbd-luks-cli-test
test/librbd: add luks encryption cli test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-26 09:46:20 -05:00
Ilya Dryomov
4cbd952916
Merge pull request #39060 from idryomov/wip-krbd-msgr2
krbd: add support for msgr2 (kernel 5.11)

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-26 11:46:08 +01:00
Kefu Chai
05aef6d660
Merge pull request #38929 from jdurgin/wip-cot-log
qa/tasks/ceph_manager: let c-o-t log errors

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-26 17:33:22 +08:00
Matt Benjamin
d3a78fa196
Merge pull request #37250 from cbodley/wip-qa-librgw
qa/rgw: add librgw_file unit tests to rgw/verify task
2021-01-25 22:10:37 -05:00
Neha Ojha
6533027912
Merge pull request #39063 from yuriw/wip-yuriw-crontab-master
qa/tests: added pacific branch to the mix

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-01-25 14:11:53 -08:00
Casey Bodley
61de548c42
Merge pull request #39009 from mdw-at-linuxbox/wip-master-keystonebindep
qa/tasks/keystone.py: centos-8 bindep fix

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-01-25 17:04:36 -05:00
Matt Benjamin
9bac99361f test/rgw_file: override keyring if we gen keys
Run with ceph.keyring not that of client.${CEPH_ID}.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-01-25 16:46:50 -05:00
Matt Benjamin
247d00817d test/rgw_file: elaborate test cycle
Ensure that all delete phases are run so that script can be
re-run when desired.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
 Please enter the commit message for your changes. Lines starting
2021-01-25 16:46:41 -05:00
Matt Benjamin
e6d54e7d79 rgw_file: add librgw unit test arguments
Also adjust some unit test files to avoid trivial failures.
Fixes missing commit after rgw_write(), as well as conditional
cleanup.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-01-25 16:46:25 -05:00
Casey Bodley
12b5b9506c qa/rgw: librgw workunit creates a test user
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-01-25 16:46:18 -05:00
Casey Bodley
85641ac3e6 qa/rgw: add librgw_file unit tests to rgw/verify task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-01-25 16:46:04 -05:00
Sage Weil
e5e4710990 qa/suites/rados/cephadm: stop testing 18.04 + podman
The current bionice version triggers a podman/conmon bug that
truncates output, affecting both cephadm bootstrap when 'mgr dump' is
large, and teuthology 'pg dump' when it is large.

See https://tracker.ceph.com/issues/48993

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-25 15:32:33 -06:00
Ilya Dryomov
65948736a4 qa/suites/krbd: add msgr2 modes to most subsuites
basic, rbd and rbd-nomount subsuites are expanded to run with each
of ms_mode=legacy, ms_mode=crc and ms_mode=secure.  This increases
the total number of jobs in the suite from 100 to 220.

fsx, singleton and thrash subsuites choose ms_mode at random (from
the above plus ms_mode=prefer-crc).

unmap and wac subsuites remain msgr1-only.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-01-25 21:17:44 +01:00
Yuri Weinstein
dc07a51d4b qa/tests: added pacific branch to the mix
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-01-25 08:40:31 -08:00
Sage Weil
bb702eda19 mon: add 'mgr stat' command
This is analogous to 'osd stat' and 'mds stat'.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-25 08:48:44 -06:00
Kotresh HR
269adcc8b8 mgr/volumes: Evict clients based on auth-IDs and subvolume mounted
Add subvolume evict command which evicts the subvolume mounts
which are mounted using particular auth-ID.

Fixes: https://tracker.ceph.com/issues/44928
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2021-01-25 15:53:14 +05:30
Or Ozeri
4f438f0dc3 test/librbd: add luks encryption cli test
This commit adds a cli test for rbd encryption verifying LUKS compatbility with cryptsetup

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2021-01-24 09:11:50 +02:00
Sage Weil
7fe3853af9 qa/workunits/cephadm/test_repos: adjust target version
15.2.7 is available for 20.04; 15.1.1 is not

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-23 18:59:39 -06:00
Sage Weil
8304bf6510 qa/suites/rados/cephadm: add 20.04 targets
Add 20.04 targets.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-23 11:26:06 -06:00