Commit Graph

2515 Commits

Author SHA1 Message Date
Prasanna Kumar Kalever
2fa7f90d42 qa/workunits/rbd-nbd: add notrim test
Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2021-06-30 13:09:24 +05:30
Kefu Chai
75b91d49b8
Merge pull request #39624 from sebastian-philipp/mypy-812
src,qa: Upgrade to mypy 0.901

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-06-14 22:53:02 +08:00
Patrick Donnelly
0d9032771c
qa: fix api test failures
"device_health_metrics" pool is gone -- .mgr pool is in.

I don't think the pool removal code in some test cases is necessary any
longer with recent changes to remove those warnings; so that code is
gone too.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-11 19:35:17 -07:00
Sebastian Wagner
1f6b4744b5 qa: Upgrade to mypy 0.901
mypy 0.9 now requires stub packages

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-06-09 12:53:21 +02:00
Patrick Donnelly
4e1f812461
Merge PR #39910 into master
* refs/pull/39910/head:
	test: Add test for mgr hang when osd is full
	mgr: Set client_check_pool_perm to false
	mds: Add full caps to avoid osd full check

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-06-03 13:22:23 -07:00
Ilya Dryomov
bb92c4ff83
Merge pull request #41588 from idryomov/wip-rbd-trash-purge
librbd: don't stop at the first unremovable image when purging 

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-06-01 21:56:57 +02:00
Ilya Dryomov
16d9a68a3e librbd: don't stop at the first unremovable image when purging
As there is no inherent ordering, there may be multiple removable
images past the unremovable image.  On top of that, removing a clone
may make its parent removable so perform an additional pass if any
image gets removed.

Fixes: https://tracker.ceph.com/issues/51021
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-31 11:44:47 +02:00
Prasanna Kumar Kalever
e2aa4128f1 qa/workunits/rbd: use rbd cli for device attach/detach commands
Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2021-05-26 10:27:09 +05:30
Kotresh HR
2bd6ba8026 test: Add test for mgr hang when osd is full
Add fs suite for tests requiring one node as well.

Fixes: https://tracker.ceph.com/issues/50532
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2021-05-22 19:09:07 +05:30
Ilya Dryomov
338920fcf6
Merge pull request #41070 from sunnyku/wip-rbd-50522
rbd: fix default pool handling for nbd map/unmap

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-20 16:41:22 +02:00
Sunny Kumar
b19905272a qa/workunits/rbd-nbd: add new test for map/unmap
This patch includes twe new test cases:
 a. map/unmap test with only image name and
 b. map/unmap test after changing default pool which expects the image
 to come from new default pool.

Signed-off-by: Sunny Kumar <sunkumar@redhat.com>
2021-05-18 16:23:10 +01:00
Patrick Donnelly
80855c3c6d
Merge PR #40842 into master
* refs/pull/40842/head:
	qa: update the ffsb.sh to clone it from git://git.ceph.com/ffsb.git

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-17 19:49:40 -07:00
Sunny Kumar
4f6370b884 qa/workunits/rbd: use rbd device wrapper where appropriate
Use `rbd device` wrapper call instead of making a direct call to rbd-nbd.

Signed-off-by: Sunny Kumar <sunkumar@redhat.com>
2021-05-14 12:38:25 +01:00
Ilya Dryomov
02cab9670f
Merge pull request #41126 from idryomov/wip-rbd-qemu-iotests-focal
qa/workunits/rbd: use bionic version of qemu-iotests for focal

Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-05-06 11:14:46 +02:00
Xiubo Li
b1542e7699 qa: update the ffsb.sh to clone it from git://git.ceph.com/ffsb.git
Have add a ffsb repo under git://git.ceph.com/ to tracker the change
histories. And in that repo we have modernize the form of AM_INIT_AUTOMAKE.

Fixes: https://tracker.ceph.com/issues/48365
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-05-06 14:00:45 +08:00
Ilya Dryomov
602db5e386 qa/workunits/rbd: disable qemu-iotest test 055 globally
It doesn't work on Focal and already disabled on CentOS 7 and 8.  More
importantly, it doesn't actually test rbd -- it always tests "file", no
matter which protocol is specified in IMGPROTO.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-02 23:38:56 +02:00
Ilya Dryomov
2de2146c30 qa/workunits/rbd: use bionic version of qemu-iotests for focal
Currently Focal ends up with v2.2.0-rc3, which results in "WARNING:
Image format was not specified for ..." for all tests and all tests
fail.

Fixes: https://tracker.ceph.com/issues/50605
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-02 23:38:43 +02:00
Sage Weil
4b4f4ad7bf qa/workunits/cephadm/test_cephadm: test zap-osds
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-30 10:16:16 -04:00
Ernesto Puerta
95c52c978c
Merge pull request #40426 from rhcs-dashboard/host-maintenance-followups
mgr/dashboard: Host Maintenance Follow ups

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-04-27 19:03:09 +02:00
Nizamudeen A
23bdf201c4 mgr/dashboard: Host Maintenance Follow ups
Added the ability to create a host in maintenance mode

Fixes: https://tracker.ceph.com/issues/49998
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-04-27 16:11:20 +05:30
Kefu Chai
f2e0770c27 qa/workunits/mon/test_mon_config_key: use subprocess.run() instead of proc.communicate()
the loop of proc.communicate() on python3.6, where we always are able to
get something out of stdout and/or stderr PIPEs. and the `stdout` and
`stderr` keep growing until out of memory. and teuthology considers
the command crashed after a while.

Fixes: https://tracker.ceph.com/issues/50393
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 16:11:30 +08:00
J. Eric Ivancich
505b3f2108
Merge pull request #40801 from ivancich/wip-radoslist-incomplete-multipart-parts-marker
rgw: radoslist incomplete multipart parts marker

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-04-12 10:34:50 -04:00
Kefu Chai
1ee844f579
Merge pull request #40811 from tchaikov/wip-gen-corpus
script/gen-corpus.sh: set CEPH_CONF

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-12 21:40:29 +08:00
Kefu Chai
5242487486 qa/workunits/cls: add executable bit to script
all the scripts except for test_cls_cas.sh under qa/workunits/cls
are executable. to be more consistent, add the executable bit to
test_cls_cas.sh as well.

also, these scripts are launched by src/script/gen-corpus.sh directly,
so it's convenient just call them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-12 19:28:47 +08:00
Kefu Chai
caf364db5e
Merge pull request #38120 from kiizawa/wip-cls-remote-read
osd: allow remote read by calling cls method from within cls context

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-12 16:42:52 +08:00
J. Eric Ivancich
d76e65bcd3 rgw: test radosgw-admin radoslist and incomplete multiparts better
Make sure there are more than 1000 incomplete multiparts and also make
sure one of the incomplete multiparts has at least 1000 parts. This
test is done indirectly through rgw-orphan-list, which invokes
`radosgw-admin radoslist`.

Also, clean up shell flags, so script output is less verbose.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2021-04-10 02:07:53 -04:00
Samuel Just
055ebe381d
Merge pull request #39216 from myoungwon/wip-manifest-dedup-test
osd, test: reworks for manifest dedup test cases

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-09 12:42:18 -07:00
Patrick Donnelly
d06d66d88d
Merge PR #40611 into master
* refs/pull/40611/head:
	qa: retry cloning the ceph.git

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-07 19:35:58 -07:00
Xiubo Li
c160e972ab qa: retry cloning the ceph.git
The cloning may take a very long time, 2.5 hours for example, usally
it should be done in server minutes. If it really very slow, there
maybe something wrong with the current socket connections, retry it
maybe fixed.

This fixing will timeout the clone command after 30m, and retry it
by doubling the timeout value.

Fixes: https://tracker.ceph.com/issues/50021
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-04-06 16:02:45 +08:00
Ken Iizawa
5a71708cbd osd: add an object class to invoke remote reads along with a test to exercise it
Fixes: https://tracker.ceph.com/issues/48182
Signed-off-by: Ken Iizawa <iizawa.ken@fujitsu.com>
2021-04-04 01:42:47 +09:00
myoungwon oh
ed24df159c qa/workuints: add ceph_dedup_tool test for scrub refcount
Based on CDC flush, a test, which calls get/put reference,
is added.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-03-29 17:13:28 +09:00
Sage Weil
4d5c6044b0 qa/workunits/cephadm/test_cephadm: specify image separately
On master, this will be IMAGE_MASTER.  On pacific branch, we'll make it
IMAGE_PACIFIC so that we don't hit the release mismatch error.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-25 07:33:26 -05:00
Patrick Donnelly
54b3c8f7a7
test/libcephsqlite,qa: add tests for libcephsqlite
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-19 08:52:55 -07:00
Kefu Chai
ee3b0499ce
Merge pull request #40098 from tchaikov/wip-qa-powertools
qa/workunits/rados/test_envlibrados_rocksdb: s/PowerTools/powertools/

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-15 23:05:47 +08:00
Sage Weil
8bcb281a7d osd: propagate base pool application_metadata to tiers
If there is application metadata on the base pool, it should be mirrored
to any other tiers in the set.  This aligns with the fact that the
'ceph osd pool application ...' commands refuse to operate on a non-base
pool.

This fixes problems with accessing tiers (e.g., cache tiers) when the
cephx cap is written in terms of application metadata.

Fixes: https://tracker.ceph.com/issues/49788
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-13 11:51:19 -05:00
Kefu Chai
6364748328 qa/workunits/rados/test_envlibrados_rocksdb: s/PowerTools/powertools/
see also 7a68845579

Fixes: https://tracker.ceph.com/issues/49787
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-13 17:03:32 +08:00
Jason Dillaman
bc0b9f52ad librbd: permit disabling QCOW migration format support
Downstream Red Hat products do not support the older QCOW format. This
will allow the support for the legacy QCOW format to be disabled for the
new RBD import-only migration support.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-23 07:19:43 -05:00
Mykola Golub
f737c2855a qa/workunits/rbd: make luks-encryption test work on vstart cluster
When running as non-root, it might not find the `rbd` binary.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-02-15 15:03:00 +00:00
Mykola Golub
b4d9cc45d6
Merge pull request #39155 from dillaman/wip-49037
librbd: correct incremental deep-copy object-map inconsistencies

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-02-10 18:37:34 +02:00
Casey Bodley
a635e523be qa/rgw: test_rgw_reshard.py just tries common ports
the 'sudo netstat | grep radosgw' command is causing failures:

  File "qa/workunits/rgw/test_rgw_reshard.py", line 53, in get_radosgw_port
    x = out.decode('utf8').split(" ")
AttributeError: 'bool' object has no attribute 'decode'

because when valgrind is enabled, the process name is 'valgrind' instead
of 'radosgw'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-09 14:26:26 -05:00
Jason Dillaman
f079116e87 qa/workunits/rbd: show snapshot deltas during stress test failure
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-08 10:13:35 -05:00
Jason Dillaman
094bfeaf8e qa/suites/rbd: add snapshot-based mirroring stress test
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-08 09:23:35 -05:00
Jason Dillaman
8643b046fb test/rbd-mirror: fix broken ceph_test_rbd_mirror_random_write
It appears that commit 6eb8f30a23 broke the test utility and
its failure was masked by the test case that expected a failure
due to a timeout force-killing the app.

Fixes: https://tracker.ceph.com/issues/49117
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-02 23:34:18 -05:00
Sage Weil
fafdb1e47d Merge PR #39149 into master
* refs/pull/39149/head:
	qa/workunits/cephtool/test.sh: tolerate some settling for osd info vs dump test

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 16:25:01 -06:00
Josh Durgin
25651e57b5
Merge pull request #38805 from kamoltat/wip-mgr-pg-autoscaler-improve-out-of-box-experience
pybind/mgr/pg_autoscaler: avoid scale-down until there is pressure

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 11:33:55 -08:00
Kamoltat
daeb6f6ac0 mgr/pg_autoscaler: avoid scale-down until there is pressure
The autoscaler will start out with scaling each
pools to have a full complements of pgs from the start
and will only decrease it when pools need more due to
increased usage.

Introduced a unit test that tests only the
function get_final_pg_target_and_ratio() which
deals with the distrubtion of pgs amongst the
pools

Edited workunit script to reflect the change
of how pgs are calculated and distrubted.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-02-01 13:05:54 +00:00
Sage Weil
b2651236b9 Merge PR #39097 into master
* refs/pull/39097/head:
	qa/workunits/cephadm/test_cephadm: fix argument
	qa/workunits/cephadm/test_cephadm: show exporter output
	qa/workunits/cephadm/test_cephadm: don't bother pulling octopus
	qa/workunits/cephadm/test_cephadm: behave on terminal
	qa/workunits/cepham/test_cephadm: pull only recent images, from quay.ceph.io
	qa/workunits/cephadm/test_cephadm: don't respawn for python versions

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-01-30 10:14:43 -06:00
Sage Weil
8c625c077b qa/workunits/cephadm/test_cephadm: fix argument
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 13:34:44 -06:00
Sage Weil
a78dab9e53 qa/workunits/cephadm/test_cephadm: show exporter output
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 15:15:02 -06:00
Sage Weil
7bbc92eda3 mon: updates for quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00