Commit Graph

2502 Commits

Author SHA1 Message Date
Kotresh HR
2bd6ba8026 test: Add test for mgr hang when osd is full
Add fs suite for tests requiring one node as well.

Fixes: https://tracker.ceph.com/issues/50532
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2021-05-22 19:09:07 +05:30
Ilya Dryomov
02cab9670f
Merge pull request #41126 from idryomov/wip-rbd-qemu-iotests-focal
qa/workunits/rbd: use bionic version of qemu-iotests for focal

Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-05-06 11:14:46 +02:00
Ilya Dryomov
602db5e386 qa/workunits/rbd: disable qemu-iotest test 055 globally
It doesn't work on Focal and already disabled on CentOS 7 and 8.  More
importantly, it doesn't actually test rbd -- it always tests "file", no
matter which protocol is specified in IMGPROTO.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-02 23:38:56 +02:00
Ilya Dryomov
2de2146c30 qa/workunits/rbd: use bionic version of qemu-iotests for focal
Currently Focal ends up with v2.2.0-rc3, which results in "WARNING:
Image format was not specified for ..." for all tests and all tests
fail.

Fixes: https://tracker.ceph.com/issues/50605
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-02 23:38:43 +02:00
Sage Weil
4b4f4ad7bf qa/workunits/cephadm/test_cephadm: test zap-osds
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-30 10:16:16 -04:00
Ernesto Puerta
95c52c978c
Merge pull request #40426 from rhcs-dashboard/host-maintenance-followups
mgr/dashboard: Host Maintenance Follow ups

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-04-27 19:03:09 +02:00
Nizamudeen A
23bdf201c4 mgr/dashboard: Host Maintenance Follow ups
Added the ability to create a host in maintenance mode

Fixes: https://tracker.ceph.com/issues/49998
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-04-27 16:11:20 +05:30
Kefu Chai
f2e0770c27 qa/workunits/mon/test_mon_config_key: use subprocess.run() instead of proc.communicate()
the loop of proc.communicate() on python3.6, where we always are able to
get something out of stdout and/or stderr PIPEs. and the `stdout` and
`stderr` keep growing until out of memory. and teuthology considers
the command crashed after a while.

Fixes: https://tracker.ceph.com/issues/50393
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 16:11:30 +08:00
J. Eric Ivancich
505b3f2108
Merge pull request #40801 from ivancich/wip-radoslist-incomplete-multipart-parts-marker
rgw: radoslist incomplete multipart parts marker

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-04-12 10:34:50 -04:00
Kefu Chai
1ee844f579
Merge pull request #40811 from tchaikov/wip-gen-corpus
script/gen-corpus.sh: set CEPH_CONF

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-12 21:40:29 +08:00
Kefu Chai
5242487486 qa/workunits/cls: add executable bit to script
all the scripts except for test_cls_cas.sh under qa/workunits/cls
are executable. to be more consistent, add the executable bit to
test_cls_cas.sh as well.

also, these scripts are launched by src/script/gen-corpus.sh directly,
so it's convenient just call them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-12 19:28:47 +08:00
Kefu Chai
caf364db5e
Merge pull request #38120 from kiizawa/wip-cls-remote-read
osd: allow remote read by calling cls method from within cls context

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-12 16:42:52 +08:00
J. Eric Ivancich
d76e65bcd3 rgw: test radosgw-admin radoslist and incomplete multiparts better
Make sure there are more than 1000 incomplete multiparts and also make
sure one of the incomplete multiparts has at least 1000 parts. This
test is done indirectly through rgw-orphan-list, which invokes
`radosgw-admin radoslist`.

Also, clean up shell flags, so script output is less verbose.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2021-04-10 02:07:53 -04:00
Samuel Just
055ebe381d
Merge pull request #39216 from myoungwon/wip-manifest-dedup-test
osd, test: reworks for manifest dedup test cases

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-09 12:42:18 -07:00
Patrick Donnelly
d06d66d88d
Merge PR #40611 into master
* refs/pull/40611/head:
	qa: retry cloning the ceph.git

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-07 19:35:58 -07:00
Xiubo Li
c160e972ab qa: retry cloning the ceph.git
The cloning may take a very long time, 2.5 hours for example, usally
it should be done in server minutes. If it really very slow, there
maybe something wrong with the current socket connections, retry it
maybe fixed.

This fixing will timeout the clone command after 30m, and retry it
by doubling the timeout value.

Fixes: https://tracker.ceph.com/issues/50021
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-04-06 16:02:45 +08:00
Ken Iizawa
5a71708cbd osd: add an object class to invoke remote reads along with a test to exercise it
Fixes: https://tracker.ceph.com/issues/48182
Signed-off-by: Ken Iizawa <iizawa.ken@fujitsu.com>
2021-04-04 01:42:47 +09:00
myoungwon oh
ed24df159c qa/workuints: add ceph_dedup_tool test for scrub refcount
Based on CDC flush, a test, which calls get/put reference,
is added.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-03-29 17:13:28 +09:00
Sage Weil
4d5c6044b0 qa/workunits/cephadm/test_cephadm: specify image separately
On master, this will be IMAGE_MASTER.  On pacific branch, we'll make it
IMAGE_PACIFIC so that we don't hit the release mismatch error.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-25 07:33:26 -05:00
Patrick Donnelly
54b3c8f7a7
test/libcephsqlite,qa: add tests for libcephsqlite
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-19 08:52:55 -07:00
Kefu Chai
ee3b0499ce
Merge pull request #40098 from tchaikov/wip-qa-powertools
qa/workunits/rados/test_envlibrados_rocksdb: s/PowerTools/powertools/

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-15 23:05:47 +08:00
Sage Weil
8bcb281a7d osd: propagate base pool application_metadata to tiers
If there is application metadata on the base pool, it should be mirrored
to any other tiers in the set.  This aligns with the fact that the
'ceph osd pool application ...' commands refuse to operate on a non-base
pool.

This fixes problems with accessing tiers (e.g., cache tiers) when the
cephx cap is written in terms of application metadata.

Fixes: https://tracker.ceph.com/issues/49788
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-13 11:51:19 -05:00
Kefu Chai
6364748328 qa/workunits/rados/test_envlibrados_rocksdb: s/PowerTools/powertools/
see also 7a68845579

Fixes: https://tracker.ceph.com/issues/49787
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-13 17:03:32 +08:00
Jason Dillaman
bc0b9f52ad librbd: permit disabling QCOW migration format support
Downstream Red Hat products do not support the older QCOW format. This
will allow the support for the legacy QCOW format to be disabled for the
new RBD import-only migration support.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-23 07:19:43 -05:00
Mykola Golub
f737c2855a qa/workunits/rbd: make luks-encryption test work on vstart cluster
When running as non-root, it might not find the `rbd` binary.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-02-15 15:03:00 +00:00
Mykola Golub
b4d9cc45d6
Merge pull request #39155 from dillaman/wip-49037
librbd: correct incremental deep-copy object-map inconsistencies

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-02-10 18:37:34 +02:00
Casey Bodley
a635e523be qa/rgw: test_rgw_reshard.py just tries common ports
the 'sudo netstat | grep radosgw' command is causing failures:

  File "qa/workunits/rgw/test_rgw_reshard.py", line 53, in get_radosgw_port
    x = out.decode('utf8').split(" ")
AttributeError: 'bool' object has no attribute 'decode'

because when valgrind is enabled, the process name is 'valgrind' instead
of 'radosgw'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-09 14:26:26 -05:00
Jason Dillaman
f079116e87 qa/workunits/rbd: show snapshot deltas during stress test failure
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-08 10:13:35 -05:00
Jason Dillaman
094bfeaf8e qa/suites/rbd: add snapshot-based mirroring stress test
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-08 09:23:35 -05:00
Jason Dillaman
8643b046fb test/rbd-mirror: fix broken ceph_test_rbd_mirror_random_write
It appears that commit 6eb8f30a23 broke the test utility and
its failure was masked by the test case that expected a failure
due to a timeout force-killing the app.

Fixes: https://tracker.ceph.com/issues/49117
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-02-02 23:34:18 -05:00
Sage Weil
fafdb1e47d Merge PR #39149 into master
* refs/pull/39149/head:
	qa/workunits/cephtool/test.sh: tolerate some settling for osd info vs dump test

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 16:25:01 -06:00
Josh Durgin
25651e57b5
Merge pull request #38805 from kamoltat/wip-mgr-pg-autoscaler-improve-out-of-box-experience
pybind/mgr/pg_autoscaler: avoid scale-down until there is pressure

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 11:33:55 -08:00
Kamoltat
daeb6f6ac0 mgr/pg_autoscaler: avoid scale-down until there is pressure
The autoscaler will start out with scaling each
pools to have a full complements of pgs from the start
and will only decrease it when pools need more due to
increased usage.

Introduced a unit test that tests only the
function get_final_pg_target_and_ratio() which
deals with the distrubtion of pgs amongst the
pools

Edited workunit script to reflect the change
of how pgs are calculated and distrubted.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-02-01 13:05:54 +00:00
Sage Weil
b2651236b9 Merge PR #39097 into master
* refs/pull/39097/head:
	qa/workunits/cephadm/test_cephadm: fix argument
	qa/workunits/cephadm/test_cephadm: show exporter output
	qa/workunits/cephadm/test_cephadm: don't bother pulling octopus
	qa/workunits/cephadm/test_cephadm: behave on terminal
	qa/workunits/cepham/test_cephadm: pull only recent images, from quay.ceph.io
	qa/workunits/cephadm/test_cephadm: don't respawn for python versions

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-01-30 10:14:43 -06:00
Sage Weil
8c625c077b qa/workunits/cephadm/test_cephadm: fix argument
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 13:34:44 -06:00
Sage Weil
a78dab9e53 qa/workunits/cephadm/test_cephadm: show exporter output
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 15:15:02 -06:00
Sage Weil
7bbc92eda3 mon: updates for quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
a4eb550615 qa/workunits/cephtool/test.sh: tolerate some settling for osd info vs dump test
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:20:22 -06:00
Sage Weil
f394eafd64 qa/workunits/cephadm/test_cephadm: don't bother pulling octopus
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 21:46:24 -06:00
Sage Weil
c82770f77c qa/workunits/cephadm/test_cephadm: behave on terminal
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 21:46:09 -06:00
Jason Dillaman
f8862cff1b
Merge pull request #39089 from orozery/librbd-luks-cli-test
test/librbd: fix luks encryption cli test on unsupported runs

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-26 15:17:12 -05:00
Sage Weil
8aba5ebcc6 Merge PR #39028 into master
* refs/pull/39028/head:
	cephadm: retry for 30s instead of 10s
	cephadm: try 'mgr stat' before 'mgr dump' to get the epoch
	mon: add 'mgr stat' command

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-01-26 11:22:50 -06:00
Or Ozeri
2f1eb8eba0 test/librbd: fix luks encryption cli test on unsupported runs
This commit changes the luks encryption cli test to return success instead of failure when not supported.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2021-01-26 18:54:05 +02:00
Sage Weil
1dccdd2fa1 qa/workunits/cepham/test_cephadm: pull only recent images, from quay.ceph.io
No reason to pull nautilus/mimic, which don't even support cephadm.

This test will mostly run in the sepia lab, so pull from there.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 10:19:53 -06:00
Sage Weil
90676eb9b1 qa/workunits/cephadm/test_cephadm: don't respawn for python versions
We aren't supporting python2 anymore.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-26 10:19:20 -06:00
Jason Dillaman
988a6ac8d3
Merge pull request #39006 from orozery/librbd-luks-cli-test
test/librbd: add luks encryption cli test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-26 09:46:20 -05:00
Matt Benjamin
9bac99361f test/rgw_file: override keyring if we gen keys
Run with ceph.keyring not that of client.${CEPH_ID}.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-01-25 16:46:50 -05:00
Matt Benjamin
247d00817d test/rgw_file: elaborate test cycle
Ensure that all delete phases are run so that script can be
re-run when desired.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
 Please enter the commit message for your changes. Lines starting
2021-01-25 16:46:41 -05:00
Matt Benjamin
e6d54e7d79 rgw_file: add librgw unit test arguments
Also adjust some unit test files to avoid trivial failures.
Fixes missing commit after rgw_write(), as well as conditional
cleanup.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-01-25 16:46:25 -05:00
Casey Bodley
12b5b9506c qa/rgw: librgw workunit creates a test user
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-01-25 16:46:18 -05:00