Commit Graph

2214 Commits

Author SHA1 Message Date
Sebastian Wagner
bbd18f1986
Merge pull request #32049 from mgfritch/wip-cd-timeout
cephadm: add ability to specify a timeout

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-17 08:32:06 +01:00
Kefu Chai
d8a3c605cb
Merge pull request #32625 from mgfritch/cephadm-workunit-test-cleanup
qa/workunits/cephadm/test_cephadm: workunit test cleanup

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-15 12:33:52 +08:00
Sage Weil
ef91c1e70b Merge PR #32622 into master
* refs/pull/32622/head:
	qa/workunits/cephadm/test_cephadm: drop stray 'exit 0'

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-14 08:45:30 -06:00
Michael Fritch
19e20c2e89
qa/workunits/cephadm/test_cephadm: add SUDO to vgchange
2020-01-13T10:48:14.235 INFO:tasks.workunit.client.0.smithi177.stderr:+ vgchange -an test_cephadm
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr:  WARNING: Running as a non-root user. Functionality may be unavailable.
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr:  /run/lvm/lvmetad.socket: access failed: Permission denied
2020-01-13T10:48:14.240 INFO:tasks.workunit.client.0.smithi177.stderr:  WARNING: Failed to connect to lvmetad. Falling back to device scanning.
2020-01-13T10:48:14.260 INFO:tasks.workunit.client.0.smithi177.stderr:  /dev/mapper/control: open failed: Permission denied
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr:  Failure to communicate with kernel device-mapper driver.
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr:  Incompatible libdevmapper 1.02.145 (2017-11-03) and kernel driver (unknown version).
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  /run/lock/lvm/V_test_cephadm:aux: open failed: Permission denied
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  Can't get lock for test_cephadm
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  Cannot process volume group test_cephadm

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-13 15:18:24 -07:00
Michael Fritch
57f3dc87b1
qa/workunits/cephadm/test_cephadm: need to add quotes for PYTHONS var
2020-01-13T10:48:13.374 INFO:tasks.workunit.client.0.smithi177.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh: line 46: [: python3: binary operator expected

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-13 15:18:24 -07:00
Sage Weil
fe8f423345 qa/workunits/cephadm/test_cephadm: drop stray 'exit 0'
Introduced in 40b70c632d

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-13 14:40:51 -06:00
Casey Bodley
cfa5922fd8 qa/rgw: add rgw_obj and throttle tests to rgw verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-01-09 16:51:37 -05:00
Michael Fritch
906bfb3251
cephadm: add timeout for run, shell, enter, logs
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-09 07:59:40 -07:00
Ilya Dryomov
53066d09ab
Merge pull request #32358 from idryomov/wip-krbd-py3-fixup
qa: krbd_exclusive_option.sh: fixup for json.tool ordering change

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-06 21:54:43 +01:00
Patrick Donnelly
e389d9016c
Merge PR #32480 into master
* refs/pull/32480/head:
	qa: use -D_GNU_SOURCE when compiling fsync-tester.c
	qa: add comment about fsync-tester distribution

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:34:37 -08:00
Kefu Chai
f05696ebeb qa: enable CRB repo for RHEL8
instead of enabling PowerTools repo, we need to enable CodeReady Builder
repo for RHEL8

also, since we are moving to RHEL8, there is no need to install cmake3
specifically for CentOS. CentOS 8 comes with cmake3.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-06 23:41:23 +08:00
Ilya Dryomov
b2b7610d1a qa: krbd_exclusive_option.sh: fixup for json.tool ordering change
In Python 3.5 json.tool was changed to produce unsorted output and
--sort-keys option was added to compensate.  This wasn't caught by
4fe245cc2f ("qa: update krbd tests for python3") because it raced
with 50933b863a ("qa: krbd_exclusive_option.sh: update for recent
kernel changes").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-06 15:12:25 +01:00
Patrick Donnelly
6ea7c5ce49
qa: use -D_GNU_SOURCE when compiling fsync-tester.c
Otherwise loff_t is unavailable for some distributions.

Fixes: https://tracker.ceph.com/issues/43460
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 15:45:52 -08:00
Patrick Donnelly
95013b0346
qa: add comment about fsync-tester distribution
I was initially confused why this would not be included in the QA suite.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 15:45:29 -08:00
Kefu Chai
62f4ace05b
Merge pull request #31722 from tchaikov/wip-mon-deprecated-tell
mon: make "compact" tell command, and add deprecate/obsolete check for tell commands

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-26 18:03:13 +08:00
Sage Weil
31e6b807f9 Merge PR #32405 into master
* refs/pull/32405/head:
	qa/workunits/rados/test_large_omap_detection: py3-ify

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-25 09:18:58 -06:00
Mykola Golub
39700358df
Merge pull request #32409 from dillaman/wip-qa-rbd-python3
qa/workunits/rbd: fixed python interpreter for EL8

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-12-24 18:11:15 +02:00
Kefu Chai
4c6a5798c2
Merge pull request #32222 from toabctl/qa-flake8-py3
qa: Run flake8 on python2 and python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-24 10:47:07 +08:00
Jason Dillaman
5116a77f5d qa/workunits/rbd: fixed python interpreter for EL8
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-12-23 15:23:49 -05:00
Sage Weil
f70e206e13 qa/workunits/rados/test_large_omap_detection: py3-ify
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-23 13:55:08 -06:00
Sage Weil
40b70c632d cephadm: move mon creation config bits into mgr/cephadm
There's no need for mgr/cephadm to pass --mon-* arguments to
/usr/bin/cephadm just so it can add bits to the config file when the
config file is also being passed in from mgr/cephadm.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-22 10:50:23 -06:00
Sage Weil
e43c7cd6dd qa/workunits/cephadm/test_cephadm.sh: detect python3 and python2
Only test on whichever pythons are available on the host.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-21 09:03:55 -06:00
Sage Weil
4a566bdc2d Merge PR #32362 into master
* refs/pull/32362/head:
	qa/packages/packages: el8 has granular -debuginfo
	qa/tasks/cbt: include py2 deps on ubuntu for now
	src/test: misc python -> python3
	qa/suites/rados/singleton-flag/valgrind-leaks: run on latest centos
	qa/workunits: env python -> env python3
	qa/suites/rados/dashboard/tasks/dashboard: whitelist OSDMAP_FLAGS
	qa/suites/rados/verify: ping to specific centos
	qa/workunits/rados/test_envlibrados_rocksdb: enable el8 PowerTools
	qa/workunits/rados/test_pool_access.sh: python -> python3
	mgr/crash: fix signature for py3

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-20 09:29:47 -06:00
Sage Weil
1abcb0bb9b qa/workunits: env python -> env python3
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Sage Weil
481a09f6b9 qa/workunits/rados/test_envlibrados_rocksdb: enable el8 PowerTools
We need it for snappy-devel

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Sage Weil
bfbad54b55 qa/workunits/rados/test_pool_access.sh: python -> python3
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Kefu Chai
acbd038522 mon: drop "mon compact" command
quote from Sage's reply

> This is a mon-specific command--it doesn't make sense as a CLI command
> for the entire cluster--it only makes sense as a command to tell a
> specific monitor.  Like ``ceph tell mon.a compact``.  Back when Joao
> did #4595 these commands were all mixed together and putting it under
> 'ceph mon ...' made sense, but now you're specifially sending it to a
> mon, so the 'mon' part of the command is redundant.

so let's drop "mon compact" in favor of "compact" command

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-20 15:56:04 +08:00
Kefu Chai
e9a5ce0897 mon: mark "scrub" commands obsolete
"scrub" was marked deprecated in
1814d7441b. this commit
was in turn included by v10.0.0. so it's long enough for its
retirement.

the test is updated accordingly

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-20 15:56:04 +08:00
Sage Weil
253a557f10 qa/workunits: python -> python3 throughout
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-19 12:38:47 -06:00
Sage Weil
d9756f0a08 qa/workunits/fs/misc/direct_io.py: fix for py3
os.write takes bytes, os.read returns bytes

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-19 12:35:13 -06:00
Sage Weil
3fb581c86f Merge PR #32339 into master
* refs/pull/32339/head:
	qa/tasks/cephfs: python3
	qa/workunits/fs: python3
	qa/tasks/cephfs/fuse_mount: use python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-19 08:13:27 -06:00
Kefu Chai
79584862f6 src,qa: install python bindings into lib/cython_modules/lib.3
instead of checking for the WITH_PYTHON* options, just hardwire to lib.3

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-19 11:52:54 +08:00
Sage Weil
c3112510c1 qa/workunits/fs: python3
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-18 17:39:03 -06:00
Sage Weil
3268ec7ac8 Merge PR #32252 into master
* refs/pull/32252/head:
	qa/cephfs/begin: libaio-devel on el8
	qa/tasks: nosetests -> python -m nose
	qa/tasks/rbd_fio: fio 2.21 -> 3.16
	src/test/cli-integration/rbd/snap-diff.t: python -> python
	qa/workunits: use nose 3
	qa/tasks/cbt: install python3 deps
	qa/tasks/ceph_manager.py: do not use python to write a file
	test/pybind/test_rados: execute takes a bytes (not str) payload
	qa/packages/packages: python[3]-ceph is no more
	qa: use python3 for venvs etc
	packaging: remove python3-ipaddres, as it is part of the stdlib in py3
	qa/packages: python-ceph -> python3-ceph
	qa/distros: centos7 -> centos8, rhel7 -> rhel8
	spec: remove _python_buildid in favor of python3_pkgversion macro
	spec: remove python2 packages and conditions
	debian: remove python >= 2.7 requirement
	debian: add mgr python versions
	debian: explicitly set PYTHON2=OFF to prevent picking up python2 interpreter
	debian: update control file to use python3 dependency names
	debian: remove all python2 overrides and declarations
	debian: remove all python2 install files

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-12-17 15:23:27 -06:00
Sage Weil
6476517def qa/tasks: nosetests -> python -m nose
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 12:57:57 -06:00
Jason Dillaman
6787219e71
Merge pull request #32280 from dillaman/wip-librbd-qos-test
qa/workunit/rbd: fixed QoS throughput unit parsing

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-12-17 12:30:52 -05:00
Jason Dillaman
7838d3e18e qa/workunit/rbd: fixed QoS throughput unit parsing
The 'rbd bench' command was recently modified to print IEC units
instead of bytes/sec. This broke the handling for QoS throughput
tests since it was incorrectly evaluating the available RBD
throughput. Additionally, the QoS tests should use a "<="
comparison operator since the QoS is the upper-bound limit.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-12-17 09:12:43 -05:00
Sage Weil
889446a515 qa/workunits: use nose 3
Ubuntu is /usr/bin/nosetests3, el is /usr/bin/nosetests-3, so do neither.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-16 17:02:45 -06:00
Jason Dillaman
48e14037b3
Merge pull request #32217 from trociny/wip-41557-2
librbd: explicitly specify mode on mirror image enable

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-16 13:14:28 -05:00
Mykola Golub
678b53735b librbd: explicitly specify mode on mirror image enable
- don't use journaling feature to chose the mode;
- provide new API function mirror_image_enable2;
- return back the old behavior to automatically enable/disable
  journaling feature on enabling/disabling image mirroring.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-12-16 08:24:30 +00:00
Sage Weil
240154f114 qa: use python3 for venvs etc
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-13 08:47:28 -06:00
Michael Fritch
34a2bb4495
qa/workunits/cephadm/test_cephadm.sh: re-enable adopt tests
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-13 07:44:34 -07:00
Thomas Bechtold
bdcc94a1d1 qa: Run flake8 on python2 and python3
To be able to catch problems with python2 *and* python3, run flake8
with both versions. From the flake8 homepage:

It is very important to install Flake8 on the correct version of
Python for your needs. If you want Flake8 to properly parse new
language features in Python 3.5 (for example), you need it to be
installed on 3.5 for Flake8 to understand those features. In many
ways, Flake8 is tied to the version of Python on which it runs.

Also fix the problems with python3 on the way.
Note: This requires now the six module for teuthology. But this is
already an install_require in teuthology itself.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>
2019-12-13 09:24:20 +01:00
Sage Weil
3d18771ebe Merge PR #32220 into master
* refs/pull/32220/head:
	qa/workunits/cephadm/test_cephadm.sh: need --fsid always

Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-12 14:23:06 -06:00
Sage Weil
feaa79f902 qa/workunits/cephadm/test_cephadm.sh: need --fsid always
Otherwise the test breaks if there are other cluster(s) on the host (like
there normally are in my dev environment).

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-12 10:46:15 -06:00
Thomas Bechtold
0127cd1e88 qa: Enable flake8 tox and fix failures
There were a couple of problems found by flake8 in the qa/
directory (most of them fixed now). Enabling flake8 during the usual
check runs hopefully avoids adding new issues in the future.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>
2019-12-12 10:21:01 +01:00
Kefu Chai
cb399a9b39
Merge pull request #32143 from tchaikov/wip-qa-rocksdb-test
qa/workunits/rados/test_envlibrados_for_rocksdb: accomodate rocksdb c…

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-12 13:51:03 +08:00
Sage Weil
d120ffcdff ceph-daemon-adoption-corpus -> cephadm-adoption-corpus
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-11 19:14:17 -06:00
Sage Weil
137fa64e12 qa: rename ceph-daemon tests -> cephadm
Also move the workunit to a better location.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-11 19:14:09 -06:00
Jason Dillaman
f6c18468ce
Merge pull request #30548 from trociny/wip-41557
rbd-mirror: snapshot mirror mode

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-10 16:41:28 -05:00