Commit Graph

22 Commits

Author SHA1 Message Date
Matan Breizman
fe83ca08f9 qa/tasks/cbt.py: Fix perf package naming
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-07-24 09:02:43 +00:00
Nitzan Mordechai
e174c6e2cf tasks: Adding cbt performance collect
The change will add another process after cbt complete and results
are available in json format to collect the results into DB
that will later on display in grafana dashboard

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2023-07-09 08:30:08 +00:00
Matan Breizman
780f6f55cd qa/tasks/cbt.py: Install collectl manually
See: d4a04809fd

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-07-04 11:42:34 +00:00
Kyr Shatskyy
85f4747133 qa/tasks/cbt: user remote.write_file
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
2020-09-04 00:02:15 +02:00
Kefu Chai
d7258ea7fd qa/tasks: use next(iter(..)) for accessing first element in a view
in python2, dict.values() and dict.keys() return lists. but in python3,
they return views, which cannot be indexed directly using an integer index.

there are three use cases when we access these views in python3:

1. get the first element
2. get all the elements and then *might* want to access them by index
3. get the first element assuming there is only a single element in
   the view
4. iterate thru the view

in the 1st case, we cannot assume the number of elements, so to be
python3 compatible, we should use `next(iter(a_dict))` instead.

in the 2nd case, in this change, the view is materialized using
`list(a_dict)`.

in the 3rd case, we can just continue using the short hand of
```py
(first_element,) = a_dict.keys()
```
to unpack the view. this works in both python2 and python3.

in the 4th case, the existing code works in both python2 and python3, as
both list and view can be iterated using `iter`, and `len` works as
well.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-07 20:33:47 +08:00
Kefu Chai
8f9e8cce03 Revert "qa/tasks/cbt: include py2 deps on ubuntu for now"
This reverts commit 3f2270a1c4.

since https://github.com/ceph/cbt/pull/208 got merged, there is no need
to install python2 for cbt anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-07 09:35:20 +08:00
Sage Weil
3f2270a1c4 qa/tasks/cbt: include py2 deps on ubuntu for now
...until cbt is converted to py3

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-20 07:17:10 -06:00
Sage Weil
3268ec7ac8 Merge PR #32252 into master
* refs/pull/32252/head:
	qa/cephfs/begin: libaio-devel on el8
	qa/tasks: nosetests -> python -m nose
	qa/tasks/rbd_fio: fio 2.21 -> 3.16
	src/test/cli-integration/rbd/snap-diff.t: python -> python
	qa/workunits: use nose 3
	qa/tasks/cbt: install python3 deps
	qa/tasks/ceph_manager.py: do not use python to write a file
	test/pybind/test_rados: execute takes a bytes (not str) payload
	qa/packages/packages: python[3]-ceph is no more
	qa: use python3 for venvs etc
	packaging: remove python3-ipaddres, as it is part of the stdlib in py3
	qa/packages: python-ceph -> python3-ceph
	qa/distros: centos7 -> centos8, rhel7 -> rhel8
	spec: remove _python_buildid in favor of python3_pkgversion macro
	spec: remove python2 packages and conditions
	debian: remove python >= 2.7 requirement
	debian: add mgr python versions
	debian: explicitly set PYTHON2=OFF to prevent picking up python2 interpreter
	debian: update control file to use python3 dependency names
	debian: remove all python2 overrides and declarations
	debian: remove all python2 install files

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-12-17 15:23:27 -06:00
Sage Weil
299375852a qa/tasks/cbt: install python3 deps
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-16 10:46:13 -06:00
Thomas Bechtold
0127cd1e88 qa: Enable flake8 tox and fix failures
There were a couple of problems found by flake8 in the qa/
directory (most of them fixed now). Enabling flake8 during the usual
check runs hopefully avoids adding new issues in the future.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>
2019-12-12 10:21:01 +01:00
Sage Weil
56e99ba5f0 qa/tasks/cbt: run stop-all.sh when finishing up
stop-all.sh will work if the right deps are there (currently we lack 'nc')

also killall -9 java to be sure.

Fixes: https://tracker.ceph.com/issues/42496
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-26 13:25:39 -05:00
Kefu Chai
4913510173 qa/tasks/cbt.py: use "git --depth 1 for" faster clone
we don't need the full history for performing the test.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-08-12 16:58:12 +08:00
Neha Ojha
143c1da2d2 qa/tasks/cbt.py: add support for client_endpoints
Note that this will only work for librbdfio for now.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-06-12 22:36:12 +00:00
Neha Ojha
ee02416c65 qa/tasks/cbt.py: change port to work with client_endpoints
hack to work with https://github.com/ceph/cbt/pull/160/

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-06-06 17:21:38 -07:00
Kefu Chai
4b0e2c8ed4 qa: fix typos
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-09-21 12:41:42 +08:00
Neha Ojha
bf62e1fadc qa/tasks/cbt.py: changes to run on bionic
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-06-04 17:23:21 -07:00
Neha Ojha
8198936df1 qa/tasks: run cosbench using the CBT task
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-04-26 16:36:57 -07:00
Neha Ojha
46dee4b102 qa: preserve cbt task results
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-12-06 13:23:44 -08:00
Neha Ojha
877e3ccada qa: install collectl with cbt task
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-12-04 13:50:33 -08:00
Neha Ojha
973e21694f qa: add cbt repo parameter
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-10-25 10:22:43 -07:00
Neha Ojha
59531d81c5 qa: avoid using make install for fio
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-09-12 08:26:27 -07:00
Neha Ojha
2793ee7d7e qa: add cbt task for performance testing
Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-09-07 15:44:48 -07:00