Commit Graph

7802 Commits

Author SHA1 Message Date
Patrick Donnelly
37f7bba5c0
Merge PR #38776 into master
* refs/pull/38776/head:
	qa: get pool holding file data from file layout

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-01-08 11:27:08 -08:00
Patrick Donnelly
b9c35d9d22
Merge PR #38664 into master
* refs/pull/38664/head:
	qa: bump scrub timeout
	qa: move cephfs_ec_profile under cephfs
	qa: do not use ec pools for default data pool
	qa: skip check-counters for light workloads
	qa: remove empty multimds suite
	qa: merge multimds:verify with fs:verify
	qa: merge multimds:thrash to fs:thrash
	qa: remove dead multimds:basic
	qa: move functional multimds tests to fs:functional
	qa: migrate multimds workloads to fs:workloads
	qa: only run valgrind on cephfs daemons
	qa: stop testing filestore on cephfs suites
	qa: load data pools before deleting fs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Tested-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 11:25:23 -08:00
Patrick Donnelly
ea61b6a10f
Merge PR #38693 into master
* refs/pull/38693/head:
	qa: execute scrubs only on rank 0
	client: print debug information about resolved MDS
	qa: let Client::resolve_mds lookup the rank

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-01-08 10:47:07 -08:00
Patrick Donnelly
abe7c86337
qa: remove ceph file systems on completion
So that we can avoid MDS replacement warnings.

Fixes: https://tracker.ceph.com/issues/48757
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 10:44:53 -08:00
Patrick Donnelly
f70228e35a
qa: add test for reserved keyword feature
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 08:27:38 -08:00
Varsha Rao
24b70c5186 mgr/volumes/nfs: remove 'ganesha-' prefix from cluster id
Orchestrator defines service name as "<service_type>.<service_id>". The ganesha
common config object name in orchestrator is "conf-<service_name>". Volume's
nfs plugin deploys nfs-ganesha clusters with 'ganesha' prefixed to cluster id
and common config object.  It can cause unecessary issues in rook and cephadm.
So let's remove the prefix.

Fixes: https://tracker.ceph.com/issues/48514
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-01-08 12:35:53 +05:30
Patrick Donnelly
0cb3bce3a8
qa: use no client for required client feature tests
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 13:30:46 -08:00
Patrick Donnelly
f7617cf4d7
qa: bump scrub timeout
To avoid timeouts for large workloads.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00
Patrick Donnelly
488f10c62f
qa: move cephfs_ec_profile under cephfs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00
Patrick Donnelly
faa30050c1
qa: do not use ec pools for default data pool
This configuration unnecessarily slows down backtrace writes and bloats
the used disk space.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00
Patrick Donnelly
4a45b9eb3e
qa: skip check-counters for light workloads
None of these are likely to generate exports.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00
Patrick Donnelly
a8bae02bee
qa: remove empty multimds suite
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
2021-01-07 12:55:25 -08:00
Patrick Donnelly
7f449dd09f
qa: merge multimds:verify with fs:verify
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
2021-01-07 12:55:25 -08:00
Patrick Donnelly
cb45fc085c
qa: merge multimds:thrash to fs:thrash
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
2021-01-07 12:55:25 -08:00
Patrick Donnelly
09a1a8d044
qa: remove dead multimds:basic
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
2021-01-07 12:55:24 -08:00
Patrick Donnelly
474cb0a9ca
qa: move functional multimds tests to fs:functional
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
2021-01-07 12:55:24 -08:00
Patrick Donnelly
a32462fe4d
qa: migrate multimds workloads to fs:workloads
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Fixes: https://tracker.ceph.com/issues/48121
2021-01-07 12:55:24 -08:00
Patrick Donnelly
36d731c6f3
qa: only run valgrind on cephfs daemons
OSD valgrind slows things down too much to the point where some tasks
fail to complete.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:24 -08:00
Patrick Donnelly
5441c93537
qa: stop testing filestore on cephfs suites
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:24 -08:00
Patrick Donnelly
52059703bc
qa: load data pools before deleting fs
Otherwise current data pools at time of deletion may not be known.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:24 -08:00
Patrick Donnelly
0aba110696
Merge PR #38794 into master
* refs/pull/38794/head:
	qa: add debug vstart_runner option

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-01-07 08:46:24 -08:00
Sebastian Wagner
80cbe7ecaa
Merge pull request #38681 from pcuzner/enable-exporter
cephadm: enable exporter deployment at bootstrap

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-07 10:30:53 +01:00
Yuri Weinstein
962df165b2 qa/tests: changed the dirs structure
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-01-06 13:12:44 -08:00
Yuri Weinstein
fd78328ca0
Merge pull request #38787 from yuriw/wip-yuriw-octopus-x-master
qa/tests: octopus-x suite added more workloads

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-01-06 12:47:06 -08:00
Patrick Donnelly
2bce009d99
qa: add debug vstart_runner option
The default was changed to INFO recently but there was no way to restore
visibility of DEBUG messages.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-06 11:36:49 -08:00
Patrick Donnelly
1015e935ea
qa: check for rank hole without racy joinable flag gymnastics
Fixes: https://tracker.ceph.com/issues/48770
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-06 11:30:15 -08:00
Patrick Donnelly
79a027bb4a
qa: skip client mounts for TestResize
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-06 11:30:14 -08:00
Yuri Weinstein
03dc6cb3b5 qa/tests: octopus-x suite added more workloads
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-01-06 10:23:40 -08:00
Neha Ojha
f3af610721 qa/tasks/cephadm.py: do not create rbd pool by default
rados/cephadm/smoke* does not use the install task and the adjust-ulimits
dependency is met as a part of it. create_rbd_pool needs adjust-ulimits,
so for now we will disable create_rbd_pool by default and only set it
to true for the upgrade suite.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-01-06 17:35:15 +00:00
Patrick Donnelly
d7cacef125
qa: get pool holding file data from file layout
Otherwise it always looks at the default data pool. For ec pools, this
may not be where the file data is.

Fixes: https://tracker.ceph.com/issues/48756
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-06 07:11:20 -08:00
Neha Ojha
fcff116216 qa/suites/upgrade/octopus-x: add rados_loadgenbig workload
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-01-05 21:36:04 +00:00
Neha Ojha
276a4fb8b0 qa/tasks/cephadm.py: create RBD pool
The ceph task already does this and a bunch of tests rely on this pool
being already present. Can be disabled by setting create_rbd_pool to False.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-01-05 21:32:41 +00:00
Ronen Friedman
1323bdb839 qa/standalone/scrub/osd-recovery-scrub: fix unnoticed recovery state
The 'recovering' state is transitory. Existing code looks for it by
polling 'pg stat', missing from time to time.
New version searches the tails of the relevant OSDs' logs.

Fixes: https://tracker.ceph.com/issues/48719
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-01-04 13:29:41 +02:00
Kefu Chai
a51f8f2612
Merge pull request #38676 from ronen-fr/wip-48690
qa/standalone/scrub/osd-scrub-snaps.sh: fix Python print syntax

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-04 19:04:45 +08:00
Mykola Golub
5fbae26e9e
Merge pull request #38694 from dillaman/wip-migration-import
librbd/migration: tweaks and initial set of documentation

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-01-03 11:07:20 +02:00
Jason Dillaman
d22ca3d978 librbd/migration: require snapshot when importing from native source
Since we cannot mark the source image read-only when running in import-only
migration mode, we should require the user to provide a snapshot to ensure
that data cannot change while the migration is running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:53 -05:00
Kefu Chai
bd0553730b
Merge pull request #36088 from rhcs-dashboard/fix-45822-master
mgr/dashboard:minimize console log traces of Ceph backend API test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-01-01 12:10:25 +08:00
Ronen Friedman
bb848cfd90 qa/standalone/ceph-helpers.sh: log meaningful PIDs for run_in_background()
While the relevant comment says:
'# Execute the command and prepend the output with its pid'
the actual PID logged is the same for all background processes,
which isn't very helpful.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-12-28 10:47:02 +02:00
Ronen Friedman
445db7f171 qa/standalone/scrub/osd-recovery-scrub: handle a Primary change
Stop waiting for a scrub to happen if the Primary for the target
PG changes.

Fixes: https://tracker.ceph.com/issues/48720
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-12-28 10:42:41 +02:00
Patrick Donnelly
ac84e8277e
Merge PR #38037 into master
* refs/pull/38037/head:
	qa: test_readahead add kernel client support

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-23 20:33:47 -08:00
Yuri Weinstein
5ab1e53221
Merge pull request #38707 from ceph/wip-yuriw-octopus-x-4-master
qa/tests: initial check in for octopus-x/parallel tests (try 2)

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-23 13:09:51 -08:00
Josh Durgin
c79fa6d780 qa/tasks/cephadm: include first mgr host when applying mgrs
This prevents the first mgr from being shut down due to lack of
appropriate placements.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-12-23 11:30:54 -08:00
Patrick Donnelly
1eb6511bcc
qa: execute scrubs only on rank 0
Fixes: https://tracker.ceph.com/issues/48702
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-23 09:41:54 -08:00
Aashish Sharma
f5dd0195cd mgr/dashboard:minimize console log traces of Dashboard backend API tests
Changed log levels in some files to reduce console log traces

Fixes: https://tracker.ceph.com/issues/45822
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2020-12-23 11:32:43 +05:30
Patrick Donnelly
94d4a400cd
qa: let Client::resolve_mds lookup the rank
Who knew this magic already existed!

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-22 20:16:31 -08:00
Yuri Weinstein
a6e601b7f2 qa/tests: add light octopus-x/copy (cephadm based)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-12-22 16:20:15 -08:00
Paul Cuzner
bd8036a900 cephadm: update QA tests to include cephadm-exporter
Test updated to include deployment of a cluster with
cephadm-exporter active. Tests include varifying config
(token), the state of it's threads are all active and a
check that the placement pattern is for all hosts

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-12-23 12:24:52 +13:00
Varsha Rao
4c83f93f83 qa/cephfs/nfs: Add test for readonly export
Fixes: https://tracker.ceph.com/issues/48622
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-22 11:47:38 +00:00
Sebastian Wagner
af9dac1ff5
Merge pull request #38650 from dmick/wip-dmick-docker-mirror
qa/distros: configure podman to pull from docker-mirror

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-22 01:08:18 +01:00
Ronen Friedman
dff7faaf3c qa/standalone/scrub/osd-scrub-snaps.sh: fix Python print syntax
Fixes: https://tracker.ceph.com/issues/48690
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-12-21 16:52:27 +02:00
Ernesto Puerta
23f2604d6f
Merge pull request #38259 from rhcs-dashboard/fix-jwt-token
mgr/dashboard: Use secure cookies to store JWT Token

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2020-12-21 11:23:53 +01:00
Kefu Chai
2d2e71fe0d
Merge pull request #38522 from tchaikov/wip-mon-health-cleanup
mon/HealthMonitor: split large method into smaller ones and cleanups

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-12-19 11:11:36 +08:00
Patrick Donnelly
802fd61bf4
Merge PR #38495 into master
* refs/pull/38495/head:
	doc: add documentation for new multifs feature
	qa: update tests concerning setting of multifs
	mon,mds: mark multifs stable

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-12-18 13:24:43 -08:00
Aashish Sharma
3c72dc3099 mgr/dashboard: Use secure cookies to store JWT Token
This PR intends to store the jwt token in secure cookies instead of local storage

Fixes: https://tracker.ceph.com/issues/44591

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 36703c63381e6723fff57266235f8230e6af1d92)
2020-12-18 19:33:50 +05:30
Dan Mick
f30c55a242 qa/distros: configure podman to pull from docker-mirror
This also requires a change to cephadm.py to search for
registry entries for docker.io by 'prefix' or 'location',
and to only add the mirror if a mirror isn't already present

Signed-off-by: Dan Mick <dmick@redhat.com>
2020-12-18 09:53:50 +00:00
Ilya Dryomov
fb03fa3766
Merge pull request #38638 from idryomov/wip-krbd-stable-writes-attr
qa: krbd_stable_pages_required.sh: move to stable_writes attribute

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-18 10:30:34 +01:00
Xiubo Li
2f4980f394 qa: test_readahead add kernel client support
If the "ceph.cluster_fsid" and "ceph.client_id" vxattrs or the
"metric" debug file are not support yet, will assume the test
succeeds.

Fixes: https://tracker.ceph.com/issues/48053
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-18 09:07:26 +08:00
Ernesto Puerta
b383a1fdf3
Merge pull request #38284 from rhcs-dashboard/48355-read-pwd-from-file
mgr/dashboard: CLI commands: read passwords from file

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: knortema <knortema@redhat.com>
2020-12-17 17:36:42 +01:00
Xiubo Li
62426772f5 qa: add ceph iscsi test suite support
Currently this only supports the gwcli tests on CentOS/RHEL 8 with
2 ceph iscsi gateways.

Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:49:21 +08:00
Ilya Dryomov
5adfc15b87 qa: krbd_stable_pages_required.sh: move to stable_writes attribute
bdi/stable_pages_required attribute was deprecated in 5.10 and now
always returns 0.  The replacement is queue/stable_writes.  (It is
also writeable, so we can simplify these test cases somewhat in the
future.)

Fixes: https://tracker.ceph.com/issues/48232
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-12-17 13:41:34 +01:00
Xiubo Li
8bcb63877c qa/tasks: get the correct clone_dir for each client
The clone_dir will be overrided in the loop.

Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:38:48 +08:00
Xiubo Li
8b0ebe1240 qa/tasks: allow none client prefixed node to run the cram
Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:38:48 +08:00
Xiubo Li
cfb86025fa qa/tasks: fix not enough values to unpack value error
Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:38:48 +08:00
Alfonso Martínez
5d7ee7c1f0 mgr/dashboard: CLI commands: read passwords from file
Fixes: https://tracker.ceph.com/issues/48355

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-12-17 08:36:57 +01:00
Patrick Donnelly
c0a30527db
Merge PR #38236 into master
* refs/pull/38236/head:
	qa: forward scrubbing background task

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-16 20:11:42 -08:00
Patrick Donnelly
123de8cda8
qa: fix tox failures
Fixes: c6121e48ec
Fixes: https://tracker.ceph.com/issues/48633
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-16 12:43:58 -08:00
Patrick Donnelly
c6121e48ec
Merge branch 'CVE-2020-27781' into master
* CVE-2020-27781:
  tasks/cephfs/test_volume_client: Add tests for authorize/deauthorize
  pybind/ceph_volume_client: Optionally authorize existing auth-ids
  pybind/ceph_volume_client: Preserve existing caps while authorize/deauthorize auth-id
  pybind/ceph_volume_client: Disallow authorize auth_id

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2020-12-16 08:19:21 -08:00
Nizamudeen A
41941f0d28 mgr/dashboard: Temporary User Lockout if 10 Invalid Login attempts
Implemented a user lockout mechanism if the user enters 10 invalid attempts. The attempt count gets resetted to 0 once the user succesfully logins before getting disabled. Once the user gets disabled administrator has to manually enable the user which will also resets the number of attempts.

Fixes: https://tracker.ceph.com/issues/40914
Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-12-16 16:14:47 +05:30
Patrick Donnelly
4bd9ef0965
qa: update tests concerning setting of multifs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-14 10:42:23 -08:00
Milind Changire
a4757451f2 qa: forward scrubbing background task
Add forward scrubbing thrasher task to scrub file-system while a long
running IO is taking place.

Fixes: https://tracker.ceph.com/issues/17856
Signed-off-by: Milind Changire <mchangir@redhat.com>
2020-12-14 03:32:38 +05:30
Kefu Chai
ea9c14c322
Merge pull request #38020 from mdw-at-linuxbox/teuth-fix-x509-san
qa/tasks/openssl_keys.py: add subjectAltName to certificates

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-12 12:18:16 +08:00
Patrick Donnelly
cd62a8494b
Merge PR #38322 into master
* refs/pull/38322/head:
	test_cephfs_shell: add tests for ls command

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-12-11 18:59:42 -08:00
Patrick Donnelly
0c663e7d4e
Merge PR #38511 into master
* refs/pull/38511/head:
	qa/tasks/cephfs/nfs: Check if host ip is in cluster info output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 09:47:35 -08:00
Kefu Chai
694ed23e9d qa/standalone/misc/ver-health.sh: include the bootup-time
in my test bed, it takes 11 seconds to boot the 3 OSDs and to restart
one of them, this fails the test.

so we need to take the time into consideration. in this change, the
delay is added to the total "warn_older_version_delay", so the monitor
does not start sending warning earlier than expected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:14:03 +08:00
Kefu Chai
4bcfa139ab mon/HealthMonitor: use timespan for mon_warn_older_version_delay
for better user experience

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:12:47 +08:00
Kefu Chai
3f1aa66ee2
Merge pull request #38501 from tchaikov/wip-cmake-crimson-test
test/crimson: do not link against crimson-{os,common}

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 15:52:22 +08:00
Kotresh HR
aa4beb3d99
tasks/cephfs/test_volume_client: Add tests for authorize/deauthorize
1. Add testcase for authorizing auth_id which is not added by
   ceph_volume_client
2. Add testcase to test 'allow_existing_id' option
3. Add testcase for deauthorizing auth_id which has got it's caps
   updated out of band

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:58 -08:00
Sebastian Wagner
84a110744c
Merge pull request #38490 from sebastian-philipp/mypy-0.790
src,qa,dashboard: Upgrade to mypy 0.790

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-10 22:41:47 +01:00
Kefu Chai
cbaa18e85a
Merge pull request #38524 from tchaikov/wip-crimson-qa-rbd
qa/suites: add crimson-rados/rbd test suites

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-10 22:18:39 +08:00
Sebastian Wagner
56db4fbed8
Merge pull request #38009 from ideepika/wip-48058-cephadm
qa/tasks/cephadm: update_info_yam() only if ctx.archive is valid

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-10 15:13:42 +01:00
Jason Dillaman
6f4e3b0dd1
Merge pull request #36551 from CongMinYin/immutable_object_cache_throttle
tools: add throttle mechanism to immutable object cache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 09:07:16 -05:00
Kefu Chai
c467027a95 qa/suites: add crimson-rados/rbd test suites
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-10 20:41:30 +08:00
Ernesto Puerta
f977d1acf2
Merge pull request #38435 from votdev/issue_48449_test_standby
mgr/dashboard: test_standby* (tasks.mgr.test_dashboard.TestDashboard) failed locally

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-10 13:25:03 +01:00
Kefu Chai
1f5406a752 src/*: do not pass cct to ceph_version_to_str()
in e5b1ae5554, a new option named
"debug_version_for_testing" is introduced to override the version so
we can test version check.

in crimson, we have two families of shared functions.

- one of them is used by alien store. they are compiled with
  -DWITH_SEASTAR and -DWITH_ALIEN, to enable the shim code between
  seastar and POSIX thread.
- another is used by crimson in general. where no lock is allowed.

currently, we use the "crimson" and "ceph" namespace to differentiate
these two families of functions, so they can colocate in the same
executable without violating the ODR. see src/include/common_fwd.h for
more details.

the functions defined in src/common/version.cc are also shared by
alien store and crimson code. and because we have different
implementations of `CephContext` in crimson and in classic OSD (i.e.
alienstore), we have to have different implementations of this function
as well, if we follow the same approach. but since these functions are
very simple and are non-blocking, there is not much value in
differentiating them, it is better to inject the test settings using
environment variable instead of using ceph option subsystem.

in this change, "ceph_debug_version_for_testing" environment variable is
checked instead, so that crimson and alienstore can share the same
compilation unit of version.cc. and "debug_version_for_testing" option
is removed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-10 18:26:39 +08:00
Ronen Friedman
32fb8e9a38
Merge pull request #38472 from ronen-fr/wip-ronenf-qa-scrub
test: cancelling both noscrub *and* nodeep-scrub
2020-12-09 21:41:14 +02:00
Patrick Donnelly
69e073aed3
Merge PR #38407 into master
* refs/pull/38407/head:
	qa: allow arbitrary mount options on kclient mounts

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-12-09 11:29:10 -08:00
Ronen Friedman
43b1129030 test: cancelling both noscrub *and* nodeep-scrub
as part of osd-scrub-test.sh.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-12-09 20:16:23 +02:00
Varsha Rao
db50dd29c3 qa/tasks/cephfs/nfs: Check if host ip is in cluster info output
Along with host IP, sometimes Docker container IP's shows up in 'hostname -I'
output. Since this output is variable. Just check if host IP is present in the
cluster info output.

Fixes: https://tracker.ceph.com/issues/48491
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-09 16:52:50 +00:00
Sebastian Wagner
8b55bb6556 src,qa: Upgrade to mypy 0.790
dashboard/tools: Make sure {begin,end}_time are set.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-09 09:18:16 +01:00
Patrick Donnelly
7ba3669e88
Merge PR #38419 into master
* refs/pull/38419/head:
	vstart_runner: print result line unless opt_rotate_log is set

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-08 07:35:23 -08:00
Jeff Layton
4181742a3b qa: allow arbitrary mount options on kclient mounts
With this, we can pass a list of mount options to the kclient that will
be added onto the default ones. This is necessary to support testing
with fscache enabled (and other features activated by mount options).

Fixes: https://tracker.ceph.com/issues/6373
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2020-12-04 18:22:28 -05:00
Ernesto Puerta
4ae467e979
Merge pull request #38298 from bk201/wip-43165
mgr/dashboard: refactor /api/orchestrator/* endpoints

Reviewed-by: Courtney Caldwell <ccaldwel@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-04 18:24:46 +01:00
Mykola Golub
4939841633
Merge pull request #38379 from dillaman/wip-librbd-migration-5
librbd/migration: add thick-provisioned snapshot support to the raw format

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-04 17:43:59 +02:00
Volker Theile
9d4282e53a mgr/dashboard: test_standby* (tasks.mgr.test_dashboard.TestDashboard) failed locally
Fixes: https://tracker.ceph.com/issues/48449

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-12-04 14:39:37 +01:00
Tarang Sharma
8e1afc35f8 test_cephfs_shell: add tests for ls command
Signed-off-by: Tarang Sharma <tarangnsharma@gmail.com>
2020-12-04 00:03:19 +05:30
Deepika Upadhyay
4da3b23b89 qa/tasks/ceph: rename s/update_archive_setting/update_info_yaml
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-03 22:08:52 +05:30
Deepika Upadhyay
6d7ba1180e qa/tasks/cephadm: use cluster.sh and remote.sh for better readibility
in extention for: 9536625558

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-03 21:23:12 +05:30
Deepika Upadhyay
22b832e94e qa/tasks/cephadm: refactor
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-03 21:23:12 +05:30
Deepika Upadhyay
2f0209ae43 qa/tasks/cephadm: update_info_yaml() only if ctx.archive is valid
related to: 6cd8e4b55883b2d282f101f11521a2759b3db564
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-03 21:23:11 +05:30
Jason Dillaman
80fe5a8735 qa/suites/rbd: new basic migration CLI test case
Pending a larger suite of tests for instant-restore image migration,
this test provides a basic sanity check for both the native and
raw image formats -- including basic snapshot tests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-03 08:30:52 -05:00