Commit Graph

8263 Commits

Author SHA1 Message Date
Sage Weil
779af3da6f qa/tasks/cephadm: let cephadm.shell take string or list
Make it a bit more forgiving.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 07:36:47 -05:00
Kefu Chai
d54605c7e6
Merge pull request #40837 from liewegas/cephadm-qa-shorten-thrash
qa/suites/rados/thrash: shorten radosbench

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-04-16 12:42:05 +08:00
Patrick Donnelly
2a81253141
Merge PR #40412 into master
* refs/pull/40412/head:
	vstart_runner: reuse code in LocalRemoteProcess

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-15 21:05:51 -07:00
Patrick Donnelly
3a30edf3de
Merge PR #39660 into master
* refs/pull/39660/head:
	qa: Update the mdsmap schema in mgr/dashboard/test_health.py
	doc: add lsflags command to Administrative Commands document
	qa: test fs lsflags command
	mon: add command to print fs flags
	mds: print each flag value

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-15 21:03:19 -07:00
Casey Bodley
dbede38c7e
Merge pull request #40821 from cbodley/wip-50218
qa/rgw: use symlinks to specify distro

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2021-04-14 14:45:00 -04:00
Sage Weil
babbab14f4 qa/suites/rados/thrash: shorten radosbench
This is the longest of the thrash workloads; reducing it will bring
this test in line with the others (<= 45 min).

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-13 17:42:21 -05:00
Casey Bodley
8cb94edcb1 qa/rgw: rgw/crypt uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-13 10:44:05 -04:00
Ilya Dryomov
7eb9c5ddb2 Merge branch 'master' into wip-unauthorized-gids
Sync up with master up to commit 3d8e73b266 ("Merge pull request
#40731 from tchaikov/wip-yamlize-options").  Specifically, bring in
src/common/options.cc yamlization and move new auth-related options
into src/common/options/global.yaml.in.

Conflicts:
	src/common/options.cc
	src/common/options/global.yaml.in

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-13 15:42:06 +02:00
Sage Weil
dcd90a1c8d Merge PR #40626 into master
* refs/pull/40626/head:
	qa/suites/rados/objectstore: separate store_test tests
	qa/standalone: split osd/ into 2 directories

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-12 22:38:49 -04:00
Sage Weil
d4ac4f3b78 qa/suites/rados/objectstore: separate store_test tests
This takes 5 hours currently.

- Separate out filestore and memstore into separate task (~1 hr)
- Split bluestore into -a and -b (a tests exclude SynethicMatrixC,
  b tests include it)

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-12 16:27:29 -05:00
Ilya Dryomov
ca822b9a8d
Merge pull request #40576 from idryomov/wip-no-cephxv2-for-unmap
qa/suites/krbd: don't require CEPHX_V2 for unmap subsuite

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2021-04-12 21:23:06 +02:00
Kefu Chai
8b879ca72c qa/suites/upgrade/pacific-x/rgw-multisite: specify distro
instead of using the default / existing distro, specify the distro for
testing. this change prevents us from using bionic for testing the
builds. this has two consequences:

* so we are one step closer to a non-bionic world.
* avoid building packages with PPA repo which *might* introduce runtime
  dependencies on 3rd party runtimes provided by PPA repo.

see also: https://tracker.ceph.com/issues/50218

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-12 12:56:35 -04:00
Casey Bodley
6262cfa41f qa/rgw: reenable valgrind in rgw/website
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:31:26 -04:00
Casey Bodley
bbefbd3146 qa/rgw: rgw/tempest uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:30:01 -04:00
Casey Bodley
0a4437ba6f qa/rgw: rgw/multifs uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
09c93945a7 qa/rgw: rgw/thrash uses ubuntu_latest.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1a42bd37d2 qa/rgw: rgw/notifications no longer pins centos
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
c59f994a7e qa/rgw: use symlinks for rgw/sts suite, target supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:28:55 -04:00
Casey Bodley
1942095a32 qa/rgw: rgw/multisite uses supported-random-distro$
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:06:29 -04:00
Casey Bodley
8f27c845be qa/rgw: move rgw/multisite valgrind config into valgrind.yaml.disabled
the valgrind coverage wasn't enabled, and it will take a lot more work
before we can reenable

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-04-12 12:05:16 -04:00
Sage Weil
0f65e5cffa qa/standalone: split osd/ into 2 directories
The whole osd/ directory takes 3 hours to run.  Of that, about half is
osd-backfill*:

2021-04-05T20:38:55.932 INFO:tasks.workunit:Running workunit osd/osd-backfill-prio.sh...
2021-04-05T20:47:27.184 INFO:tasks.workunit:Running workunit osd/osd-backfill-recovery-log.sh...
2021-04-05T20:55:59.497 INFO:tasks.workunit:Running workunit osd/osd-backfill-space.sh...
2021-04-05T21:48:47.549 INFO:tasks.workunit:Running workunit osd/osd-backfill-stats.sh...
2021-04-05T22:17:09.197 INFO:tasks.workunit:Running workunit osd/osd-bench.sh...

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-12 09:59:17 -05:00
J. Eric Ivancich
505b3f2108
Merge pull request #40801 from ivancich/wip-radoslist-incomplete-multipart-parts-marker
rgw: radoslist incomplete multipart parts marker

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-04-12 10:34:50 -04:00
Kefu Chai
6676cf92e1
Merge pull request #40656 from tchaikov/wip-qa-upgrade-focal
qa/suites: test upgrade/octopus-x on focal instead bionic

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-04-12 21:42:43 +08:00
Kefu Chai
1ee844f579
Merge pull request #40811 from tchaikov/wip-gen-corpus
script/gen-corpus.sh: set CEPH_CONF

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-12 21:40:29 +08:00
Kefu Chai
5242487486 qa/workunits/cls: add executable bit to script
all the scripts except for test_cls_cas.sh under qa/workunits/cls
are executable. to be more consistent, add the executable bit to
test_cls_cas.sh as well.

also, these scripts are launched by src/script/gen-corpus.sh directly,
so it's convenient just call them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-12 19:28:47 +08:00
Kefu Chai
caf364db5e
Merge pull request #38120 from kiizawa/wip-cls-remote-read
osd: allow remote read by calling cls method from within cls context

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-12 16:42:52 +08:00
J. Eric Ivancich
d76e65bcd3 rgw: test radosgw-admin radoslist and incomplete multiparts better
Make sure there are more than 1000 incomplete multiparts and also make
sure one of the incomplete multiparts has at least 1000 parts. This
test is done indirectly through rgw-orphan-list, which invokes
`radosgw-admin radoslist`.

Also, clean up shell flags, so script output is less verbose.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2021-04-10 02:07:53 -04:00
Patrick Donnelly
4d29e591dd
Merge PR #40481 into master
* refs/pull/40481/head:
	qa: test standby-replay with fs:workloads

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-09 20:04:32 -07:00
Patrick Donnelly
76ac006875
Merge PR #40431 into master
* refs/pull/40431/head:
	qa/cephfs: remove create_keyring_file from cephfs_test_case.py
	qa/cephfs: don't use sudo to write files in /tmp

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-04-09 20:02:27 -07:00
Samuel Just
055ebe381d
Merge pull request #39216 from myoungwon/wip-manifest-dedup-test
osd, test: reworks for manifest dedup test cases

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-09 12:42:18 -07:00
Kefu Chai
b026037d44 qa/suites: test upgrade/octopus-x on focal instead bionic
so we can solely build on focal in future once all other bionic facets
in qa/ is removed or replaced.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-10 00:51:40 +08:00
Yuri Weinstein
5f2f793af2
Merge pull request #40623 from ronen-fr/wip-ronenf-revert-40077
osd: Revert "osd: Try other PGs when reservation failures occur"

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-04-09 07:45:55 -07:00
Jos Collin
90ec86d8ff
qa: Update the mdsmap schema in mgr/dashboard/test_health.py
Fixed the error:
tasks.mgr.dashboard.helper._ValError: In `input['fs_map']['filesystems'][0]['mdsmap']`: unknown keys: {'flags_state'}
Traceback (most recent call last):
File "/home/jenkins-build/build/workspace/ceph-api/qa/tasks/mgr/dashboard/test_health.py", line 273, in test_full_health
self.assertSchema(data, schema)

Fixes: https://tracker.ceph.com/issues/48683
Signed-off-by: Jos Collin <jcollin@redhat.com>
2021-04-09 17:34:19 +05:30
Patrick Donnelly
4702be4f47
qa: test standby-replay with fs:workloads
Fixes: https://tracker.ceph.com/issues/50045
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-08 11:37:56 -07:00
Rishabh Dave
511434ac5a qa/cephfs: remove create_keyring_file from cephfs_test_case.py
Since teuthology.orchestra.remote.mktemp() can write a temporary file
and not just create it, create_keyring_file() is now redundant.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-04-08 12:11:00 +05:30
Rishabh Dave
e213849581 qa/cephfs: don't use sudo to write files in /tmp
Files in /tmp cannot be written by any user( including the root user)
other than the file owner even if the permission mode on the file is
777.

Fixes: https://tracker.ceph.com/issues/49466
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-04-08 11:56:00 +05:30
Venky Shankar
714d51301b
Merge pull request #40342 from batrick/snap_schedule-qa-fixes
qa: snap_schedule test debugging

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-08 11:51:05 +05:30
Jos Collin
58b62f10d9
qa: test fs lsflags command
Fixes: https://tracker.ceph.com/issues/48682
Signed-off-by: Jos Collin <jcollin@redhat.com>
2021-04-08 11:09:18 +05:30
Yuval Lifshitz
c43878d0bd
Merge pull request #40625 from TRYTOBE8TME/wip-rgw-notifications
rgw/test: Changing force-branch to master
2021-04-08 08:32:45 +03:00
Patrick Donnelly
d06d66d88d
Merge PR #40611 into master
* refs/pull/40611/head:
	qa: retry cloning the ceph.git

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-07 19:35:58 -07:00
Kefu Chai
a9fe167c1a
Merge pull request #40636 from tchaikov/wip-50196
qa/tasks/mgr: skip test_diskprediction_local on python>=3.8

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2021-04-08 10:15:33 +08:00
Kalpesh
42d87989e9 rgw/test: Changing force-branch to master
This PR includes 2 things:
1. Changing force-branch to master and removing the git-remote. This change was forgetten for PR #39139.
2. Proper cleanup/removal after completion of commands more precisely removing the kafka logs directory.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-04-08 01:37:29 +05:30
Kefu Chai
39b2b5edc0 qa/tasks/mgr: skip test_diskprediction_local on python>=3.8
query the python version before trying to test diskprediction_local

Fixes: https://tracker.ceph.com/issues/50196
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-07 21:27:44 +08:00
Casey Bodley
4bf2ea2f70
Merge pull request #40601 from cbodley/wip-50147
qa/rgw: move ignore-pg-availability.yaml out of suites/rgw

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-04-07 08:49:49 -04:00
Kefu Chai
c76940977e
Merge pull request #40604 from liewegas/podman-registries-conf
qa/distros/podman: preserve registries.conf

Reviewed-by: David Galloway <dgallowa@redhat.com>
2021-04-07 15:12:24 +08:00
Ronen Friedman
b8045f7b18 Revert "test: Add test for scrub parallelism"
This reverts commit dd63577ab3.

As 08c3ede084 (the tested functionality) is reverted.
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2021-04-07 08:37:03 +03:00
Sage Weil
72c4fc75ad qa/standalone: default to disable insecure global id reclaim
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-06 17:29:23 -04:00
Sage Weil
3e80f61efe qa/suites/upgrade/octopus-x: disable insecure global_id reclaim health warnings
These will trigger on upgrade; suppress them so that our health gates
will still work.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-06 17:29:23 -04:00
Sage Weil
9f6fd4fe56 qa/tasks/ceph[adm].conf[.template]: disable insecure global_id reclaim health alerts
Turn these off everywhere for our tests so they don't interfere with our health checks.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-06 17:29:21 -04:00
Sage Weil
7ca7418322 cephadm: set auth_allow_insecure_global_id_reclaim for mon on bootstrap
If this is a fresh pacific cluster, let's assume that there won't be
legacy clients connecting.  (And if there are, let's put the burden on
the user to enable them to do so insecurely.)

This is in contrast to upgrades, where our focus is on not breaking
anything.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-06 17:28:55 -04:00