Commit Graph

5394 Commits

Author SHA1 Message Date
Sage Weil
379bf4b423 qa/suites/rados/singleton-nomsg/osd_stale_reads.yaml
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-28 11:51:18 -05:00
Lenz Grimmer
b8951d43e6
Merge pull request #29460 from rhcs-dashboard/bucket-versioning
mgr/dashboard: enable/disable versioning on RGW bucket

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-26 15:27:58 +00:00
Patrick Donnelly
9fb9d9b326
Merge PR #28834 into master
* refs/pull/28834/head:
	libcephfs: Add test for lazyio via libcephfs
	libcephfs: Add lazyio_propogate and lazyio_synchronize methods to libcephfs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-09-26 06:26:46 -07:00
Patrick Donnelly
b09b17ef15
Merge PR #30462 into master
* refs/pull/30462/head:
	qa: have kclient tests use new mount.ceph functionality

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2019-09-26 06:17:10 -07:00
Lenz Grimmer
36d1e644e1
mgr/dashboard: test_mgr_module QA test has not been adapted to… (#30513)
mgr/dashboard: Adapt test_mgr_module QA test to latest controller changes

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-09-26 08:48:31 +00:00
Alfonso Martínez
8955809716 mgr/dashboard: enable/disable versioning on RGW bucket
Fixes: https://tracker.ceph.com/issues/40920
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-09-26 08:41:14 +02:00
Patrick Donnelly
30909f5a6a
Merge PR #29824 into master
* refs/pull/29824/head:
	qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning
	mds: add a HEALTH_WARN message when inline_data is enabled
	mds: log a warning message when mds is started on an fs with inline_data
	mon: deprecate CephFS inline_data support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2019-09-24 04:32:28 -07:00
Kefu Chai
b6dc4b020a
Merge pull request #30507 from tchaikov/wip-mgr-features-in-mgrmap
qa/tasks/mgr/dashboard/test_health: update schema

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-09-23 23:18:01 +08:00
Sage Weil
ab594b9b31 Merge PR #30475 into master
* refs/pull/30475/head:
	qa/standalone/ceph-helpers: default pg autoscale mode off for standalone
	os/bluestore: fix objectstore_blackhole read-after-write
	test,misc: do not specify pg_num per pool
	mgr/volumes: do not specify pg_num
	pybind/ceph_volume_client: do not specify pg_num for new pools
	doc: remove all pg_num arguments to 'osd pool create'
	mon: do not require pg_num to 'osd pool create'
	common: default pg_autoscale_mode=on for new pools

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-23 09:12:42 -05:00
Sage Weil
2b56b0387d Merge PR #30506 into master
* refs/pull/30506/head:
	qa/standalone/osd/divergent-priors: add reproducer for bug 41816

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-23 09:11:34 -05:00
Volker Theile
59a7bb209d mgr/dashboard: test_mgr_module QA test has not been adapted to latest controller changes
Fixes: https://tracker.ceph.com/issues/41993

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-09-23 12:54:35 +02:00
Lenz Grimmer
35674ff19c
mgr/dashboard: fix error when linking a bucket to a tenanted u… (#30123)
mgr/dashboard: fix error when linking a bucket to a tenanted user

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-23 10:49:48 +00:00
Mykola Golub
9068510305
Merge pull request #30411 from dillaman/wip-41653
rbd-mirror: simplify peer bootstrapping

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-09-23 10:50:01 +03:00
Sage Weil
f71672c6ad qa/standalone/ceph-helpers: default pg autoscale mode off for standalone
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-22 16:59:07 -05:00
Kefu Chai
2687e5f20c qa/tasks/mgr/dashboard/test_health: update schema
see 351a3b9d38

Fixes: https://tracker.ceph.com/issues/41947
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-22 20:45:24 +08:00
Kefu Chai
83d74a72f3
Merge pull request #29800 from Devp00l/wip-41372
mgr/dashboard: CephFS tab component

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-22 12:08:58 +08:00
Sage Weil
8994a65242 qa/standalone/osd/divergent-priors: add reproducer for bug 41816
Reproducer for https://tracker.ceph.com/issues/41816

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-21 10:09:15 -05:00
Ilya Dryomov
7bbd290de3
Merge pull request #30502 from idryomov/wip-krbd-avoid-hexdump-s
qa: avoid hexdump skip and length options

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-09-21 11:12:28 +02:00
Ilya Dryomov
d1b69136b0 qa: avoid hexdump skip and length options
On Debian-based distros, hexdump(1) comes from FreeBSD in bsdmainutils
package (other distros ship a Linux version from util-linux).  It turns
out that '-s skip' for anything but a regular file has been broken for
ages in FreeBSD -- instead of calling fseek(), it consumed the input
byte by byte with getchar().  This was fixed in commit 7cd5ae492557
"hexdump(1): Speed up -s flag on devices" last year, but it hasn't made
it to the Debian world yet.

bsdmainutils_9.0.6ubuntu3 in xenial had a custom patch for that, but
it's no longer there in bsdmainutils_11.1.2ubuntu1 in bionic.  hexdump
-s <large offset> is now a fancy infinite loop!

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-09-20 21:43:49 +02:00
Jason Dillaman
85f98c01c0 qa/suites/rbd: test case for rbd-mirror bootstrap
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-09-20 08:09:21 -04:00
Jeff Layton
57f91d1550 qa: have kclient tests use new mount.ceph functionality
Now that the mount helper has the ability to discover mon addrs and
can scrape secrets from the keyring, take advantage of it and simplify
the KernelMount class.

Fixes: https://tracker.ceph.com/issues/41892
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-20 06:50:43 -04:00
Jeff Layton
6b5baba2f5 qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning
Some of our tests still enable this, so just ignore this warning
globally.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-19 09:15:29 -04:00
Jeff Layton
9c406d0ab3 mon: deprecate CephFS inline_data support
The plan is to start deprecating this feature now so that we can remove
it in a future release. Change it to require the
--yes-i-really-really-mean-it flag, and to emit a custom
warning when that isn't specified.

For now, we leave the testing in place since we do want to be notified
if something breaks before we're ready to rip it out completely.

Fixes: https://tracker.ceph.com/issues/41311
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-19 09:15:13 -04:00
Sidharth Anupkrishnan
1184619128 libcephfs: Add test for lazyio via libcephfs
Signed-off-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2019-09-19 17:45:25 +05:30
Kiefer Chang
7866c5fc8f
mgr/dashboard: fix error when linking a bucket to a tenanted user
- Prefix bucket name with '/' when linking bucket to a tenanted user
- Add qa tests

Fixes: https://tracker.ceph.com/issues/41611

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-09-19 14:20:51 +08:00
Ilya Dryomov
a9ed8d3279 qa: avoid page cache for krbd discard round off tests
rbd rounds off and ignores discards that are smaller than alloc_size,
but the page cache is invalidated according to the original offset and
length, before calling into the driver.  For a 512~4193792 discard, all
pages except for the first will be invalidated, but the first page may
remain cached after being partially zeroed out.  This results in an
inconsistency when alloc_size != 512.  E.g. for 64k:

                0       512     4k      64k             4M
                |       |       |       |               |
  page cache:   xxxxxxxx00000000xxxxxxxx0000000000000000
       RADOS:   xxxxxxxxxxxxxxxxxxxxxxxx0000000000000000

Given that these tests asserts on-disk state, we need to read directly
from disk.  krbd_discard_512b.t and krbd_zeroout.t are fine -- there is
no rounding there.

Fixes: https://tracker.ceph.com/issues/41753
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-09-17 22:20:27 +02:00
Casey Bodley
97f1be5d3a qa/rgw: rgw/website suite uses subdomain calling format
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:52 -04:00
Casey Bodley
bb56ac01c2 qa/rgw: add new rgw/website suite for static website tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:51 -04:00
Casey Bodley
71312246ad qa/rgw: s3test tasks sets s3website_domain to match dns-s3website-name
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:51 -04:00
Casey Bodley
7a84a00b6b qa/s3tests: use correct endpoint from rgw_server
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:22:21 -04:00
Casey Bodley
c9aac91b18 qa/ragweed: use correct endpoint from rgw_server
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:19:28 -04:00
Casey Bodley
1feca42f4c qa/rgw: fix for extra_args in s3tests task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:19:28 -04:00
Casey Bodley
8c801f073d
Merge pull request #30218 from cbodley/wip-qa-rgw-barbican
qa/rgw: add integration test for sse-kms with barbican

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2019-09-17 08:17:30 -04:00
Stephan Müller
aae81f5f6c mgr/dashboard: CephFS tab Component
The problem was that the CephFS details component was entirely responsible for
managing all other tabs besides it's own. Besides that many API requests
were triggered, which now has been reduced to just one request which is
fired inside the tabs component.

I added an endpoint which contains all adaptations that were done in the
frontend before. This limits the request size and increases the
performance (at least a bit).

Fixes: https://tracker.ceph.com/issues/41372
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-09-17 12:16:26 +02:00
Patrick Donnelly
81d1a162c5
Merge PR #30058 into master
* refs/pull/30058/head:
	qa/tasks: test for prevent negative subvolume size
	mgr/volumes: prevent negative subvolume size

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2019-09-16 11:43:19 -07:00
J. Eric Ivancich
e487604ad2
Merge pull request #29549 from smanjara/wip-multisite-metadata
rgw: Allow admin APIs that write metadata to be executed first on the mast…

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-15 12:54:24 -04:00
Ilya Dryomov
d63570c5a5
Merge pull request #30363 from idryomov/wip-krbd-huge-osdmap
qa: add script to test how libceph handles huge osdmaps

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-09-13 22:35:57 +02:00
Patrick Donnelly
9e59ba40c3
Merge PR #28560 into master
* refs/pull/28560/head:
	cephfs-shell: handle du's arguments elsewhere outside do_du()
	cephfs-shell: reuse code
	cephfs-shell: rewrite call to perror in do_du
	pybind/cephfs: define variable for hexcode used in stat()
	test_cephfs_shell: test cephfs-shell command at invocation
	cephfs-shell: refactor do_du()
	cephfs-shell: option -r is not for reverse
	cephfs-shell: extend to_bytes()
	test_cephfs_shell: test du with no args
	test_cephfs_shell: test du with multiple paths in args
	test_cephfs_shell: test behaviour of "du -r"
	test_cephfs_shell: test du's output for softlinks
	qa/cephfs: add convenience method lstat()
	qa/cephfs: add option to make stat() unfollow symlinks
	test_cephfs_shell: test du's output for hardlinks
	test_cephfs_shell: test du's output for directories
	test_cephfs_shell: test du's output for regular files
	test_cephfs_shell: add a method to get command output
	test_cephfs_shell: allow cmd as list too
	test_cephfs_shell: rename and rewrite _cephfs_shell()
	test_cephfs_shell: copy humanize() from cephfs-shell
	cephfs-shell: print disk usage for non-directory files too
	pybind/cephfs: add method that stats symlinks without following
	cephfs-shell: Fix 'du' command error

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-13 12:39:39 -07:00
Casey Bodley
3bb3d817ff qa/keystone: add --debug to openstack commands
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
392d746141 qa/keystone: save keystone config to archive dir
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
020511eb1f qa/tempest: update url for upper-constraints.txt in tox.ini
the tox command fails to invoke tools/tox_install.sh because it passes
a stale url for its extra requirements. patch that url in tox.ini

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
71a87afb5d qa/barbican: pin barbican to 5.0.1 release
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
29ac64304d qa/keystone: hardcode --os-identity-api-version 2.0
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
2dac5c5012 qa/keystone: add requirements.txt with python-openstackclient
works around a VersionConflict error by including the requirements on
jsonschema when installing python-openstackclient

also pin the version of python-openstackclient, because newer clients
don't seem to recognize --os-url

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
7d479d0bf8 qa/keystone: log to a file in the archive dir
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
2144fd8cc7 qa/keystone: pip install bindep
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
86930f3e0f qa/keystone: use bindep to discover keystone's dependencies
downloads the keystone repository first, because we need
keystone/bindep.txt to discover the binary dependencies

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
0cc6a832c3 qa/keystone: add missing ConfigError import
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
c9c3805cd1 qa: barbican task doesn't look for ceph release branches
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
b797418c04 qa: remove unnecessary imports in barbican task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00