Commit Graph

5406 Commits

Author SHA1 Message Date
Lenz Grimmer
2f4c2440e8
Merge pull request #30478 from votdev/issue_41930_standby_dashboard
mgr/dashboard: Standby Dashboards don't handle all requests properly

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-09-27 09:37:37 +00:00
Kefu Chai
7ae9ffff65
Merge pull request #30517 from tchaikov/wip-test/dashboard/scheme-allow-unknown
qa/tasks/mgr/dashboard/test_health: add "allow_unknown" in mgr_map

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-09-27 13:36:23 +08:00
Patrick Donnelly
719cb3f5b4
Merge PR #30297 into master
* refs/pull/30297/head:
	test_cephfs_shell: add note on how to run this testsuite
	cephfs-shell: rewrite help text for put and get commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-26 22:34:28 -07:00
Patrick Donnelly
07db3c12a1
Merge PR #29906 into master
* refs/pull/29906/head:
	vstart_runner: name booleans for options differently
	qa/vstart_runner.py: add an option to remove old log
	qa/vstart_runner.py: make log initialization code reusable
	qa/vstart_runner.py: make printing of stdout of ps optional
	qa/vstart_runner.py: add timeout for vstart.sh and stop.sh
	qa/vstart_runner.py: add an option to teardown cluster

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-09-26 22:12:03 -07:00
Lenz Grimmer
b8951d43e6
Merge pull request #29460 from rhcs-dashboard/bucket-versioning
mgr/dashboard: enable/disable versioning on RGW bucket

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-26 15:27:58 +00:00
Patrick Donnelly
9fb9d9b326
Merge PR #28834 into master
* refs/pull/28834/head:
	libcephfs: Add test for lazyio via libcephfs
	libcephfs: Add lazyio_propogate and lazyio_synchronize methods to libcephfs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-09-26 06:26:46 -07:00
Patrick Donnelly
b09b17ef15
Merge PR #30462 into master
* refs/pull/30462/head:
	qa: have kclient tests use new mount.ceph functionality

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2019-09-26 06:17:10 -07:00
Lenz Grimmer
36d1e644e1
mgr/dashboard: test_mgr_module QA test has not been adapted to… (#30513)
mgr/dashboard: Adapt test_mgr_module QA test to latest controller changes

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-09-26 08:48:31 +00:00
Alfonso Martínez
8955809716 mgr/dashboard: enable/disable versioning on RGW bucket
Fixes: https://tracker.ceph.com/issues/40920
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2019-09-26 08:41:14 +02:00
Rishabh Dave
dc21d04172 vstart_runner: name booleans for options differently
This achieves 2 things: makes it more understandable for the reader that
the boolean variable is an option and reads less like a method name.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-25 12:13:18 +05:30
Rishabh Dave
254f705e27 qa/vstart_runner.py: add an option to remove old log
Add an option "--clear-old-log" to get rid of log entries before making
entries for current batch of tests.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-25 12:13:10 +05:30
Rishabh Dave
e16ad0126b qa/vstart_runner.py: make log initialization code reusable
Move it to a method so that the code be can be reused.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-25 12:12:00 +05:30
Rishabh Dave
1ef02b724d qa/vstart_runner.py: make printing of stdout of ps optional
stdout of ps command is generally pretty huge which makes it harder to
interpret logs. Don't print it by default and add "--log-ps-output" to
enable printing it.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-25 12:11:54 +05:30
Rishabh Dave
842b5590aa qa/vstart_runner.py: add timeout for vstart.sh and stop.sh
Override default timeout for execution of vstart.sh and stop.sh since
neither scripts take more than 100 seconds normally.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-25 12:10:22 +05:30
Rishabh Dave
83ff993e95 qa/vstart_runner.py: add an option to teardown cluster
Add "--teardown" option so that vstart_runner.py tears down Ceph
cluster automatically after the batch of tests has completed running.
Also delete build/dev and build/out directories, after running stop.sh.

Update the doc for vstart_runner.py as well.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-25 12:09:58 +05:30
Patrick Donnelly
30909f5a6a
Merge PR #29824 into master
* refs/pull/29824/head:
	qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning
	mds: add a HEALTH_WARN message when inline_data is enabled
	mds: log a warning message when mds is started on an fs with inline_data
	mon: deprecate CephFS inline_data support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Douglas Fuller <dfuller@redhat.com>
2019-09-24 04:32:28 -07:00
Kefu Chai
5399337d65 qa/tasks/mgr/dashboard/test_health: add "allow_unknown" in mgr_map
tests/functionalities are not broken if we add more fields to mgr_map.

see also #30507

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-23 23:25:16 +08:00
Kefu Chai
b6dc4b020a
Merge pull request #30507 from tchaikov/wip-mgr-features-in-mgrmap
qa/tasks/mgr/dashboard/test_health: update schema

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-09-23 23:18:01 +08:00
Sage Weil
ab594b9b31 Merge PR #30475 into master
* refs/pull/30475/head:
	qa/standalone/ceph-helpers: default pg autoscale mode off for standalone
	os/bluestore: fix objectstore_blackhole read-after-write
	test,misc: do not specify pg_num per pool
	mgr/volumes: do not specify pg_num
	pybind/ceph_volume_client: do not specify pg_num for new pools
	doc: remove all pg_num arguments to 'osd pool create'
	mon: do not require pg_num to 'osd pool create'
	common: default pg_autoscale_mode=on for new pools

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-23 09:12:42 -05:00
Sage Weil
2b56b0387d Merge PR #30506 into master
* refs/pull/30506/head:
	qa/standalone/osd/divergent-priors: add reproducer for bug 41816

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-23 09:11:34 -05:00
Volker Theile
59a7bb209d mgr/dashboard: test_mgr_module QA test has not been adapted to latest controller changes
Fixes: https://tracker.ceph.com/issues/41993

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-09-23 12:54:35 +02:00
Lenz Grimmer
35674ff19c
mgr/dashboard: fix error when linking a bucket to a tenanted u… (#30123)
mgr/dashboard: fix error when linking a bucket to a tenanted user

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-23 10:49:48 +00:00
Mykola Golub
9068510305
Merge pull request #30411 from dillaman/wip-41653
rbd-mirror: simplify peer bootstrapping

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-09-23 10:50:01 +03:00
Sage Weil
f71672c6ad qa/standalone/ceph-helpers: default pg autoscale mode off for standalone
Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-22 16:59:07 -05:00
Kefu Chai
2687e5f20c qa/tasks/mgr/dashboard/test_health: update schema
see 351a3b9d38

Fixes: https://tracker.ceph.com/issues/41947
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-22 20:45:24 +08:00
Kefu Chai
83d74a72f3
Merge pull request #29800 from Devp00l/wip-41372
mgr/dashboard: CephFS tab component

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-22 12:08:58 +08:00
Sage Weil
8994a65242 qa/standalone/osd/divergent-priors: add reproducer for bug 41816
Reproducer for https://tracker.ceph.com/issues/41816

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-21 10:09:15 -05:00
Ilya Dryomov
7bbd290de3
Merge pull request #30502 from idryomov/wip-krbd-avoid-hexdump-s
qa: avoid hexdump skip and length options

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-09-21 11:12:28 +02:00
Ilya Dryomov
d1b69136b0 qa: avoid hexdump skip and length options
On Debian-based distros, hexdump(1) comes from FreeBSD in bsdmainutils
package (other distros ship a Linux version from util-linux).  It turns
out that '-s skip' for anything but a regular file has been broken for
ages in FreeBSD -- instead of calling fseek(), it consumed the input
byte by byte with getchar().  This was fixed in commit 7cd5ae492557
"hexdump(1): Speed up -s flag on devices" last year, but it hasn't made
it to the Debian world yet.

bsdmainutils_9.0.6ubuntu3 in xenial had a custom patch for that, but
it's no longer there in bsdmainutils_11.1.2ubuntu1 in bionic.  hexdump
-s <large offset> is now a fancy infinite loop!

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-09-20 21:43:49 +02:00
Jason Dillaman
85f98c01c0 qa/suites/rbd: test case for rbd-mirror bootstrap
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-09-20 08:09:21 -04:00
Jeff Layton
57f91d1550 qa: have kclient tests use new mount.ceph functionality
Now that the mount helper has the ability to discover mon addrs and
can scrape secrets from the keyring, take advantage of it and simplify
the KernelMount class.

Fixes: https://tracker.ceph.com/issues/41892
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-20 06:50:43 -04:00
Volker Theile
29cc91f92d mgr/dashboard: Standby Dashboards don't handle all requests properly
Fixes: https://tracker.ceph.com/issues/41930

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-09-19 16:30:15 +02:00
Jeff Layton
6b5baba2f5 qa: whitelist new FS_INLINE_DATA_DEPRECATED health warning
Some of our tests still enable this, so just ignore this warning
globally.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-19 09:15:29 -04:00
Jeff Layton
9c406d0ab3 mon: deprecate CephFS inline_data support
The plan is to start deprecating this feature now so that we can remove
it in a future release. Change it to require the
--yes-i-really-really-mean-it flag, and to emit a custom
warning when that isn't specified.

For now, we leave the testing in place since we do want to be notified
if something breaks before we're ready to rip it out completely.

Fixes: https://tracker.ceph.com/issues/41311
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-09-19 09:15:13 -04:00
Sidharth Anupkrishnan
1184619128 libcephfs: Add test for lazyio via libcephfs
Signed-off-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2019-09-19 17:45:25 +05:30
Kiefer Chang
7866c5fc8f
mgr/dashboard: fix error when linking a bucket to a tenanted user
- Prefix bucket name with '/' when linking bucket to a tenanted user
- Add qa tests

Fixes: https://tracker.ceph.com/issues/41611

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-09-19 14:20:51 +08:00
Ilya Dryomov
a9ed8d3279 qa: avoid page cache for krbd discard round off tests
rbd rounds off and ignores discards that are smaller than alloc_size,
but the page cache is invalidated according to the original offset and
length, before calling into the driver.  For a 512~4193792 discard, all
pages except for the first will be invalidated, but the first page may
remain cached after being partially zeroed out.  This results in an
inconsistency when alloc_size != 512.  E.g. for 64k:

                0       512     4k      64k             4M
                |       |       |       |               |
  page cache:   xxxxxxxx00000000xxxxxxxx0000000000000000
       RADOS:   xxxxxxxxxxxxxxxxxxxxxxxx0000000000000000

Given that these tests asserts on-disk state, we need to read directly
from disk.  krbd_discard_512b.t and krbd_zeroout.t are fine -- there is
no rounding there.

Fixes: https://tracker.ceph.com/issues/41753
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-09-17 22:20:27 +02:00
Casey Bodley
97f1be5d3a qa/rgw: rgw/website suite uses subdomain calling format
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:52 -04:00
Casey Bodley
bb56ac01c2 qa/rgw: add new rgw/website suite for static website tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:51 -04:00
Casey Bodley
71312246ad qa/rgw: s3test tasks sets s3website_domain to match dns-s3website-name
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:24:51 -04:00
Casey Bodley
7a84a00b6b qa/s3tests: use correct endpoint from rgw_server
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:22:21 -04:00
Casey Bodley
c9aac91b18 qa/ragweed: use correct endpoint from rgw_server
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:19:28 -04:00
Casey Bodley
1feca42f4c qa/rgw: fix for extra_args in s3tests task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-17 08:19:28 -04:00
Casey Bodley
8c801f073d
Merge pull request #30218 from cbodley/wip-qa-rgw-barbican
qa/rgw: add integration test for sse-kms with barbican

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2019-09-17 08:17:30 -04:00
Rishabh Dave
d165b98554 test_cephfs_shell: add note on how to run this testsuite
Inform that exporting path to cephfs-shell is needed beforehand.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-17 17:24:30 +05:30
Stephan Müller
aae81f5f6c mgr/dashboard: CephFS tab Component
The problem was that the CephFS details component was entirely responsible for
managing all other tabs besides it's own. Besides that many API requests
were triggered, which now has been reduced to just one request which is
fired inside the tabs component.

I added an endpoint which contains all adaptations that were done in the
frontend before. This limits the request size and increases the
performance (at least a bit).

Fixes: https://tracker.ceph.com/issues/41372
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-09-17 12:16:26 +02:00
Patrick Donnelly
81d1a162c5
Merge PR #30058 into master
* refs/pull/30058/head:
	qa/tasks: test for prevent negative subvolume size
	mgr/volumes: prevent negative subvolume size

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2019-09-16 11:43:19 -07:00
J. Eric Ivancich
e487604ad2
Merge pull request #29549 from smanjara/wip-multisite-metadata
rgw: Allow admin APIs that write metadata to be executed first on the mast…

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-15 12:54:24 -04:00
Ilya Dryomov
d63570c5a5
Merge pull request #30363 from idryomov/wip-krbd-huge-osdmap
qa: add script to test how libceph handles huge osdmaps

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-09-13 22:35:57 +02:00
Patrick Donnelly
9e59ba40c3
Merge PR #28560 into master
* refs/pull/28560/head:
	cephfs-shell: handle du's arguments elsewhere outside do_du()
	cephfs-shell: reuse code
	cephfs-shell: rewrite call to perror in do_du
	pybind/cephfs: define variable for hexcode used in stat()
	test_cephfs_shell: test cephfs-shell command at invocation
	cephfs-shell: refactor do_du()
	cephfs-shell: option -r is not for reverse
	cephfs-shell: extend to_bytes()
	test_cephfs_shell: test du with no args
	test_cephfs_shell: test du with multiple paths in args
	test_cephfs_shell: test behaviour of "du -r"
	test_cephfs_shell: test du's output for softlinks
	qa/cephfs: add convenience method lstat()
	qa/cephfs: add option to make stat() unfollow symlinks
	test_cephfs_shell: test du's output for hardlinks
	test_cephfs_shell: test du's output for directories
	test_cephfs_shell: test du's output for regular files
	test_cephfs_shell: add a method to get command output
	test_cephfs_shell: allow cmd as list too
	test_cephfs_shell: rename and rewrite _cephfs_shell()
	test_cephfs_shell: copy humanize() from cephfs-shell
	cephfs-shell: print disk usage for non-directory files too
	pybind/cephfs: add method that stats symlinks without following
	cephfs-shell: Fix 'du' command error

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-13 12:39:39 -07:00