Commit Graph

5099 Commits

Author SHA1 Message Date
Sage Weil
07badf051d qa/suites/rados/multimon: whitelist SLOW_OPS while thrashing mons
The mons may have slow ops.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-18 16:44:23 -05:00
Patrick Donnelly
64059d6479
Merge PR #28692 into master
* refs/pull/28692/head:
	test_volume_client: add positive test for ceph_volume_client method
	test_volume_client: rename test_put_object_versioned()
	test_volume_client: rewrite test_put_object_versioned
	test_volume_client: use sudo_write_file() form teuthology
	test_volume_client: make test_object_versioned py3 compatible

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-18 14:03:50 -07:00
Ali Maredia
d7e2acb86b
Merge pull request #22788 from adamyanova/wip-s3java
A task to run S3 Java tests against RGW
2019-07-18 14:37:50 -04:00
Ricardo Marques
caea8feb01
Merge pull request #28935 from votdev/issue_40248
mgr/dashboard: Allow users to change their password on the UI

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-07-18 14:37:19 +01:00
Sage Weil
a4bfe96cd1 Merge PR #29069 into master
* refs/pull/29069/head:
	qa/tasks/ceph_manager: make upmap thrasher behave when no pools/pgs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-17 17:20:12 -05:00
Volker Theile
ee80139fa0 mgr/dashboard: Allow users to change their password on the UI
Fixes: https://tracker.ceph.com/issues/40248

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-17 11:00:58 +02:00
Patrick Donnelly
df78003054
Merge PR #28003 into master
* refs/pull/28003/head:
	client: do not return EEXIST for mkdirs
	pybind/mgr/volumes: print exceptions in purge thread
	pybind/mgr/volumes: refactor trash readdir
	pybind/mgr/volumes: use existing client provided recursive mkdir
	pybind/mgr/volumes: cleanup fs removal
	pybind/mgr/subvolumes: use bytes for paths
	pybind/mgr/volumes: remove unused property
	test: add basic purge queue validation test
	mgr / volumes: schedule purge job for volumes on init
	mgr / volumes: purge queue for async subvolume delete
	mgr / volumes: maintain connection pool for fs volumes
	mgr / volumes: wrap rmtree() call within try..except block
	mgr / volumes: use negative error codes everywhere
	test: cleanup removing all subvolumes before removing subvolume group

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-16 13:40:10 -07:00
Sage Weil
97a45c9c2e qa/tasks/ceph_deploy: assume systemd and simplify shutdown wonkiness
The 'service' command was succeeding but not actually stopping ceph.  But
we can safely assume systemd now so get rid of the weirdness here.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 10:25:15 -05:00
Sage Weil
1b46267cf7 Merge PR #28839 into master
* refs/pull/28839/head:
	osd: support osd_repair_during_recovery

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-07-16 10:07:53 -05:00
Sage Weil
e7ca5a92d4 qa/tasks/ceph_manager: make upmap thrasher behave when no pools/pgs
Fixes: https://tracker.ceph.com/issues/40635
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 10:04:35 -05:00
Casey Bodley
35cb8dcee7
Merge pull request #28964 from cbodley/wip-qa-workunit-s3tests
qa/rgw: update run-s3tests.sh

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-07-15 09:14:41 -04:00
Rishabh Dave
9aa9ff01fd test_volume_client: add positive test for ceph_volume_client method
ceph_volume_client.py's put_object_versioned() has only one test. Since
this only test is a negative test it may fail to assure that
put_object_versioned() works as expected with positive inputs even when
it completes successfully. Therefore, write a positive test for better
coverage.

Also, make sure the new test is both python 2 and python3 compatible.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:43:03 +05:30
Rishabh Dave
7980e1fb7c test_volume_client: rename test_put_object_versioned()
test_put_object_versioned() is too generic for a negative test that
specifically tests if the version is verified before writing.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:43:03 +05:30
Rishabh Dave
37744ecc2b test_volume_client: rewrite test_put_object_versioned
The test's success depends on whether CommandFailedError exception is
raised. This manner of testing is unreliable since there's no way to
check if the exception was raised by the statement (in the embedded
Python program) the test expects to.

This implies that this test's failure may go undetected. This is primary
reason why bugs like tracker #38946 occured despite of having a test.

Fixes: http://tracker.ceph.com/issues/39510
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:43:03 +05:30
Rishabh Dave
878c34c701 test_volume_client: use sudo_write_file() form teuthology
Instead of defining another method to write a file as root user in
test_volume_client.py, use the method from teuthology/misc.py.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:11:02 +05:30
Rishabh Dave
975b47502d test_volume_client: make test_object_versioned py3 compatible
Convert strings to bytes in the Python program embedded inside this
test. Also, in the process don't lose Python 2 compatibility.

Fixes: http://tracker.ceph.com/issues/39405
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:10:58 +05:30
Sage Weil
01d34051a6 Merge PR #28978 into master
* refs/pull/28978/head:
	qa/tasks/mgr/dashboard/test_health: fix test_full_health test
	mon: use per-pool stats only when all OSDs are reporting
	osd: report whether we have per-pool stats
	osd/osd_types: osd_stat_t: include num_per_pool_osds member

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-12 17:21:05 -05:00
Sage Weil
be49d46521 Merge PR #29003 into master
* refs/pull/29003/head:
	qa/standalone/scrub/osd-scrub-snaps.sh: adjust expected output
	osd/SnapMapper: to_raw_key: use hobject pool member, not SnapMapper:pool
	ceph-objectstore-tool: fix use of SnapSet::snaps
	qa/standalone/scrub/osd-scrub-snaps: fix kv grep

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-12 17:20:47 -05:00
Sage Weil
fbc8be423c Merge PR #29013 into master
* refs/pull/29013/head:
	qa/tasks/ceph_manager: 5s -> 15s for 'osd out' to be visible

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-12 17:20:21 -05:00
Sage Weil
ff7813aa14 qa/standalone/scrub/osd-scrub-snaps.sh: adjust expected output
SnapSet now dumps just seq, not a (fake) SnapContext.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 09:55:06 -05:00
Sage Weil
03b9c66080 ceph-objectstore-tool: fix use of SnapSet::snaps
Instead, use clone_snaps to identify clones.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 09:55:06 -05:00
Sage Weil
35d2cbdc54 Merge PR #28990 into master
* refs/pull/28990/head:
	qa: vstart_runner fails because of string index out of range

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-07-12 08:58:45 -05:00
Sage Weil
d014b7924d qa/tasks/ceph_manager: 5s -> 15s for 'osd out' to be visible
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:56:50 -05:00
Sage Weil
e0a66c564e qa/tasks/mgr/dashboard/test_health: fix test_full_health test
New fields!

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:15:15 -05:00
Sage Weil
23eaf7c498 qa/standalone/scrub/osd-scrub-snaps: fix kv grep
SnapMapper keys are now SNA_, not MAP_.

Fixes: http://tracker.ceph.com/issues/40725
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:11:21 -05:00
Sage Weil
8cbd27af66 Merge PR #29002 into master
* refs/pull/29002/head:
	qa/tasks/ceph_deploy: do not rely on ceph-create-keys

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2019-07-11 19:00:54 -05:00
Sage Weil
ec62f78630 Merge PR #28944 into master
* refs/pull/28944/head:
	qa/workunits/rados/test_cache_pool.sh: s/forward/proxy/
	qa/workunits/cephtool/test.sh: cache forward mode is no longer allowed
	mon/OSDMonitor: forward -> proxy, readforward -> readproxy on octopus
	mon/OSDMonitor: disallow FORWARD and READFORWARD cache modes
	osd: do proxy when in forward/readforward cache modes

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-11 16:28:34 -05:00
Sage Weil
daeaabf187 qa/tasks/ceph_deploy: do not rely on ceph-create-keys
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-11 11:16:32 -05:00
Sage Weil
d27069f751 Merge PR #28969 into master
* refs/pull/28969/head:
	qa/tasks/ceph_manager: make is_{clean,recovered,active_or_down} less racy

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-11 09:33:28 -05:00
Sage Weil
200d4d9c16 Merge PR #28943 into master
* refs/pull/28943/head:
	qa: stop testing on 16.04 xenial

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-11 09:32:59 -05:00
Volker Theile
b812689c48 qa: vstart_runner fails because of string index out of range
Fix problem in LocalRemote::_perform_checks_and_return_list_of_args() when LocalCephManager::raw_cluster_cmd() is called with a empty command parameter.

Fixes: https://tracker.ceph.com/issues/40729
Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-11 15:15:10 +02:00
Brad Hubbard
aeded77aa3
Merge pull request #28070 from badone/wip-lazy-omap-test
Wip lazy omap test

Reviewed-by: Greg Farnum gfarnum@redhat.com
2019-07-11 09:52:12 +10:00
Sage Weil
09b7eddad6 qa/workunits/rados/test_cache_pool.sh: s/forward/proxy/
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-10 17:39:19 -05:00
Sage Weil
e577581d45 qa/workunits/cephtool/test.sh: cache forward mode is no longer allowed
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-10 17:39:19 -05:00
Sage Weil
0b4ce2ab4c qa/tasks/ceph_manager: make is_{clean,recovered,active_or_down} less racy
Currently these can be thrown off if the cluster is creating or removing
pools at the same time.  Fix by taking a single snapshot of the pg stats
and based our judgement on that.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-10 11:04:49 -05:00
Casey Bodley
a171b2cc7c qa/rgw: run-s3tests.sh runs in s3tests directory
something looks for request_decision_graph.yml in the working directory

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-07-10 11:45:59 -04:00
Sage Weil
141ad20e73 qa: stop testing on 16.04 xenial
Note that the hammer old-client test will now *only* run on centos.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-10 10:04:30 -05:00
Casey Bodley
523c522a2f qa/rgw: disable some more tags for run-s3tests
lifecycle_expiration tests require some additional configuration.
beast and civetweb are both strict about header parsing and require
fails_strict_rfc2616

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-07-10 11:00:18 -04:00
Casey Bodley
71db427455 qa/rgw: run-s3tests workunit uses sample config and vstart users
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-07-10 10:59:31 -04:00
Brad Hubbard
88e9ca58a0 tests: Add test for lazy omap stat collection
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-07-10 07:53:37 +10:00
Casey Bodley
9aa1eeb37a
Merge pull request #28910 from yuvalif/wip-yuval-pubsub-test-fixes
rgw/pubsub: tests enhancements and fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-09 16:24:56 -04:00
Yuri Weinstein
a2ac7e2f36
Merge pull request #28931 from yuriw/wip-yuriw-40452-master
qa/tests: added ragweed coverage to stress-split* upgrade suites
2019-07-09 12:54:07 -07:00
Yuri Weinstein
695f41952d
Merge pull request #28932 from yuriw/wip-yuriw-40452-master_2
qa/tests: added ragweed coverage to stress-split* upgrade suites
2019-07-09 12:53:52 -07:00
Yuri Weinstein
0f6b30d600 qa/tests: added ragweed coverage to stress-split* upgrade suites
added ceph config set global bluestore_warn_on_legacy_statfs fals
changed user "foo" to "ragweed" in ragweed.py

Fixes: http://tracker.ceph.com/issues/40452
Fices: http://tracker.ceph.com/issues/40467
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 12:51:51 -07:00
Yuri Weinstein
291629b417 qa/tests: added ragweed coverage to stress-split* upgrade suites
added ceph config set global bluestore_warn_on_legacy_statfs fals
chnaged user "foo" to "ragweed" in ragweed.py

Fixes: http://tracker.ceph.com/issues/40452
Fices: http://tracker.ceph.com/issues/40467
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 5e7e1f382f)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 12:38:25 -07:00
Casey Bodley
bf99e58799
Merge pull request #28823 from cbodley/wip-qa-rgw-swift-server
qa/rgw: more fixes for swift task

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-08 11:16:42 -04:00
Sage Weil
b2eb5232de Merge PR #28901 into master
* refs/pull/28901/head:
	qa/standalone/scrub/osd-scrub-repair: fix 'scrub ok' grep
	osd/osd_types: remove 'snap_context' from SnapSet::dump()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-08 08:36:05 -05:00
Venky Shankar
aec1d90b36 test: add basic purge queue validation test
.. and since we have async subvolume deletes now, check
trash directory for emptiness in other tests.

Fixes: http://tracker.ceph.com/issues/40036
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-07-07 23:58:16 -04:00
Venky Shankar
ae470a64ec test: cleanup removing all subvolumes before removing subvolume group
Test `test_subvolume_create_with_desired_mode_in_group()` creates three
subvolume in a subvolume group. During cleanup, it only removed two of
the three subvolumes. This causes failure when removing the subvolume
group since it's not empty.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-07-07 23:58:16 -04:00
Jeegn Chen
80f4e1f677 osd: support osd_repair_during_recovery
osd_repair_during_recovery=true allow explicitly requested reqair
to be scheduled on OSDs with active recovering.

Fixes: http://tracker.ceph.com/issues/40620
Signed-off-by: Jeegn Chen <jeegnchen@tencent.com>
2019-07-08 09:26:27 +08:00