Commit Graph

1276 Commits

Author SHA1 Message Date
Rishabh Dave
fef0180c93 test_cephfs_shell: allow running CephFS shell script
Add a method to test_cephfs_shell.py that allows running CephFS shell
script using option "-b" of cephfs-shell.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:11 +05:30
Sage Weil
0c0093e450 Merge PR #29034 into master
* refs/pull/29034/head:
	doc/mgr/crash: document missing commands, options
	qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
	qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
	qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
	mgr/telemetry: fix remote into crash do_ls()
	mgr/crash: don't make these methods static
	mgr/BaseMgrModule: handle unicode health detail strings
	mgr/crash: verify timestamp is valid
	qa/suites/mgr: whitelist RECENT_CRASH
	mgr/crash: remove unused var
	mgr/crash: remove unused import 'six'
	qa/workunits/rados/test_crash: health check
	mgr/crash: improve validation on post
	mgr/crash: automatically prune old crashes after a year
	mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
	mgr/crash: add 'crash ls-new'
	mgr/crash: add option and serve infra
	mgr/crash: keep copy of crashes in memory
	mgr/pg_autoscaler: adjust style to match built-in tables
	mgr/crash: make 'crash ls' a nice table with a NEW column
	mgr/crash: nicely format 'crash info' output
	mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-24 17:20:21 -05:00
Kefu Chai
361b7febcc
Merge pull request #28983 from myoungwon/wip-dedup-io-test
src/test, qa/suites/rados/thrash: add dedup test

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:54:54 +08:00
Sage Weil
c237f9a430 Merge PR #29172 into master
* refs/pull/29172/head:
	mgr/dashboard: Fix dashboard health test failure

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-23 09:08:26 -05:00
Sebastian Wagner
d0855cf5e5
Merge pull request #29042 from sebastian-philipp/orchestrator-doc-disable
mgr/orchestrator: Fix disabling the orchestrator

Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-23 09:03:48 +02:00
Patrick Donnelly
932ea37ca3
Merge PR #22645 into master
* refs/pull/22645/head:
	qa/tests: test if unresponsive MDS client with no caps is evicted directly
	qa/tests: add a method to signal a MDS client
	qa/cephfs: memoize FUSE client pid

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-22 16:24:53 -07:00
Sage Weil
c8f35af6e1 Merge PR #29109 into master
* refs/pull/29109/head:
	qa/tasks/ceph_manager: wait for clean before asserting clean on minsize test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-22 13:39:31 -05:00
Sage Weil
46e4d1a0d5 Merge PR #29144 into master
* refs/pull/29144/head:
	qa/tasks/ceph_manager: fix thrash_pg_upmap_items when no pools

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-22 13:38:13 -05:00
Ricardo Marques
476d0fab61 mgr/dashboard: Fix dashboard health test failure
Fixes: https://tracker.ceph.com/issues/40869

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-07-22 17:15:27 +01:00
Ricardo Marques
65c259c7b7
Merge pull request #28764 from rhcs-dashboard/rgw-bucket-placement-target
mgr/dashboard: select placement target on RGW bucket creation

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-22 09:04:53 +01:00
Sage Weil
dc32b1ac0e Merge PR #29072 into master
* refs/pull/29072/head:
	qa/suites/upgrade: set pg_autoscale_mode=off on existing pools
	mon/MgrMonitor: make pg_autoscaler always on
	qa/tasks/ceph.conf.template: osd_pool_default_pg_autoscale_mode = off

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-20 15:20:31 -05:00
Rishabh Dave
80152465b5 qa/tests: test if unresponsive MDS client with no caps is evicted directly
Test if an unresponsive MDS client session holding no caps is evicted
directly at session_autoclose without being marked as stale at
session_timeout.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-20 09:04:50 +05:30
Josh Durgin
234a400376
Merge pull request #29120 from neha-ojha/wip-add-write-omap
qa: add basic omap testing capability

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-19 14:46:22 -07:00
Sage Weil
848c5b4a9a qa/tasks/ceph_manager: fix thrash_pg_upmap_items when no pools
Follow-on to e7ca5a92d4

Fixes: https://tracker.ceph.com/issues/40635
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:49:26 -05:00
Sage Weil
3bddcc5ddf qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Patrick Donnelly
cd97739905
Merge PR #29123 into master
* refs/pull/29123/head:
	test_sessionmap: use sudo_write_file() from teuthology.misc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-19 10:41:29 -07:00
alfonsomthd
9d1700cbaf mgr/dashboard: select placement target on RGW bucket creation
* Select a placement target from the zone that the RGW daemon is running on.

Fixes: https://tracker.ceph.com/issues/40567
Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-07-19 16:02:44 +02:00
Ricardo Marques
a74df9b26d mgr/dashboard: Evict a CephFS client
Fixes: https://tracker.ceph.com/issues/24892

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-07-19 09:00:15 +01:00
Rishabh Dave
4b77624070 test_sessionmap: use sudo_write_file() from teuthology.misc
Instead of defining a method to write files within the testsuite, use
sudo_write_file() from teuthology.misc.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-19 10:05:18 +05:30
Patrick Donnelly
f21c7f0f58
Merge PR #29067 into master
* refs/pull/29067/head:
	qa/tasks: add exception in do_thrash()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-18 18:45:27 -07:00
Jos Collin
614eef907a
qa/tasks: add exception in do_thrash()
Fixes the bug during DaemonWatchdog testing:

Traceback (most recent call last):
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-daemonwatchdog-testing13/qa/tasks/daemonwatchdog.py", line 38, in _run
    self.watch()
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-daemonwatchdog-testing13/qa/tasks/daemonwatchdog.py", line 112, in watch
    if thrasher.e is not None:
AttributeError: MonitorThrasher instance has no attribute 'e'

Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-07-19 06:12:09 +05:30
Patrick Donnelly
64059d6479
Merge PR #28692 into master
* refs/pull/28692/head:
	test_volume_client: add positive test for ceph_volume_client method
	test_volume_client: rename test_put_object_versioned()
	test_volume_client: rewrite test_put_object_versioned
	test_volume_client: use sudo_write_file() form teuthology
	test_volume_client: make test_object_versioned py3 compatible

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-18 14:03:50 -07:00
Ali Maredia
d7e2acb86b
Merge pull request #22788 from adamyanova/wip-s3java
A task to run S3 Java tests against RGW
2019-07-18 14:37:50 -04:00
Neha Ojha
1bf14c543c qa: add basic omap testing capability
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-07-18 11:13:28 -07:00
Sage Weil
50b439f22f qa/tasks/ceph_manager: wait for clean before asserting clean on minsize test
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-18 09:11:30 -05:00
Ricardo Marques
caea8feb01
Merge pull request #28935 from votdev/issue_40248
mgr/dashboard: Allow users to change their password on the UI

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-07-18 14:37:19 +01:00
Sage Weil
a4bfe96cd1 Merge PR #29069 into master
* refs/pull/29069/head:
	qa/tasks/ceph_manager: make upmap thrasher behave when no pools/pgs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-17 17:20:12 -05:00
Sebastian Wagner
0342479835 mgr/mgr_module: Allow resetting module options
Introduced in 4872cc5aa3

`_ceph_set_module_option` also accepts `None`, not just strings.

Fixes: http://tracker.ceph.com/issues/40779

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-17 15:41:45 +02:00
Volker Theile
ee80139fa0 mgr/dashboard: Allow users to change their password on the UI
Fixes: https://tracker.ceph.com/issues/40248

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-17 11:00:58 +02:00
Patrick Donnelly
df78003054
Merge PR #28003 into master
* refs/pull/28003/head:
	client: do not return EEXIST for mkdirs
	pybind/mgr/volumes: print exceptions in purge thread
	pybind/mgr/volumes: refactor trash readdir
	pybind/mgr/volumes: use existing client provided recursive mkdir
	pybind/mgr/volumes: cleanup fs removal
	pybind/mgr/subvolumes: use bytes for paths
	pybind/mgr/volumes: remove unused property
	test: add basic purge queue validation test
	mgr / volumes: schedule purge job for volumes on init
	mgr / volumes: purge queue for async subvolume delete
	mgr / volumes: maintain connection pool for fs volumes
	mgr / volumes: wrap rmtree() call within try..except block
	mgr / volumes: use negative error codes everywhere
	test: cleanup removing all subvolumes before removing subvolume group

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-16 13:40:10 -07:00
Sage Weil
7e56d39cc1 qa/tasks/ceph.conf.template: osd_pool_default_pg_autoscale_mode = off
Otherwise we'll get pg count warnings in almost every test.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 12:10:02 -05:00
Sage Weil
97a45c9c2e qa/tasks/ceph_deploy: assume systemd and simplify shutdown wonkiness
The 'service' command was succeeding but not actually stopping ceph.  But
we can safely assume systemd now so get rid of the weirdness here.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 10:25:15 -05:00
Sage Weil
e7ca5a92d4 qa/tasks/ceph_manager: make upmap thrasher behave when no pools/pgs
Fixes: https://tracker.ceph.com/issues/40635
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-16 10:04:35 -05:00
Rishabh Dave
855a561d9d qa/tests: add a method to signal a MDS client
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 19:47:17 +05:30
Rishabh Dave
54c3bb5531 qa/cephfs: memoize FUSE client pid
Save client PID so that we avoid calling get_client_pid() every now and
then. This, more importantly, allows sending SIGCONT to client which is
already stopped using SIGKILL.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 12:54:15 +05:30
Rishabh Dave
9aa9ff01fd test_volume_client: add positive test for ceph_volume_client method
ceph_volume_client.py's put_object_versioned() has only one test. Since
this only test is a negative test it may fail to assure that
put_object_versioned() works as expected with positive inputs even when
it completes successfully. Therefore, write a positive test for better
coverage.

Also, make sure the new test is both python 2 and python3 compatible.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:43:03 +05:30
Rishabh Dave
7980e1fb7c test_volume_client: rename test_put_object_versioned()
test_put_object_versioned() is too generic for a negative test that
specifically tests if the version is verified before writing.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:43:03 +05:30
Rishabh Dave
37744ecc2b test_volume_client: rewrite test_put_object_versioned
The test's success depends on whether CommandFailedError exception is
raised. This manner of testing is unreliable since there's no way to
check if the exception was raised by the statement (in the embedded
Python program) the test expects to.

This implies that this test's failure may go undetected. This is primary
reason why bugs like tracker #38946 occured despite of having a test.

Fixes: http://tracker.ceph.com/issues/39510
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:43:03 +05:30
Rishabh Dave
878c34c701 test_volume_client: use sudo_write_file() form teuthology
Instead of defining another method to write a file as root user in
test_volume_client.py, use the method from teuthology/misc.py.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:11:02 +05:30
Rishabh Dave
975b47502d test_volume_client: make test_object_versioned py3 compatible
Convert strings to bytes in the Python program embedded inside this
test. Also, in the process don't lose Python 2 compatibility.

Fixes: http://tracker.ceph.com/issues/39405
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-13 11:10:58 +05:30
Sage Weil
01d34051a6 Merge PR #28978 into master
* refs/pull/28978/head:
	qa/tasks/mgr/dashboard/test_health: fix test_full_health test
	mon: use per-pool stats only when all OSDs are reporting
	osd: report whether we have per-pool stats
	osd/osd_types: osd_stat_t: include num_per_pool_osds member

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-12 17:21:05 -05:00
Sage Weil
fbc8be423c Merge PR #29013 into master
* refs/pull/29013/head:
	qa/tasks/ceph_manager: 5s -> 15s for 'osd out' to be visible

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-12 17:20:21 -05:00
Sage Weil
35d2cbdc54 Merge PR #28990 into master
* refs/pull/28990/head:
	qa: vstart_runner fails because of string index out of range

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-07-12 08:58:45 -05:00
Sage Weil
d014b7924d qa/tasks/ceph_manager: 5s -> 15s for 'osd out' to be visible
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:56:50 -05:00
Sage Weil
e0a66c564e qa/tasks/mgr/dashboard/test_health: fix test_full_health test
New fields!

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:15:15 -05:00
Sage Weil
8cbd27af66 Merge PR #29002 into master
* refs/pull/29002/head:
	qa/tasks/ceph_deploy: do not rely on ceph-create-keys

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2019-07-11 19:00:54 -05:00
Sage Weil
daeaabf187 qa/tasks/ceph_deploy: do not rely on ceph-create-keys
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-11 11:16:32 -05:00
Volker Theile
b812689c48 qa: vstart_runner fails because of string index out of range
Fix problem in LocalRemote::_perform_checks_and_return_list_of_args() when LocalCephManager::raw_cluster_cmd() is called with a empty command parameter.

Fixes: https://tracker.ceph.com/issues/40729
Signed-off-by: Volker Theile <vtheile@suse.com>
2019-07-11 15:15:10 +02:00
myoungwon oh
c1b69f48d2 src/test, qa/suites/rados/thrash: add dedup test
Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2019-07-11 20:28:55 +09:00
Sage Weil
0b4ce2ab4c qa/tasks/ceph_manager: make is_{clean,recovered,active_or_down} less racy
Currently these can be thrown off if the cluster is creating or removing
pools at the same time.  Fix by taking a single snapshot of the pg stats
and based our judgement on that.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-10 11:04:49 -05:00