Commit Graph

1304 Commits

Author SHA1 Message Date
Patrick Donnelly
a6066f4214
Merge PR #29355 into master
* refs/pull/29355/head:
	mgr/volumes: set uid/gid of FS client's mount as 0/0

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-31 11:33:36 -07:00
Patrick Donnelly
837836107c
Merge PR #29388 into master
* refs/pull/29388/head:
	qa: sleep briefly after resetting kclient

Reviewed-by: David Galloway <dgallowa@redhat.com>
2019-07-31 10:33:18 -07:00
Kefu Chai
d59090afe0
Merge pull request #29368 from tchaikov/wip-40618
qa/tasks/mgr/test_progress.py: s/ev/new_event/

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-30 09:27:29 +08:00
Patrick Donnelly
602e5f6eb4
qa: sleep briefly after resetting kclient
Continuation of 6b83f43ba0.

Fixes: https://tracker.ceph.com/issues/40999
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-29 14:08:17 -07:00
Patrick Donnelly
2a82081f77
Merge PR #28825 into master
* refs/pull/28825/head:
	qa: wait for kernel client death
	qa: use hard_reset to reboot kclient

Reviewed-by: David Galloway <dgallowa@redhat.com>
2019-07-29 13:08:29 -07:00
Kefu Chai
9b4dbf0749 qa/tasks/mgr/test_progress.py: s/ev/new_event/
as a follow-up fix for 5604ba4e

Fixes: http://tracker.ceph.com/issues/40618
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-28 19:32:24 +08:00
Ramana Raja
033d9e743a mgr/volumes: set uid/gid of FS client's mount as 0/0
... to allow creating subvolumes/subvolume groups within a filesystem.

Fixes: http://tracker.ceph.com/issues/40927
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-07-27 19:48:06 +05:30
Sage Weil
1f7d00f286 Merge PR #29239 into master
* refs/pull/29239/head:
	qa/tasks/ceph_manager.py: always use self.logger

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-07-27 08:00:16 -05:00
Kefu Chai
db20513eb6
Merge pull request #29361 from tchaikov/wip-qa-osd-pause
qa: fixes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-27 10:26:43 +08:00
Patrick Donnelly
6b83f43ba0
qa: wait for kernel client death
After sending the reboot command, we need to wait briefly for it to be
rebooted so that the kernel client doesn't voluntarily give up its Fb
cap.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:34:17 -07:00
Patrick Donnelly
b75544be86
qa: use hard_reset to reboot kclient
power_off may allow the mounts to gracefully unmount. We don't want this if the
kclient is stuck or we desire the client to "disappear" and come back.

Fixes: http://tracker.ceph.com/issues/37681
Depends-on: https://github.com/ceph/teuthology/pull/1296
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:34:00 -07:00
Patrick Donnelly
02eace72e2
Merge PR #28793 into master
* refs/pull/28793/head:
	qa/cephfs: make run_shell() accept args as str too
	qa/vstart_runner.py: ignores when source and destination are same
	test_cephfs_shell: add a test for cd with arguments
	test_cephfs_shell: add a test for cd with no arguments
	test_cephfs_shell: group test methods
	test_cephfs_shell: add a new method to return script output
	test_cephfs_shell: allow running CephFS shell script
	cephfs-shell: cd with no args shouldn't print an error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-26 15:15:19 -07:00
Patrick Donnelly
200e3fb5cc
Merge PR #29336 into master
* refs/pull/29336/head:
	qa: wait for MDS to come back after removing it

Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-26 15:09:14 -07:00
Kefu Chai
d6170e70b6 mgr/dashboard/qa: add more fields to report
to be in sync with #28847

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-27 01:50:33 +08:00
Kefu Chai
d5ed1eaa1b
Merge pull request #29264 from rjfd/wip-dashboard-fix-qa-rbd
mgr/dashboard: qa: fix RBD test when matching error strings

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-26 14:25:35 +08:00
Patrick Donnelly
2adf929f80
Merge PR #29103 into master
* refs/pull/29103/head:
	mgr/volumes: add `ceph fs subvolumegroup getpath` command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:12:31 -07:00
Patrick Donnelly
19c724c1d6
qa: wait for MDS to come back after removing it
Fixes: http://tracker.ceph.com/issues/40967
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 14:42:34 -07:00
Sage Weil
3968d564c5 Merge PR #29111 into master
* refs/pull/29111/head:
	qa/mgr/progress: Update the test suite for progress module

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-25 12:44:24 -05:00
Rishabh Dave
a83ea849d7 qa/cephfs: make run_shell() accept args as str too
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:50 +05:30
Rishabh Dave
07688b96e1 qa/vstart_runner.py: ignores when source and destination are same
put_file() in vstart_runner.py should ignore the error when source and
destination paths supplied are same, since source and destination for
put_file() method in teuthology are on different machines, they
represent different locations.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:50 +05:30
Rishabh Dave
d94a42dc1b test_cephfs_shell: add a test for cd with arguments
Add a method to test that the cd command changes the current working
directory to the path passed as an argument to it.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:50 +05:30
Rishabh Dave
dee9ec1650 test_cephfs_shell: add a test for cd with no arguments
Add a method to test that the cd command changes the current working
directory to root when no argument is passed.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:50 +05:30
Rishabh Dave
70f22f69b5 test_cephfs_shell: group test methods
Move tests into different classes created on the basis of a shell
functionality within the testsuite. This arrangement allows running
tests related to only one functionality at a time.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:50 +05:30
Rishabh Dave
2a98e9cb31 test_cephfs_shell: add a new method to return script output
Add a new method that runs the given CephFS shell script on the given
mount and returns the output with whitespace removed.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:28 +05:30
Rishabh Dave
fef0180c93 test_cephfs_shell: allow running CephFS shell script
Add a method to test_cephfs_shell.py that allows running CephFS shell
script using option "-b" of cephfs-shell.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-25 10:51:11 +05:30
Sage Weil
0c0093e450 Merge PR #29034 into master
* refs/pull/29034/head:
	doc/mgr/crash: document missing commands, options
	qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
	qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
	qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
	mgr/telemetry: fix remote into crash do_ls()
	mgr/crash: don't make these methods static
	mgr/BaseMgrModule: handle unicode health detail strings
	mgr/crash: verify timestamp is valid
	qa/suites/mgr: whitelist RECENT_CRASH
	mgr/crash: remove unused var
	mgr/crash: remove unused import 'six'
	qa/workunits/rados/test_crash: health check
	mgr/crash: improve validation on post
	mgr/crash: automatically prune old crashes after a year
	mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
	mgr/crash: add 'crash ls-new'
	mgr/crash: add option and serve infra
	mgr/crash: keep copy of crashes in memory
	mgr/pg_autoscaler: adjust style to match built-in tables
	mgr/crash: make 'crash ls' a nice table with a NEW column
	mgr/crash: nicely format 'crash info' output
	mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-24 17:20:21 -05:00
Ricardo Dias
cf31e24066
mgr/dashboard: qa: fix RBD test when matching error strings
This commit fixes a problem caused by changes to the error
descriptions in the RBD python bindings introduced in:
a66b06cc76

Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-07-24 14:24:18 +01:00
Kefu Chai
310ccd9f9f qa/tasks/ceph_manager.py: always use self.logger
in fbd4836d, a regression is introduced:

self.log("failed to read erasure_code_profile. %s was likely removed",
pool)

because `self.log` is actually a lambda which just do

self.logger.info(x)

in this change

* `Thrasher.log()` is added for three reasons:
 - in PEP-8,

> Always use a def statement instead of an assignment statement that
> binds a lambda expression directly to an identifier
so a better way is to define a method using `def`
 - and i think it helps with the readability
* `logger` parameter is now mandatory now in the constructor of
  `Thrasher` class. because the instance of this class is only created
by `qa/tasks/thrashosds.py`, like:

thrash_proc = ceph_manager.Thrasher(
        cluster_manager,
        config,
        logger=log.getChild('thrasher')
        )

and `log.getChild()` does not return `None`, so there is no need to
handle that case.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-24 10:28:00 +08:00
Kefu Chai
361b7febcc
Merge pull request #28983 from myoungwon/wip-dedup-io-test
src/test, qa/suites/rados/thrash: add dedup test

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:54:54 +08:00
Sage Weil
c237f9a430 Merge PR #29172 into master
* refs/pull/29172/head:
	mgr/dashboard: Fix dashboard health test failure

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-23 09:08:26 -05:00
Sebastian Wagner
d0855cf5e5
Merge pull request #29042 from sebastian-philipp/orchestrator-doc-disable
mgr/orchestrator: Fix disabling the orchestrator

Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-23 09:03:48 +02:00
Patrick Donnelly
932ea37ca3
Merge PR #22645 into master
* refs/pull/22645/head:
	qa/tests: test if unresponsive MDS client with no caps is evicted directly
	qa/tests: add a method to signal a MDS client
	qa/cephfs: memoize FUSE client pid

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-22 16:24:53 -07:00
Sage Weil
c8f35af6e1 Merge PR #29109 into master
* refs/pull/29109/head:
	qa/tasks/ceph_manager: wait for clean before asserting clean on minsize test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-22 13:39:31 -05:00
Sage Weil
46e4d1a0d5 Merge PR #29144 into master
* refs/pull/29144/head:
	qa/tasks/ceph_manager: fix thrash_pg_upmap_items when no pools

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-22 13:38:13 -05:00
Ricardo Marques
476d0fab61 mgr/dashboard: Fix dashboard health test failure
Fixes: https://tracker.ceph.com/issues/40869

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-07-22 17:15:27 +01:00
Kamoltat (Junior) Sirivadhna
5604ba4ec1 qa/mgr/progress: Update the test suite for progress module
Update the test suite to reflect a feature
change that has been merged to master in
progress module where you create an event
when an osd is marked in.

Fixes: http://tracker.ceph.com/issues/40618
with success QA run in sepia:
http://pulpito.ceph.com/kchai-2019-07-16_10:10:01-rados-master-distro-basic-mira/

Signed-off-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
2019-07-22 11:09:42 -04:00
Ricardo Marques
65c259c7b7
Merge pull request #28764 from rhcs-dashboard/rgw-bucket-placement-target
mgr/dashboard: select placement target on RGW bucket creation

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-22 09:04:53 +01:00
Sage Weil
dc32b1ac0e Merge PR #29072 into master
* refs/pull/29072/head:
	qa/suites/upgrade: set pg_autoscale_mode=off on existing pools
	mon/MgrMonitor: make pg_autoscaler always on
	qa/tasks/ceph.conf.template: osd_pool_default_pg_autoscale_mode = off

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-20 15:20:31 -05:00
Rishabh Dave
80152465b5 qa/tests: test if unresponsive MDS client with no caps is evicted directly
Test if an unresponsive MDS client session holding no caps is evicted
directly at session_autoclose without being marked as stale at
session_timeout.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-20 09:04:50 +05:30
Josh Durgin
234a400376
Merge pull request #29120 from neha-ojha/wip-add-write-omap
qa: add basic omap testing capability

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-19 14:46:22 -07:00
Sage Weil
848c5b4a9a qa/tasks/ceph_manager: fix thrash_pg_upmap_items when no pools
Follow-on to e7ca5a92d4

Fixes: https://tracker.ceph.com/issues/40635
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:49:26 -05:00
Sage Weil
3bddcc5ddf qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-19 14:45:47 -05:00
Patrick Donnelly
cd97739905
Merge PR #29123 into master
* refs/pull/29123/head:
	test_sessionmap: use sudo_write_file() from teuthology.misc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-19 10:41:29 -07:00
alfonsomthd
9d1700cbaf mgr/dashboard: select placement target on RGW bucket creation
* Select a placement target from the zone that the RGW daemon is running on.

Fixes: https://tracker.ceph.com/issues/40567
Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-07-19 16:02:44 +02:00
Ricardo Marques
a74df9b26d mgr/dashboard: Evict a CephFS client
Fixes: https://tracker.ceph.com/issues/24892

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-07-19 09:00:15 +01:00
Rishabh Dave
4b77624070 test_sessionmap: use sudo_write_file() from teuthology.misc
Instead of defining a method to write files within the testsuite, use
sudo_write_file() from teuthology.misc.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-07-19 10:05:18 +05:30
Patrick Donnelly
f21c7f0f58
Merge PR #29067 into master
* refs/pull/29067/head:
	qa/tasks: add exception in do_thrash()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-18 18:45:27 -07:00
Jos Collin
614eef907a
qa/tasks: add exception in do_thrash()
Fixes the bug during DaemonWatchdog testing:

Traceback (most recent call last):
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-daemonwatchdog-testing13/qa/tasks/daemonwatchdog.py", line 38, in _run
    self.watch()
  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-daemonwatchdog-testing13/qa/tasks/daemonwatchdog.py", line 112, in watch
    if thrasher.e is not None:
AttributeError: MonitorThrasher instance has no attribute 'e'

Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-07-19 06:12:09 +05:30
Patrick Donnelly
64059d6479
Merge PR #28692 into master
* refs/pull/28692/head:
	test_volume_client: add positive test for ceph_volume_client method
	test_volume_client: rename test_put_object_versioned()
	test_volume_client: rewrite test_put_object_versioned
	test_volume_client: use sudo_write_file() form teuthology
	test_volume_client: make test_object_versioned py3 compatible

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-18 14:03:50 -07:00
Ali Maredia
d7e2acb86b
Merge pull request #22788 from adamyanova/wip-s3java
A task to run S3 Java tests against RGW
2019-07-18 14:37:50 -04:00