Commit Graph

5910 Commits

Author SHA1 Message Date
Sage Weil
c01f2ee0e2 move ceph-qa-suite dirs into qa/ 2016-12-14 11:29:55 -06:00
Sage Weil
0c061c14a6 Revert "tasks/workunit.py: depth 1 clone"
This reverts commit 4faf77a649.
2016-12-14 12:28:23 -05:00
Zack Cerza
124712a4d5 Merge pull request #1307 from ceph/wip-workunit-repo
tasks/workunit: use correct git mirror url
2016-12-14 10:21:05 -07:00
Sage Weil
4faf77a649 tasks/workunit.py: depth 1 clone
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-14 12:19:44 -05:00
Sage Weil
159c455a03 tasks/workunit: remove kludge to use git.ceph.com
This was hard-coded to ceph.git (almost) and breaks when
you specify --ceph-repo.  Remove it entirely.  We'll see if
github.com is better at handling our load than it used to
be!

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-14 12:18:29 -05:00
Sage Weil
bd83719e6e Merge pull request #1309 from ceph/wip-16800-kefu
tasks/ceph: restore context of osd mount path before mkfs
2016-12-14 09:56:25 -06:00
John Spray
2871374c38 Merge pull request #1156 from ceph/wip-kclient-python
Enable cephfs python tests on kclient
2016-12-14 14:09:13 +00:00
Kefu Chai
53225d5272 tasks/ceph: restore context of osd mount path before mkfs
all newly created files and directories under the mount dir inherit the
SELinux type of their parent directory. so we need to set it before
mkfs.

Fixes: http://tracker.ceph.com/issues/16800
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-12-14 19:15:16 +08:00
John Spray
8fdae47fd3 tasks/cephfs: set norequire_active_mds on kclient
The kernel client's cluster availability test is
more primitive than the fuse client, so we need
to switch it off to avoid client mounts failing
while MDSs are still coming up.

Fixes: http://tracker.ceph.com/issues/18161
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-13 01:05:25 +00:00
Jason Dillaman
857dfee932 Merge pull request #1304 from vshankar/wip-15028
cram: support fetching from sha1 branch, tag, commit hash

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-12-12 16:29:54 -05:00
Sage Weil
63249312c2 Merge pull request #1305 from ceph/wip-h-j-x
upgrade/hammer-jewel-x: whitelist quota
2016-12-12 11:37:30 -06:00
Sage Weil
9c31801188 upgrade/hammer-jewel-x: whitelist quota
This is from teh librados api test.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-12 12:29:09 -05:00
Venky Shankar
d2f0d74598 cram: support fetching from sha1 branch, tag, commit hash
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2016-12-11 16:46:36 +05:30
Patrick Donnelly
79c2db9bea
Merge remote-tracking branch 'upstream/pull/1302/head'
* upstream/pull/1302/head:
  fsx-mpi: fsx-mpi expects a file name not a dir
  fsx-mpi: remove chef task
  Fix mpi calls
2016-12-09 11:09:02 -05:00
Patrick Donnelly
0a6d76f29b
fsx-mpi: fsx-mpi expects a file name not a dir
The test still fails even after being enabled:

	2016-12-07T18:00:44.337 INFO:teuthology.orchestra.run.mira105:Running: 'mpiexec -f /home/ubuntu/cephtest/mpi-hosts -wdir /home/ubuntu/cephtest/gmnt sudo /home/ubuntu/cephtest/fsx-mpi -o 1MB -N 50000 -p 10000 -l 1048576 /home/ubuntu/cephtest/gmnt/test'
	2016-12-07T18:00:44.486 INFO:teuthology.orchestra.run.mira105.stderr:Warning: Permanently added '172.21.8.122' (ECDSA) to the list of known hosts.
	2016-12-07T18:00:44.571 INFO:teuthology.orchestra.run.mira105.stdout:skipping zero size read
	2016-12-07T18:00:44.591 INFO:teuthology.orchestra.run.mira105.stdout:truncating to largest ever: 0x7cccb
	2016-12-07T18:00:44.606 INFO:teuthology.orchestra.run.mira083:Running: 'sudo logrotate /etc/logrotate.d/ceph-test.conf'
	2016-12-07T18:00:44.611 INFO:teuthology.orchestra.run.mira100:Running: 'sudo logrotate /etc/logrotate.d/ceph-test.conf'
	2016-12-07T18:00:44.614 INFO:teuthology.orchestra.run.mira105:Running: 'sudo logrotate /etc/logrotate.d/ceph-test.conf'
	2016-12-07T18:00:44.887 INFO:teuthology.orchestra.run.mira105.stdout:skipping zero size read
	2016-12-07T18:00:44.954 INFO:teuthology.orchestra.run.mira105.stdout:Size error: expected 0xa6f7c stat 0xd4000 seek 0xd5000
	2016-12-07T18:00:44.954 INFO:teuthology.orchestra.run.mira105.stdout:LOG DUMP (2 total operations):
	2016-12-07T18:00:44.954 INFO:teuthology.orchestra.run.mira105.stdout:1(1 mod 256): SKIPPED (no operation)
	2016-12-07T18:00:44.954 INFO:teuthology.orchestra.run.mira105.stdout:2(2 mod 256): WRITE        0x1c748 thru 0xa6f7b    (0x8a834 bytes) HOLE
	2016-12-07T18:00:44.990 INFO:teuthology.orchestra.run.mira105.stdout:Correct content saved for comparison
	2016-12-07T18:00:44.990 INFO:teuthology.orchestra.run.mira105.stdout:(maybe hexdump "/home/ubuntu/cephtest/gmnt/test" vs "/home/ubuntu/cephtest/gmnt/test.fsxgood")
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stdout:
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stdout:===================================================================================
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stdout:=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stdout:=   EXIT CODE: 120
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stdout:=   CLEANING UP REMAINING PROCESSES
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stdout:=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stdout:===================================================================================
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stderr:[proxy:0:0@mira105] HYD_pmcd_pmip_control_cmd_cb (./pm/pmiserv/pmip_cb.c:886): assert (!closed) failed
	2016-12-07T18:00:45.000 INFO:teuthology.orchestra.run.mira105.stderr:[proxy:0:0@mira105] HYDT_dmxu_poll_wait_for_event (./tools/demux/demux_poll.c:77): callback returned error status
	2016-12-07T18:00:45.001 INFO:teuthology.orchestra.run.mira105.stderr:[proxy:0:0@mira105] main (./pm/pmiserv/pmip.c:206): demux engine error waiting for event
	2016-12-07T18:00:45.002 INFO:teuthology.orchestra.run.mira105.stderr:[mpiexec@mira105] HYDT_bscu_wait_for_completion (./tools/bootstrap/utils/bscu_wait.c:76): one of the processes terminated badly; aborting
	2016-12-07T18:00:45.002 INFO:teuthology.orchestra.run.mira105.stderr:[mpiexec@mira105] HYDT_bsci_wait_for_completion (./tools/bootstrap/src/bsci_wait.c:23): launcher returned error waiting for completion
	2016-12-07T18:00:45.002 INFO:teuthology.orchestra.run.mira105.stderr:[mpiexec@mira105] HYD_pmci_wait_for_completion (./pm/pmiserv/pmiserv_pmci.c:217): launcher returned error waiting for completion
	2016-12-07T18:00:45.002 INFO:teuthology.orchestra.run.mira105.stderr:[mpiexec@mira105] main (./ui/mpich/mpiexec.c:331): process manager error waiting for completion

I am not sure what the cause is. I'm leaving the test disabled for now and merging this PR.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-07 14:08:57 -05:00
Patrick Donnelly
c70ec42db1
fsx-mpi: remove chef task
Per Sage's comment: https://github.com/ceph/ceph-qa-suite/pull/284#issuecomment-141463034

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-07 14:07:30 -05:00
Yehuda Sadeh
02e7e8395b Merge pull request #977 from ceph/wip-rgw-compression
rgw/verify: use rgw_compression_type = "random"

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-12-07 09:18:42 -08:00
Sage Weil
8fa08e96de upgrade/hammer-jewel-x/stress-split: no xenial
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-07 10:27:19 -05:00
Sage Weil
577cf95d59 Merge pull request #1211 from ceph/wip-15753-master
upgrade/hammer-jewel-x suite
2016-12-07 09:54:24 -05:00
Sage Weil
8ee41c6fa2 upgrade/hammer-jewel-x: redo stress-split
Make this easy: write a singel yaml that does the hammer install,
some limited work, then upgardes to jewel.  Copy it from the
parallel suite.  Then, symlink all of the rest from the jewel-x
stress-split suite.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-07 09:53:39 -05:00
Sage Weil
836921e07d upgrade/hammer-jewel-x: misc fixes 2016-12-07 09:53:20 -05:00
Sage Weil
c6a0564aea upgrade/hammer-jewel-x: fix upgrade order 2016-12-07 09:53:20 -05:00
Sage Weil
e9b066672d upgrade/hammer-jewel-x: no xenial
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-07 09:53:20 -05:00
Sage Weil
3ea7610dc2 upgrade/hammer-jewel-x: no mds, no fs tests 2016-12-07 09:53:20 -05:00
Sage Weil
f774097a65 exclude ceph-mgr 2016-12-07 09:53:20 -05:00
Sage Weil
e3c3c67bcb upgrade/hammer-jewel-x/parallel: update
Merger hammer-x (jewel branch) and jewel-x (master branch).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-07 09:53:20 -05:00
Yuri Weinstein
03427961b9 Added new hammer-jewel-x suite
Removed rbd/test_librbd_python.sh for now
Removed all `sudo` from exec lines

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2016-12-07 09:53:20 -05:00
John Spray
5a5a2b3f4a tasks/cephfs: use kill in test_reconnect_eviction
Previously relied on client being able to unmount
while the MDS was offline, which is not necessarily
so.  Use kill instead.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 13:40:09 +00:00
John Spray
063d61d851 Merge pull request #1300 from batrick/multimds-merge
suites/multimds: sync with fs suites

Reviewed-by: John Spray <john.spray@redhat.com>
2016-12-07 12:19:54 +00:00
Patrick Donnelly
dc648a798a
suites/multimds: add kclient disable override
The libcephfs tests are negatively affected by other mounts. This commit
adds a kclient disable in addition to the ceph-fuse one.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-06 22:38:38 -05:00
Patrick Donnelly
9be89e58cf
suites/multimds: sync with fs suites
This commit synchronizes the multimds suite with the fs suite. The
basic/verify sub-suites now do the same tests except with different
cluster layouts (i.e. multiple actives). This is mostly accomplished by
symlinking parts of each sub-suite to its counterpart in the fs suite.

This commit also does a few things of note to the prior multimds suite:

o Turn on directory fragmentation.
o Add several tests from fs/basic/tasks to multimds/basic.
o Remove libcephfs as fs/basic/tasks already contain
  multimds/basic/tasks.

Prior implementation and discussion are in PR#1114: https://github.com/ceph/ceph-qa-suite/pull/1114

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-06 22:38:31 -05:00
John Spray
5f1abf9c31 suites/kcephfs: disable broken python tests
Disabling strays because of:
http://tracker.ceph.com/issues/17193

Disabling test_failover because of:
http://tracker.ceph.com/issues/18161

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 01:03:41 +00:00
John Spray
d86b67ef9d tasks/cephfs: make test_journal_repair work with more daemons
Previously this assumed it was running with exactly two MDS
daemons.  When there were more, it would fail to execute
"fs reset" because the extra daemons were active in
the map.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:12 +00:00
John Spray
98842b7c96 suites/kcephfs: run python tests with 4 MDSs
For the benefit of test_failover

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:12 +00:00
John Spray
d6d9715ddd tasks/cephfs: skip volumeclient client test on kcephfs
This relies on quota-ish stuff that doesn't exist
in kclient.  We can still run the outer part
of the test though.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
0bd95f72a2 tasks/cephfs: fix unmount call in volumeclient test
Should have been to umount_wait, not umount (i.e.
the blocking foreground version).  This happened
to matter because umount_wait is more tolerant
of being called if the client is not already mounted.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
45eb4bf716 tasks/cephfs: special case for kcephfs behaviour
It does not generate EIOs in all the cases that
the fuse client does.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
1eabbbda25 tasks/cephfs: skip TestVolumeClient.test_evict on kcephfs
This test was probably buggy and only happened to work
with ceph-fuse, because it expects the MDS to immediately
respond to updates to the client's auth caps, but that
doesn't happen.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
989ecd6b1a suites/kcephfs: disable test_full for kcephfs
Until http://tracker.ceph.com/issues/17204 is done.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
14f3a688a2 tasks/cephfs: fix race in TestStrays.test_dirfrag_limit
With the kernel client, this was proceeding to attempt
a split before the directory had persisted, because
there was no fsync after creating it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
370ad523fc suites/kcephfs: remove task for cap flush test
This test skips all if not running against
fuse.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
1aa7ad6a7a tasks/cephfs: skip test_client_abort on kclient
This tests a fuse-only feature, ticket for adding
it in kclient is:
http://tracker.ceph.com/issues/17805

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:10 +00:00
John Spray
bc680e7a1e tasks/cephfs: support multi-fs in kernel client
Change the Mount interface to take it as an
argument to mount() instead of setting it
out of band in a config file as we used to
for the fuse client.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
d1277afd08 tasks/cephfs: fix eviction test for volumeclient
It was not correct to expect a client to block after
eviction unless it was also deauthorised.  I guess
this was working with fuse because fuse does a less
good job at re-establishing a session than the kclient?

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
507cfebbc7 tasks/cephfs: update test_journal_repair for kclient
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
1f7d2ef746 tasks/ceph: handle down nodes in log rotation
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
28aed55875 tasks/cephfs: skip ENOSPC testing on kclient
Ticket #17204 exists to revive the old patchset, until then
we skip the tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
c5f6dfc14f suites/kcephfs: put clients on dedicated nodes
Some tests want to use power cycling to reset stuck
mounts, and that needs to not kill OSDs as collateral
damage.

Need to revisit this to avoid unnecessarily using a whole
node for the client for those tests that don't require it
(i.e. those that don't use CephFSTestCase.REQUIRE_KCLIENT_REMOTE)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
2f6b034d09 tasks/cephfs: add a skip for non-fuse
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
2e99bd1005 suites/fs: s/yam/yaml/
Oops!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00