Commit Graph

66866 Commits

Author SHA1 Message Date
Yuri Weinstein
03427961b9 Added new hammer-jewel-x suite
Removed rbd/test_librbd_python.sh for now
Removed all `sudo` from exec lines

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2016-12-07 09:53:20 -05:00
Sage Weil
26220f0608 mon/OSDMonitor: only show interesting flags in health warning
Also add PAUSEREC flag into the list.

Fixes: http://tracker.ceph.com/issues/18175
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-07 09:50:26 -05:00
Kefu Chai
329846a30b Merge pull request #12361 from dachary/wip-18030-pglog
tests: remove TestPGLog EXPECT_DEATH tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-07 22:42:58 +08:00
John Spray
aa0a0e2271 Merge pull request #12208 from ukernel/wip-18047
mds: don't access mdsmap from log submit thread

Reviewed-by: John Spray <john.spray@redhat.com>
2016-12-07 14:15:25 +00:00
John Spray
d6b991a396 Merge pull request #12077 from jcsp/wip-17954
mds: fix dropping events in standby replay

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2016-12-07 14:13:52 +00:00
John Spray
4ed4224391 Merge pull request #12133 from jcsp/wip-16924
mds: don't maintain bloom filters in standby replay

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-12-07 14:12:53 +00:00
John Spray
5a5a2b3f4a tasks/cephfs: use kill in test_reconnect_eviction
Previously relied on client being able to unmount
while the MDS was offline, which is not necessarily
so.  Use kill instead.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 13:40:09 +00:00
John Spray
4006cdebd8 Merge pull request #12360 from wido/docs-cephfs-datascan-workers
doc: Fix for worker arguments to cephfs-data-scan tool

Reviewed-by: John Spray <john.spray@redhat.com>
2016-12-07 12:50:53 +00:00
John Spray
063d61d851 Merge pull request #1300 from batrick/multimds-merge
suites/multimds: sync with fs suites

Reviewed-by: John Spray <john.spray@redhat.com>
2016-12-07 12:19:54 +00:00
Loic Dachary
f1b457ff98 tests: remove TestPGLog EXPECT_DEATH tests
As per Sam Just advice, remove the EXPECT_DEATH tests to avoid
intermittent hang because they do not play well with threads.

Fixes: http://tracker.ceph.com/issues/18030

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-12-07 10:50:43 +01:00
huanwen ren
6a601eba5e test/cephfs: add readlink test
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2016-12-07 17:19:48 +08:00
huanwen ren
1217ef5530 libcephfs: add readlink function in cephfs.pyx
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2016-12-07 17:11:55 +08:00
Kefu Chai
8f4d3ce147 Merge pull request #12327 from iain-buclaw-sociomantic/pybind-validate-args
pybind/rados: Add @requires for all aio methods

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-07 16:55:31 +08:00
Wido den Hollander
82c2f840b6
doc: Fix for worker arguments to cephfs-data-scan tool
The docs were incorrect and these arguments should work.

Signed-off-by: Wido den Hollander <wido@42on.com>
2016-12-07 09:49:09 +01:00
Kefu Chai
321691d89a cmake: turn krbd into a static lib
* simplify the link dependencies.
* s/keyutils/${KEYUTILS_LIBRARIES}/

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-12-07 16:09:08 +08:00
Kefu Chai
b805505d25 cmake: find keyutils if rbd or libcephfs is enabled
* find_package(keyutils REQUIRED) if (WITH_LIBCEPHFS OR WITH_RBD)
  prior to this change, we detect keyutils if the building platform is not
  FreeBSD, we should instead check the WITH_* options, and let the
  maintainer to decided what is the best for his/her platform, and error
  out if the building host cannot fulfill the requirement to build the
  asserts.
* build krbd.cc if (WITH_RBD)

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-12-07 16:09:08 +08:00
xie xingguo
bf3f57afb7 os/bluestore: fix global commit latency
"start" is used to calculate the global bluestore commit latency
and hence shall not be updated at each internal state enter/exit.

Otherwise the l_bluestore_commit_lat counter won't reflect the
real commit latency precisely.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-12-07 15:37:10 +08:00
Uday Mullangi
5af460091c doc: correcting the object name
Signed-off-by: umullangi@walmartlabs.com
2016-12-07 11:47:20 +05:30
Patrick Donnelly
dc648a798a
suites/multimds: add kclient disable override
The libcephfs tests are negatively affected by other mounts. This commit
adds a kclient disable in addition to the ceph-fuse one.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-06 22:38:38 -05:00
Patrick Donnelly
9be89e58cf
suites/multimds: sync with fs suites
This commit synchronizes the multimds suite with the fs suite. The
basic/verify sub-suites now do the same tests except with different
cluster layouts (i.e. multiple actives). This is mostly accomplished by
symlinking parts of each sub-suite to its counterpart in the fs suite.

This commit also does a few things of note to the prior multimds suite:

o Turn on directory fragmentation.
o Add several tests from fs/basic/tasks to multimds/basic.
o Remove libcephfs as fs/basic/tasks already contain
  multimds/basic/tasks.

Prior implementation and discussion are in PR#1114: https://github.com/ceph/ceph-qa-suite/pull/1114

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-12-06 22:38:31 -05:00
Xie Xingguo
66953e3224 Merge pull request #12350 from chanyoung/struct-OSDOp-typos
osd: fix typos in "struct OSDOp" comments

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-12-07 10:04:23 +08:00
John Spray
5f1abf9c31 suites/kcephfs: disable broken python tests
Disabling strays because of:
http://tracker.ceph.com/issues/17193

Disabling test_failover because of:
http://tracker.ceph.com/issues/18161

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 01:03:41 +00:00
Yunchuan Wen
f9fc3548ae osd: mark queued flag for op
queue_op will check the op epoch with current osdmap epoch,
and then, the op will be push into waiting_for_map or mark
queued flag.
but when the op pop from waiting_for_map, take_op_map_waiters
forget to mark queued flag before handle it.

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2016-12-07 08:56:14 +08:00
John Spray
d86b67ef9d tasks/cephfs: make test_journal_repair work with more daemons
Previously this assumed it was running with exactly two MDS
daemons.  When there were more, it would fail to execute
"fs reset" because the extra daemons were active in
the map.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:12 +00:00
John Spray
98842b7c96 suites/kcephfs: run python tests with 4 MDSs
For the benefit of test_failover

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:12 +00:00
John Spray
d6d9715ddd tasks/cephfs: skip volumeclient client test on kcephfs
This relies on quota-ish stuff that doesn't exist
in kclient.  We can still run the outer part
of the test though.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
0bd95f72a2 tasks/cephfs: fix unmount call in volumeclient test
Should have been to umount_wait, not umount (i.e.
the blocking foreground version).  This happened
to matter because umount_wait is more tolerant
of being called if the client is not already mounted.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
45eb4bf716 tasks/cephfs: special case for kcephfs behaviour
It does not generate EIOs in all the cases that
the fuse client does.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
1eabbbda25 tasks/cephfs: skip TestVolumeClient.test_evict on kcephfs
This test was probably buggy and only happened to work
with ceph-fuse, because it expects the MDS to immediately
respond to updates to the client's auth caps, but that
doesn't happen.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
989ecd6b1a suites/kcephfs: disable test_full for kcephfs
Until http://tracker.ceph.com/issues/17204 is done.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
14f3a688a2 tasks/cephfs: fix race in TestStrays.test_dirfrag_limit
With the kernel client, this was proceeding to attempt
a split before the directory had persisted, because
there was no fsync after creating it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
370ad523fc suites/kcephfs: remove task for cap flush test
This test skips all if not running against
fuse.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:11 +00:00
John Spray
1aa7ad6a7a tasks/cephfs: skip test_client_abort on kclient
This tests a fuse-only feature, ticket for adding
it in kclient is:
http://tracker.ceph.com/issues/17805

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:46:10 +00:00
John Spray
bc680e7a1e tasks/cephfs: support multi-fs in kernel client
Change the Mount interface to take it as an
argument to mount() instead of setting it
out of band in a config file as we used to
for the fuse client.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
d1277afd08 tasks/cephfs: fix eviction test for volumeclient
It was not correct to expect a client to block after
eviction unless it was also deauthorised.  I guess
this was working with fuse because fuse does a less
good job at re-establishing a session than the kclient?

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
507cfebbc7 tasks/cephfs: update test_journal_repair for kclient
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
1f7d2ef746 tasks/ceph: handle down nodes in log rotation
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
28aed55875 tasks/cephfs: skip ENOSPC testing on kclient
Ticket #17204 exists to revive the old patchset, until then
we skip the tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
c5f6dfc14f suites/kcephfs: put clients on dedicated nodes
Some tests want to use power cycling to reset stuck
mounts, and that needs to not kill OSDs as collateral
damage.

Need to revisit this to avoid unnecessarily using a whole
node for the client for those tests that don't require it
(i.e. those that don't use CephFSTestCase.REQUIRE_KCLIENT_REMOTE)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
2f6b034d09 tasks/cephfs: add a skip for non-fuse
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
2e99bd1005 suites/fs: s/yam/yaml/
Oops!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
318aa226b9 suites/kcephfs: s/yam/yaml/
Oops!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:46 +00:00
John Spray
3ac80a3576 suites/kcephfs: tolerate skipping tests
With fuse client we expect everything to be
runnable so treat SkipTest as a failure because
it indicates something bad in the config.  With kclient
we known we have to skip some tests, so tolerate it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
62d5177708 suites/kcephfs: add TestFailover
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
e5264ec5b4 tasks/kclient: unmount conditionally
Don't assume the workload left the mount up and
running.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
04951c8ae3 tasks/cephfs: skip test_session_reject cleanly
Instead of asserting in configure_auth (which in fact
works fine with KernelMount.write_secret_file), raise
a SkipTest in test_session_reject (because the kernel
client cannot handle the client_metadata setting to
inject bogus data)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
b21b825d7f tasks/cephfs: make KernelMount.umount_wait idempotent
Some places (notably CephFSTestCase.setUp) don't check
for mountedness before calling this.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
cd084c7d6d suites/kcephfs: add python tests
Let's see which of these is happy running with a kernel client!

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-07 00:45:45 +00:00
John Spray
0676444e62 Merge pull request #1282 from batrick/fs-reorg
fs: unify common parts of sub-suites

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-12-07 00:44:31 +00:00
chanyoung
8b2c896d9d osd: fix typos in "struct OSDOp" comments
"nembers" -> "members"

Signed-off-by: Chanyoung Park <park910113@gmail.com>
2016-12-07 09:25:56 +09:00