1
0
mirror of https://github.com/ceph/ceph synced 2025-04-07 18:17:22 +00:00
Commit Graph

53 Commits

Author SHA1 Message Date
Josh Durgin
a9872182d3 tasks: update ctx.ceph.conf readers to use per-cluster conf
Just use the default cluster name for now, since these tasks aren't used
for multi-cluster tests yet.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-05-09 14:55:27 -07:00
Xiaoxi Chen
226a5068ed tasks/cephfs: check data written to NS.
NS is always used for security isolation.

Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2016-04-17 17:27:57 +08:00
John Spray
9e202b44c8 tasks/cephfs: support old mdsmap command during setup
While Filesystem at large requires the new commands, for
use from the `ceph` task we must support old style commands,
as the ceph task is used to instantiate old clusters during
upgrade testing.

Fixes: , , 

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-15 16:52:49 +00:00
John Spray
e1634ed2ed tasks/cephfs: debug in wait_for_daemons
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:40:11 +00:00
John Spray
53f4430d03 tasks/cephfs: further thrasher fixes
Move the thrasher-specific methods out of CephManager
into MDSThrasher and plumb them into MDSCluster.

Signed-off-by: John Spray <john.spray@redhat.com
2016-03-11 10:39:37 +00:00
John Spray
9ca3721d72 tasks/cephfs: simplify recreate()
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:39:36 +00:00
John Spray
951102df37 tasks/cephfs: rename Filesystem.reset to recreate
Name was ambiguous wrt "fs reset"

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
b02afb2a2a tasks: fix mds_thrash for multi filesystems
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
22b350de86 tasks: generalise cephfs classes for multi-fs
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-11 10:36:43 +00:00
John Spray
356579be97 tasks/cephfs: update TestDamage
...to account for the behavioural changes with
the addition of DamageTable.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-03 21:56:47 +00:00
Sage Weil
bb2f575598 tasks/cephfs/filesystem: ceph_file_layout -> file_layout_t
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-01 09:27:59 -05:00
John Spray
9cf37080fc tasks/cephfs: test sharded cephfs-data-scan
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-29 10:26:32 +00:00
John Spray
58c13c1a28 tasks/cephfs: fix wait_for_state timing
Return actual elapsed wallclock time instead of
the number of times we polled.

Fixes: 
Signed-off-by: John Spray <john.spray@redhat.com>
2016-01-07 11:24:57 +00:00
Greg Farnum
2e47e03745 filesystem: fix get_daemon_names
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-10-29 15:35:43 -07:00
John Spray
176e9ef267 tasks/cephfs: add test_failover
A quick check that clients refuse to mount
when daemons are laggy, and while we're at it,
that the basics of failover work.  It's a trivial
test, but it's nice to have this kind of thing
so that we don't have to wait for weird thrasher
failures if something breaks.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-14 02:20:00 +01:00
John Spray
0584b9c8dc tasks/cephfs: fix test_journal_migration
It was trying to get the output file from
a different remote than the one used to
run the journal tool.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:18 +01:00
John Spray
4f8adf155b tasks/cephfs: raise error on non-string stdins
Shouldn't be any from the fs tests that get run

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:17 +01:00
John Spray
cbb85720f3 tasks/cephfs: updates for cmake environ
Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:17 +01:00
John Spray
9a1ca94edc tasks/cephfs: cluster_down before fs rm
In teuthology this isn't needed because we join the
mds child processes after killing them.  In vstart
we're killing them asynchronously, so be a bit more
careful to ensure they can't re-insert themselves
to the mdsmap between our calling fail and our calling
fs rm.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:16 +01:00
John Spray
7e6f8d4905 tasks/cephfs: use stdin/stdout in Filesystem._read_data_xattr
...so that it doesn't rely on a temp local file and using
run.Raw(">") in commands.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:16 +01:00
John Spray
bab4c7aa71 tasks/cephfs: add Filesystem.exists
Use this during test setup to check whether
a filesystem is configured at all, before
trying to tear it down.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:16 +01:00
John Spray
e2f8b48d94 tasks/cephfs: add Filesystem._prefix
So that my vstart subclass can put ./ before
all the commands.

One could set $PATH, but I like to unambiguously point
it at the local built binaries in case someone also
has some systemwide packages.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:15 +01:00
John Spray
99a8a123da tasks/cephfs: add Filesystem.delete_all
So that we can clear down filesysteems created by
someone other than ourselves (like vstart.sh)

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:15 +01:00
John Spray
ad562f4b79 tasks/cephfs: make Filesystem rados command overridable
Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:15 +01:00
John Spray
7884d5b555 tasks/cephfs: use raw_cluster_cmd in Filesystem
...instead of manually invoking 'ceph' -- so that
it's easier to override this for vstart.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-10-02 17:41:15 +01:00
Gregory Farnum
ba6e8e6d94 Merge pull request from ceph/wip-offline-backward
Tests for damage handling and cephfs-data-scan

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-07-14 11:43:02 +01:00
Yan, Zheng
44dc0320fa Merge pull request from ceph/wip-4161
Add cephfs TestBacktrace
2015-07-13 17:22:58 +08:00
John Spray
21abe9d928 tasks/cephfs: add test_backtrace
This is for verifying the new layout-writing behaviour.  While
we're at it, test that the pre-existing backtrace behaviours
are really happening (updating old_pools)

Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-25 17:19:03 +01:00
John Spray
cc2e9ff579 tasks/cephfs: allow stdin for Filesystem.rados
Useful for puts when injecting data to test
corruption handling.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-18 11:22:12 +01:00
John Spray
e6afe66b24 tasks/cephfs: allow stdin for Filesystem.rados
Useful for puts when injecting data to test
corruption handling.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-17 14:06:23 +01:00
John Spray
0f34d0785c tasks/cephfs: add Filesystem.data_scan wrapper
Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-17 14:06:22 +01:00
John Spray
13c7f97d89 tasks/cephfs: cover pool quota in test_full
Run the same procedure as TestClusterFull, but
instead of limiting OSD memstore size, use pool
quota on the data pool.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-05-08 14:09:59 +01:00
John Spray
f36011051c tasks/cephfs: cope with missing ctx.daemons attr
...so that we may be used with the ceph_deploy task
that doesn't set that up.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-19 17:46:18 -07:00
John Spray
8b61310ce3 tasks/cephfs: tweak use of mon for admin commands
... s/mon_remote/admin_remote/ and allow caller to pass
in which remote they want to use for that.  Enables use
with ceph_deploy task which does not give admin keys
to mons.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-19 17:46:18 -07:00
John Spray
ea7c39222a tasks/ceph: refactor legacy FS configuration check
Move up into Filesystem so that this can be used from
the ceph_deploy task as well.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-19 17:46:18 -07:00
John Spray
bd3ae1eeba tasks/cephfs: add test_strays
This tests the new purge file/ops throttling
in the MDS, via the new perf counters for
strays/purging.

Fixes: 
Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
79906e3d07 tasks/cephfs: better multiple-mds handling
Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
ce1196d62f tasks/cephfs: be tolerant of multiple MDSs
...as long as only one is active, all the ops
that default to talking to a single MDS should
be happy to talk to the active MDS, even if there
happens to be a standby lying around too.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:38 +01:00
John Spray
5b2fd3d614 tasks/cephfs: don't run iptables in parallel
Where multiple MDSs were on the same node, trying
to concurrently update their firewall state was
causing an exception because the iptables command
errors out if another instance is already running.

Fixes: 
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-02 12:41:13 +00:00
John Spray
bf13a4e062 tasks/mds_journal_repair: create new test
This tests the new  repair functionality
where we selectively scrape dentries out of
the journal while the MDS is offline.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-19 19:36:34 +00:00
John Spray
997c0c3d62 tasks/cephfs: remove config from Filesystem cons
This was only used in get_first_mon, which doesn't actually
need the parameter itself.  Makes it easier to casually
use Filesystem from any place with a ctx to hand.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-09 10:09:53 +00:00
John Spray
8630c4ab3b tasks/cephfs: move ROOT_INO into filesystem module
...so that other tests can get at it.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-09 10:09:52 +00:00
John Spray
5e3f5766d0 tasks/cephfs: be more precise in set_clients_block
Instead of blocking the whole port range (which
might make OSDs running on that node collateral
damage), read the MDS's port out of the MDS map
and just block that.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-09 10:09:52 +00:00
John Spray
7696afd3fa tasks: create mds_flush task
This tests:
 * The new 'flush journal' asok command
 * That the resulting on disk structures are as expected
 * That cephfs-journal-tool is happy with the result

Fixes: 

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-19 13:40:53 +00:00
John Spray
849e259b96 tasks: add mds_full task
This is for exercising the CephFS behaviour
when the cluster becomes full.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-18 12:45:31 +00:00
John Spray
f9609c4688 tasks/cephfs: let get_config use non-mon services
Previously was always using the default values of things
so querying mon instead of the appropriate service
worked fine.  However, for things we might want to
update on a per-test basis we need to go ask the
correct service what the setting really is.

Needed for osd_mon_report_interval_max in the ENOSPC
testing.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-18 12:45:30 +00:00
John Spray
8fc3550002 tasks/ceph: move FS creation inside Filesystem
Leave the legacy handling out in cephfs_setup, move
the filesystem creation stuff into Filesystem.  I
anticipate this being the right place for it if/when
we have tests that want to do 'fs rm' 'fs new' type
cycles within themselves.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-02 13:31:57 +00:00
John Spray
89beed1b0a tasks/ceph: conservative PG count in FS pools
This was tripping over the recent commit 42c85e80
in Ceph master, which tightens the limits on
acceptable PG counts per OSD, and was making
teuthology runs fail due to never going clean.

Rather than put in a new hardcoded count, infer
it from config.  Move some code around so that
the ceph task can get at a Filesystem object
to use in FS setup (this already has conf-getting
methods).

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-02 13:30:06 +00:00
John Spray
b77b3bec72 tasks: add mds_client_limits
New CephFS tests for the behaviour of the system while
enforcing its resource limits.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-09-29 15:04:18 +01:00
John Spray
b6ccf0d414 tasks: generalize config writing for Filesystem
Signed-off-by: John Spray <john.spray@redhat.com>
2014-09-29 15:03:17 +01:00