Commit Graph

320 Commits

Author SHA1 Message Date
Greg Farnum
4e4395f449 Merge remote-tracking branch 'origin/wip-11316' into greg-testing-quotas 2015-04-19 18:18:51 -07:00
Greg Farnum
f83976c258 Merge remote-tracking branch 'origin/wip-10390' into greg-testing-quotas
Conflicts:
	suites/fs/recovery/tasks/mds-full.yaml
2015-04-19 18:18:35 -07:00
John Spray
7c2e6cdc6c tasks/ceph_deploy: configure CephFS
This test apparently had not been touched since
"fs new" was added.  In addition to calling
Filesystem.create:
 * modify the get_nodes_using_role
   function to modify ctx.cluster.remotes so that the
   service IDs match what ceph-deploy will set
 * log exceptions during ceph_deploy setup, as otherwise
   they can get lost if another exception occurs during
   teardown (so that it's all easier to debug).
 * default to passing --dev=master during install, so
   that we don't error out horribly when run without
   an explicit branch set (e.g. when run outside
   scheduled suite)

Fixes: #11316
Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-19 17:46:18 -07:00
John Spray
f36011051c tasks/cephfs: cope with missing ctx.daemons attr
...so that we may be used with the ceph_deploy task
that doesn't set that up.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-19 17:46:18 -07:00
John Spray
8b61310ce3 tasks/cephfs: tweak use of mon for admin commands
... s/mon_remote/admin_remote/ and allow caller to pass
in which remote they want to use for that.  Enables use
with ceph_deploy task which does not give admin keys
to mons.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-19 17:46:18 -07:00
John Spray
ea7c39222a tasks/ceph: refactor legacy FS configuration check
Move up into Filesystem so that this can be used from
the ceph_deploy task as well.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-19 17:46:18 -07:00
Gregory Farnum
18c35bf23b Merge pull request #403 from ceph/wip-6613
task/samba: use SIGTERM to stop samba server

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-04-16 16:41:50 -07:00
Sage Weil
a14a951640 git.ceph.com
Signed-off-by: Sage Weil <sage@redhat.com>
2015-04-16 09:05:30 -07:00
Sage Weil
f062b171f4 git.ceph.com
Signed-off-by: Sage Weil <sage@redhat.com>
2015-04-16 08:37:56 -07:00
John Spray
7bc8875b42 tasks: implement TestStrays.test_mv_hardlink_cleanup
Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:40 +01:00
John Spray
a2a8c21abe tasks: update test_journal_repair
This broke with recent Client changes that
do better caching of readdir results, such
that doing an ls twice is no longer sufficient
to see a fresh result after repair - we need
to remount instead.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:40 +01:00
John Spray
097ccbb5be tasks: update journal_repair test for 'damaged' state
To track recent change in master where instead of
crashing on missing MDSTable object we'll go
into damaged state.

Instead of catching a crash, handle the rank's
transition to the damanged state.  Leave the crash
handling code (unused for the moment) in the
Filesystem class in case it's needed elsewhere
soon.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
bd3ae1eeba tasks/cephfs: add test_strays
This tests the new purge file/ops throttling
in the MDS, via the new perf counters for
strays/purging.

Fixes: #10390
Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
abb635588f tasks/cephfs: add test_sessionmap
Tests for the persistence behaviour of SessionMap.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
2b5137bf06 tasks: generalise cephfs test runner
...to avoid having boilerplate in each test module,
and gain the ability to run them all in one go
with a nice test-by-test pass/fail report.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
f54e5414f9 tasks/ceph_fuse: populate ctx.mounts earlier
...so that if an error happens during mount, I can
use the interactive console to access ctx.mounts.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
2b39fe5951 tasks/mds_flush: be more careful monitoring stats
Were previously taking the baseline from just after the
client did a delete, which was racy: should have taken
it from before, to get a steady state.

Also update the perf dump calls to take advantage of
the new filtering syntax.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
3d3b095bb1 tasks: lots of s/mds_restart/mds_fail_restart/
Wherever we are subsequently waiting for daemons
to be healthy, we should be doing a fail during the restart.

Also catch some places that were doing this longhand and use
the handy fail_restart version instead.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
79906e3d07 tasks/cephfs: better multiple-mds handling
Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:39 +01:00
John Spray
0de712f42a tasks/ceph_manager: DRY in mds_status
Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:38 +01:00
John Spray
5c1071b103 ceph_manager: fix bad type assertions
In python, isinstance(foo, str) will fail if
a unicode string is passed in.  The correct check
is basestring.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:38 +01:00
John Spray
ce1196d62f tasks/cephfs: be tolerant of multiple MDSs
...as long as only one is active, all the ops
that default to talking to a single MDS should
be happy to talk to the active MDS, even if there
happens to be a standby lying around too.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-04-14 14:13:38 +01:00
Yan, Zheng
86bd6bc377 task/samba: use SIGTERM to stop samba server
man samba(8) contains sentences:

To shut down a user's smbd process it is recommended that SIGKILL (-9)
NOT be used, except as a last resort, as this may leave the shared
memory area in an inconsistent state. The safe way to terminate an smbd
is to send it a SIGTERM (-15) signal and wait for it to die on its own.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-04-14 17:07:33 +08:00
Douglas Fuller
7b855dea09 RBD: added optional YAML parameters to test xfstests from different repos
These variables are needed because ceph-qa-suite bootstraps ceph-qa-chef via
http download of solo-from/scratch/run. This adds a variable to override the
default script. It also adds variables to the rbd task to override the versions
of run_xfstests_krbd.sh and run_xfstests.sh downloaded by the default task.

variables added
======
tasks:
-chef
  script_url: # override default location for solo-from-scratch for Chef
  chef_repo: # override default Chef repo used by solo-from-scratch
  chef_branch: # to choose a different git upstream branch for ceph-qa-chef
-rbd.xfstests:
  client.0:
   xfstests_branch: # to choose a different git upstream branch for xfstests
   xfstests_url: # override git base URL for run_xfstests{_krbd}.sh

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2015-04-07 17:45:20 -07:00
Douglas Fuller
b0f5cb1bf1 Increased default test RBD size to 10G to help tests pass
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2015-04-07 16:49:11 -07:00
Loic Dachary
f13eb91e51 rados: explain that the task is asynchronous by default
Signed-off-by: Loic Dachary <loic@dachary.org>
2015-04-03 11:10:26 +02:00
Andrew Schoen
8cb28ddb8e Revert "ceph: be less weird about passing -f to mkfs" 2015-04-02 15:08:13 -05:00
Andrew Schoen
855d3a7623 Merge pull request #385 from ceph/wip-mkfs
ceph: be less weird about passing -f to mkfs
2015-03-31 11:03:00 -05:00
Sage Weil
182cb63034 ceph: fix mkfs -f bug
Pass -f by default to btrfs instead of first trying without and *then*
trying with.

Among other things, this avoids a confusing failure where we try mkfs.ext4
device (no -f), fail for some reason, and then try again with -f and get
a usage error (-f does not mean force for mke2fs).

Signed-off-by: Sage Weil <sage@redhat.com>
2015-03-31 07:56:53 -07:00
Yuri Weinstein
581fcf192f Merge pull request #380 from ceph/wip-11204
Make sure that ulimits are adjusted for ceph-objectstore-tool
2015-03-27 12:23:37 -07:00
Dan Mick
58174f05e9 calamari_setup: der. Use dict.update() correctly
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-26 17:54:36 -07:00
Andrew Schoen
85e7be5a48 Merge pull request #381 from dmick/master
calamari_setup fixes
2015-03-26 17:21:18 -07:00
Sage Weil
dcb5e8da9d Merge remote-tracking branch 'gh/hammer'
Conflicts:
	.gitignore
2015-03-26 17:09:33 -07:00
Dan Mick
e3ec2fc7c4 calamari_setup: Require test_image to be set
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-26 17:01:48 -07:00
Dan Mick
dee010163b calamari_setup: centralize config defaults
Make a DEFAULTS dict that is updated by any user parms, so that
defaults are documented centrally and so config.get(key, defval) is
no longer necessary everywhere.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-26 17:01:48 -07:00
Dan Mick
3a69c3f494 calamari_setup: remove "build test image" code; add 'test_image' cfgvar
Stop trying to build test images inside this test; presume the test
image is available built externally (in a file path or an http URL).
Config vars ice_tool_dir, ice_version, iceball_location, and
ice_git_location go away in favor of 'test_image', the path to the
testable image (which can still be a tar.gz or an .iso).

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-26 17:01:48 -07:00
Dan Mick
5644bb5a8d calamari_setup: mounting iso on older distros requires -o loop
Ubuntu's mount/kernel support "mount <file> <mntpnt>" directly;
apparently Centos 6 (and presumably RHEL6) require specifying at
least '-o loop' (a /dev/loopN will be dynamically allocated and removed
on unmount).

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-26 17:01:48 -07:00
Sage Weil
bafe87a8e5 tasks/watch_notify_same_primary: wait for watch before notify
Make sure watch is done registering and ready before sending the
notifies.

Fixes: #10634
Signed-off-by: Sage Weil <sage@redhat.com>
2015-03-26 16:51:56 -07:00
David Zafman
e6ce90fdb1 Make sure that ulimits are adjusted for ceph-objectstore-tool
Fixes: #11204

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-03-26 15:18:47 -07:00
Loic Dachary
fc39550933 ensure summary is looked for the user we need (part 2)
Move the get_user_summary(out, user) logic to util.rgw so that it can be
shared between radosgw_admin_rest.py and radosgw_admin.py and modify
them accordingly.

http://tracker.ceph.com/issues/11180 Fixes: #11180

Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from commit 97e6d808f0)
2015-03-24 13:37:41 -04:00
Loic Dachary
97e6d808f0 ensure summary is looked for the user we need (part 2)
Move the get_user_summary(out, user) logic to util.rgw so that it can be
shared between radosgw_admin_rest.py and radosgw_admin.py and modify
them accordingly.

http://tracker.ceph.com/issues/11180 Fixes: #11180

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-03-22 21:07:51 +01:00
David Zafman
6c5300552d ceph_manager: Check for exit status 11 from ceph-objectstore-tool import
Fixes: #11139

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-03-20 21:25:41 -07:00
Gregory Meno
798f31d836 Merge pull request #371 from ceph/wip-iso-style
Add support for ISOs to tasks/calamari_setup
2015-03-20 20:33:53 -04:00
Dan Mick
c571e65671 calamari_setup: oops: ice-tools is still where it was on github.com
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-20 17:28:10 -07:00
Alfredo Deza
b6c2e978d6 ensure summary is looked for the user we need
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f7ea0a424a)
2015-03-20 13:23:02 -04:00
Alfredo Deza
f7ea0a424a ensure summary is looked for the user we need
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-03-20 09:27:05 -04:00
Gregory Meno
81c493c99f calamari_setup: add -y to yum localinstall icesetup
also fix a few flake8 things

Signed-off-by: Ubuntu <ubuntu@vpm047.front.sepia.ceph.com>
2015-03-19 20:14:52 +00:00
Dan Mick
93c0b8a0bd calamari_setup: handle iso, preserving support for tar.gz
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-18 18:03:21 -07:00
Dan Mick
da668abb92 calamari_setup: small comment/logmsg fixes, correct git user path
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-18 18:03:18 -07:00
Dan Mick
9087b7da12 calamari_setup: make iceball fetch/creators return path to iceball
Also, widen the concept of "iceball" to include both iso and tar.gz

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-18 17:16:53 -07:00