Commit Graph

869 Commits

Author SHA1 Message Date
Ramana Raja
cbadb384f2 tasks/cephfs: test volume client eviction
Test whether the CephFSVolumeClient can evict a client based on its
auth ID and the volume path it has mounted.

Fixes: http://tracker.ceph.com/issues/15045

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-05-04 18:54:08 +05:30
Ramana Raja
64869a3e4d tasks/cephfs: make mount point more configurable
The mount points of the test clients were created based on the auth
ID they used. So two clients using the same auth ID could not create
different mount points in a straight forward way. Expose the
directory name of the mount point as a public attribute allowing
client mount points to be easily changed whenever needed.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2016-05-04 18:54:08 +05:30
David Zafman
5c0edbae3e repair_test: Disable scheduled scrubbing to not mess up do_pg_scrub()
Fixes: http://tracker.ceph.com/issues/15679

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-05-03 09:11:51 -07:00
David Zafman
b25392451e scrub_test: Fix swapped assert error messages
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-05-03 09:11:51 -07:00
David Zafman
4d0c668e9e scrub_test: Fixes need with wip-13507
Accept an attribute if not present as False
Change required due change to dict with "epoch" and "inconsistents"

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-05-03 09:11:33 -07:00
Samuel Just
18f2aa09ff Revert "Rados: Tracker-13531-resolve stuck peering" 2016-05-02 20:39:39 -07:00
shylesh kumar
e3bb551067 Rados: wip-13531:Resolve stuck peering
Signed-off-by: shylesh kumar <shylesh.mohan@gmail.com>
2016-05-02 12:41:14 -04:00
David Zafman
8da6e97bd4 CephManager: Wait 1 second for pool creation to get far enough along
Fixes: http://tracker.ceph.com/issues/15673

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-04-29 14:29:13 -07:00
David Zafman
a595651c54 CephManager: Maximum 2 minutes for raw cluster commands
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-04-29 09:43:39 -07:00
David Zafman
447bf873a8 thrasher: Add noscrub_toggle_delay and flip the noscrub osd flags
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-04-29 09:43:39 -07:00
David Zafman
7a528763d1 thrasher: Add dump_ops_enable and optrack_toggle_delay options
Add dump_ops_enable which continuously dumps ops using 3 commands
Add optrack_toggle_delay to alternate op tracking enablement

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-04-29 09:43:38 -07:00
David Zafman
4ad3b86604 ceph_manager: Add timeout to admin_socket/osd_admin_socket
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-04-29 09:43:38 -07:00
Casey Bodley
2a48199c1d Merge pull request #891 from ceph/wip-rgw-new-multisite
Wip rgw new multisite

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-04-29 12:10:28 -04:00
John Spray
35cb248ce5 Merge pull request #959 from xiaoxichen/add_ns_check
tasks/cephfs: check data written to NS.

Reviewed-by: John Spray <john.spray@redhat.com>
2016-04-26 12:22:48 -05:00
Orit Wasserman
7b5ab7adcb rgw: fix debug messages
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:07 +02:00
Orit Wasserman
3e8f55054f rgw: fix zone get with multisite
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:07 +02:00
Orit Wasserman
9472ee4067 rgw: configure users on all clients
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:07 +02:00
Orit Wasserman
724e7e0b77 rgw: do not overwrite user_info with zone user_info
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:07 +02:00
Orit Wasserman
f0920081ab rgw: allow already exist realm
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:07 +02:00
Orit Wasserman
fd6a6f8f85 rgw: increase timeout to wait for master to 20 seconds
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
c5ee9dec81 rgw: we can have multicluster without multizone
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
d03594eab5 rgw: no need to do period pull
realm pull already pulls latest period

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
564a883bc1 rgw: non master zones need to be created on the remote gateway
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
20dab79dd0 rgw: mtime is now a time string with microseconds
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
b75011f2d5 rgw suite: add --rgw-zone
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
82e03386b8 rgw suite: create default zone after zonegroup creation
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
895f9d334d rgw suite: debug zone info
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
1673e9f62c rgw suite: set default zonegroup on all clients
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
5f9b6003ae rgw: default zone should be always master zone
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
e88ee582c0 rgw suite: different clients have different defaults zone
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
157600bcb6 rgw suite: In multisite configuration start the master gw first
Than pull realm and period configuration from it

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
c203974eb6 rgw suite: use master_zonegroup not master_region
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
b8120f7c7a rgw suite: use zonegroups instead of regions
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
1c71383c78 rgw: move realm pull and period pull to pull_configuration
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
d91121431e rgw: update and commit period
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
63192cbf46 rgw: add realm creation
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Orit Wasserman
6d066a7a0c rgw suite: always add --rgw-frontends fastcgi
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-19 12:39:06 +02:00
Xiaoxi Chen
226a5068ed tasks/cephfs: check data written to NS.
NS is always used for security isolation.

Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2016-04-17 17:27:57 +08:00
Sage Weil
52b13e82a6 tasks/ceph: allow set allow_multiple to fail
This will fail on upgrade tests.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-16 09:10:51 -04:00
Gregory Farnum
827bf93d80 Merge pull request #936 from ceph/wip-layout-snafu-followup
tasks/cephfs: test health messages from readonly stat
2016-04-12 07:50:02 -07:00
Gregory Farnum
7cd48dbe82 Merge pull request #933 from ceph/wip-fs-lockouts
cephfs: update tests to enable multimds when needed
2016-04-12 07:49:51 -07:00
Gregory Farnum
89b15788f9 Reproducer for 15303
Reproducer for http://tracker.ceph.com/issues/15303
2016-04-12 07:47:07 -07:00
Orit Wasserman
7f0ad8ab4e rgw: use civetweb if no frontend was configured
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-12 11:04:37 +02:00
Greg Farnum
a739533cd1 FIXUP 'cephfs: update tests to enable multimds when needed' 2016-04-11 21:46:12 -07:00
Greg Farnum
1c4e019ad4 cephfs: enable dirfrags in test_data_scan fragmentation test
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-11 14:16:30 -07:00
Sage Weil
897e52ee82 Merge pull request #944 from athanatos/wip-lfn-upgrade
LFN upgrade tests and a few other misc fixes
2016-04-11 14:01:21 -04:00
Casey Bodley
a32f116345 Merge pull request #954 from ceph/wip-rgw-fix-zone-get
rgw: add default zone name
2016-04-11 10:01:25 -04:00
Loic Dachary
6334196a39 Merge pull request #950 from dachary/wip-buildpackages-xenial
buildpackages: xenial support
2016-04-09 19:37:53 +02:00
Robin H. Johnson
a33517a88f buildpackages: add build timeouts.
The build/upload process CAN get stuck sometimes. As we are paying
utility rates for the high-power build server, we should timeout when
it's likely the build is stuck.

Use a default timeout just short of 4 hours, as some providers round up
partial instance-hours for billing.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:44:04 +02:00
Robin H. Johnson
df5d147094 buildpackages: support ubuntu 12.04.
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:42:13 +02:00
Robin H. Johnson
cd4b7ad642 buildpackages: fix configure on Ubuntu 12.04.
Ubuntu 12.04/precise has a buggy lttng; it fails our lttng-is-sane
check, as it leaves out headers.

This should not stop building of Ceph, as the automatic build handling
from debian/rules will correctly omit LTTNG on Precise.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:42:13 +02:00
Robin H. Johnson
785801c2e9 buildpackages: catch VM instances in ERROR state.
It is possible for 'server create' to return success, but then NOT have
a good VM afterwards. The instance will be in state ERROR.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-09 00:42:09 +02:00
Orit Wasserman
6927f64866 rgw: add default zone name
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-08 23:29:55 +02:00
Orit Wasserman
4534e8ed61 rgw: policy acl format should be xml
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-08 22:46:31 +02:00
Loic Dachary
465ff97711 buildpackages: add ubuntu 16.04 xenial support
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-08 13:30:09 +02:00
Samuel Just
7e53203e80 rados/singleton-nomsgr: add lfn upgrade tests
Upgrade from hammer/infernalis to x and verify lfn objects are valid
across upgrade.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
4629585536 tasks: add create_verify_lfn_objects
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
93892eb82a ceph_manager: return exit status on do_get, do_put, do_rm
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
269d6002f1 ceph_manager: add do_rm
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
670ca43dfc ceph_manager: extend do_put and do_get to allow a namespace
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Samuel Just
c8f7694d52 ceph_manager: fix do_get to actually do a get
Currently unused.

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-04-07 15:35:30 -07:00
Loic Dachary
c655de7ef3 buildpackages: discard google-perftools on trusty aarch64
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-07 15:36:22 +02:00
Greg Farnum
5e7e017d7d cephfs: update tests to enable multimds when needed
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-06 16:32:44 -07:00
Loic Dachary
5ab482e82c arch: teuthology must use aarch64, not arm64
teuthology / gitbuilder / ansible_architecture arch is

   dpkg-architecture --query DEB_HOST_GNU_CPU (x86_64 and aarch64)

deb package Architectures: (conf/distributions) is

   dpkg-architecture --query DEB_HOST_GNU_ARCH (amd64 and arm64)

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
Loic Dachary
42836aaf2f buildpackages: runabove has 30GB root disk max
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
Loic Dachary
3e7f311b76 buildpackages: install rsync
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
Loic Dachary
4f1029102a buildpackages: add missing arm64 to make-deb.sh
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-06 21:02:31 +02:00
John Spray
ac383735ae tasks/cephfs: test health messages from readonly stat
Signed-off-by: John Spray <john.spray@redhat.com>
2016-04-06 17:17:32 +01:00
Loic Dachary
86619401ab buildpackages: add debian 8.0 support
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-31 14:49:25 +02:00
John Spray
9263bef283 tasks/cephfs: update vstart_runner for cmake build changes
All binaries now go into bin/

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-29 12:13:37 +01:00
John Spray
240c0dd2f0 tasks/cephfs: reproducer for #15303 client bug
Run through two-client scenario where the first client
thinks a dir is empty even though the second client
has written some files to it.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-29 12:13:15 +01:00
John Spray
4f33f263eb tasks/cephfs: tidy Mount.ls to return [] on empty dir
Previously returned ['']

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-29 12:13:15 +01:00
Loic Dachary
c6bf2cd4a2 Merge pull request #908 from dachary/wip-archs
archs: add files for each known architecture
2016-03-29 01:01:32 +02:00
Loic Dachary
b976563af2 buildpackages: do not try tcmalloc on arm64
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 21:58:42 +02:00
Loic Dachary
b9b00a5ddb buildpackages: desambiguate nic on server create
When there are more than one network, it is required to select the one
to be attached to the nic of the instance.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 19:52:00 +02:00
Sage Weil
826aaad0bd Merge remote-tracking branch 'gh/jewel' 2016-03-28 12:39:11 -04:00
Loic Dachary
a8f4321f5c buildpackages: build will work on a range of flavors
When selecting a flavor to build, we prefer the largest we can find and
fallback to smaller ones, down to the minimum acceptable flavor, if
there is no other available.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Loic Dachary
c5182f257c buildpackages: do not hardcode x86_64 in build scripts
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Loic Dachary
f9c4858a26 buildpackages: use architecture suffixed images
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Loic Dachary
40277ca6a9 archs: add files for each known architecture
So that they can be prepend to teuthology-suite to run a job on a
designated architecture.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-28 18:15:12 +02:00
Gregory Farnum
11963dcd3e Merge pull request #905 from ceph/wip-15065
tasks/cephfs: extend TestMultiFilesystems
2016-03-24 18:01:41 -07:00
Yan, Zheng
b977e86f5d tasks/cephfs: test for request caps during lookup/open
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2016-03-24 17:47:53 -07:00
Gregory Farnum
f5a1cab663 Merge pull request #874 from ceph/jewel-15008
Jewel 15008

Reviewed-by: John Spray <john.spray@redhat.com>
2016-03-23 17:09:02 -07:00
John Spray
41b27979f1 tasks/cephfs: extend TestMultiFilesystems
...with cases for standby_for_rank and standby_for_fscid.

Fixes: #15065
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-22 12:03:13 +00:00
John Spray
bea9b5bb2e tasks: fix ceph_deploy call to Filesystem()
Fixes: #15204
Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-21 10:13:25 +00:00
Loic Dachary
1cc657798a buildpackages: provision a small build machine for tests
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-19 11:15:22 +01:00
Sage Weil
7567c80885 Merge remote-tracking branch 'gh/jewel' 2016-03-17 09:27:07 -04:00
Dan Mick
228f71e176 tasks/ceph.py: Remove *.pid at end of run
http://tracker.ceph.com/issues/15162
Fixes: #15162
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2016-03-16 15:50:30 -07:00
Loic Dachary
c9a1f767c2 Merge pull request #882 from dachary/wip-buildpackages
buildpackages: allow for packages to be re-used for releases
2016-03-16 14:40:03 +01:00
Loic Dachary
63c1a6f9ed buildpackages: ensure clone to a ceph directory
In case the repository from which the clone is not named ceph.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
df3eba0f6b buildpackages: for source inclusion in debian
We do not build debian versions (i.e. -2 -3 etc). Even if the debian
detection logic infers that the previous debian version already had the
source package, it is incorrect.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
33b4397da8 buildpackages: allow for more parallel builds
Builds are in parallel if the OS type / version and the SHA1 are
different. Having just one build at a time for a given SHA1 slows thing
down when there are more than a few supported OS.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
c60ace31ea buildpackages: enable autoindex in the packages repository
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
b30655eeb6 buildpackages: do not requires the long tag version
So that v10.1.0 is used instead of 10.1.0-0-g35ac827 when possible.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
5e145c1a2f buildpackages: also pull tags from the user ceph fork
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 14:36:52 +01:00
Loic Dachary
d1f456850c workunit: git checkout sha1/branch/tag
git clone --branch refspec only accepts branches and tags but not a sha1
git reset --hard refspec only accepts tags and sha1 but not branches

Use git checkout because it interprets branches, tags and sha1 as
expected.

$ git checkout jewel
Branch jewel set up to track remote branch jewel from origin.
Switched to a new branch 'jewel'
$ git checkout v0.94.6
HEAD is now at e832001... 0.94.6
$ git checkout b2503b0e15
HEAD is now at 95cefea... 0.94.3

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-16 09:25:56 +01:00
Gregory Farnum
7413c38bdf Merge pull request #875 from ceph/wip-15124
tasks/cephfs: support old mdsmap command during setup
2016-03-15 22:33:29 -07:00
Dan Mick
3f54da5eb2 Merge pull request #836 from ceph/wip-fix_cdtest
fix ceph-deploy test

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-03-15 12:58:18 -07:00
Gregory Farnum
6254215399 Merge pull request #861 from ceph/wip-vstart-fixes
tasks/cephfs: vstart & fuse improvements
2016-03-15 12:41:07 -07:00
Gregory Farnum
5116fb07f0 Merge pull request #867 from ceph/jewel-15050
tasks/cephfs: cover fancy layout in test_strays
2016-03-15 12:27:47 -07:00