Commit Graph

5874 Commits

Author SHA1 Message Date
David Galloway
7abc768941 qemu: Set permissions on /dev/kvm
Hack until fix in https://bugzilla.redhat.com/show_bug.cgi?id=1333159
makes it into CentOS repos.

Fixes: http://tracker.ceph.com/issues/17977

Signed-off-by: David Galloway <dgallowa@redhat.com>
2016-11-30 18:05:24 -05:00
Samuel Just
08801a0e9f Merge pull request #1291 from ceph/wip-18085
rados/thrash*: do no set osd_max_backfills=1

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-11-30 09:20:17 -08:00
Sage Weil
9717bc34a2 rados/thrash*: vary osd_max_backfills, always >1
This can lead to a copy-from vs backfill deadlock; see
http://tracker.ceph.com/issues/18085

This effectively reverts 5e880228fd
which aimed to catch bugs in recovery reservations.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-30 12:13:14 -05:00
Sage Weil
49fdc370e7 Merge pull request #894 from ceph/wip-bluestore
rados: test bluestore too
2016-11-29 21:55:46 -05:00
Sage Weil
0fa0fa9ce0 rados/objectstore/objectstore.yaml: do not test kstore
It's flaky.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-29 21:55:18 -05:00
Sage Weil
87175c1ab2 rados/objectstore/objectstore.yaml: test bluestore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-29 21:53:36 -05:00
Sage Weil
2ac9ad0289 rbd: test on filestore and bluestore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-29 21:53:36 -05:00
Sage Weil
a7e183d420 fs: test bluestore and filestore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-29 21:53:36 -05:00
Sage Weil
e7f6e5a081 rgw: test bluestore and filestore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-29 21:53:36 -05:00
Sage Weil
1a1ba44d9a rados: test bluestore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-29 21:53:36 -05:00
John Spray
ef48920827 Merge pull request #1289 from ceph/wip-16397-workaround
suites/knfs: pin to ubuntu

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2016-11-30 01:06:15 +00:00
Sage Weil
59bc5ffe94 Merge pull request #1283 from SUSE/wip-18014
thrashosds: try ceph-objectstore-tool for one minute

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-11-29 11:07:32 -05:00
John Spray
b6ba7c0104 suites/knfs: pin to ubuntu
Workaround for http://tracker.ceph.com/issues/16397, which
manifests when we run bleeding edge kernels against the version
of nfs-utils in centos7.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-29 14:28:13 +00:00
Nathan Cutler
862b47faac thrashosds: try ceph-objectstore-tool for 10 minutes
If ceph-objectstore-tool binary is not present, it's likely because we're in
the middle of an upgrade. Do not try to run the binary until we verify that
it's really present. If it is absent, spend up to 10 minutes waiting for it to
appear.

Before this patch there was quite a large window for a race to occur. This
patch doesn't entirely eliminate it, but drastically reduces it.

Fixes: http://tracker.ceph.com/issues/18014
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2016-11-25 22:50:31 +01:00
Jason Dillaman
0e5653feaf Merge pull request #1235 from vshankar/wip-rbd-data-pool
suites/rbd: add data pool test cases

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-11-23 12:26:22 -05:00
Josh Durgin
4fe434995b Merge pull request #1277 from ceph/wip-exclude-upgrade-clients
Excluded 'libcephfs2','libcephfs-devel','libcephfs-dev'

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-11-22 16:48:07 -08:00
Yuri Weinstein
3d4c358378 Excluded 'libcephfs2','libcephfs-devel','libcephfs-dev'
Removed firefly and infernalis paths
Removed mds role from hammer (per chat with Jason)
Add "fs: xfs" override

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2016-11-23 00:40:59 +00:00
Venky Shankar
0d538a1438 rbd: add datapool config YAML to rbd suite
- cli
- librbd
- qemu

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2016-11-22 16:05:22 +05:30
Patrick Donnelly
eef0d958dd
suites/fs: link to common tasks
Goal is to reduce arbitrary differences between fs suites.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 16:24:32 -05:00
Patrick Donnelly
ef5d7f4564
suites/fs: unify/reuse common fs
Goal is to reduce arbitrary differences between fs suites.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 16:22:56 -05:00
Patrick Donnelly
b89733aa72
suites/fs: unify/reuse common overrides
Goal is to reduce arbitrary differences between fs suites.

Note:
  o fs/{multiclient,multifs,recovery,snaps,standbyreplay} now use basic/overrides/whitelist_wrongly_marked_down.yaml.
  o fs/{snaps,standbyreplay} now use basic/overrides/debug.yaml.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 16:22:55 -05:00
Patrick Donnelly
78e3feaae3
suites/fs: unify/reuse common (fuse) mount
Goal is to reduce arbitrary differences between fs suites.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 16:22:45 -05:00
Patrick Donnelly
df5a6b1843
suites/fs: unify/reuse common cluster layout
Goal is to reduce arbitrary differences between fs suites.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:10 -05:00
Patrick Donnelly
4260dd57e3
suites/fs: unify install/start task creation
Goal is to reduce arbitrary differences between fs suites.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:10 -05:00
Patrick Donnelly
bdd1b71e71
verify: remove old debugging addition
Added in 7ae1aefa to help resolve http://tracker.ceph.com/issues/1737.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:10 -05:00
Patrick Donnelly
6336f83d5f
suites/fs: add ceph-fuse disable override
Some tests require fuse mounts to not be unmounted. This avoids the need
to manually specify clients as unmounted.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:07 -05:00
John Spray
60d9a77aa0 Merge pull request #1262 from batrick/cephfs-delete-bugfix
cephfs: get new fsmap after marking clusters down

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-21 12:51:53 +00:00
John Spray
8047f8ce37 tasks/cephfs: add test_fragment
Fixes: http://tracker.ceph.com/issues/17853
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:09 +00:00
John Spray
e69d78cbc7 tasks: mark start and end of tests in clog
This makes it much easier to associate e.g. slow
requests messages with which test was running.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
John Spray
797a4e7765 tasks/cephfs: reinstate ctx.filesystem
This got lost in the multi-filesystem
refactor.  It's just a debug convenience.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
John Spray
fc9d0198e4 tasks/cephfs: fix wait_until_true logging
The success log message was in the wrong
place (and unreachable)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-17 23:50:08 +00:00
David Zafman
21dde0f865 Merge pull request #1274 from ceph/wip-16064
Improve scrub analysis, list-inconsistent-obj output and osd-scrub-repair test
2016-11-17 13:49:39 -08:00
Yuri Weinstein
437f65719b Merge pull request #1260 from ceph/wip-17902-master
Added excluded packages "'libcephfs-devel','libcephfs-dev'"
2016-11-17 12:56:45 -08:00
Sage Weil
0eb2dd8931 Merge pull request #1227 from athanatos/wip-ec-overwrites
ec overwrites tests (and bonus fix to fast reads)
2016-11-17 12:56:13 -06:00
Kefu Chai
a9f4883fe3 Merge pull request #1271 from SUSE/wip_flake8_F401_time_imported_but_unused
tasks.rgw: 'time' imported but unused

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-17 18:49:15 +08:00
Owen Synge
ef1d2a6aab tasks.rgw: 'time' imported but unused
flake8 was failing.

Signed-off-by: Owen Synge <osynge@suse.com>
2016-11-17 11:37:59 +01:00
Yuri Weinstein
cae569ab48 Added excluded packadges "'libcephfs-devel','libcephfs-dev'"
Fixes http://tracker.ceph.com/issues/17902
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2016-11-17 00:29:43 +00:00
David Zafman
e000ab2f46 tasks/scrub_test.py: Make test deterministic by updating digests
ceph_test_rados: Get coverage of digest updates in deep-scrub/repair

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5fe8522df4 repair_test, scrub_test: Fix whitelists for scrub changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5ae0f5c75a scrub_test: Fix for list-inconsistent-obj output changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
Matt Benjamin
32bc189e60 Merge pull request #1269 from ceph/wip-rgw-sync-agent-retry
rgw: fix some races with radosgw and radosgw-agent startup

(verified by Orit)
2016-11-16 11:35:20 -05:00
Casey Bodley
3e68bfdbb2 rgw: remove unnecessary sleeps
remove the sleeps that were added to address radosgw startup races

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
5e6538e623 rgw: start_rgw() polls gateway until it accepts connections
resolves various races between radosgw startup and further operations -
both within the rgw task itself (such as the 'radosgw-admin realm pull'),
and in later tasks

Fixes: http://tracker.ceph.com/issues/17794
Fixes: http://tracker.ceph.com/issues/17872

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
69bbafa804 rgw: add retry/backoff to sync agent requests
resolves an issue where startup of the radosgw-agent races with the
requests we send to it to run sync. uses the requests package with
urllib3 to add retry with backoff to these requests

Fixes: http://tracker.ceph.com/issues/16129

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:33:18 -05:00
Samuel Just
44d4e7ead7 objectstore.yaml: raise fd limit
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
d897e02f47 fast.yaml: overrides not override
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
66836c957f thrash-erasure-code: disable ceph-objectstore-tool testing for now
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
fd39fa52ef rados,thrash-erasure-code: add overwrites workloads
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Sage Weil
ec33331596 Merge pull request #1263 from ceph/wip-cephfs-perm
rados/singleton-nomsgr/all/cache-fs-trunc: debug
2016-11-15 15:09:47 -06:00
Patrick Donnelly
a9b51c3e6d
cephfs: get new fsmap after marking clusters down
Credit to John Spray for identifying the problem/cause.

Fixes: http://tracker.ceph.com/issues/17894

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-15 14:42:08 -05:00