Commit Graph

5791 Commits

Author SHA1 Message Date
Patrick Donnelly
4260dd57e3
suites/fs: unify install/start task creation
Goal is to reduce arbitrary differences between fs suites.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:10 -05:00
Patrick Donnelly
bdd1b71e71
verify: remove old debugging addition
Added in 7ae1aefa to help resolve http://tracker.ceph.com/issues/1737.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:10 -05:00
Patrick Donnelly
6336f83d5f
suites/fs: add ceph-fuse disable override
Some tests require fuse mounts to not be unmounted. This avoids the need
to manually specify clients as unmounted.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-21 14:08:07 -05:00
John Spray
60d9a77aa0 Merge pull request #1262 from batrick/cephfs-delete-bugfix
cephfs: get new fsmap after marking clusters down

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-21 12:51:53 +00:00
David Zafman
21dde0f865 Merge pull request #1274 from ceph/wip-16064
Improve scrub analysis, list-inconsistent-obj output and osd-scrub-repair test
2016-11-17 13:49:39 -08:00
Yuri Weinstein
437f65719b Merge pull request #1260 from ceph/wip-17902-master
Added excluded packages "'libcephfs-devel','libcephfs-dev'"
2016-11-17 12:56:45 -08:00
Sage Weil
0eb2dd8931 Merge pull request #1227 from athanatos/wip-ec-overwrites
ec overwrites tests (and bonus fix to fast reads)
2016-11-17 12:56:13 -06:00
Kefu Chai
a9f4883fe3 Merge pull request #1271 from SUSE/wip_flake8_F401_time_imported_but_unused
tasks.rgw: 'time' imported but unused

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-11-17 18:49:15 +08:00
Owen Synge
ef1d2a6aab tasks.rgw: 'time' imported but unused
flake8 was failing.

Signed-off-by: Owen Synge <osynge@suse.com>
2016-11-17 11:37:59 +01:00
Yuri Weinstein
cae569ab48 Added excluded packadges "'libcephfs-devel','libcephfs-dev'"
Fixes http://tracker.ceph.com/issues/17902
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2016-11-17 00:29:43 +00:00
David Zafman
e000ab2f46 tasks/scrub_test.py: Make test deterministic by updating digests
ceph_test_rados: Get coverage of digest updates in deep-scrub/repair

Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5fe8522df4 repair_test, scrub_test: Fix whitelists for scrub changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
David Zafman
5ae0f5c75a scrub_test: Fix for list-inconsistent-obj output changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-11-16 12:32:10 -08:00
Matt Benjamin
32bc189e60 Merge pull request #1269 from ceph/wip-rgw-sync-agent-retry
rgw: fix some races with radosgw and radosgw-agent startup

(verified by Orit)
2016-11-16 11:35:20 -05:00
Casey Bodley
3e68bfdbb2 rgw: remove unnecessary sleeps
remove the sleeps that were added to address radosgw startup races

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
5e6538e623 rgw: start_rgw() polls gateway until it accepts connections
resolves various races between radosgw startup and further operations -
both within the rgw task itself (such as the 'radosgw-admin realm pull'),
and in later tasks

Fixes: http://tracker.ceph.com/issues/17794
Fixes: http://tracker.ceph.com/issues/17872

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:57:43 -05:00
Casey Bodley
69bbafa804 rgw: add retry/backoff to sync agent requests
resolves an issue where startup of the radosgw-agent races with the
requests we send to it to run sync. uses the requests package with
urllib3 to add retry with backoff to these requests

Fixes: http://tracker.ceph.com/issues/16129

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-11-16 09:33:18 -05:00
Samuel Just
44d4e7ead7 objectstore.yaml: raise fd limit
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
d897e02f47 fast.yaml: overrides not override
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
66836c957f thrash-erasure-code: disable ceph-objectstore-tool testing for now
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Samuel Just
fd39fa52ef rados,thrash-erasure-code: add overwrites workloads
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-11-15 16:00:21 -08:00
Sage Weil
ec33331596 Merge pull request #1263 from ceph/wip-cephfs-perm
rados/singleton-nomsgr/all/cache-fs-trunc: debug
2016-11-15 15:09:47 -06:00
Patrick Donnelly
a9b51c3e6d
cephfs: get new fsmap after marking clusters down
Credit to John Spray for identifying the problem/cause.

Fixes: http://tracker.ceph.com/issues/17894

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-15 14:42:08 -05:00
Sage Weil
fdb78d98de rados/singleton-nomsgr/all/cache-fs-trunc: debug
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-15 11:58:39 -05:00
Dan Mick
571a90f46e Merge pull request #1258 from ceph/jewel-x-fixes
rados/upgrade: skip libcephfs-devel install

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-11-14 19:40:34 -08:00
Sage Weil
cd43a3cead rados/upgrade: skip libcephfs-devel install
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-14 21:48:33 -05:00
Sage Weil
20a6081c65 Merge pull request #1253 from ceph/wip-vive-la-libcephfs-devel
packages: s/libcephfs2-devel/libcephfs-devel/
2016-11-14 08:31:02 -06:00
Kefu Chai
76c6f3085f packages: s/libcephfs2-devel/libcephfs-devel/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-11-13 12:50:15 +08:00
Sage Weil
39a7edb841 Merge pull request #1251 from ceph/distros
distros/supported: add xenial
2016-11-11 13:53:30 -06:00
Sage Weil
4156b3cc26 rados/singleton/all/mon-seesaw: give mons more time to stabilize
10s wasn't long enough for one run to get pgs created.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-11 14:05:52 -05:00
Sage Weil
1c05121017 distros/supported: add xenial
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-11 13:40:09 -05:00
Sage Weil
6e4ee890c1 Merge pull request #1249 from ceph/radostool-osds
rados/singleton: need 3 osds for radostool test
2016-11-11 09:55:54 -06:00
Sage Weil
d065a99dae rados/singleton: need 3 osds for radostool test
There's a k=2 m=1 ec pool in the test!

Fixes: http://tracker.ceph.com/issues/17775
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-11 10:55:11 -05:00
Sage Weil
7f13fe264f Merge pull request #1248 from ceph/scrub-vs-recovery
rados/thrash: test osd_scrub_during_recovery=false
2016-11-11 09:49:56 -06:00
Sage Weil
aa603b1bea rados/thrash: test osd_scrub_during_recovery = false
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-11 10:04:36 -05:00
Yuri Weinstein
28059dfccd Merge pull request #1246 from ceph/wip-powercycle
suites/powercycle: skip ext4; add bluestore
2016-11-10 14:46:45 -08:00
Sage Weil
a3a48c51bb suites/powercycle: test bluestore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-10 17:34:52 -05:00
Sage Weil
2a71071bc1 suites/powercycle: no ext4
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-10 17:34:19 -05:00
Gregory Farnum
d89e8abc02 Merge pull request #1224 from jcsp/wip-hadoop-on-ubuntu
suites/hadoop: run only on ubuntu
2016-11-08 14:51:00 -08:00
Zack Cerza
c3a201858d Merge pull request #1238 from ceph/rados-upgrades
rados/singleton-nomsgr: drop hammer, infernalis upgrades
2016-11-08 14:35:51 -07:00
Sage Weil
9b38a86cb1 upgrade/jewel-x: skip libcephfs2 install
None of these tests currently cover fs, so this is
sufficient... :/

Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-08 15:17:45 -05:00
Sage Weil
660a2edaa2 rados/singleton-nomsgr: drop hammer, infernalis upgrades
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-08 12:06:43 -05:00
John Spray
8372178605 Merge pull request #1175 from batrick/multimds-thrash
MDS thrasher for multimds

Reviewed-by: John Spray <john.spray@redhat.com>
2016-11-08 17:12:30 +01:00
Patrick Donnelly
69fe46c1bc
Merge remote-tracking branch 'origin/pull/1/head' into multimds-thrash
* origin/pull/1/head:
  tasks/vstart_runner: fix default run-all
  tasks/vstart_runner: update for Filesystem changes
2016-11-08 10:54:55 -05:00
Sage Weil
dad47ee5fe rados/upgrade: skip libcephfs2
Signed-off-by: Sage Weil <sage@redhat.com>
2016-11-08 10:47:04 -05:00
John Spray
530d03d3f8 tasks/vstart_runner: fix default run-all
This broke when path changed.  It's a bit
weird to run the cephfs tests by default
now that vstart_runner is not cephfs-specific,
but for the moment just restore the old
behaviour.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-08 12:15:19 +00:00
John Spray
f748226843 tasks/vstart_runner: update for Filesystem changes
Signed-off-by: John Spray <john.spray@redhat.com>
2016-11-08 12:15:19 +00:00
Patrick Donnelly
9832beac85
tasks/mds_thrash: support multimds
This commit amends the MDS thrasher task to also work on multimds
clusters. Main changes:

o New FSStatus class in tasks/cephfs/filesystem.py which gets a snapshot
  of the fsmap (`ceph fs dump`). This allows consecutive operations on
  the same fsmap without repeated fs dumps.

o Only one MDSThrasher is started for each file system.

o The MDSThrasher operates on ranks instead of names (and groups of
  standbys following the initial active).

o The MDSThrasher also will change the max_mds for the cluster to a new
  value [1, current) or (current, starting max_mds]. When reduced,
  randomly selected MDSs other than rank 0 will be deactivated to reach
  the new max_mds. The likelihood of changing max_mds in a given cycle of
  the MDSThrasher is set by the "thrash_max_mds" config.

o The MDSThrasher prints out stats on completion, e.g. number of
  mds deactivated or mds_max changed.

Pre-requisite for: http://tracker.ceph.com/issues/10792
Partially fixes: http://tracker.ceph.com/issues/15134

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2016-11-07 21:24:09 -05:00
Sage Weil
49ca81242d Merge pull request #1223 from ceph/wip-jlayton-libcephfs2
libcephfs1 -> libcephfs2 rename
2016-11-07 18:41:42 -06:00
Zack Cerza
f047522cf5 Merge pull request #1236 from ceph/wip-upgrade-mgr
rados/upgrade: skip ceph-mgr on jewel install
2016-11-07 10:30:19 -07:00