RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-04 02:02:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
73,016 Commits 212 Branches 394 Tags 1.6 GiB
02242ea48e
Commit Graph

2076 Commits

Author SHA1 Message Date
Sage Weil
d0a73ec955 Merge pull request #13610 from liewegas/wip-snapset 
osd: eliminate snapdir objects and move clone snaps vector into SnapSet

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-05-11 21:18:11 -05:00
Yan, Zheng
b67a599ebe Merge pull request #14598 from batrick/mds-balancer-pin 
mds: support export pinning on directories
 2017-05-11 11:56:34 +08:00
Yan, Zheng
bbb3369b50 qa/suites/fs: fix write size calculation in full tests 
'max_avail' has already taken full_ratio into account

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2017-05-11 11:18:22 +08:00
Patrick Donnelly
02c41f683d
qa: add health warning test for insufficient standbys 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-05-10 11:05:09 -04:00
Patrick Donnelly
a4cb10900d
qa: turn off spurious standby health warning 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-05-10 10:21:28 -04:00
Yan, Zheng
9778b81bb8 qa/suites/fs: reserve more space for mds in full tests 
Fixes: http://tracker.ceph.com/issues/19891
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2017-05-10 17:04:18 +08:00
Sage Weil
bfcd2fffe1 Merge pull request #14854 from ceph/wip-reduce-smoke 
qa/suites: Reduce fs combination tests for smoke, use bluestore

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-05-09 12:38:21 -05:00
Sage Weil
f08de01c58 mon/OSDMonitor: 'osd set-require-min-compat-client ...' 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-09 11:32:56 -05:00
Sage Weil
a17e320098 qa/releases/luminous: set require_min_compat_client after upgrade 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-09 11:32:56 -05:00
Sage Weil
1de9c90776 qa/suites: set initial require_min_compat_client 
For cases where we are selecting crush tunables beyond the default
min of hammer.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-09 11:32:56 -05:00
Sage Weil
39d5bdf0d0 Merge pull request #14962 from liewegas/wip-denc-dump 
include/denc: support ENCODE_DUMP

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-05-08 11:33:31 -05:00
Patrick Donnelly
9552efde4a
qa: improve time handling for test_exports test 
Also catches corner-case found by Zheng where an unjournaled directory will
cause export pinning to fail because it cannot be made a subtree until its
parent is stable.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-05-05 19:07:05 -04:00
Sage Weil
40fe1d181c qa/workunits/rgw/run-s3tests.sh: run s3-tests 
This works out of the box with a vstart environment and

 RGW=1 ../src/vstart.sh -n -l
 PATH=bin:$PATH ../qa/workunits/rgw/run-s3tests.sh

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 15:20:18 -04:00
Sage Weil
73f8fb9976 qa/suites/upgarde/jewel-x: add final scrub and legacy snapset check 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
8bd54abc74 qa/suites/rados: at end, scrub pgs, verify no legacy snapsets 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
5f5f370925 qa/suites/rados: switch require-luminous facet to use full_sequential_finally 
This lets us run multiple cleanup steps right before ceph
teardown.

Note that we drop the facet from multimon/ because it
doesn't factor out cluster creation before this step
properly.  That's fine because the require_luminous
cleanup shouldn't be related to the multimon tests.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
83dcc988db qa/suites/rados/verify: refactor thrash and cluster create 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
c9b93af06a qa/suites/rados/monthrash: simplify 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
6e20af4fd1 qa/suites/rados/thrash-erasure-code: factor out cluster create 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
112e232054 qa/suites/rados/basic: factor out cluster start 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
dc39cbab18 qa/suites/rados/thrash: extra cluster create 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-05-05 13:39:14 -04:00
Sage Weil
99928c9e0d Merge pull request #14931 from tchaikov/wip-19771 
qa/tasks/ceph_manager: always fix pgp_num when done with thrashosd task

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-05-05 08:53:38 -05:00
Mykola Golub
dff49227fa Merge pull request #14963 from dillaman/wip-19858 
rbd-mirror: failover and failback of unmodified image results in split-brain

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2017-05-05 15:27:07 +03:00
Mykola Golub
a20c62760b Merge pull request #14465 from dillaman/wip-librbd-devstack-tempest 
qa/workunits: switch to OpenStack Ocata release for RBD testing

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2017-05-05 14:12:53 +03:00
Jason Dillaman
4031555dda librbd: add no-op event when promoting an image 
The rbd-mirror process needs an event in the journal
to properly detect the transition between primary and
non-primary state between peers.

Fixes: http://tracker.ceph.com/issues/19858
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-05-04 20:26:03 -04:00
Tamilarasi Muthamizhan
a189b61095 Merge pull request #14400 from ceph/wip-cd-1node 
qa/tasks: few fixes to get ceph-deploy 1node to working state
 2017-05-04 10:42:50 -07:00
Vasu Kulkarni
df44582c91 default vpm is trusty and for master we need latest which is xenial 
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-05-03 17:47:37 -07:00
Vasu Kulkarni
e58dd3938a install mgr on the node 
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-05-03 16:47:14 -07:00
Yuri Weinstein
1cce4c7f68 Merge pull request #14723 from neha-ojha/objclass-sdk 
osd: objclass sdk

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-05-03 09:28:59 -07:00
Kefu Chai
da1161cbd8 qa/tasks/ceph_manager: always fix pgp_num when done with thrashosd task 
Fixes: http://tracker.ceph.com/issues/19771
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-05-03 18:28:27 +08:00
Yan, Zheng
d836fce730 qa: update log whitelists for kcephfs suite 
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2017-05-03 11:54:48 +08:00
Patrick Donnelly
63cbe330b7
qa: remove errant mount requirement 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-05-02 18:29:08 -04:00
Yuri Weinstein
9cb79d2fe3 qa/added overrides 
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2017-05-02 15:06:49 -07:00
Vasu Kulkarni
34ea04e00f Remove bluestore.yaml from top level folder which is redundant 
objectstore folder has the link.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-05-02 14:21:54 -07:00
Vasu Kulkarni
cdac849e31 Reduce fs combination tests for smoke, use bluestore 
for basic and filestore.xfs for 1node and sytemd

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-05-02 14:20:22 -07:00
Jason Dillaman
f6531fd077 qa/workunits/rbd: add additional OpenStack services 
The Ocata release requires additional services to be running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-05-02 15:43:36 -04:00
Yuri Weinstein
35171b97a3 Merge pull request #14687 from jcsp/wip-mgr-suite 
qa/suites: move mgr tests into rados suite

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-05-02 09:06:51 -07:00
Sage Weil
fcd64d75ab Merge pull request #14444 from liewegas/wip-past-intervals 
osd: simplify past_intervals representation

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-05-02 10:51:37 -05:00
Yuri Weinstein
3a6801751d Merge pull request #14858 from dmick/wip-config-dump 
mon/ConfigKeyService: add 'config-key dump' to show keys and vals

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-05-02 08:25:16 -07:00
Jason Dillaman
736890fb30 qa/workunits: fix appdir setup issue in devstack 
See https://bugs.launchpad.net/devstack/+bug/1667545

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-05-02 09:56:57 -04:00
Jason Dillaman
37d8a42510 qa/workunits: switch to OpenStack Ocata release for RBD testing 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-05-02 09:55:38 -04:00
Patrick Donnelly
6bd58fefb7
mds: use aux subtrees for export pinned inodes 
Idea here is that a pinned inode should not be exported when its parent is.
Setting the pinned inode's dirfrags to aux subtrees prevents them from being
merged with a parent subtree.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-05-02 00:30:35 -04:00
Neha Ojha
522bd84dc0 objclass-sdk: add override to whitelist the sdk class 
Signed-off-by: Neha Ojha <nojha@redhat.com>
 2017-05-01 16:28:54 -07:00
Sage Weil
e4874b4091 Merge pull request #14788 from liewegas/wip-jewel-x-rgw 
qa/suites/jewel-x/point-to-point: don't scane for keys on second s3tests either

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-05-01 17:12:39 -05:00
Casey Bodley
0e30e3ef01 Merge pull request #14845 from cbodley/wip-rgw-qa-s3tests 
qa/rgw: add cluster name to path when s3tests scans rgw log

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
 2017-05-01 10:49:12 -04:00
Sage Weil
1e0162fecc Merge pull request #14887 from liewegas/wip-kraken-x 
qa/suites/upgrade/kraken-x: misc fixes
 2017-05-01 06:55:30 -05:00
Kefu Chai
f0aab98567 Merge pull request #14884 from tchaikov/wip-singleton-bluestore-tests 
qa/suites/rados/singleton-bluestore: concat settings

Reviewed-by: Nathan Cutler <ncutler@suse.com>
 2017-05-01 00:13:38 +08:00
Kefu Chai
86c9137fa0 qa/suites/rados/singleton-bluestore: concat settings 
otherwise the bluestore tests will fail with failures like

qa/workunits/cephtool/test.sh:1343: test_mon_osd_pool:  ceph osd pool set ec_test allow_ec_overwrites true
Error EINVAL: pool must only be stored on bluestore for scrubbing to work: osd.1 uses filestore
qa/workunits/cephtool/test.sh:1343: test_mon_osd_pool:  return 1

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-30 23:19:07 +08:00
Mykola Golub
8c2631c6f7 Merge pull request #14846 from dillaman/wip-rbd-cli 
qa/workunits/rbd: increased trash deferment period

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-30 09:59:52 +03:00
Kefu Chai
7424345c77 qa/erasure-code: override min_size to 2 
so isa(k=2,m=1) can survive with 1 down OSD.

Fixes: http://tracker.ceph.com/issues/19770
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-29 10:43:17 +08:00
Kefu Chai
5f50298025 qa/tasks/rados: add optional setting of "min_size" 
this setting only affects the newly created pool

Fixes: http://tracker.ceph.com/issues/19770
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-29 10:39:02 +08:00
Sage Weil
4c41537556 Merge pull request #14847 from smithfarm/wip-19797 
tests: rados: move cephtool.yaml to new singleton/bluestore subsuite

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-28 19:39:12 -05:00
Sage Weil
1868c56f54 qa/suites/upgrade/kraken-x: limit fs matrix 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-28 17:51:33 -04:00
Dan Mick
557b2a7870 qa/workunits/mon/test_mon_config_key.py: add test for list and dump 
Signed-off-by: Dan Mick <dan.mick@redhat.com>
 2017-04-28 11:45:40 -07:00
Yehuda Sadeh
a5afab1086 Merge pull request #14842 from cbodley/wip-rgw-admin-suite 
qa/rgw: fix assertions in radosgw_admin task

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-04-28 09:39:59 -07:00
Sage Weil
3ab8dff07f qa/suites/upgrade/jewel-x: add cache tiering + snaps workload 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-28 11:30:38 -04:00
Sage Weil
d063c3dc73 qa/suites/upgrade/kraken-x/stress-split-erasure-code: fix 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-28 11:14:45 -04:00
Sage Weil
79f95bc65f qa/suites/upgrade/kraken-x/parallel: fix 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-28 11:13:50 -04:00
Sage Weil
8dfc148652 qa/suites/upgrade/jewel-x/parallel: remove stray kraken.yaml 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-28 11:13:22 -04:00
Nathan Cutler
e69a9763a0 tests: rados: move cephtool.yaml to new singleton/bluestore subsuite 
cephtool.yaml is bluestore-only, yet it was in singleton/ which runs against a
generalized objectstore matrix.

Fixes: http://tracker.ceph.com/issues/19797
Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2017-04-28 15:36:50 +02:00
Casey Bodley
88b6a142bc qa/rgw: fix assertions in radosgw_admin task 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-27 19:38:10 -04:00
Neha Ojha
b7215b025a objclass-sdk: create SDK for Ceph object classes 
Creates an installable version of "src/include/rados/objclass.h" that allows
object classes to be built outside of the Ceph tree. cls_sdk is an example
of such an object class.

Signed-off-by: Neha Ojha <nojha@redhat.com>
 2017-04-27 13:05:53 -07:00
Jason Dillaman
b51db2655b qa/workunits/rbd: increased trash deferment period 
Teuthology would periodically fail due to a delay >10 seconds
between moving the item to the trash and checking its status.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-27 15:27:50 -04:00
Casey Bodley
a31aa6f65c qa/rgw: add cluster name to path when s3tests scans rgw log 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-27 14:48:40 -04:00
Jason Dillaman
b67c5c7aa4 Merge pull request #14754 from trociny/wip-19128 
rbd: import needs to sanity check auto-generated image name

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-27 14:40:51 -04:00
Jason Dillaman
46119d15b3 Merge pull request #14836 from idryomov/wip-krbd-wac-tests 
qa: krbd write-after-checksum tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-27 11:42:55 -04:00
Ilya Dryomov
7c8a7f52da qa: krbd write-after-checksum tests 
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2017-04-27 16:28:08 +02:00
Sage Weil
dd174148ef qa/suites/upgrade/kraken-x/stress-split: updates 
Bring this in line with jewel-x (which now passes).

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-27 10:07:44 -04:00
Sage Weil
92d8e19660 Merge pull request #14831 from smithfarm/wip-stress-split 
tests: fix broken links in upgrade/hammer-jewel-x/stress-split
 2017-04-27 08:43:30 -05:00
Nathan Cutler
7c973b0968 tests: fix broken links in upgrade/hammer-jewel-x/stress-split 
Fixes: http://tracker.ceph.com/issues/19793
Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2017-04-27 14:03:04 +02:00
Ilya Dryomov
9038074796 Merge pull request #14785 from idryomov/wip-krbd-exclusive-option 
rbd: recognize exclusive option

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-26 16:25:31 +02:00
Ilya Dryomov
192f6ca079 qa/workunits/rbd: test exclusive map option 
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2017-04-26 15:05:50 +02:00
Sage Weil
dd34df8f42 qa/suites/upgrade/jewel-x: fix indentation 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-25 15:23:01 -04:00
Sage Weil
d02fa40963 qa/suites/jewel-x/point-to-point: don't scane for keys on second s3tests either 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-25 15:13:11 -04:00
Sage Weil
dffcfbfce1 Merge pull request #14713 from smithfarm/wip-19740 
tests: set -x in suites/iozone.sh workunit

Reviewed-by: Loic Dachary <ldachary@redhat.com>
 2017-04-25 10:56:17 -05:00
Sage Weil
a2f8e50c0f Merge pull request #14756 from yehudasa/wip-rgw-suite-fix 
qa/suite: replace reference to fs/xfs.yaml
 2017-04-25 10:44:41 -05:00
Yehuda Sadeh
180e276dd1 qa/suite: replace reference to fs/xfs.yaml 
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-04-24 15:40:12 -07:00
John Spray
d0d3a4a02e Merge pull request #12935 from stiopaa1/17855_evictClient 
mds/Server.cc: Don't evict a slow client if...

Reviewed-by: John Spray <john.spray@redhat.com>
 2017-04-24 22:10:01 +01:00
Mykola Golub
40de8f1183 rbd: import needs to sanity check auto-generated image name 
Fixes: http://tracker.ceph.com/issues/19128
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-24 20:29:36 +02:00
John Spray
53477e4b05 qa: switch off btrfs for multimds and kcephfs 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:56 +01:00
John Spray
e8f8b4c83e qa: update links for modified fs subsuite names 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:56 +01:00
John Spray
837a71c0af qa/tasks/cephfs: clean up mount point setup 
Previously were sometimes trying to maintain a mounted
client across a filesystem destroy/create.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:55 +01:00
John Spray
6369120d63 qa/suites: don't use btrfs for cephfs testing 
This change happened a while back, but it got rolled back
when the generic objectstore/ dir had its filestore
entry split out into xfs and btrfs in 208675af.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:55 +01:00
John Spray
b56fb50ef2 qa: remove unused fs/ dir 
The objectstore/ dir is now selecting the backing fs.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:55 +01:00
John Spray
ea688a6d46 qa/suites/fs: more meaningful names for sub suites 
The "recovery" sub suite was originally tests for
client/mds recovery in certain failure cases, it has
since grown to include lots of unit testing of
various features using CephFSTestCase.

The "basic" suite is now specifically just running workloads
now that I've moved out the smaller functional tests.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:55 +01:00
John Spray
0362d08121 qa/suites/fs: put simple functional tests together 
Most of what's in basic/ is "workload" type testing
(i.e. a simple cluster cluster configuration and then
running a script inside the client), which gets
permuted in various ways.  Move the simpler
functional tests out with the others like themselves.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:54 +01:00
John Spray
3e3b94783c qa: don't permute object store for functional tests 
These are unit tests for specific CephFS functionality,
it is gratuitous to repeat them with different underlying
RADOS object stores.

We retain coverage of XFS vs. bluestore in the workload tests.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-24 11:19:54 +01:00
John Spray
16702ff13d Merge pull request #14018 from jcsp/wip-17939 
client: getattr before returning quota/layout xattrs

Reviewed-by: Yan, Zheng <zyan@redhat.com>
 2017-04-24 11:12:26 +01:00
Michal Jarzabek
1a5cb534d9 mds/Server.cc: Don't evict a slow client if... 
... it's the only client

Fixes: http://tracker.ceph.com/issues/17855
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
 2017-04-23 13:31:47 +01:00
Sage Weil
27dd6530a2 Merge pull request #14559 from liewegas/wip-pg-map 
mon: move 'pg map' to OSDMonitor

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-21 18:53:17 -05:00
Kefu Chai
c237e7ed29 Merge pull request #14232 from jcsp/wip-19412 
mgr: fix python module teardown & add tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-21 22:57:44 +08:00
Sage Weil
069182f91f qa/tasks/ceph_manager: use 'pg map' for get_pg_{primary,replica} 
Pulling this out of the 'pg dump' heap is inefficient.
Also, pg dump data comes from the mgr and may be stale.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-21 10:56:28 -04:00
Kefu Chai
6fa16c4477 Merge pull request #14584 from tchaikov/wip-19631 
qa/suites: Revert "qa/suites: add mon-reweight-min-pgs-per-osd = 4"

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-21 22:56:21 +08:00
Sage Weil
4aa9bfa716 Merge pull request #14697 from ceph/wip-rgw-upgrade-s3tests-encryption 
qa/rgw: don't scan radosgw logs for encryption keys on jewel upgrade test

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-21 09:06:39 -05:00
Nathan Cutler
25d468e3e7 tests: set -x in suites/iozone.sh workunit 
Seems like this should be a "best practice."

Fixes: http://tracker.ceph.com/issues/19740
Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2017-04-21 15:30:02 +02:00
John Spray
01c2016aca qa/suites: add third mon to mgr test 
There were always meant to be three, having two
was a typo.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-21 11:27:50 +01:00
Jason Dillaman
dee4f31cab Merge pull request #13978 from trociny/wip-18787 
rbd-mirror A/A: proxy InstanceReplayer APIs via InstanceWatcher RPC

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-20 21:52:56 -04:00
David Zafman
daeb4d072c Merge pull request #14647 from dzafman/wip-19698 
Fix full testing in cephtool/test.sh when used by rados suite
Replace using sleep with new wait_for_health() bash function

Reviewed-by: Loic Dachary <ldachary@redhat.com>
 2017-04-20 18:18:16 -07:00
David Zafman
7d579ff12b cephtool.yaml: Add "failsafe" osd error messages to whitelist 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:47:12 -07:00
Willem Jan Withagen
59238fb1db qa/workunits/ceph-helpers.sh: Improve test_mon_pg() by starting healthy 
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2017-04-20 15:47:01 -07:00
Willem Jan Withagen
e07f9ccb13 qa/workunits/ceph-helpers.sh: introduce (and use) wait_for_health 
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:34 -07:00
David Zafman
1810a17e23 mon: Fix incorrect health output and test code to match 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:34 -07:00
David Zafman
86fea9d539 /workunits/cephtool/test.sh: Improve testing of health-output. 
Instead of 9ff401e65b use regex to handle:
       HEALTH_ERR 2 pgs stuck unclean; Full ratio(s) out of order

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:33 -07:00
David Zafman
1474d0f233 test: Fix test_admin_heap_profiler() and enable it 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:33 -07:00
David Zafman
84f2182881 cephtool/test.sh: Get socket for whichever environment this test is running 
Need sudo for qa suite runs

Fixes: http://tracker.ceph.com/issues/19698

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-20 15:39:09 -07:00
John Spray
017f260c9b qa/suites: disable scrub on shutdown in mgr test 
The tests that exercise mgr failover do not necessarily
leave a happy working mgr daemon in place, and since
pg dump moved into the mgr, that means they should
not try and call "pg dump" to validate PG state on shutdown.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-20 22:34:42 +01:00
John Spray
0829093383 qa/suites: move mgr tests into rados suite 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-20 22:34:42 +01:00
Casey Bodley
a4fc5c38e5 qa/rgw: don't scan radosgw logs for encryption keys on jewel upgrade test 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-20 14:49:04 -04:00
Sage Weil
b9dfb3caac qa/suites/upgrade/jewel-x/point-to-point: no xenial 
Avoid conflict with upstream repo having a newer version
than what we're installing.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-20 14:18:59 -04:00
Sage Weil
0ff16f3c57 upgrade/jewel-x/stress-split: not pg import/export tests during upgrade 
These aren't meant to be run on a mixed-version cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-20 14:17:19 -04:00
Sage Weil
1207f8945d qa/suites/upgrade/jewel-x: add mgr.x role 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-20 12:32:59 -04:00
John Spray
f695a0e30f qa: s/REQUIRE_MGRS/MGRS_REQUIRED/ for consistency 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-20 15:00:31 +01:00
John Spray
636fc40d90 qa: additions to mgr.test_failover 
Reproducers for recent fixes:
http://tracker.ceph.com/issues/19407
http://tracker.ceph.com/issues/19258

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-20 15:00:31 +01:00
John Spray
8ea98b4cbf qa: fix vstart_runner --create for mgr tests 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-20 15:00:31 +01:00
Mykola Golub
dda32847e8 qa/workunits/rbd: don't use deprecated syntax 
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Nathan Cutler
210249a8d7 Merge pull request #14638 from dillaman/wip-19692 
test: rbd master/slave notify test should test active features

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
 2017-04-20 14:12:24 +02:00
Kefu Chai
b3075c485c qa/suites: Revert "qa/suites: add mon-reweight-min-pgs-per-osd = 4" 
This reverts commit ef7583d717.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 14:18:21 +08:00
Kefu Chai
e6a436bb27 qa/tasks/ceph_manager: be able to store options with service type 
so we are able to change options for services other than mon while
thrashing.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 14:18:21 +08:00
Kefu Chai
ee653ba87c Merge pull request #14608 from tchaikov/wip-19594 
qa/tasks: assert on pg status with a timeout

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-20 10:49:12 +08:00
Kefu Chai
960032e513 qa/tasks: update tests with helper to wait for pg-stats 
and remove unused helpers

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:05 +08:00
Kefu Chai
1207caf3a2 qa/tasks/ceph_manager: add a "wait_for_pg_stats()" decorator 
and accompany it with two helpers to access the pg stats in a more
natural way

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:04 +08:00
Josh Durgin
cab2968e8f qa: use bluestore for (k)rbd ec overwrites tests 
Only bluestore supports ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:49:11 -07:00
Josh Durgin
4a7c058183 qa: use 4k stripe_width again for test_rados_tool.sh 
The stripe_unit change altered the default stripe_width to depend on k.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:44 -07:00
Josh Durgin
a3e5cba3f1 qa: move ec overwrites tests to a bluestore-only subsuite 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
4315221179 osd,OSDMonitor: try to protect against ec overwrites with filestore 
This isn't perfect, but it's better than nothing. Prevent enabling the
allow_ec_overwrites flag if any of a sample of pgs in the pool map to
osds using filestore. This mainly protects filestore-only clusters
from enabling it.

If a filestore osd is started later, warn in the cluster log when it
gets a pg with ec overwrites enabled.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
3ca750d41d test/osd/osd-scrub-repair.sh: add ec overwrites test cases 
Move pool and profile creation into a single function, and
add a 'allow_overwrites' parameter for it so each ec test
can be paramterized by it.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
a219319137 qa/tasks/rados: test sparse reads with ec overwrites 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
6fba80c1fa osd, OSDMonitor, qa: mark ec overwrites non-experimental 
Keep the pool flag around so we can distinguish between a pool that
should maintain hashes for each chunk, and a missing one is a bug, vs
an overwrites pool where we rely on bluestore checksums for detecting
corruption.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Patrick Donnelly
0b420be7e9
mds: add export_pin feature 
This allows the client/admin to pin a directory tree to a particular rank,
preventing its export by the dynamic balancer.

Fixes: http://tracker.ceph.com/issues/17834

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-04-19 18:21:19 -04:00
Sage Weil
ee1bb01a54 Merge pull request #14556 from liewegas/wip-pgupmap 
osd: pg-remap -> pg-upmap

Reviewed-by: David Zafman <dzafman@redhat.com>
 2017-04-19 17:07:01 -05:00
Sage Weil
9d463ed9d7 Merge pull request #14623 from liewegas/wip-bluestore-compression 
qa/objectstore: test bluestore with aggressive compression
 2017-04-19 12:01:00 -05:00
Jason Dillaman
7ab93b7779 qa/suites: client-upgrade/jewel-client-x should test multiple features 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-19 09:12:04 -04:00
Jason Dillaman
ca70fe440a Merge pull request #14631 from idryomov/wip-krbd-data-pool-fix 
qa: krbd_data_pool.sh: account for rbd_info metadata object

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-19 07:30:27 -04:00
Sage Weil
1e6531e28a Merge pull request #14614 from wjwithagen/wip-wjw-cephtool-test-mon.sh 
qa/workunits/cephtool/test.sh: Be more liberal in testing health-output.

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:56:37 -05:00
Sage Weil
bac484f225 qa/objecstore/bluestore-comp: test bluestore with compression on 
Enable aggressive compression.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:53:58 -04:00
Sage Weil
fb6cc95ad9 qa/objectstore/bluestore: drop old option 
This test code has been removed.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:53:41 -04:00
Ilya Dryomov
5b2d7f76bb qa: krbd_data_pool.sh: account for rbd_info metadata object 
... added in commit a16beba784 ("librbd: image create validates that
pool supports overwrites").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2017-04-18 21:47:36 +02:00
Zack Cerza
28d746bff3 Merge pull request #14464 from ceph/wip-systemd 
qa/tasks: use sudo to check ceph health for systemd test
 2017-04-18 11:34:27 -06:00
Sage Weil
ce188e8fdf osd: pg-remap -> pg-upmap 
'remap' is to non-specific a name.  In particular, it
sounds like it is related to the 'remapped' PG state
but in reality it is not related.

'upmap' or 'pg-upmap' is more specific: it maps a pgid
to the 'up' set value (or item)

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 12:59:40 -04:00
Casey Bodley
da7acc4211 Merge pull request #13597 from cbodley/wip-s3tests-crypto 
qa/rgw: add configuration for server-side encryption tests

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
 2017-04-18 12:28:37 -04:00
Kefu Chai
1b54b5f3f1 Merge pull request #14415 from smithfarm/wip-19556 
tests: Thrasher: handle "OSD has the store locked" gracefully

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-18 23:18:35 +08:00
John Spray
033ee6bd1f Merge pull request #14396 from jcsp/wip-19550 
qa: re-enable ENOSPC tests for kclient
 2017-04-18 12:59:14 +01:00
John Spray
d98e19fdbd Merge pull request #14589 from jcsp/wip-19640 
client: refine fsync/close writeback error handling

Reviewed-by: Jeff Layton <jlayton@redhat.com>
 2017-04-18 12:58:37 +01:00
John Spray
a2a100dc13 Merge pull request #14272 from jcsp/wip-vstart-fixup 
qa: fix test_standby_for_invalid_fscid with vstart_runner

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-04-18 12:50:20 +01:00
John Spray
1a69bec52f client: refine fsync/close writeback error handling 
Previously, errors stuck indelibly to the inode, which
meant that a close call would see an error even if the
user already dutifully fsync()'d and handled it.

We should emit each error only once per file handle.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-18 07:47:10 -04:00
Willem Jan Withagen
9ff401e65b /workunits/cephtool/test.sh: Be more liberal in testing health-output. 
Sometimes I get output like:
   HEALTH_ERR 2 pgs stuck unclean; Full ratio(s) out of order

Which goes away over time. So it is a transit issue

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2017-04-18 13:43:54 +02:00
Orit Wasserman
cb94e5ad3f Merge pull request #12535 from ceph/wip-rgw-multisite-teuthology 
rgw: multisite enabled over multiple clusters
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 11:47:48 +03:00
David Zafman
3becdd3138 test: Test health check output for full ratios 
Test out of order ratios summary and details
Test various full osd conditions summary and details

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-17 13:02:57 -07:00
David Zafman
a5731076ad osd: Handle backfillfull_ratio just like nearfull and full 
Add BACKFILLFULL as a local OSD cur_state
Notify monitor of this new fullness state

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-17 08:00:24 -07:00
David Zafman
e927cd2cf2 test: Fix intended test flow and restore nearfull-ratio 
This is inconsequential but seems to have always been wrong since original
commit 6cafb0e3e0

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-17 07:58:30 -07:00