Commit Graph

1456 Commits

Author SHA1 Message Date
Mykola Golub
a20c62760b Merge pull request #14465 from dillaman/wip-librbd-devstack-tempest
qa/workunits: switch to OpenStack Ocata release for RBD testing

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-05-05 14:12:53 +03:00
Yuri Weinstein
1cce4c7f68 Merge pull request #14723 from neha-ojha/objclass-sdk
osd: objclass sdk

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-03 09:28:59 -07:00
Jason Dillaman
f6531fd077 qa/workunits/rbd: add additional OpenStack services
The Ocata release requires additional services to be running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-02 15:43:36 -04:00
Yuri Weinstein
3a6801751d Merge pull request #14858 from dmick/wip-config-dump
mon/ConfigKeyService: add 'config-key dump' to show keys and vals

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-02 08:25:16 -07:00
Jason Dillaman
736890fb30 qa/workunits: fix appdir setup issue in devstack
See https://bugs.launchpad.net/devstack/+bug/1667545

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-02 09:56:57 -04:00
Jason Dillaman
37d8a42510 qa/workunits: switch to OpenStack Ocata release for RBD testing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-05-02 09:55:38 -04:00
Mykola Golub
8c2631c6f7 Merge pull request #14846 from dillaman/wip-rbd-cli
qa/workunits/rbd: increased trash deferment period

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-30 09:59:52 +03:00
Dan Mick
557b2a7870 qa/workunits/mon/test_mon_config_key.py: add test for list and dump
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-04-28 11:45:40 -07:00
Neha Ojha
b7215b025a objclass-sdk: create SDK for Ceph object classes
Creates an installable version of "src/include/rados/objclass.h" that allows
object classes to be built outside of the Ceph tree. cls_sdk is an example
of such an object class.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2017-04-27 13:05:53 -07:00
Jason Dillaman
b51db2655b qa/workunits/rbd: increased trash deferment period
Teuthology would periodically fail due to a delay >10 seconds
between moving the item to the trash and checking its status.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-27 15:27:50 -04:00
Jason Dillaman
b67c5c7aa4 Merge pull request #14754 from trociny/wip-19128
rbd: import needs to sanity check auto-generated image name

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-27 14:40:51 -04:00
Ilya Dryomov
7c8a7f52da qa: krbd write-after-checksum tests
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-04-27 16:28:08 +02:00
Ilya Dryomov
9038074796 Merge pull request #14785 from idryomov/wip-krbd-exclusive-option
rbd: recognize exclusive option

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-26 16:25:31 +02:00
Ilya Dryomov
192f6ca079 qa/workunits/rbd: test exclusive map option
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-04-26 15:05:50 +02:00
Sage Weil
dffcfbfce1 Merge pull request #14713 from smithfarm/wip-19740
tests: set -x in suites/iozone.sh workunit

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-25 10:56:17 -05:00
Mykola Golub
40de8f1183 rbd: import needs to sanity check auto-generated image name
Fixes: http://tracker.ceph.com/issues/19128
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-24 20:29:36 +02:00
Nathan Cutler
25d468e3e7 tests: set -x in suites/iozone.sh workunit
Seems like this should be a "best practice."

Fixes: http://tracker.ceph.com/issues/19740
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-04-21 15:30:02 +02:00
Jason Dillaman
dee4f31cab Merge pull request #13978 from trociny/wip-18787
rbd-mirror A/A: proxy InstanceReplayer APIs via InstanceWatcher RPC

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-20 21:52:56 -04:00
Willem Jan Withagen
59238fb1db qa/workunits/ceph-helpers.sh: Improve test_mon_pg() by starting healthy
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-04-20 15:47:01 -07:00
Willem Jan Withagen
e07f9ccb13 qa/workunits/ceph-helpers.sh: introduce (and use) wait_for_health
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-20 15:39:34 -07:00
David Zafman
1810a17e23 mon: Fix incorrect health output and test code to match
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-20 15:39:34 -07:00
David Zafman
86fea9d539 /workunits/cephtool/test.sh: Improve testing of health-output.
Instead of 9ff401e65b1a66a320953aeef8ab65b6f1fb6f10 use regex to handle:
       HEALTH_ERR 2 pgs stuck unclean; Full ratio(s) out of order

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-20 15:39:33 -07:00
David Zafman
1474d0f233 test: Fix test_admin_heap_profiler() and enable it
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-20 15:39:33 -07:00
David Zafman
84f2182881 cephtool/test.sh: Get socket for whichever environment this test is running
Need sudo for qa suite runs

Fixes: http://tracker.ceph.com/issues/19698

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-20 15:39:09 -07:00
Mykola Golub
dda32847e8 qa/workunits/rbd: don't use deprecated syntax
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-20 14:29:14 +02:00
Josh Durgin
4a7c058183 qa: use 4k stripe_width again for test_rados_tool.sh
The stripe_unit change altered the default stripe_width to depend on k.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:44 -07:00
Josh Durgin
4315221179 osd,OSDMonitor: try to protect against ec overwrites with filestore
This isn't perfect, but it's better than nothing. Prevent enabling the
allow_ec_overwrites flag if any of a sample of pgs in the pool map to
osds using filestore. This mainly protects filestore-only clusters
from enabling it.

If a filestore osd is started later, warn in the cluster log when it
gets a pg with ec overwrites enabled.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
3ca750d41d test/osd/osd-scrub-repair.sh: add ec overwrites test cases
Move pool and profile creation into a single function, and
add a 'allow_overwrites' parameter for it so each ec test
can be paramterized by it.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
a219319137 qa/tasks/rados: test sparse reads with ec overwrites
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Josh Durgin
6fba80c1fa osd, OSDMonitor, qa: mark ec overwrites non-experimental
Keep the pool flag around so we can distinguish between a pool that
should maintain hashes for each chunk, and a missing one is a bug, vs
an overwrites pool where we rely on bluestore checksums for detecting
corruption.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-04-19 17:45:43 -07:00
Jason Dillaman
ca70fe440a Merge pull request #14631 from idryomov/wip-krbd-data-pool-fix
qa: krbd_data_pool.sh: account for rbd_info metadata object

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-19 07:30:27 -04:00
Ilya Dryomov
5b2d7f76bb qa: krbd_data_pool.sh: account for rbd_info metadata object
... added in commit a16beba784 ("librbd: image create validates that
pool supports overwrites").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-04-18 21:47:36 +02:00
Willem Jan Withagen
9ff401e65b /workunits/cephtool/test.sh: Be more liberal in testing health-output.
Sometimes I get output like:
   HEALTH_ERR 2 pgs stuck unclean; Full ratio(s) out of order

Which goes away over time. So it is a transit issue

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-04-18 13:43:54 +02:00
David Zafman
3becdd3138 test: Test health check output for full ratios
Test out of order ratios summary and details
Test various full osd conditions summary and details

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 13:02:57 -07:00
David Zafman
a5731076ad osd: Handle backfillfull_ratio just like nearfull and full
Add BACKFILLFULL as a local OSD cur_state
Notify monitor of this new fullness state

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
e927cd2cf2 test: Fix intended test flow and restore nearfull-ratio
This is inconsequential but seems to have always been wrong since original
commit 6cafb0e3e0

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
John Spray
0cb0c494d9 Merge pull request #13466 from jcsp/wip-cephfs-ecoverwrites
Add test for is_hacky_ecoverwrites in cephfs pool checks

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-15 19:44:00 +01:00
Kefu Chai
8442cbb521 Merge pull request #14468 from tchaikov/wip-show-me-fake-plugin
qa/workunits/ceph-helpers: display rejected string

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-04-13 22:24:03 +08:00
Mykola Golub
bf52a2a53b qa/workunits/rbd: diff.sh failed removing nonexistent file
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-04-12 16:22:43 +02:00
Mykola Golub
9a80faa546 Merge pull request #14460 from dillaman/wip-qa-rbd-cli
qa/workunits: corrected issues with RBD cli test

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-12 15:44:25 +03:00
Kefu Chai
6cb4503a40 qa/workunits/ceph-helpers: do not error out if is_clean
it would be a race otherwise, because we cannot be sure that the cluster
pgs are not all clean or not when run_osd() returns, but we can be sure
that they are expected to active+clean after a while. that's what
wait_for_clean() does.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-12 17:32:44 +08:00
Kefu Chai
0196e154ed qa/workunits/ceph-helpers: display rejected string
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-12 16:34:51 +08:00
Jason Dillaman
15e5b8e3dc qa/workunits: corrected issues with RBD cli test
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-11 11:18:29 -04:00
Ricardo Dias
b844f58481
qa/workunits/rbd: cli testing of rbd trash commands
Signed-off-by: Ricardo Dias <rdias@suse.com>
2017-04-11 12:09:41 +01:00
Sage Weil
7e547a10b1 Merge pull request #13073 from chardan/jfw-wip-15475-admin_heap_command
osd: add "heap *" admin command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-04-10 16:24:14 -05:00
Mykola Golub
712e7e9677 Merge pull request #14401 from dillaman/wip-rbd-import-fixes
rbd: correct issues with image importing

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-10 22:23:53 +03:00
Sage Weil
175e33bd5b Merge pull request #14130 from liewegas/wip-json-slash
common/escape: do not escape / in json

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Dan Mick <dmick@redhat.com>
2017-04-08 13:21:44 -05:00
Sage Weil
6db1193906 qa/workunits/cephtool/test.sh: handle non-escaped-/ json
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-08 14:19:00 -04:00
Jason Dillaman
a5d0d0ca08 qa/workunits: partial revert of commit 5b486d9
Testing for disk usage and diff extents for a sparsely written
imported RBD image cannot generically be handled across different
OSD object stores and RBD image features.

The only alternatives would include grepping the rbd CLI
debug log for specific invocations of aio_write or mocking
the rbd CLI for unit testing.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-07 21:06:37 -04:00
John Spray
f452256ff0 test: test cephfs pool ops with ec overwrites
Signed-off-by: John Spray <john.spray@redhat.com>
2017-04-04 11:32:53 +01:00