Commit Graph

1053 Commits

Author SHA1 Message Date
Mykola Golub
595c1e5650 tests: rbd/admin_socket: use xmlstarlet when parsing perf dump
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-11-11 09:19:47 +02:00
Josh Durgin
d46d4a98b6 Merge pull request #5987 from dillaman/wip-rbd-refactor
rbd: refactor cli command handling

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-11-10 21:18:04 -08:00
Mykola Golub
d33842d237 tests: librbd: admin socket commands to flush and invalidate cache
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-11-09 16:14:11 +02:00
Loic Dachary
402d181ede tests: fix test_rados_tools.sh rados lookup
http://tracker.ceph.com/issues/13691 Fixes: #13691

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-11-09 12:57:11 +01:00
Jason Dillaman
b838ed11bb qa/workunits/rbd: fixed incorrect stripe settings
The rbd merge-diff tool does not support fancy striped
image exports.  Corrected the test to reflect this fact.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-11-05 16:12:42 -05:00
Loic Dachary
e8fe4bc59c tests: concatenate test_rados_test_tool from src and qa
It is good for src/test/test_rados_tool.sh to be run by
rados/singleton/all/radostool.yaml because it contains a lot more tests
than qa/workunits/rados/test_rados_tool.sh

http://tracker.ceph.com/issues/13691 Fixes: #13691

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-11-04 18:28:45 +01:00
Loic Dachary
f14144441b tests: port uniqueness reminder
When copy/pasting a tests, it is easy to forget (or not know) that the
port used must be unique to allow for multiple tests to run in
parallel (make -j8). Add a reminder next to each port.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-10-27 17:38:17 +09:00
Loic Dachary
f4906a124c tests: ceph-disk workunit uses configobj
Instead of using augtool to modify the configuration file, use
configobj. It is also used by the install teuthology task. The .ini
lens (puppet lens really) is unable to read ini files created by
configobj.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-10-23 00:44:23 +02:00
Loic Dachary
163de5b0f8 tests: ceph-disk workunit uses the ceph task
The ceph-disk workunit deploy keys that are not deployed by default by
the ceph teuthology task.

The OSD created by the ceph task are removed from the default
bucket (via osd rm) so they do not interfere with the tests.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-10-23 00:43:30 +02:00
Jason Dillaman
661e2a0ef7 qa: remove legacy OS support from rbd/qemu-iotests
RHEL7 derivatives were failing test 002 since they were using
legacy test cases for now unsupported OSes.

Fixes: #13483
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-10-15 12:44:06 -04:00
John Spray
858059ed01 qa: avoid using sudo in fsstress
This test required root in order to copy its built
binary into /usr (presumably to avoid rebuilding it).

That's not really a good thing anyway because there's
no guarantee that a binary in that path is the binary
we wanted, so just run the thing straight out of /tmp.  The
build is really quick anyway.

Signed-off-by: John Spray <john.spray@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-10-07 10:44:43 -07:00
Sage Weil
8d97771c3c Merge pull request #6084 from liewegas/wip-revert-scrub
Revert "osd: new pool settings: scrub intervals"

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2015-09-28 16:40:31 -04:00
Sage Weil
80b7237e5e qa/workunits/cephtool/test.sh: don't assume crash_replay_interval=45
e.g., it's 5 in teuthology's ceph.conf.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-28 13:13:40 -04:00
Sage Weil
216eef53e9 Revert "osd: new pool settings: scrub intervals"
This reverts commit 30810da4b5.

After some discussion we have decided it is better to build a generic
dictionary in pg_pool_t to store infrequently used per-pool properties.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-25 14:01:19 -04:00
Sage Weil
7757342ffc qa: https://ceph.com/git -> https://git.ceph.com
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 18:36:57 -04:00
Sage Weil
d4d65fbd6a qa: http://ceph.com/qa -> http://download.ceph.com/qa
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 18:10:46 -04:00
Sage Weil
fb5f058a92 Merge remote-tracking branch 'gh/infernalis' 2015-09-22 14:04:44 -04:00
Loic Dachary
182676d6bf tests: ceph-disk: workunit must fail when test fail
Signed-off-by: Joe Julian <me@joejulian.name>
2015-09-22 08:46:57 +02:00
Loic Dachary
0cf0e88e29 tests: ceph-disk: only install multipath on CentOS
If installed on Ubuntu where multipath does not activate properly, it
interferes with the other tests.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-22 08:46:57 +02:00
Loic Dachary
fb4dd7d4f2 tests: ceph-disk: inline run_osd
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-22 08:46:57 +02:00
Loic Dachary
24b3a800e6 tests: ceph-disk: wait for the OSD to be up
After preparing an OSD, wait for the corresponding OSD to be up
according to ceph osd dump before asserting the devices are in the
expected state. Otherwise the test races with ceph-disk activate which
is run asynchronously via udev / upstart / system.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-22 08:46:57 +02:00
Loic Dachary
46a3c93ab3 tests: ceph-disk: race condition is fixed
It turns out it was not CentOS 7 specific. There is no excuse to skip
the tests anymore.

http://tracker.ceph.com/issues/12787 Refs: #12787

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-22 08:46:57 +02:00
Loic Dachary
d24f1f10aa tests: ceph-disk: multipath now auto activates
http://tracker.ceph.com/issues/12786 Refs: #12786

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-22 08:46:57 +02:00
Loic Dachary
d4d5153cd4 tests: ceph-disk: use sh() instead of helper() when possible
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-22 08:46:57 +02:00
Loic Dachary
b6470382f8 tests: doc: ceph-disk workunit reminders
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-22 08:46:57 +02:00
Mykola Golub
30810da4b5 osd: new pool settings: scrub intervals
ceph osd pool set $POOL scrub_min_interval N
 ceph osd pool set $POOL scrub_max_interval N
 ceph osd pool set $POOL deep_scrub_interval N

If N > 0, this value is used for the pool instead of
the corresponding global parameter from the config
(osd_scrub_min_interval, osd_scrub_max_interval or
osd_deep_scrub_interval).

Fixes: #13077
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-09-21 09:08:16 +03:00
Mykola Golub
48db7b16d4 osd: new pool flags: noscrub, nodeep-scrub
This allows to disable periodic scrub on per pool basis.

Fixes: #13076
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-09-21 09:08:16 +03:00
Mykola Golub
b97ae7660e osd: make 'ceph osd pool get' work for all settable pool flags
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-09-21 09:08:16 +03:00
Mykola Golub
10235e3ff3 osd: refactor setting write_fadvise_dontneed pool flag
Handle together with other flags.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-09-21 09:08:16 +03:00
Loic Dachary
21a1e75d8a tests: update to match crushmap validation message
http://tracker.ceph.com/issues/13182 Fixes: #13182

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-21 00:13:08 +02:00
Sage Weil
c625671c58 Merge pull request #5840 from liewegas/wip-12991
qa/workunits/cephtool/test.sh: make mds epoch check more tolerant

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-09-13 09:08:57 -04:00
Sage Weil
4a5a5b3705 qa/workunits/cephtool/test.sh: make mds epoch check more tolerant
This can race with an actual mdsmap epoch update for some other
reason.  We just need to make sure the epoch *increased*, not that
it is exactly old + 1.

Fixes: #12991
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-12 13:51:13 -04:00
Kefu Chai
d32a3be1a6 qa/workunits/rados/test_alloc_hint.sh: sudo to ls files
The osd data dir is owned by ceph and not readable by other
non-root users.

Fixes: #12861
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-09-08 20:50:36 +08:00
Sage Weil
0200403bec Merge pull request #5785 from liewegas/wip-12861
qa/workunits/rados/test_alloc_hint.sh: sudo to list files
2015-09-07 10:40:37 -04:00
Sage Weil
82b0243ec3 qa/workunits/post-file.sh: sudo
Only root can read the key in /usr/share/...

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-06 14:19:24 -04:00
Sage Weil
64962aafed qa/workunits/rados/test_alloc_hint.sh: sudo to list files
The osd data dir is owned by ceph and not readable by other
non-root users.

Fixes: #12861
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-02 21:58:37 -04:00
Loic Dachary
32446ffb00 tests: ceph-disk: dmcrypt simplification
* Get rid of the cryptsetup calls that are redundant with what ceph
  prepare already does
* Do not use the --dmcrypt-key-dir option. This is less coverage but it
  interferes with the udev logic and is expected to be refactored soon.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-01 19:04:19 +02:00
Sage Weil
ad3f16912b Merge remote-tracking branch 'gh/infernalis' 2015-08-31 11:29:14 -04:00
Sage Weil
f030af3cd3 Merge pull request #4869 from joaquimrocha/cls_numops
CLS numops

Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2015-08-31 10:16:10 -04:00
Kefu Chai
f8f33bcaa6 Merge pull request #5024 from xinxinsh/wip-12018
make rbd and pool quota work

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-08-31 12:11:09 +08:00
Kefu Chai
09464ec6b7 Merge pull request #5570 from dachary/wip-12673-proxy-read
osd: trigger the cache agent after a promotion

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-08-31 12:04:59 +08:00
Loic Dachary
5ce7ed1bdd ceph-disk: integration tests for multipath
Add integration tests for multipath to the ceph-disk workunit, with the
following caveats:

A workaround is added (explicit call to ceph-disk activate) until the
CentOS activation bug http://tracker.ceph.com/issues/12786 is fixed.

The tests do not run on Ubuntu because of the multipath / device mapper
bug
https://bugs.launchpad.net/ubuntu/+source/multipath-tools/+bug/1488688
and it has not been tested on Debian.

http://tracker.ceph.com/issues/11881 Refs: #11881

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-08-29 02:37:52 +02:00
Loic Dachary
d447098cfc ceph-disk: implement workunit
This new ceph-disk workunit re-implements the tests that previously were
in the src/test/ceph-disk.sh src/test/ceph-disk-root.sh scripts and is
meant to run in a virtual machine instead of docker.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-08-29 02:37:52 +02:00
Sage Weil
660ae5bcbb osd: always load erasure plugins from the configured directory
Ignore the profile 'directory' field.

This ensures that we can always find plugins even when teh cluster
is installed across a mix of distros.

Rename the option to have no osd_ (or mon_) prefix since anybody
may use the ec factory/plugin code.

We still hard-code .libs in the unit tests... sigh.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-08-21 16:03:30 -04:00
Samuel Just
afb4db73cc Merge remote-tracking branch 'origin/wip-sam-proxy-write'
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Conflicts:
	src/include/ceph_features.h
	src/osd/ReplicatedPG.cc
	src/osd/ReplicatedPG.h
2015-08-19 16:07:30 -07:00
Sage Weil
b4a4bc140e Merge pull request #5470 from ceph/wip-newstore-sort
osd: change sort order for hobject_t

Reviewed-by: Samuel Just <sjust@redhat.com>
2015-08-19 11:07:14 -04:00
Zhiqiang Wang
61c86a1281 test: change the test_tiering test case accordingly for proxy write
When an object is first created, it's proxied to base tier, need to
change the behavior of the test_tiering test case accordingly.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>
2015-08-18 11:25:24 -07:00
Yan, Zheng
479f2a760b qa/fsstress.sh: fix 'cp not writing through dangling symlink'
On some test machines, /usr/lib/ltp/testcases/bin/fsstress is
dangling symlink. 'cp -f' is impotent in this case.

Fixes: #12710
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-08-18 15:26:34 +08:00
Joaquim Rocha
63a0cf2922 qa/workunits/cls: add workunit for cls_numops tests
Signed-off-by: Joaquim Rocha <joaquim.rocha@cern.ch>
2015-08-17 22:23:30 +02:00
Loic Dachary
7924231930 tests: tiering agent and proxy read
Verify that an object promoted to a cache tier because of a proxy read
is evicted as expected.

http://tracker.ceph.com/issues/12673 Refs: #12673

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-08-14 14:31:52 +02:00