Commit Graph

1052 Commits

Author SHA1 Message Date
Jason Dillaman aef7f9e268 qa/workunits/rbd: do not use object map during read flag testing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-03-14 17:06:41 -04:00
Josh Durgin 750701b644 Merge pull request #8068 from SUSE/wip-15104
qa/workunits/rbd: use POSIX function definition

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-03-11 17:48:43 -08:00
Nathan Cutler 996be8ef49 qa/workunits/rbd: use POSIX function definition
In scripts with /bin/sh shebang, we must use POSIX function definitions to
avoid syntax errors on platforms that link /bin/sh to something other than
/bin/bash.

See https://wiki.ubuntu.com/DashAsBinSh#function for more information.

http://tracker.ceph.com/issues/15104 Fixes: #15104

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2016-03-12 02:03:27 +01:00
Josh Durgin b1f0cb902a Merge pull request #7944 from trociny/wip-rbd-mirror-image-replayer-async
rbd-mirror: ImageReplayer async start/stop

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-03-11 11:24:12 -08:00
Gregory Farnum a7a0dac6a4 Merge pull request #6953 from jcsp/wip-fsmap
Multi-filesystem support

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-03-11 09:36:30 -08:00
Sage Weil 5d745b2bee Merge pull request #7982 from liewegas/wip-14606
qa/workunits/rest/test.py: add confirmation to 'mds setmap'
2016-03-11 10:30:53 -05:00
Sage Weil c9124548e4 Merge pull request #8004 from liewegas/wip-rados-test-stderr
qa/workunits/rados/test.sh: capture stderr too
2016-03-11 10:29:39 -05:00
Mykola Golub 3295253d64 test: add rbd-mirror test script
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-03-11 16:12:00 +02:00
Mykola Golub 866a704882 test: rbd_mirror_image_replay improve commit position parsing
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-03-11 16:12:00 +02:00
John Spray 22ff1224fd qa: update cephtool test for CephFS multi filesystems
Includes adding test for the enable_multiple flag.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-03-10 11:18:28 +00:00
Sage Weil 2b9775db2c Merge pull request #7890 from liewegas/wip-reweight
mon: osd [test-]reweight-by-{pg,utilization} command updates

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-03-09 14:06:30 -05:00
Sage Weil bd6c64da23 qa/workunits/rados/test.sh: capture stderr too
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-09 13:37:10 -05:00
Sage Weil 661891aa28 mon: remove range=100 from reweight-by-* commands
Specifying the range makes it skip instead of error when you give
it a bad value.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-09 13:25:55 -05:00
Sage Weil 2dc78c86d8 Merge pull request #7552 from dachary/wip-14669-key-management
ceph-disk: key management support

Reviewed-by: Sage Weil <sage@redhat.com>
2016-03-09 10:31:53 -05:00
Sage Weil bdcc84042c qa/workunits/rest/test.py: add confirmation to 'mds setmap'
Broken when we added the confirmation in
fc3554e36a

Fixes: #14606
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-08 14:34:40 -05:00
Sage Weil 3a72d21e30 Merge pull request #7861 from tchaikov/wip-14910
qa/workunits/cephtool/test.sh: wait longer in ceph_watch_start()

Reviewed-by: Sage Weil <sage@redhat.com>
2016-03-07 12:23:46 -05:00
Loic Dachary 94c5df4567 tests: verify ceph-disk lockbox activation scenarii
Simulate the cases where the activation (via udev running trigger)
sequences are:

* journal then lockbox
* data then lockbox
* lockbox

All of them must end with the OSD verfied to be up.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-04 09:13:35 +07:00
Loic Dachary ed56cef1f1 tests: make ceph-disk workunit resilient to non ascii
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-04 09:13:35 +07:00
Loic Dachary 869eb3af80 tests: verify ceph-disk activate-lockbox
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-04 09:13:35 +07:00
Loic Dachary 1ec58fcfc8 ceph-disk: implement lockbox key management
Instead of storing the dmcrypt keys in the /etc/ceph/dmcrypt-keys
directory, they are stored in the monitor. If a machine with
OSDs created with ceph-disk prepare --dmcrypt is lost, it does
not contain the key that would allow to decrypt their content.

The dmcrypt key is retrieved from the monitor using a different keyring
for each OSD. It is stored in a small partition called the lockbox. At
boot time the lockbox is mounted

    /var/lib/ceph/osd-lockbox/$uuid

and used when the $uuid partition is detected by udev to map it with
cryptsetup.

The OSDs that were prepared prior to the lockbox implementation are
supported by looking up the key found in /etc/ceph/dmcrypt-keys before
looking in /var/lib/ceph/osd-lockbox/$uuid.

http://tracker.ceph.com/issues/14669 Fixes: #14669

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-03-04 09:13:35 +07:00
Sage Weil 28b33a5b57 qa/workunits/cephtool/test.sh: test reweight-by-x commands
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-03 13:49:06 -05:00
Gregory Farnum 22417925fe Merge pull request #7098 from liewegas/wip-file-layout
mds, client: add namespace to file_layout_t (previously ceph_file_layout)

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-03-02 19:15:18 -08:00
Sage Weil 2786f0bf11 Merge remote-tracking branch 'gh/jewel' 2016-03-02 09:22:28 -05:00
Kefu Chai 389ecbbc2a Merge pull request #7390 from badone/wip-13829
common: Allow OPT_INT settings with negative values

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2016-03-02 11:22:24 +08:00
Sage Weil c31e94d3b5 qa/workunits/fs/misc/layout_vxattrs: test layout.pool_namespace
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-01 11:18:17 -05:00
Sage Weil 58a00e01f5 qa/workunits/fs/misc/layout_vxattr.sh: detect data pool name
Signed-off-by: Sage Weil <sage@redhat.com>
2016-03-01 11:16:58 -05:00
Kefu Chai 6eff39af79 qa/workunits/cephtool/test.sh: wait longer in ceph_watch_start()
"ceph --watch-debug" and "ceph tell mon.foo version" could connect
to different monitors, and there is chance that "ceph --watch-debug"
is not connected yet when "ceph tell" completes, and hence the former
fails to collect the cluster log including the "ceph tell" related
message. this renders test_mon_tell() unreliable. so, in
ceph_watch_start(), we should wait until the "ceph" cli connects to the
monitor and receives messages from it.

Fixes: #14910
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-03-01 20:48:24 +08:00
Zack Cerza 2a80042728 rbd/run_cli_tests.sh: Reflect test failures
Signed-off-by: Zack Cerza <zack@redhat.com>
2016-02-26 08:01:30 -07:00
Loic Dachary 86e2987fcf Merge pull request #7805 from ErwanAliasr1/evelu-check-btrfs
Fixing BTFS issue at 'make check'

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-02-26 11:34:42 +07:00
Erwan Velu 9ae89269f8 ceph-helpers: Delete remaining subvolumes on destroy_osd()
Before deleting $dir/$id, we have to delete the associated subvolumes unless the
rm will fail.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-02-25 16:46:49 +01:00
Erwan Velu cd0389ddb1 ceph-helpers.sh: Deleting forgoten btrfs subvolumes
While running a make check on a btrfs system, many subvolumes are let at the end
of the build. It's pretty common to have several hundreds of those.

btrfs is pretty sensible to the path when requesting a subvolume removal.
The current code was misleading the path and didn't deleted the remaining
volumes.

This patch list the current subvolumes, filter thoses created by the
test process and ajust the path because brtfs reports
  erwan/chroot/ceph/src/testdir/test-7202/dev/osd1/snap_439
while regarding the current working directory we want to delete :
  testdir/test-7202/dev/osd1/snap_439

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-02-25 15:33:10 +01:00
Mykola Golub 103eee4d13 test: image_replay: use flush to speedup commit position update
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 09:25:53 +02:00
Mykola Golub e92b45278c rbd-mirror: ImageReplayer: pass registered client ID as external param
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 09:25:20 +02:00
Sage Weil b9a4b977a3 Merge pull request #7714 from SUSE/wip-qa-typo
doc: standardize @param (not @parma, @parmam, @params)

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-02-22 12:36:42 -05:00
Mykola Golub cc4b73b3f5 test: rbd-mirror: add tool to test ImageReplayer
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-20 10:05:13 +02:00
Nathan Cutler 882066d6b7 doc: standardize @param (not @parma, @parmam, @params)
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2016-02-19 15:32:14 +01:00
Greg Farnum 12a55d6b1a rstats: enable by default on client; move test workunit to its own dir
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-02-18 12:44:22 -08:00
Gregory Farnum 957c77d570 Merge pull request #7323 from ukernel/wip-client-dirsize
client: add option to control how directory size is calculated

This lets you disable rstats if your workload is unhappy about directories
changing size (eg, tar of recently-moved/created/untarred files).

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-02-18 12:47:05 -08:00
Sage Weil adfc653ea0 Merge pull request #7218 from dachary/wip-13942-ceph-disk
ceph-disk: support bluestore

Reviewed-by: Sage Weil <sage@redhat.com>
2016-02-05 09:15:26 -05:00
Sage Weil 30ff251367 Merge pull request #7447 from liewegas/wip-parallel-rados-test
test: run rados api tests in parallel

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-02-04 08:38:09 -05:00
Loic Dachary 36656c8dc9 tests: ceph-disk tests pid files must exist
http://tracker.ceph.com/issues/13422 made it so ceph-osd won't start
unless the pidfile can be created successfully. The default location
being the current directory, ceph-osd must explicitly be told to write
in a directory where it has write permissions.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-04 17:01:46 +07:00
Loic Dachary c50f3b9f48 tests: ceph-disk qa workunit for bluestore
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-04 17:01:46 +07:00
Loic Dachary 65bc36e610 ceph-disk: bluestore prepare
Only support the block file for now. It is handled the same as the
journal, only with a different name (block) and it's own set of ptypes
depending on multipath or dmcrypt.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-04 17:01:46 +07:00
Loic Dachary ec4a28885a tests: generic ceph-disk qa check_osd_status
The helper function no longer has journal hardcoded.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-04 14:38:08 +07:00
Loic Dachary 7f6295d21f ceph-disk: make all must setup.py install
Refactor the test / virtualenv setup in the same way it was done for
ceph-detect-init.

All shell tests use ceph-helpers.sh which is modified to add ceph-disk /
ceph-detect-init virtualenv/bin to the PATH to ensure the source version
is used even if ceph is installed.

See "ceph-detect-init: make all must setup.py install"

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-04 14:38:08 +07:00
Loic Dachary c7fbe2124b tests: instructions to collect ceph-disk coverage
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-04 14:38:08 +07:00
Loic Dachary 5151063fda ceph-disk: refactor into a proper python module
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-04 14:36:37 +07:00
Sage Weil 2aeadc9acf Merge remote-tracking branch 'gh/jewel' 2016-02-03 09:46:47 -05:00
Sage Weil 93413b5f4f qa/workunits/rados/test.sh: bash
Signed-off-by: Sage Weil <sage@redhat.com>
2016-02-02 17:45:55 -05:00
Sage Weil 15ea140b3b qa/workunits/objectstore/test_fuse.sh: fix root check
$EUID not defined everywhere.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-02-01 15:49:25 -05:00