Commit Graph

362 Commits

Author SHA1 Message Date
Sage Weil
5551aa5b3b mds: parse ceph.*.layout vxattr key/value content
Use qi to parse a strictly formatted set of key/value pairs.  Be picky
about whitespace.  Any subset of recognized keys is allowed.  Parse the
same set of keys as the ceph.*.layout.* vxattrs.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-20 17:09:49 -08:00
Sage Weil
473beb53c5 qa: mon/pool_ops.sh: fix last test
Got this one backwards, bah!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-20 08:44:03 -08:00
Sage Weil
96e153aeef qa: mon/pool_ops.sh: test pool set size
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-19 15:54:52 -08:00
Sage Weil
7bd49d02ad qa: mon/pool_ops.sh: fix pool tests
The '! command' doesn't fail properly, even with -e, in bash (wtf!).

Also, the last pool deletion command succeeds because the pool
'--yes-i-really-really-mean-it' doesn't exist.  So drop that test.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-19 15:54:07 -08:00
Gary Lowell
d0424ebced Merge branch 'master' of https://github.com/ceph/ceph 2013-02-19 14:55:14 -08:00
Gary Lowell
bcb210c677 Merge branch 'next' 2013-02-19 14:53:54 -08:00
Joe Buck
3ff0fe0fc7 testing: updating hadoop-internal test
Small tweaks to the hadoop-internal test
to better use existing environment varaibles.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2013-02-19 14:05:38 -08:00
Noah Watkins
f1bff178a4 qa: sample test for new replication tests
Signed-off-by: Joe Buck <jbbuck@gmail.com>
2013-02-19 14:05:11 -08:00
Sage Weil
6d338591b7 qa: mon/workloadgen.sh: drop TEST_CEPH_CONF code
The binaries already pick up on CEPH_CONF, which will be set as needed.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-19 09:02:14 -08:00
Joe Buck
b45f67e0b5 test: correcting hadoop-internal tests
Changing the hadoop-internal tests to use the
newly added $TESTDIR environment variable.
Also, removed unneeded variables.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Sam Lang <sam.lang@inktank.com>
2013-02-19 08:36:36 -08:00
Joe Buck
d2dbab1f4f testing: adding a Hadoop wordcount test
Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Sam Lang <sam.lang@inktank.com>
2013-02-19 08:35:13 -08:00
Sage Weil
45a4fe0915 qa: rbd map-snapshot-io: udevadm settle
Udev runs blkid on device close, thwarting any rbd unmap that
immediately follows use of the device.  Explicitly settle for now.

See #4183.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-18 20:32:41 -08:00
Sage Weil
231dc1bee6 qa: rbd/map-snapshot-io: remove image when done
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-18 11:24:46 -08:00
Sage Weil
1a7a57ac8f qa: fix quoting of wget URLs
Broke this in ae0c2bbb50.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-18 10:58:10 -08:00
Sage Weil
f45e9be2f3 Merge branch 'next' 2013-02-15 17:21:42 -08:00
Sage Weil
3f5c252796 qa: rbd/map-snapshat-io: unmap image when done
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-15 16:26:16 -08:00
Sage Weil
bc74429c8b qa: rbd/map-snapshot-io.sh: chown rbd device stuff
This is fugly, but sudo -E doesn't work.  Fix this after we are installing
debs and the path doesn't matter anymore!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-15 13:57:47 -08:00
Sage Weil
ae0c2bbb50 qa: pull qa stuff from ceph.com ceph.git mirror
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-15 09:20:24 -08:00
Danny Al-Gaaf
6f3f17397a test_sync_io.c: add error handling
Add error handling for open(), posix_memalign() and malloc().
Reuse code for read_* and write_* functions.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-15 10:22:49 +01:00
Danny Al-Gaaf
26cdb6a61b test_short_dio_read.c: add error handling
Add error handling for open() calls.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-15 10:21:57 +01:00
Sage Weil
670a14827a qa: fix mon/osd.sh
It needs to be a valid osd id that we try to remove (that doesn't exist).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-13 08:30:09 -08:00
Josh Durgin
0fec0fde42 Merge branch 'next'
Conflicts:
	src/include/ceph_features.h
2013-02-12 16:55:32 -08:00
Sam Lang
ed6c3ff50c qa/workunits: Add vxattr set pool test script
Add a test script that tests for creating a pool
and then setting the layout for a (pre-existing)
file to that pool.

Signed-off-by: Sam Lang <sam.lang@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-02-12 14:44:24 -08:00
tamil
e2b8e0f13c modified the perl file name
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-02-12 10:55:39 -08:00
tamil
2783fce24e work unit for rbd cli tests
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-02-11 18:11:26 -08:00
tamil
7c8d3d053a added new cli tests
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-02-11 17:29:03 -08:00
Sage Weil
3f4d8532ea Merge remote-tracking branch 'gh/next' 2013-02-11 17:12:22 -08:00
Sage Weil
3d5969d680 qa/rbd: +x on map-snapshot-io.sh
Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-11 08:48:44 -08:00
Danny Al-Gaaf
7b89ee666b ceph-test: give binaries from ceph-test package useful names
The files from the ceph-test subpackage are installed to /usr/bin,
give them more useful names to make sure that the user know they
belong to ceph. add a 'ceph_' prefix and change some test* binaries
to ceph_test_*.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-02-10 18:33:56 +01:00
Sage Weil
4d054e2e29 qa: fix iogen script
Wait 10 minutes and then stop.

Signed-off-by: Sage Weil <sage@inktank.com>
(cherry picked from commit 75c40fac60)
2013-02-09 21:00:16 -08:00
tamil
5896b971a3 modified the script to run on both argonaut and bobtail.
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-02-07 11:47:06 -08:00
Sage Weil
75c40fac60 qa: fix iogen script
Wait 10 minutes and then stop.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-06 22:01:24 -08:00
Sage Weil
b79067a863 qa: add workunits/mon/crush_ops.sh
Test creating, listing, removing crush rules via the mon.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-05 14:31:13 -08:00
Sage Weil
b970d054ce qa: smalliobenchrbd workunit
Run a bunch of parallel smalliobenchrbd processes.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-02-03 09:28:22 -08:00
Alex Elder
97c6619d3f qa: update the rbd/concurrent.sh workunit
A few changes, now that a few rbd problems have been fixed.
First, the more substantive changes:
    - Generate a source file, and compare what's read back from rbd
      devices with the content of that file.
    - Write to the rbd device such that the written data spans
      an (assumed 4 MB) rbd object boundary, as well as starting
      and ending on non-page-aligned offsets.
    - Perform multiple reads on rbd devices: entirely within a range
      before any written data; beginning before but ending within
      written data; the exact written data (and validating what's
      read); beginning within written data but ending after it;
      reading after written data but within a written rbd object;
      and reading from an unwritten rbd object.
    - Have the sleep between iterations provide a non-integer value
      to avoid zero (or quantized) delays.

Also, some a little less substantive (but possibly informative):
    - Don't run with "set -x".  It produces a ton of noise that is
      not useful for this test.  This is an exerciser, looking
      really for system crashes during concurrent activity, and
      knowing which commands were (concurrently) active isn't going
      to help much in diagnosis.
    - Create two more directories, used to track the degree of
      concurrency (more or less) and the highest rbd id consumed.
      Files whose names are numbers are touched in each, and the
      highest at the end is the highest during the run.  This gets
      around issues passing environment info from sub-shells to the
      top-level shell.  As a bonus, it offers a better chance of
      avoiding problems due to concurrent update.
    - NAMESDIR is renamed NAMES_DIR, and it (and the others) is
      set up in the setup() function.
    - Increase the concurrency and iteration counts.
    - Move the default definitions before the ceph secrets stuff

Signed-off-by: Alex Elder <elder@inktank.com>
2013-01-31 11:55:59 -06:00
Sage Weil
c782d2ac53 qa: add test for rbd map and snapshots
This tests for the behavior reported in #3964.  It passes on the current
code, but fails on 3.2 in squeeze (and 32-bit?).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-01-30 01:06:03 -08:00
Sage Weil
1564c3a0a3 Merge branch 'wip-vxattr'
Reviewed-by: Sam Lang <sam.lang@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-01-29 16:26:57 -08:00
Sage Weil
61fbe27a52 qa: add layout_vxattrs.sh test script
Test virtual xattrs for file and directory layouts.

TODO: create a data pool, add it to the fs, and make sure we can use it.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-01-29 16:25:05 -08:00
Alex Elder
59ac4d3534 qa: add rbd/concurrent workunit
This defines a new workunit shell script that performs a bunch of
rbd operations concurrently in order to exercise code paths and
catch reference count and bad pointer problems.

Signed-off-by: Alex Elder <elder@inktank.com>
2013-01-29 16:42:44 -06:00
Josh Durgin
1a6197a75b qa: fix mon pool_ops workunit
Use ! for clarity when commands are supposed to fail.
Check a few other cases that should fail, and correct deleting
non-existent pools.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-01-28 15:25:13 -08:00
Sage Weil
1ba4c80bcf qa/workunits/rbd/copy.sh: use non-deprecated --image-format option
--format is deprecated.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-01-26 13:46:12 -08:00
Sage Weil
bbb86ec794 mon: safety interlock for pool deletion
Require that the pool name be passed twice along with an force option
before we irreversibly delete an entire pool of objects.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-01-26 13:45:12 -08:00
tamil
b2a473be92 workunit for iogen
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2013-01-25 18:07:22 -08:00
Sage Weil
6f0e11371c libcephfs-java test: use provided environment
Signed-off-by: Sage Weil <sage@inktank.com>
2013-01-24 15:13:37 -08:00
Sage Weil
b9f58baaa6 libcephfs-java test: jar files are in /usr/local/share/java, it seems
Signed-off-by: Sage Weil <sage@inktank.com>
2013-01-24 10:41:34 -08:00
Sage Weil
64b9dd088d Merge remote-tracking branch 'gh/wip-3832-oc-flushrange'
Reviewed-by: Sage Weil <sage@inktank.com>
2013-01-23 18:47:25 -08:00
Sam Lang
6401abf8d0 qa/workunit: Add iozone test script for sync
The iozone-sync.sh script runs iozone testing
various sync flags, O_SYNC, O_DSYNC, O_RSYNC.

Signed-off-by: Sam Lang <sam.lang@inktank.com>
2013-01-22 15:05:55 -06:00
Joe Buck
00b1186922 testing: add workunit to run hadoop internal tests.
This workunit runs the internal tests for our local branch of hadoop-common.
Requires ant be installed on the host running the test.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
2013-01-22 12:43:37 -08:00
Dan Mick
2491f976e4 workunits/cephtool: add tests for ceph osd pool set/get
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-01-18 22:36:31 -08:00
Sage Weil
ea9628fba4 Merge remote-tracking branch 'gh/next' 2013-01-18 20:57:40 -08:00