Commit Graph

936 Commits

Author SHA1 Message Date
Loic Dachary
7e2a7a8685 tests: cephtool/test.sh wait_for_clean after PG (re)mapping
A get/set command may fail with

   Error EBUSY: currently creating pgs, wait

if issued before the PGs are clean. Call wait_for_clean after the pool
is created or a pool setting is changed and remaps the PGs it
contains (size, pg_num...) to ensure the PGs are clean and the set/get
command that follow will succeed.

http://tracker.ceph.com/issues/11624 Fixes: #11624

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-06-01 01:13:44 +02:00
Loic Dachary
f6e4000589 tests: reduce pg_num in test_mon_osd_pool_set
No need for more than one pg to test get/set on pools: it also is faster
to become clean.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-06-01 01:13:44 +02:00
Loic Dachary
d2cc2b184b tests: use get_pg from ceph-helpers.sh
The semantic and interface of get_pg are the same, that avoids
duplication and the ceph-helpers.sh version is tested and documented.

Make the ceph-test package dependent on xmlstarlet because it is
needed by ceph-helpers.sh.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-06-01 01:11:28 +02:00
Loic Dachary
64944d4105 tests: ceph-helpers.sh use expr instead of (( ))
Because (( timer++ )) is mistaken by set -e to not be a successful
command, use expr instead.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-05-31 18:33:20 +02:00
Loic Dachary
d2172b0e89 tests: move ceph-helpers.sh to qa/workunits
So that it can be used by scripts in qa/workunits that need it.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-05-31 18:33:17 +02:00
Samuel Just
8a95f13a69 Merge remote-tracking branch 'upstream/wip-11493'
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2015-05-29 14:17:42 -07:00
Sage Weil
c6f62f518f Merge remote-tracking branch 'gh/next' 2015-05-27 17:25:28 -04:00
John Spray
38a319d515 qa/cephtool: add blacklist json output check
...not very elegantly because this is bash, but
at least check the expected value is somewhere
present in the JSON output.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-05-26 10:58:32 +01:00
Loic Dachary
5c69f5e15f tests: ceph create may consume more than one id
When CEPH_CLI_TEST_DUP_COMMAND=1 is set, ceph osd create will consume
two osd id and return the later. Fix the test to account for that and
not assume the osd id being allocated by osd create is always the
next available osd id.

The other osd create tests do not suffer from the same variation because
they provide a UUID argument that guarantees the same osd id is going to
be returned every time.

http://tracker.ceph.com/issues/11618 Fixes: #11618

Signed-off-by: Loic Dachary <ldachary@redhdat.com>
2015-05-22 10:16:24 +02:00
Vasu Kulkarni
f9e5b68b23 qa: unbreak concurrent.sh workunit
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2015-05-19 15:55:05 -04:00
Loic Dachary
e4ca4685e0 tests: reduce make check verbosity
Move check-local scripts

   src/test/run-cli-tests
   encode-decode-non-regression.sh
   test/encoding/readable.sh

to check_SCRIPTS. Their output is captured in .log file when running
with a recent automake. This reduces the output of make check by an
order of magnitude.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-05-18 00:41:16 +02:00
Sage Weil
ccd54c6574 Merge pull request #4662 from dachary/wip-11359-tier-tests
tests: more robust tiering agent tests

Reviewed-by: Sage Weil <sage@redhat.com>
2015-05-15 13:36:31 -07:00
Samuel Just
11b7801bb5 OSDMonitor: disallow ec pools as tiers
Fixes: 11650
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-05-15 13:20:00 -07:00
Sage Weil
bbec53edf9 mon: prevent pool with snapshot state from being used as a tier
If we add a pool with snap state as a tier the snap state gets clobbered
by OSDMap::Incremental::propogate_snaps_to_tiers(), and may prevent OSDs
from starting.  Disallow this.

Include a test.

Fixes: #11493
Backport: hammer, giant, firefly
Signed-off-by: Sage Weil <sage@redhat.com>
2015-05-15 10:39:49 -07:00
Loic Dachary
ea2736380a Merge pull request #4654 from dachary/wip-erasure-code-bench
erasure-code: bench.sh compares isa & jerasure, vandermonde & cauchy

Reviewed-by: Andreas Peters <Andreas.Joachim.Peters@cern.ch>
2015-05-15 18:59:22 +02:00
Loic Dachary
d82681e6c7 Merge pull request #4668 from ceph/wip-rados-binary-omapsetval
rados cli: setomapval can now read from stdin

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-05-13 22:34:22 +02:00
Jason Dillaman
6306beda38 qa/workunits/rados/test_rados_tool: added test for omapsetval via stdin
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-05-13 10:39:33 -04:00
Josh Durgin
b16a6ea788 Merge pull request #4644 from ceph/wip-11405
librbd: new QA client upgrade tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-05-13 06:53:07 -07:00
Loic Dachary
f88275dd04 tests: tiering health report reworked
Instead of

* setting limit
* populate the cache
* check the health warnings

do the following

* populate the cache
* set limits below the content of the cache
* check the health warnings

The problem with the former approach is that the limits stored by the
OSD internally do not exactly match the one set by the user: they are
converted in ratios and there may be rounding errors.

Also replace the busy loop waiting for pg stats to flush with

  ceph tell osd.* flush_pg_stats || true

for simplicity.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-05-13 10:39:37 +02:00
Loic Dachary
5f252d6135 tests: no agent when testing tiering agent border case
On a machine slow enough, the tiering agent can be activated while
testing border cases where the cache is almost full. Prevent that
by deactivating the tiering agent.

http://tracker.ceph.com/issues/11359 Fixes: #11359

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-05-13 09:28:06 +02:00
Loic Dachary
b2c40d5e76 tests: uncomment tiering agent tests
http://tracker.ceph.com/issues/11359 Refs: #11359

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-05-13 09:25:57 +02:00
Sage Weil
3d591afef9 mon: prevent bucket deletion when referenced by a rule
If a rule references a bucket with 'take', prevent deletion.

Fixes: #11602
Signed-off-by: Sage Weil <sage@redhat.com>
2015-05-12 16:37:56 -07:00
Loic Dachary
28f0230c12 erasure-code: bench.sh compares isa & jerasure, vandermonde & cauchy
ISA and Jerasure can be compared for the default stripe width (4KB) and
the two most commonly used Reed Solomon matrices. Comparing the
bandwidth for large chunks (1MB) is not relevant because it is not
commonly used.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-05-12 14:58:23 +02:00
Samuel Just
05db2b0a25 Merge pull request #4452 from tchaikov/wip-interactive-ceph-cli
Wip interactive ceph cli

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-05-11 10:29:40 -07:00
Kefu Chai
87f37b6b1a Merge pull request #4227 from tchaikov/node-ls
mon,osd,mds: add "{mon,mds} metadata" and "node ls" commands

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2015-05-11 22:01:21 +08:00
Kefu Chai
89f89ca347 mon: s/recovery/recoverying/ in "pg ls*" commands' spec
* also translate "repair" if specified as "states"
* update test_mon_pg in cephtool-test-mon.sh

Fixes: #11569
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-05-11 19:40:03 +08:00
Kefu Chai
1218d4d823 Merge pull request #4624 from rajukv/wip-xio-rajukv
xio: Update XIO client connection IP and nonce

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-05-11 15:12:34 +08:00
Raju Kurunkad
6158f18fb4 Update XIO client connection IP and nonce
Obtain the local IP of the client and save the nonce provided when the messenger was created. This is required for RBD lock/unlock
Fix script error in RBD concurrent test
Reset did_bind during messenger shutdown

Signed-off-by: Raju Kurunkad <raju.kurunkad@sandisk.com>
2015-05-11 10:43:20 +05:30
Yuri Weinstein
b863ccbf69 Added a "ceph hello world" for a simple check for ceph-deploy qa suite
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 13abae1863)

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2015-05-07 17:26:29 -07:00
Yuri Weinstein
13abae1863 Added a "ceph hello world" for a simple check for ceph-deploy qa suite
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2015-05-07 17:12:35 -07:00
Kefu Chai
410175be89 Merge pull request #3743 from trociny/wip-osd_create
mon: osd create: add optional 'id' parameter

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2015-05-08 00:13:37 +08:00
Kefu Chai
71bf5f1eb3 mon: add 'node ls {all,mds,mon,osd}' asok
Fixes: #10904
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-05-07 07:29:39 -07:00
Kefu Chai
79439d43a8 mds,mon: add 'mds metadata' command
Related: #10904
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-05-07 07:29:39 -07:00
Kefu Chai
1b0386b2e1 mon: add "mon_metadata <id>" command
Related: #10904
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-05-07 07:29:39 -07:00
Jason Dillaman
124b1d3d2d qa/workunits/rbd: add notify_master/slave bootstrap scripts
Backport: hammer
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-05-05 13:21:09 -04:00
Jason Dillaman
9039955f42 qa/workunits/rbd: add new test_librbd_api workunit
This only tests the public librbd API for use during upgrade tests.

Backport: hammer
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-05-05 13:21:09 -04:00
Josh Durgin
0358840a59 Merge pull request #4461 from ceph/wip-11372
librbd: add valgrind memory checks for unit tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-04-30 09:21:48 -07:00
Jason Dillaman
30b762bc13 qa/workunits/rbd: add support for running API tests under valgrind
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-04-30 10:56:54 -04:00
Sage Weil
04b00029e1 qa/workunits/post-file: pick a dir that's readable by world
Signed-off-by: Sage Weil <sage@redhat.com>
2015-04-28 17:40:29 -07:00
Kefu Chai
da9d2b4077 ceph.in: improve the interactive mode
* if ceph is not reading from a tty, expect EOF instead of "quit"
  as the end of input.
* do not panic at seeing the EOF
* update the test case test_mon_injectargs_SI(). since we disables
  "ceph injectargs <args,...>" in a458bd83, in which the arguments
  of "injectargs" are supposed to be consumed by "tell" instead.
  so "ceph injectargs ..." is taken as an incomplete command, and
  this command will bring ceph cli into the interactive mode,
  redirecting its stdin to /dev/null helps ceph cli quit the loop,
  but in a way of throwing EOFError exception. this change handles
  the EOF, so the "ceph injectargs ..." does not throws anymore.
  but the side effect is that the test fails since it expects a
  non-zero return code. so replace it with an equivalent "tell"
  command which also fails but due to the non-SI postfix.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-04-24 15:25:30 +08:00
Kefu Chai
bc7d8c99d2 ceph.in: parse quote correctly in interactive mode
Fixes: #11279
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-04-24 15:25:30 +08:00
Sage Weil
66e90d00dc Merge pull request #4165 from liewegas/wip-post-file
qa/workunits/post-file.sh: s/base-files/aclocal/
2015-04-23 15:39:11 -07:00
Gregory Farnum
392e824736 Merge pull request #4282 from ceph/wip-3645
mds: rename snapshot support

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com
2015-04-20 11:10:21 -07:00
Kefu Chai
9403df27f6 Merge pull request #3847 from trociny/wip-test_with_crushtool.master
mon: ceph osd setcrushmap: test_with_crushtool improvements

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-04-20 16:04:25 +08:00
Loic Dachary
643a4e93dd Merge pull request #4378 from dachary/wip-11359-tier-tests-disable
tests: comment out unstable tiering tests
2015-04-16 18:50:23 +02:00
Loic Dachary
0a442eeb14 tests: comment out unstable tiering tests
So that make check does not randomly fails.

http://tracker.ceph.com/issues/11359 Refs: #11359

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-04-16 18:02:23 +02:00
Sage Weil
34c467ba06 use git://git.ceph.com
Signed-off-by: Sage Weil <sage@redhat.com>
2015-04-16 08:29:41 -07:00
Mykola Golub
0d1e770391 mon: osd create: add optional 'id' parameter
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-04-12 14:25:45 +03:00
Yan, Zheng
488727757f qa/workunits/snaps: add snapshot rename test
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-04-10 09:48:46 +08:00
Jason Dillaman
9914a73c83 qa/workunits/rbd/copy.sh: removed deprecated --new-format option
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-04-09 16:06:59 -04:00
Sage Weil
52235e3256 qa/workunits/post-file.sh: use /etc/default
base-files doesn't existing on rhel.  /etc/default is everywhere and it's
small.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-04-09 09:58:39 -07:00
Kefu Chai
de0528dca6 Merge pull request #4210 from trociny/fix-11261
ceph_argparse: return false instead exiting when argument is missed

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-04-08 15:19:29 +08:00
Sage Weil
a074a1478d Merge pull request #3560 from XinzeChi/wip-pmon-all
ceph.in: add ceph ping mon.* for ping all monitor

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-04-06 15:47:09 -07:00
Mykola Golub
46103b2c3b ceph_argparse: don't die when called by injectargs
Fixes: #11261
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-04-04 10:55:04 +03:00
Noah Watkins
aed3434dc7 java: libcephfs_jni.so is in /usr/lib64 on rhel
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2015-03-27 19:34:12 -07:00
Mykola Golub
9d1391e7fe tests: extend mon_crushmap_validation test
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-03-27 15:44:35 +02:00
Mykola Golub
21699fcf70 mon: osd setcrushmap: use own timeout implementation
instead of relying on external util.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-03-27 10:08:22 +02:00
Sage Weil
cc3527a51e Merge pull request #3870 from majianpeng/cache-tier
Cache tier bug fixs

Reviewed-by: Sage Weil <sage@redhat.com>
2015-03-25 10:27:56 -07:00
Xinze Chi
2165d053a3 test: add test case for ping_monitor
Signed-off-by: Xinze Chi <xmdxcxz@gmail.com>
2015-03-24 12:51:15 +08:00
Loic Dachary
61e4932867 Merge pull request #3841 from ceph/wip-10217
qa/workunits/fs/misc: fix filelock_interrupt.py

Reviewed-by: John Spray <john.spray@redhat.com>
2015-03-22 09:08:21 +01:00
Sage Weil
714fac3df0 Merge pull request #4010 from majianpeng/osdmap-nspace
mon:make 'ceph osd map' accept namespace.

Reviewed-by: Sage Weil <sage@redhat.com>
2015-03-21 14:39:35 -07:00
Jianpeng Ma
537e88ec7d qa/cephtool: Using add-cache rather than add to test ceph health.
Don't forget set cachemode.
By the way, For test max_target_bytes, don't reply on /etc/passwd
because different host have different size of /etc/passwd.
Avoid met this bug, i create a tmp file.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2015-03-20 09:55:39 +08:00
Sage Weil
d26a9dce5e Merge remote-tracking branch 'gh/hammer'
Conflicts:
	PendingReleaseNotes
	src/Makefile.am
	src/gmock
	src/test/Makefile.am
2015-03-19 12:41:04 -07:00
Sage Weil
78790b304b Merge pull request #3898 from jdurgin/wip-rbd-merge-diff
qa: make rbd-fuse exit cleanly with lttng

Reviewed-by: Sage Weil <sage@redhat.com>
2015-03-18 13:18:18 -07:00
Sage Weil
2a5ad8e3f7 Merge remote-tracking branch 'gh/hammer'
Conflicts:
	src/gmock
	src/msg/xio/XioPortal.h
2015-03-17 10:57:13 -07:00
Jianpeng Ma
5951946b75 qa/cephtool: add ceph for 'ceph osd map pool object namespce'.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2015-03-17 14:50:55 +08:00
Jianpeng Ma
5a8d4c5068 qa,cephtool: add test case for 'ceph osd tier add-cache'
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2015-03-10 20:15:49 -07:00
Kefu Chai
d2057bd6d9 Merge pull request #3887 from stiopaa1/feature10891
mon: add "osd pool get $pool all" command

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-03-10 22:16:29 +08:00
Sage Weil
faa1f2741c Merge remote-tracking branch 'gh/hammer'
Conflicts:
	src/gmock
2015-03-10 06:24:59 -07:00
Michal Jarzabek
ea6192116c mon/OSDMonitor: refactor and new key "all" for osd pool get command
This will only output all the values applicable to a given type of pool.
So for example for a pool that is not a tier pool values like HIT_SET_TYPE,
HIT_SET_PERIOD, HIT_SET_COUNT etc. will be ignored.

Fixes: #10891
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2015-03-09 19:44:26 +00:00
Josh Durgin
918afc0a58 qa: make rbd-fuse exit cleanly with lttng
lttng requires daemons (things that call fork, clone, or daemon
without exec, like fuse) to use a LD_PRELOAD library. Without this,
the lttng atexit() handler crashes.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-03-06 18:57:32 -08:00
Gregory Farnum
060ff1536c Merge pull request #3877 from ceph/hammer-backports-hadoop
Hammer backports hadoop

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-03-06 09:29:22 -08:00
Jason Dillaman
3ca182a63d Merge pull request #3880 from jdurgin/wip-librbd-permissions-test
librbd: remove bad assert and fix permissions test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2015-03-05 16:13:39 -05:00
Loic Dachary
452c651151 Merge pull request #3822 from dachary/wip-10947-setcrushmap
mon: timeout if crushtool takes longer than mon_lease

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>
2015-03-05 14:28:27 +01:00
Josh Durgin
fa13a5dc5b qa: fix up rbd permissions test
! doesn't do what we want in bash -e. Use a more explicit helper
instead, and specify expected error codes.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-03-04 18:38:29 -08:00
Noah Watkins
099264fb17 hadoop: workunits don't need java path
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
(cherry picked from commit b3329a961b)

Conflicts:
	qa/workunits/hadoop/terasort.sh
2015-03-04 09:58:38 -08:00
Noah Watkins
2f2ace317c qa: update old replication tests
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
(cherry picked from commit 15da810086)
2015-03-04 09:58:37 -08:00
Kefu Chai
a3af64c257 ceph.in: print help on 'osd' or 'mon'
Fixes: #10888
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-03-04 17:39:02 +08:00
Loic Dachary
1e3f814869 mon: ignore crushtool validation if too long
The crushtool is aborted if it takes more than mon lease seconds. Since
the monitor blocks while running it, this is mandatory otherwise the
monitor will be considered down and new elections triggered.

http://tracker.ceph.com/issues/10947 Fixes: #10947

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-03-03 02:13:27 +01:00
Josh Durgin
0d468ae352 Merge pull request #3831 from dachary/wip-qemu-iotests
Maipo should also use the local qemu clone

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-03-02 15:34:39 -08:00
Jason Dillaman
6cff494e18 qa/workunits/rbd/copy.sh: remove all image locks
If the exclusive lock feature is enabled, all locks need
to be removed prior removing the image.

Fixes: #10990
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-03-02 16:24:17 -05:00
Sage Weil
b65f8fa422 Merge remote-tracking branch 'gh/hammer' 2015-03-02 09:11:11 -08:00
Yan, Zheng
4ececa3dc4 qa/workunits/fs/misc: fix filelock_interrupt.py
Handle the case that kernel does not support fcntl.F_OFD_SETLK.
Also fix the code that checks if fnctl fails with errno == EINTR.

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-03-02 21:08:03 +08:00
Loic Dachary
a23b348979 Maipo should also use the local qemu clone
http://tracker.ceph.com/issues/10975 Fixes: #10975

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-02-28 01:20:05 +01:00
Jason Dillaman
3ec52dae63 qa/workunits/rbd/copy.sh: explicitly choose the image format
The rbd CLI now utilizes the rbd_default_format configuration
setting, therefore the copy test now needs to tell rbd which image
format it is expecting to create.

Fixes: #10961
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-02-26 12:06:53 -05:00
Noah Watkins
b3329a961b hadoop: workunits don't need java path
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2015-02-24 18:26:44 -08:00
Noah Watkins
15da810086 qa: update old replication tests
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2015-02-23 20:00:24 -08:00
Noah Watkins
6bc2b024fd hadoop: add terasort workunit
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2015-02-23 20:00:24 -08:00
Loic Dachary
c7f3691384 Merge pull request #3698 from dachary/wip-10836-erasure-code-corpus
tests: clone ceph-erasure-code-corpus from ceph

Reviewed-by: Takeshi Miyamae <miyamae.takeshi@jp.fujitsu.com>
2015-02-12 13:40:56 +01:00
Gregory Farnum
bac1846828 Merge pull request #3711 from ceph/hadoop
qa: hadoop plays nice with new teuthology task
2015-02-11 21:04:03 -08:00
Sage Weil
ee3e466fc4 Merge pull request #3522 from ceph/wip-8600
mon: OSDMonitor: tolerate catastrophically bad crush maps

Reviewed-by: Sage Weil <sage@redhat.com>
2015-02-11 18:31:42 -08:00
Noah Watkins
de6b53aba7 qa: hadoop plays nice with new teuthology task
This brings the hadoop wordcount up-to-date with the new teuthology
hadoop task.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2015-02-11 16:03:32 -08:00
Sage Weil
aa03d6a84c Merge remote-tracking branch 'gh/master' into hammer 2015-02-11 09:21:36 -08:00
Loic Dachary
94f9f60b1b tests: clone ceph-erasure-code-corpus from ceph
Instead of the http://github.com/dachary namespace. It is not an issue
in the common case because it should be cloned because it is in the
.gitmodules file with the proper namespace.

http://tracker.ceph.com/issues/10836 Fixes: #10836

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-02-11 13:34:15 +01:00
Sage Weil
a6035aee32 Merge branch 'wip-7701' of git://github.com/xinxinsh/ceph into hammer
Conflicts:
	src/osd/osd_types.h
2015-02-10 17:19:44 -08:00
Greg Farnum
a850514838 fsync-tester: print info about PATH and locations of lsof lookup
We're seeing the lsof invocation fail (as not found) in testing and nobody can
identify why. Since attempting to reproduce the issue has not worked, this
patch will gather data from a genuinely in-vitro location.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-02-09 22:30:24 -08:00
xinxin shu
a3b158311a add tests for ceph pg ls-by-pool
Signed-off-by: xinxin shu <xinxin.shu@intel.com>
2015-02-10 08:11:25 +08:00
xinxin shu
6ccced2415 add tests for ceph pg ls-by-osd
Signed-off-by: xinxin shu <xinxin.shu@intel.com>
2015-02-10 08:11:25 +08:00
xinxin shu
742c5e8b2d add tests for ceph pg ls-by-primary
Signed-off-by: xinxin shu <xinxin.shu@intel.com>
2015-02-10 08:11:25 +08:00
Mykola Golub
7920db3da9 tests: make ceph_watch_wait output watchfile content on failure
It should help in troubleshooting remote test failures.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-02-08 22:12:55 -08:00
Sage Weil
6d72a1f040 Merge pull request #3468 from ceph/wip-cephfs-snap1
Wip cephfs snap1

Reviewed-by: Sage Weil <sage@redhat.com>
2015-02-06 03:02:50 -08:00
Yan, Zheng
8624172d1a qa/workunits/snaps: remove snapshots when test finishes
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-02-05 22:40:39 +08:00
Yan, Zheng
a464558ff7 qa/workunits/snaps: don't assume snapshot is disabled
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2015-02-05 22:40:39 +08:00
Kefu Chai
fffa5e201a osd,mon: add norebalance osdmap flag
Fixes: #10559

Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-02-05 13:52:17 +08:00
Joao Eduardo Luis
0d80691979 qa: workunits: cephtool/test.sh: test 'ceph osd setcrushmap'
Signed-off-by: Joao Eduardo Luis <joao@redhat.com>
2015-02-04 14:05:14 +00:00
Sage Weil
c58307bbcf Merge pull request #3583 from jdurgin/wip-qemu-iotests
qa: use correct binary path on rpm-based systems

Reviewed-by: Sage Weil <sage@redhat.com>
2015-02-02 07:54:53 -08:00
Josh Durgin
05ce2aa1bf qa: use correct binary path on rpm-based systems
Fixes: #10715
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-02-02 16:45:14 +01:00
Sage Weil
0af16c3672 Merge pull request #3485 from jdurgin/wip-merge-diff-testing
Improve merge-diff test
2015-02-02 03:07:36 -08:00
xinxin shu
2ac116e939 add tests for ceph pg ls
Signed-off-by: xinxin shu <xinxin.shu@intel.com>
2015-02-02 13:06:21 +08:00
Yehuda Sadeh
f147143115 Merge remote-tracking branch 'origin/master' into wip-rgw-versioning-4
Conflicts:
	src/rgw/rgw_admin.cc
2015-01-29 16:05:14 -08:00
Yehuda Sadeh
00f21d8bb6 workunits/rgw: adjust radosgw-admin output parsing
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2015-01-29 09:31:33 -08:00
Yehuda Sadeh
b685baad30 workunits/rgw: set radosgw-admin location through env variable
add new RGW_ADMIN to be able to set call.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2015-01-29 09:31:33 -08:00
Mykola Golub
e5ddc502d9 tests: bring back useful test 'ceph tell osd.foo'
The test was removed in 1189138 (mon: make ceph tell mon.* version
work) as it began to fail due to #10439. After it fixed in c4548f6
(pybind: ceph_argparse: validate incorrectly formed targets), the test
can be restored.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-01-27 10:51:07 +02:00
Josh Durgin
f6406c99d8 qa: small improvements to merge-diff test
* Use set -e to detect errors
* no need to retry cleanup in a loop now that rbd-fuse closes images
* use --no-progress for long-running operations
* add output at the start of each test

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-01-24 23:10:16 -08:00
Armando Segnini
33f0afdd15 doc: Some files still use http://ceph.newdream.net
This probably redirects to http://ceph.com but ceph.newdream.net still appears in some places

http://tracker.ceph.com/issues/10615 Fixes: #10615

Related: #9922

Signed-off-by: Armando Segnini <armando.segnini@telecom-bretagne.eu>
2015-01-23 12:28:58 +01:00
Josh Durgin
448a3c3335 Merge remote-tracking branch 'origin/next' 2015-01-22 13:05:12 -08:00
Jason Dillaman
a6eadaefb7 rbd image_read.sh: disable exclusive locking
Until the kernel supports RBD exclusive locking, this test
has been updated to create shared images (exclusive locking
disabled).

Fixes: #10613
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-01-22 13:03:40 -08:00
Josh Durgin
07038a79f3 Merge branch 'next' 2015-01-21 16:11:43 -08:00
Sage Weil
6633f8a3ed Merge pull request #3409 from trociny/wip-osd_pool_flags
osd: new pool safeguard flags: nodelete, nopgchange, nosizechange

Reviewed-by: Sage Weil <sage@redhat.com>
2015-01-21 13:52:29 -08:00
John Spray
a0af5de972 qa: move fs quota to its own dir
This is because running fs/misc on a kclient
should not include quota (quota not supported
on kernel client).

Fixes: #10579
Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-21 14:36:58 +00:00
Josh Durgin
946958c13c qa: disable automatic locking for manual locking test
Automatic locking hides the ESHUTDOWN from the caller, which is how
this test detects that blacklisting works.

Fixes: #10592
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-01-20 15:56:12 -08:00
Sage Weil
8318a2e5e2 Merge pull request #3382 from xinxinsh/wip-fix
fix command 'ceph pg dump_stuck degraded'

Reviewed-by: Sage Weil <sage@redhat.com>
2015-01-19 12:35:58 -08:00
Mykola Golub
8ab3c41db7 osd: new pool safeguard flags: nodelete, nopgchange, nosizechange
* nodelete - pool can't be deleted
* nopgchange - pool's pg and pgp num can't be changed
* nosizechange - pool's size and min size can't be changed

This is intended to help some poor admin to avoid a very bad day.

Fixes: #9792 (but in a different way than it was proposed there)
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-01-19 21:50:28 +02:00
Josh Durgin
a845139d1f Merge pull request #3292 from kylinstorage/rbd-merge-diff-v2
rbd: merge diff files

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2015-01-16 12:08:02 -08:00
xinxin shu
9db596974c fix command 'ceph pg dump_stuck degraded'
undersized not valid:  undersized not in inactive|unclean|stale
undersized not valid:  undersized doesn't represent an int
Invalid command:  unused arguments: ['undersized']
pg dump_stuck {inactive|unclean|stale [inactive|unclean|stale...]} {<int>} :  show information about stuck pgs

Signed-off-by: xinxin shu <xinxin.shu@intel.com>
2015-01-16 01:33:07 +08:00
Josh Durgin
e7cc6117ad qa: ignore duplicates in rados ls
These can happen with split or with state changes due to reordering
results within the hash range requested. It's easy enough to filter
them out at this stage.

Backport: giant, firefly
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2015-01-14 15:02:38 -08:00
John Spray
e5591f8a98 qa: fail_all_mds between fs reset and fs rm
Because fs reset opens a brief window for the previously
failed MDSs to spring back into life.

Fixes: #10539

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-14 22:08:09 +00:00
Gregory Farnum
a6f5682d55 Merge pull request #3364 from ceph/wip-quota-test
qa: set -e explicitly in quota test

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-01-13 07:08:30 -08:00
John Spray
b578a53b03 qa: set -e explicitly in quota test
Previously was set in hashbang, which meant
that "./quota.sh" was OK, but "sh ./quota.sh" would
just run through ignoring errors.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-13 14:58:57 +00:00
John Spray
8630696681 qa: add fs reset to cephtool tests
This is just a superficial "I can call it" test,
it's actual behaviour is checked elsewhere.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-12 15:00:15 +00:00
Yunchuan Wen
d300220aaf rbd: test case for rbd merge-diff
Signed-off-by: Yunchuan Wen <yunchuanwen@ubuntukylin.com>
Signed-off-by: MingXin Liu <mingxinliu@ubuntukylin.com>
2015-01-12 01:05:19 +00:00
Loic Dachary
ebfe230680 Merge pull request #3272 from trociny/tell-mon-version
cli: make ceph tell mon.* version work

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-01-06 19:35:36 +01:00
Ken Dreyer
bea2d4a8f7 qa: drop tiobench suite
The tiobench software has been abandoned upstream for years. Fedora and
Debian are no longer shipping the tiobench package, so we've had to
carry the package ourselves in the Ceph project, and we're trying to
slim down our dependencies where it makes sense to do so.

Nuke the tiobench suite.

http://tracker.ceph.com/issues/10152 Refs: #10152

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2015-01-06 09:00:16 -07:00
Mykola Golub
b5c24e45a9 qa: add test_tell, which currently is used only for testing 'ceph tell mon version'.
The test requires at least two monitors run.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-01-05 15:53:54 +02:00
Mykola Golub
3b4e021cdc qa: refactor 'ceph -w' magic in test_mon_misc by introducing helper
functions ceph_watch_start and ceph_watch_wait so they can be reused
in other tests.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-01-05 12:01:15 +02:00
Mykola Golub
11891383ae mon: make ceph tell mon.* version work
Fixes: #6767
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2015-01-05 12:01:03 +02:00
Warren Usui
46a1a4cb67 If trusty, use older version of qemu
Fixes #10319
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-12-19 18:57:06 -08:00
John Spray
61126a2d71 Merge pull request #3199 from ceph/wip-qa-empty-xattr
qa: test zero size xattr

Reviewed-by: John Spray <john.spray@redhat.com>
2014-12-19 17:03:25 +00:00
Sage Weil
0a25bee539 Merge remote-tracking branch 'gh/wip-fs-quota'
Conflicts:
	src/client/Client.cc
2014-12-19 07:45:02 -08:00
Warren Usui
19dafe1648 Remove sepia dependency (use fqdn)
Fixes: #10255
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-12-18 17:16:24 -08:00
Sage Weil
0af2a1c1cc qa/workunits/rest/test.py: fix pg stat test
Back in e27b0d9e42 we changed pg stat to
not dump everything when a formatter is used.

Fixes: #10326
Signed-off-by: Sage Weil <sage@redhat.com>
2014-12-18 15:49:58 -08:00
Sage Weil
5439d9ee70 Merge pull request #3057 from ceph/wip-crush-straw
crush: fix straw bucket scaler bugs

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2014-12-18 14:13:33 -08:00
Yan, Zheng
a806778322 qa: test zero size xattr
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2014-12-18 14:43:54 +08:00
Sage Weil
47f0a52e85 Merge branch 'wyc-quota-v2' of git://github.com/kylinstorage/ceph into wip-fs-quota
Conflicts:
	src/include/ceph_features.h

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
2014-12-16 14:29:39 -08:00
João Eduardo Luís
639096d9f7 Merge pull request #3146 from ceph/wip-9323
mon: allow full flag to be manually cleared

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>
2014-12-15 16:36:08 +00:00
Ilya Dryomov
35f084d078 qa: add script to test how libceph handles huge auth tickets
Signed-off-by: Ilya Dryomov <idryomov@redhat.com>
2014-12-13 20:49:04 +03:00
Sage Weil
a8f85dccbb mon: allow full flag to be manually cleared
This is like a temporary measure as the mon will try to set them again,
but we have run into cases where the mon was misbehaving (failing to clear
the flag) and we wanted to do it.  Note that the mon will likely set it
again on the next tick() anyway.

If we're going to clear it, we may as well be able to set it, too (again,
even if the mon is going to clear it soon).  If nothing else this is useful
for writing tests.

Fixes: #9323
Signed-off-by: Sage Weil <sage@redhat.com>
2014-12-10 21:00:26 -08:00
Yunchuan Wen
e8063a1a63 test: modify cephfs quota test case
Signed-off-by: Yunchuan Wen <yunchuanwen@ubuntukylin.com>
2014-12-10 15:11:17 +08:00
Sage Weil
89b2feea8d mon: 'osd crush reweight-all'
This corresponds to the crushtool --reweight command.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-12-09 16:09:26 -08:00
Sage Weil
9000068ae4 mon: add 'osd crush {get,set}-tunable <name> [value]' commands
For now, just add the straw_calc_version tunable.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-12-09 16:09:25 -08:00