Commit Graph

36920 Commits

Author SHA1 Message Date
Josh Durgin
1cb3d6c52e Merge pull request #2873 from ceph/wip-rbd-test-fixtures
librbd: Refactor librbd unit tests to use test fixtures

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2014-11-11 07:42:39 +01:00
Sage Weil
0edd7cf3f7 Merge pull request #2893 from ceph/wip-10045
common/Readahead: use correct lock when waiting on the pending ops

Reviewed-by: Sage Weil <sage@redhat.com>
2014-11-10 18:11:18 -08:00
Jason Dillaman
27049148c7 common/Readahead: use correct lock when waiting on the pending ops
Readahead was using the incorrect lock with the pending condition,
resulting in a failed assertion.  It now uses the lock associated
with pending ops.

Fixes: #10045
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2014-11-10 19:57:08 -05:00
Sage Weil
e55f30ff48 Merge pull request #2380 from osynge/wip-suse-systemd-integration
systemd support in ceph-disk activate

Reviewed-by: Sage Weil <sage@redhat.com>
2014-11-10 16:44:26 -08:00
Yehuda Sadeh
dee0083163 Merge pull request #2446 from xylv/wip-9359
rgw: Export user stats in get-user-info Adminops API

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2014-11-10 16:35:02 -08:00
Yehuda Sadeh
f05cd2c907 Merge pull request #2725 from CzBiX/rgw-modified-since
rgw: correct "If-Modified-Since" handle.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2014-11-10 16:29:21 -08:00
Sage Weil
a7b93819c3 Merge pull request #2782 from boydc2014/master
rgw: fix can not disable max_size quota

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2014-11-10 16:21:08 -08:00
Sage Weil
1809f579b7 Merge pull request #2624 from ceph/wip-8911
rgw: swift GET / HEAD object returns X-Timestamp field

Reviewed-by: Sage Weil <sage@redhat.com>
2014-11-10 16:14:10 -08:00
Samuel Just
007e4c42a8 Merge pull request #2851 from ceph/wip-9986
objecter: fix map skipping

Reviewed-by: Sage Weil <sage@redhat.com>
2014-11-10 15:00:26 -08:00
Samuel Just
4705f5382b Merge pull request #2667 from yuandong1222/avoid-unused-pg_to_acting_osds-call
Avoid unused pg_to_acting_osds call in OSDMap::get_primary_shard

Reviewed-by: Samuel Just <sjust@redhat.com>
2014-11-10 14:58:56 -08:00
Samuel Just
1425482450 Merge pull request #2474 from dachary/wip-9420-erasure-code-non-regression
erasure-code: store and compare encoded contents

Reviewed-by: Samuel Just <sjust@redhat.com>
2014-11-10 14:57:42 -08:00
Samuel Just
0720e03ef3 Merge pull request #2456 from ceph/wip-9031-9262
Wip 9031 9262

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:30 -08:00
Samuel Just
ced51656da Merge pull request #2553 from ceph/wip-aio-journal
osd: clean up journal aio+dio header issue

Reviewed-by: Samuel Just <sjust@redhat.com>
2014-11-10 14:55:04 -08:00
Samuel Just
63cd066250 Merge pull request #2745 from ceph/wip-6756
JounralingObjectStore: journal->committed_thru after replay
2014-11-10 14:53:56 -08:00
Samuel Just
992a4a843f Merge pull request #2773 from ceph/wip-9852
mon: MDSMonitor: proper error output if pool DNE on 'add_data_pool'

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>
2014-11-10 14:52:10 -08:00
Samuel Just
07a441bdd2 Merge pull request #2822 from ceph/wip-9887
Wip 9887

Reviewed-by: Samuel Just <sjust@redhat.com>
2014-11-10 14:51:15 -08:00
Samuel Just
18a850933f Merge pull request #2850 from ceph/wip-9987
mon: fix min_last_epoch_started tracking

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>
2014-11-10 14:49:51 -08:00
Samuel Just
d392f44891 Merge pull request #2862 from ceph/wip-log-client
osd, mds: fix cluster log

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>
2014-11-10 14:47:15 -08:00
Sage Weil
17d517991c Merge pull request #2689 from zhurongze/fix-crush
crush: fix incorrect use of adjust_item_weight method

Reviewed-by: Sage Weil <sage@redhat.com>
2014-11-10 09:02:28 -08:00
Sage Weil
43f004de30 Merge pull request #2881 from ceph/wip-10030
librbd: don't close an already closed parent image upon failure

Reviewed-by: Sage Weil <sage@redhat.com>
2014-11-10 08:41:58 -08:00
Rongze Zhu
9850227d2f crush: fix incorrect use of adjust_item_weight method
adjust_item_weight method will adjust all buckets which the item
inside. If the osd.0 in host=fake01 and host=fake02, we execute
"ceph osd crush osd.0 10 host=fake01", it not only will adjust fake01's
weight, but also will adjust fake02's weight.

the patch add adjust_item_weightf_in_loc method and fix remove_item,
_remove_item_under, update_item, insert_item, detach_bucket methods.

Signed-off-by: Rongze Zhu <zrzhit@gmail.com>
2014-11-10 23:37:03 +08:00
Loic Dachary
2d7adb23bc erasure-code: erasure_code_benchmark exhaustive erasure exploration
Add the --erasure-generation exhaustive flag to try all combinations of
erasures, not just one at random.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
3ff2816b3e erasure-code: add erasure_code_benchmark --verbose
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
efe121d9f2 erasure_code: implement ceph_erasure_code to assert the existence of a plugin
This is handy when scripting in the context of teuthology and only
conditionally run tests for the isa plugin, for instance.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
49613cb2aa erasure-code: ceph_erasure_code does not need to avoid dlclose
The only reason for not dlclosing plugins at exit is for callgrind but
ceph_erasure_code has no workload that would require callgrind.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
6fdbdff2ad erasure-code: add corpus verification to make check
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
10c88c8f27 erasure-code: Makefile.am cosmetics
Cluster benchmark related lines together.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
2c84d0b1db erasure-code: s/alignement/alignment/ typos in jerasure
The jerasure-per-chunk-alignment prameter was mispelled and while
useable that would lead to confusion.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
7638b15f23 erasure-code: workunit to check for encoding regression
Clone the archive of encoded objects and decode all archived objects, up
to and including the current ceph version.

http://tracker.ceph.com/issues/9420 Refs: #9420

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
f5901303db erasure-code: store and compare encoded contents
Introduce ceph_erasure_code_non_regression to check and compare how an
erasure code plugin encodes and decodes content with a given set of
parameters. For instance:

./ceph_erasure_code_non_regression \
      --plugin jerasure \
      --parameter technique=reed_sol_van \
      --parameter k=2 \
      --parameter m=2 \
      --stripe-width 3181 \
      --create \
      --check

Will create an encoded object (--create) and store it into a directory
along with the chunks, one chunk per file. The directory name is derived
from the parameters. The content of the object is a random pattern of 31
bytes repeated to fill the object size specified with --stripe-width.

The check function (--check) reads the object back from the file,
encodes it and compares the result with the content of the chunks read
from the files. It also attempts recover from one or two erasures.

Chunks encoded by a given version of Ceph are expected to be encoded
exactly in the same way by all Ceph versions going forward.

http://tracker.ceph.com/issues/9420 Refs: #9420

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-10 14:56:43 +01:00
Loic Dachary
4b07381daf Merge pull request #2888 from dachary/wip-9970-erasure-code-documentation
erasure-code: document pool operations

Reviewed-by: Laurent Guerby <laurent@guerby.net>
2014-11-10 14:51:15 +01:00
Loic Dachary
c44bdb1dc9 erasure-code: document pool operations
A short introduction to the first time user of an erasure coded pool.
It includes a reminder of how it relates to cache tiering and links to
define new profiles with an example.

There was examples in the developer documentation but the operator
expects to find such a guide in the rados operations chapter.

http://tracker.ceph.com/issues/9970 Fixes: #9970

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-10 14:47:56 +01:00
Loic Dachary
ec92128993 Merge pull request #2750 from dachary/wip-9815-make-check-parallel
parallelize make check

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>
2014-11-10 11:58:27 +01:00
Loic Dachary
a0c1f220c7 tests: use kill -0 to check process existence
When killing a daemon, instead of using kill -9 to check the process was
terminated, use kill -0. Should the pid of the process be reused
immediately after, it would be wrong to kill the new process. Worst case
scenario the kill_daemon function returns before the process is
confirmed to be killed but this is not treated as an error and is
unlikely to cause any problem.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:51 +01:00
Loic Dachary
17f5c3659c tests: looping to wait for an osd to be up is expected
Remove the reference to a bug that suggests otherwise.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:51 +01:00
Loic Dachary
79f8b81aec tests: increase timeout to accommodate slow machines
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:51 +01:00
Loic Dachary
0b4ccbd68d tests: kill_daemon use $name.pid instead of pidfile
So that it can be used instead of stop.sh to stop vstart.sh daemons. The
problem with stop.sh is that it kills any daemon, not just a selection.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:51 +01:00
Loic Dachary
6741b71d90 tests: group workunits/cephtool/test.sh tests per daemon
So all tests related to a given daemon (mon, osd, mds) can be run at
once.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:51 +01:00
Loic Dachary
0cb12c71b9 tests: run workunits/cephtool/test.sh
Three scripts are added to run qa/workunits/cephtool/test.sh for each
daemon (mon, mds, osd) so they can be run in parallel.

http://tracker.ceph.com/issues/9815 Fixes: #9815

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:02 +01:00
Loic Dachary
c3b51ef5fa tests: remove vstart_wrapped_tests.sh
Listing tests to be run in a single script does not take advantage of
parallel runs in make.

The vstart_wrapper.sh script is reworked and made less specialized and
let the caller decide which daemons to run via CEPH_START and does not
enforce the number of deamons of each time. It no longer uses stop.sh to
avoid killing the osd/mon/mds that are unrelated to the tests.

http://tracker.ceph.com/issues/9815 Fixes: #9815

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:02 +01:00
Loic Dachary
7a6ca17f18 tests: use different ports for each mon
Run the mon on each test on a different port so they can run in
parallel.

http://tracker.ceph.com/issues/9815 Fixes: #9815

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:02 +01:00
Loic Dachary
bdca0ac0b5 tests: tolerate a disk 99% full
The tests do not need much space and will work fine even on a 99% full
disk.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-11-09 11:59:02 +01:00
Sage Weil
b8ec7d7bed Merge pull request #2869 from fgimenez/fix-tests-on-btrfs
Fix tests on btrfs: leftover subvolumes removed

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2014-11-08 21:05:40 -08:00
Loic Dachary
725d05f52f Merge pull request #2860 from XinzeChi/master
osd: cache pool: delete dead code in ReplicatedPG::agent_choose_mode

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-11-08 16:03:45 +01:00
Greg Farnum
560e22e845 test: use unsigned ints to compare against size()
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2014-11-07 16:20:57 -08:00
Gregory Farnum
daa9f9ffe8 Merge pull request #2814 from ceph/wip-inode-scrub
Wip inode scrub

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2014-11-07 16:16:02 -08:00
Loic Dachary
bc8409e50c Merge pull request #2884 from dachary/wip-mailmap
mailmap: Loic Dachary affiliation
2014-11-07 23:56:15 +01:00
Loic Dachary
a21bca1d46 mailmap: Loic Dachary affiliation
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-11-07 23:54:07 +01:00
tmuthamizhan
28f0bb8416 Merge pull request #2882 from ceph/wip-doc-dumpling-to-firefly
doc: Added Dumpling to Firefly upgrade section.
2014-11-07 14:09:02 -08:00
John Wilkins
3e0295ffa9 doc: Added Dumpling to Firefly upgrade section.
Fixes: #7679

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-11-07 13:16:45 -08:00