Commit Graph

593 Commits

Author SHA1 Message Date
Sage Weil
093128a8b1 Merge pull request #1139 from ceph/wip-agent
osd: basic cache tier agent

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-02-17 14:14:21 -08:00
Sage Weil
a1dbc9ceec qa/workunits/suites/pjd: use test suite with acl tweak
Test 45 in xacl/00.t fails on ext4 and cephfs.  Just disable it.
Everything else passes.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-16 22:25:49 -08:00
Sage Weil
dcf20b9bf3 osd: add 'notieragent' flag to OSDMap
This will pause tiering agent work.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-15 22:09:38 -08:00
Loic Dachary
199bdb1ba8 mon: test dirty stats in ceph df detail
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-02-15 22:09:38 -08:00
Sage Weil
95f25ce092 mon/OSDMonitor: allow new pool policy fields to be set
Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-15 22:08:12 -08:00
Sage Weil
af848d4a4a Merge pull request #1176 from ceph/wip-primary-affinity
osd: primary affinity

Added primary-affinity thrashing to thrashosd.py.

Reviewed-by: Loic Dachary <loic@dachary.org>
2014-02-15 16:59:35 -08:00
Loic Dachary
d921d9b383 qa: do not create erasure pools yet
comment out erasure pool related tests when an OSD is involved because
it does not work yet. See http://tracker.ceph.com/issues/7360.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-02-16 00:53:13 +01:00
Sage Weil
7e9f03b18e Merge pull request #1181 from dachary/wip-7277
DNM: mon: s/ENOSYS/ENOTSUP/

Reviewed-by: Christophe Courtaut <christophe.courtaut@gmail.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2014-02-15 10:08:45 -08:00
Sage Weil
1cc8c258b9 mon/OSDMonitor: add 'osd primary-affinity ...' command
Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-12 13:38:12 -08:00
Sage Weil
ed0980c925 Merge pull request #1168 from yuyuyu101/wip-refactor-objectstore-test
Rename test/filestore to test/objectstore

Reviewed-by: Sage Weil <sage@inktank.com>
2014-02-11 21:17:05 -08:00
Loic Dachary
8533b6ac2e Merge pull request #1185 from ceph/wip-crush
crush: "vary_r" tunable

Reviewed-by: Loic Dachary <loic@dachary.org>
2014-02-11 23:42:53 +01:00
Sage Weil
d136eb4cbd mon: allow firefly crush tunables to be selected
Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-11 11:12:56 -08:00
Josh Durgin
32aa9fdf66 Merge branch wip-librados-timeout
Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2014-02-10 14:12:35 -08:00
Josh Durgin
9e62beb80b qa: add script for testing rados client timeout options
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-02-10 12:53:12 -08:00
Haomai Wang
1a588f18ba Rename test/filestore to test/objectstore
Now ObjectStore support three backend types, so we need to make each backend
share unit test to avoid duplicate codes.

This patch mainly make workload_generator workable for objectstore.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-02-08 15:41:52 +08:00
tamil
3d656600e9 script to test rgw multi part uploads using s3 interface
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
(cherry picked from commit 5d59dd9cd67834d991b038323bcbc3e8f8612229)
2014-02-07 22:27:05 -08:00
tamil
d4e5db58fa Merge branch 'next' of github.com:ceph/ceph into next 2014-02-07 17:10:10 -08:00
tamil
0bac064e90 added script to test rgw user quota
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-02-07 17:09:30 -08:00
Sage Weil
bb6d3f81a7 rest/test.py: use larger max_file_size for mds set test
Current min is 64k.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-07 06:11:57 -08:00
Loic Dachary
302fc924fe mon: s/ENOSYS/ENOTSUP/
On Linux ENOTSUP is remapped
/usr/include/x86_64-linux-gnu/bits/errno.h

    /* Linux has no ENOTSUP error code.  */
    # define ENOTSUP EOPNOTSUPP

and should have different values on other operating systems. On Ubuntu
precise the string returned when translating the error value of ENOTSUP
or EOPNOTSUPP is always EOPNOTSUPP but on Ubuntu saucy it is always
ENOTSUP.

Replace ENOSYS with ENOTSUP because the expected semantic is very
similar and modify the test to not check on the string translation of
the error.

Rework the check_response shell function to optionaly check the return
code. The erasure coded pool size change test verifies the error message
only but not the error code.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-02-07 12:41:42 +01:00
David Zafman
42a64e19b7 Revert test case of "mon: OSDMonitor: do not allow changing an erasure-coded pool's size"
This reverts part of commit c8c4cc6e81816069886af6bff968712993554759.

Fixes: #7355

Signed-off-by: David Zafman <david.zafman@inktank.com>
2014-02-06 19:13:20 -08:00
John Spray
ce0e3bd188 qa/workunits/snaps: New allow_new_snaps syntax
These were probably just obscuring other failures.

Reviewed-by: Sage Weil <sage@inktank.com>
Signed-off-by: John Spray <john.spray@inktank.com>
2014-02-05 21:00:12 +00:00
Joao Eduardo Luis
c8c4cc6e81 mon: OSDMonitor: do not allow changing an erasure-coded pool's size
Fixes: 7277

Reviewed-by: Loic Dachary <loic@dachary.org>
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-02-04 10:22:48 +01:00
Sage Weil
8e30db8f2a rest: add a few rest api tests
Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-03 17:50:32 -08:00
Sage Weil
eb9ffd5a79 mon: use 'mds set inline_data ...' for enable/disable of inline data
This makes the management interface a bit more consistent.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-02-03 17:50:32 -08:00
Sage Weil
408b0c8e75 mon: fix 'mds set allow_new_snaps'
We had already added this as a flag (set/unset) when I generalized the
'mds set_max_mds' to be 'ceph mds set <var> <val>'.  Switch the snaps
flag to be a key/value to with true/false (similar to the hashpspool
pool flag) since there are fewer users and the var/val approach is more
general.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2014-02-03 17:50:18 -08:00
tamil
dcca41371f added perl script for rgw bucket quota tests
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-01-21 18:51:49 -08:00
tamil
28c75f81c1 removing rgw_tests.sh
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
(cherry picked from commit 54caa0192b02b03549fe4ca5d062495e6e429f97)
2014-01-21 18:50:06 -08:00
tamil
54caa0192b removing rgw_tests.sh
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-01-21 18:44:57 -08:00
tamil
8b8ede7a13 modified the port to 7280 in the script instead of the default 80
Signed-off-by: tamil <tamil@tamil-VirtualBox.(none)>
2014-01-21 17:50:00 -08:00
tamil
850b4f426f script for rgw bucket quota testing
Signed-off-by: tamil <tamil@tamil-VirtualBox.(none)>
2014-01-21 15:56:37 -08:00
tamil
47bc71a7b4 fixed the syntax for test maxmds=2
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-01-17 15:56:36 -08:00
tamil
a13ebd370a fix for the test maxmds=2
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
2014-01-17 15:41:48 -08:00
Sage Weil
2b36761b81 mon: favor 'mds set max_mds' over 'mds set_max_mds'
Signed-off-by: Sage Weil <sage@inktank.com>
2014-01-15 19:02:23 -08:00
Loic Dachary
08c17b7c5c qa: cleanup cephtool/test.sh tmp files
When run in a shared environment ( as opposed as a machine created for
the purpose of running this test only ), it is important to cleanup
leftovers to avoid poluting the /tmp space. Create a common temporary
directory for all tmp files.

Signed-off-by: Loic Dachary <loic@dachary.org>
2014-01-14 17:31:04 +01:00
Sage Weil
ca9acb9634 mon: implement 'mds set max_mds|max_file_size'
First, add the ability to modify max_file_size.  While we are at it, move
to a more sensible interface for adjusting max_mds too.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-01-09 04:31:41 -08:00
Josh Durgin
e91fb91065 librbd: better error when unprotect fails on unprotected snap
This will show up on the command line and logs, making it more
clear than EINVAL.

Fixes #6851 and #4045
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-12-31 16:26:07 -08:00
Josh Durgin
8fcfc9114f qa: test rados listomapvals with >512 keys
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-12-30 13:36:37 -08:00
Haomai Wang
d7d7ca8451 Fix qa/workunits/rados/test_cache_pool.sh typos
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2013-12-30 12:07:56 +08:00
Sage Weil
12f4631586 qa/workunits/rest/test.py: rbd pool ruleset is now 0
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-28 10:36:27 -08:00
Sage Weil
250ecf6655 qa/workunits/mon/crush_ops.sh: fix in-use rule rm test
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-28 10:22:18 -08:00
Loic Dachary
a10fc025d7 osd: build_simple creates a single rule
The three rules created by build_simple are identical. They are replaced
by a single rule named replicated_rule which is set to be used by the
data, rbd and metadata pools.

Instead of hardcoding the ruleset number to zero, it is read from
osd_pool_default_crush_ruleset which defaults to zero.

The CEPH_DEFAULT_CRUSH_REPLICATED_RULESET enum is moved from osd_type.h to
config.h because it may be needed when osd_type.h is not included.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-27 00:13:47 +01:00
Loic Dachary
5cf2cdc073 qa: remove osd pool create erasure tests
Creating an erasure pool will crash the OSD because OSD::_make_pg
asserts if the type is not replicated. The tests related to erasure
coded pool creation are removed from qa/workunits/cephtool/test.sh.

The osd-create-pool.sh unit test covers the cases removed from test.sh
more extensively. The intent is to check the interactions with the MON
only, therefore it does not run an OSD and the absence of erasure code
placement group backend implementation is not an issue.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-26 10:01:19 +01:00
Sage Weil
1e529972f3 Merge remote-tracking branch 'gh/master' into wip-cache
Conflicts:
	src/osdc/Objecter.h
	src/vstart.sh

Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-12-22 15:33:59 -08:00
Loic Dachary
df0d038d7b mon: osd create pool must fail on incompatible type
When osd create pool is called twice on the same pool, it will succeed
because the pool already exists. However, if a different type is
specified, it must fail.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-22 23:43:50 +01:00
Loic Dachary
a0d1521ddb replace pool type REP with REPLICATED
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-22 08:15:24 +01:00
Loic Dachary
1e238e6f95 mon: pool create will not fail if the type differs
It looked like it worked because the wrapper hide the error. The failing
tests are commented out so that the other tests can be used.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-20 22:00:31 +01:00
Loic Dachary
81dee1b67f osd: erasure code benchmark workunit
Display benchmark results for the default erasure code plugins, in a tab
separated CSV file. The first two column contain the amount of KB
that were coded or decoded, for a given combination of parameters
displayed in the following fields.

seconds	KB	plugin	k	m	work.	iter.	size	eras.
1.2	10	example	2	1	encode	10	1024	0
0.5	10	example	2	1	decode	10	1024	1

It can be used as input for a human readable report. It is also intented
to be used to show if a given version of an erasure code plugin performs
better than another.

The last column ( not shown above for brievety ) is the exact command
that was run to produce the result so it can be copy / pasted to
reproduce them or to profile.

Only the jerasure techniques mentionned in
https://www.usenix.org/legacy/events/fast09/tech/full_papers/plank/plank_html/
are benchmarked, the others are assumed to be less interesting.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-20 12:15:44 +01:00
Sage Weil
57e91455be qa/workunits/rados/test_cache_pool.sh: fixes
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-19 16:39:58 -08:00
Sage Weil
1bde88f87c qa/workunits/rados: rename cache pool tests
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-19 16:39:58 -08:00