RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-20 01:51:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
72,099 Commits 216 Branches 394 Tags 1.8 GiB
381f465839
Commit Graph

1962 Commits

Author SHA1 Message Date
Mykola Golub
dda32847e8 qa/workunits/rbd: don't use deprecated syntax 
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-20 14:29:14 +02:00
Nathan Cutler
210249a8d7 Merge pull request #14638 from dillaman/wip-19692 
test: rbd master/slave notify test should test active features

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
 2017-04-20 14:12:24 +02:00
Kefu Chai
b3075c485c qa/suites: Revert "qa/suites: add mon-reweight-min-pgs-per-osd = 4" 
This reverts commit ef7583d717.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 14:18:21 +08:00
Kefu Chai
e6a436bb27 qa/tasks/ceph_manager: be able to store options with service type 
so we are able to change options for services other than mon while
thrashing.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 14:18:21 +08:00
Kefu Chai
ee653ba87c Merge pull request #14608 from tchaikov/wip-19594 
qa/tasks: assert on pg status with a timeout

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-20 10:49:12 +08:00
Kefu Chai
960032e513 qa/tasks: update tests with helper to wait for pg-stats 
and remove unused helpers

Fixes: http://tracker.ceph.com/issues/19594
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:05 +08:00
Kefu Chai
1207caf3a2 qa/tasks/ceph_manager: add a "wait_for_pg_stats()" decorator 
and accompany it with two helpers to access the pg stats in a more
natural way

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-20 09:35:04 +08:00
Josh Durgin
cab2968e8f qa: use bluestore for (k)rbd ec overwrites tests 
Only bluestore supports ec overwrites

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:49:11 -07:00
Josh Durgin
4a7c058183 qa: use 4k stripe_width again for test_rados_tool.sh 
The stripe_unit change altered the default stripe_width to depend on k.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:44 -07:00
Josh Durgin
a3e5cba3f1 qa: move ec overwrites tests to a bluestore-only subsuite 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
4315221179 osd,OSDMonitor: try to protect against ec overwrites with filestore 
This isn't perfect, but it's better than nothing. Prevent enabling the
allow_ec_overwrites flag if any of a sample of pgs in the pool map to
osds using filestore. This mainly protects filestore-only clusters
from enabling it.

If a filestore osd is started later, warn in the cluster log when it
gets a pg with ec overwrites enabled.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
3ca750d41d test/osd/osd-scrub-repair.sh: add ec overwrites test cases 
Move pool and profile creation into a single function, and
add a 'allow_overwrites' parameter for it so each ec test
can be paramterized by it.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
a219319137 qa/tasks/rados: test sparse reads with ec overwrites 
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Josh Durgin
6fba80c1fa osd, OSDMonitor, qa: mark ec overwrites non-experimental 
Keep the pool flag around so we can distinguish between a pool that
should maintain hashes for each chunk, and a missing one is a bug, vs
an overwrites pool where we rely on bluestore checksums for detecting
corruption.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-19 17:45:43 -07:00
Patrick Donnelly
0b420be7e9
mds: add export_pin feature 
This allows the client/admin to pin a directory tree to a particular rank,
preventing its export by the dynamic balancer.

Fixes: http://tracker.ceph.com/issues/17834

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-04-19 18:21:19 -04:00
Sage Weil
ee1bb01a54 Merge pull request #14556 from liewegas/wip-pgupmap 
osd: pg-remap -> pg-upmap

Reviewed-by: David Zafman <dzafman@redhat.com>
 2017-04-19 17:07:01 -05:00
Sage Weil
9d463ed9d7 Merge pull request #14623 from liewegas/wip-bluestore-compression 
qa/objectstore: test bluestore with aggressive compression
 2017-04-19 12:01:00 -05:00
Jason Dillaman
7ab93b7779 qa/suites: client-upgrade/jewel-client-x should test multiple features 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-19 09:12:04 -04:00
Jason Dillaman
ca70fe440a Merge pull request #14631 from idryomov/wip-krbd-data-pool-fix 
qa: krbd_data_pool.sh: account for rbd_info metadata object

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-19 07:30:27 -04:00
Sage Weil
1e6531e28a Merge pull request #14614 from wjwithagen/wip-wjw-cephtool-test-mon.sh 
qa/workunits/cephtool/test.sh: Be more liberal in testing health-output.

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:56:37 -05:00
Sage Weil
bac484f225 qa/objecstore/bluestore-comp: test bluestore with compression on 
Enable aggressive compression.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:53:58 -04:00
Sage Weil
fb6cc95ad9 qa/objectstore/bluestore: drop old option 
This test code has been removed.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 16:53:41 -04:00
Ilya Dryomov
5b2d7f76bb qa: krbd_data_pool.sh: account for rbd_info metadata object 
... added in commit a16beba784 ("librbd: image create validates that
pool supports overwrites").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2017-04-18 21:47:36 +02:00
Zack Cerza
28d746bff3 Merge pull request #14464 from ceph/wip-systemd 
qa/tasks: use sudo to check ceph health for systemd test
 2017-04-18 11:34:27 -06:00
Sage Weil
ce188e8fdf osd: pg-remap -> pg-upmap 
'remap' is to non-specific a name.  In particular, it
sounds like it is related to the 'remapped' PG state
but in reality it is not related.

'upmap' or 'pg-upmap' is more specific: it maps a pgid
to the 'up' set value (or item)

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-18 12:59:40 -04:00
Casey Bodley
da7acc4211 Merge pull request #13597 from cbodley/wip-s3tests-crypto 
qa/rgw: add configuration for server-side encryption tests

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
 2017-04-18 12:28:37 -04:00
Kefu Chai
1b54b5f3f1 Merge pull request #14415 from smithfarm/wip-19556 
tests: Thrasher: handle "OSD has the store locked" gracefully

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-18 23:18:35 +08:00
John Spray
033ee6bd1f Merge pull request #14396 from jcsp/wip-19550 
qa: re-enable ENOSPC tests for kclient
 2017-04-18 12:59:14 +01:00
John Spray
d98e19fdbd Merge pull request #14589 from jcsp/wip-19640 
client: refine fsync/close writeback error handling

Reviewed-by: Jeff Layton <jlayton@redhat.com>
 2017-04-18 12:58:37 +01:00
John Spray
a2a100dc13 Merge pull request #14272 from jcsp/wip-vstart-fixup 
qa: fix test_standby_for_invalid_fscid with vstart_runner

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2017-04-18 12:50:20 +01:00
John Spray
1a69bec52f client: refine fsync/close writeback error handling 
Previously, errors stuck indelibly to the inode, which
meant that a close call would see an error even if the
user already dutifully fsync()'d and handled it.

We should emit each error only once per file handle.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-18 07:47:10 -04:00
Willem Jan Withagen
9ff401e65b /workunits/cephtool/test.sh: Be more liberal in testing health-output. 
Sometimes I get output like:
   HEALTH_ERR 2 pgs stuck unclean; Full ratio(s) out of order

Which goes away over time. So it is a transit issue

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2017-04-18 13:43:54 +02:00
Orit Wasserman
cb94e5ad3f Merge pull request #12535 from ceph/wip-rgw-multisite-teuthology 
rgw: multisite enabled over multiple clusters
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2017-04-18 11:47:48 +03:00
David Zafman
3becdd3138 test: Test health check output for full ratios 
Test out of order ratios summary and details
Test various full osd conditions summary and details

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-17 13:02:57 -07:00
David Zafman
a5731076ad osd: Handle backfillfull_ratio just like nearfull and full 
Add BACKFILLFULL as a local OSD cur_state
Notify monitor of this new fullness state

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-17 08:00:24 -07:00
David Zafman
e927cd2cf2 test: Fix intended test flow and restore nearfull-ratio 
This is inconsequential but seems to have always been wrong since original
commit 6cafb0e3e0

Signed-off-by: David Zafman <dzafman@redhat.com>
 2017-04-17 07:58:30 -07:00
John Spray
0cb0c494d9 Merge pull request #13466 from jcsp/wip-cephfs-ecoverwrites 
Add test for is_hacky_ecoverwrites in cephfs pool checks

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-15 19:44:00 +01:00
Sage Weil
d82ac99d70 Merge pull request #14490 from liewegas/wip-no-luminous 
mon: add mon_debug_no_require_luminous

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-04-14 20:05:45 -05:00
Sage Weil
8c6820a433 qa/suites/rados/thrash: do not thrash cluster full without luminous flag 
The interface changes with the luminous flag; this will fail.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-14 12:04:47 -04:00
Sage Weil
4857f51e68 qa/suites/rados: expand other collections with no-require-luminous 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-14 11:45:05 -04:00
John Spray
dd43d3bc64 qa/cephfs: use getfattr/setfattr helpers 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-14 06:38:48 -04:00
John Spray
61617f8f10 qa: add test for reading quotas from different clients 
Fixes: http://tracker.ceph.com/issues/17939
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-14 06:38:48 -04:00
John Spray
131d1bd570 qa: add log whitelists for MDS health messages 
Now that we send these to the cluster log, we must
whitelist them in the tests that exercise those
unhealthy states.

Fixes: http://tracker.ceph.com/issues/19551
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-14 05:47:43 -04:00
Sage Weil
8fd450e986 qa/suites/rados: require_luminous_osds at end of run, then scrub 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-13 17:11:19 -04:00
Sage Weil
5ca72c1193 qa/tasks/exec_on_cleanup.py: add 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-13 17:11:19 -04:00
Ali Maredia
b31b84529e rgw multisite: use get_config_master_client for radosgw_admin task 
Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2017-04-13 12:15:50 -04:00
Ali Maredia
c5956790e6 rgw: multisite enabled over multiple clusters 
Added '--cluster' to all necessary commands
ex: radosgw-admin, rados, ceph, made sure
necessary checks were in place so that clients
can be read with our without a cluster_name
preceeding them

Made master_client defined in the config for
radosgw-admin task

Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2017-04-13 12:15:50 -04:00
Kefu Chai
8442cbb521 Merge pull request #14468 from tchaikov/wip-show-me-fake-plugin 
qa/workunits/ceph-helpers: display rejected string

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
 2017-04-13 22:24:03 +08:00
Kefu Chai
9acd868857 Merge pull request #14404 from tchaikov/wip-another-mgr-command 
mon,mgr: move reweight-by-* to mgr

Reviewed-by: Sage Weil <sage@redhat.com>
 2017-04-13 13:57:42 +08:00
Kefu Chai
ef7583d717 qa/suites: add mon-reweight-min-pgs-per-osd = 4 
so we can run reweight commands in a small cluster with 3 OSD and 27
PGs.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-12 23:29:10 +08:00
Mykola Golub
bf52a2a53b qa/workunits/rbd: diff.sh failed removing nonexistent file 
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-12 16:22:43 +02:00
Mykola Golub
9a80faa546 Merge pull request #14460 from dillaman/wip-qa-rbd-cli 
qa/workunits: corrected issues with RBD cli test

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-12 15:44:25 +03:00
Kefu Chai
6cb4503a40 qa/workunits/ceph-helpers: do not error out if is_clean 
it would be a race otherwise, because we cannot be sure that the cluster
pgs are not all clean or not when run_osd() returns, but we can be sure
that they are expected to active+clean after a while. that's what
wait_for_clean() does.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-12 17:32:44 +08:00
Kefu Chai
0196e154ed qa/workunits/ceph-helpers: display rejected string 
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-12 16:34:51 +08:00
Vasu Kulkarni
cb0427d241 use xfs for systemd tests 
bluestore options dont work yet as the tests use
ceph-deploy to setup cluster and they still assume
either xfs or btrfs

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-04-11 13:55:13 -07:00
Vasu Kulkarni
7af157ad4c use sudo to check check health 
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-04-11 13:52:26 -07:00
Jason Dillaman
15e5b8e3dc qa/workunits: corrected issues with RBD cli test 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-11 11:18:29 -04:00
Nathan Cutler
a5b19d2d73 tests: Thrasher: handle "OSD has the store locked" gracefully 
On slower machines (VPS, OVH) it takes time for the OSD to go down.

Fixes: http://tracker.ceph.com/issues/19556
Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2017-04-11 16:09:45 +02:00
Ricardo Dias
b844f58481
qa/workunits/rbd: cli testing of rbd trash commands 
Signed-off-by: Ricardo Dias <rdias@suse.com>
 2017-04-11 12:09:41 +01:00
Sage Weil
7e547a10b1 Merge pull request #13073 from chardan/jfw-wip-15475-admin_heap_command 
osd: add "heap *" admin command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-10 16:24:14 -05:00
Mykola Golub
712e7e9677 Merge pull request #14401 from dillaman/wip-rbd-import-fixes 
rbd: correct issues with image importing

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
 2017-04-10 22:23:53 +03:00
John Spray
d529121b60 Merge pull request #10636 from fullerdj/wip-djf-15069 
cephfs: Permit recovering metadata into a new RADOS pool

Reviewed-by: John Spray <john.spray@redhat.com>
 2017-04-10 13:52:04 +01:00
John Spray
fb046b9730 qa/tasks/cephfs: update kernel_mount for debugfs format 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-09 18:13:29 +01:00
Sage Weil
175e33bd5b Merge pull request #14130 from liewegas/wip-json-slash 
common/escape: do not escape / in json

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Dan Mick <dmick@redhat.com>
 2017-04-08 13:21:44 -05:00
Sage Weil
14e7d6351a Merge pull request #14198 from liewegas/wip-fs 
qa/suites: drop 'fs' facet, and add 'objectstore' facet where missing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-08 13:21:03 -05:00
Sage Weil
6db1193906 qa/workunits/cephtool/test.sh: handle non-escaped-/ json 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-04-08 14:19:00 -04:00
Jason Dillaman
a5d0d0ca08 qa/workunits: partial revert of commit 5b486d9 
Testing for disk usage and diff extents for a sparsely written
imported RBD image cannot generically be handled across different
OSD object stores and RBD image features.

The only alternatives would include grepping the rbd CLI
debug log for specific invocations of aio_write or mocking
the rbd CLI for unit testing.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2017-04-07 21:06:37 -04:00
Vasu Kulkarni
73cccd4115 push keys on node using admin command 
will test admin command and is now needed due to create-keys change

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-04-07 12:39:19 -07:00
John Spray
e0833965b6 qa: re-enable ENOSPC tests for kclient 
Fixes: http://tracker.ceph.com/issues/19550
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-07 14:45:30 +01:00
Kefu Chai
24e69d79e7 Merge pull request #14281 from tchaikov/wip-19429 
qa/tasks/workunit.py: use "overrides" as the default settings of workunit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-04-05 10:01:27 +08:00
Douglas Fuller
37bafff9f4 qa/cephfs: Add test for rebuilding into an alternate metadata pool 
Add a test to validate the ability of cephfs_data_scan and friends to
recover metadata from a damaged CephFS installation into a fresh metadata
pool.

cf: http://tracker.ceph.com/issues/15068
cf: http://tracker.ceph.com/issues/15069
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
 2017-04-04 12:29:01 -07:00
John Spray
f452256ff0 test: test cephfs pool ops with ec overwrites 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-04-04 11:32:53 +01:00
Ning Yao
5b486d9628 test: add test for rbd import,import-diff,copy with sparse-size option 
Signed-off-by: Ning Yao <yaoning@unitedstack.com>
 2017-04-04 03:18:52 +00:00
Casey Bodley
9730fec922 qa: s3test task scans radosgw logs for leaked encryption keys 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-03 10:44:58 -04:00
Casey Bodley
c97e7b95fa qa: disable ssl enforcement for encryption in s3tests 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-03 10:44:58 -04:00
Casey Bodley
33338a9bb2 qa: add test kms keys to config for rgw encryption 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-04-03 10:44:58 -04:00
John Spray
531118fbe8 Merge pull request #14221 from jcsp/wip-19253-b 
qa: whitelist another fullness log message

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
 2017-04-03 15:31:29 +01:00
John Spray
13e8315d1a Merge pull request #13862 from jcsp/wip-16523 
qa, mds: add checks for fragmentation, and enable it by default
 2017-04-03 11:56:37 +01:00
Jesse Williamson
fc4a4aa686 osd: heap profiling cleanups in response to review notes, build fixes. 
Signed-off-by: Jesse Williamson <jwilliamson@suse.de>
 2017-04-03 01:12:29 -07:00
Kefu Chai
47080150a1 qa/tasks/workunit.py: use "overrides" as the default settings of workunit 
otherwise the settings in "workunit" tasks are always overridden by the
settings in template config. so we'd better follow the way of how
"install" task updates itself with the "overrides" settings: it uses the
"overrides" as the *defaults*.

Fixes: http://tracker.ceph.com/issues/19429
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-04-02 12:26:30 +08:00
vasukulkarni
574049a90b Merge pull request #14229 from ceph/wip-systemd 
qa: Add reboot case for systemd test
 2017-03-31 09:15:53 -07:00
John Spray
992b8499d0 Merge pull request #14254 from idryomov/wip-vstart-runner-ps 
qa/vstart_runner: amend ps invocation

Reviewed-by: John Spray <john.spray@redhat.com>
 2017-03-31 17:15:30 +01:00
John Spray
bf39f561e9 qa: fix test_standby_for_invalid_fscid with vstart_runner 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-31 12:13:57 -04:00
Jesse Williamson
23c0264e4d osd: Add test for admin heap profiling command. 
Signed-off-by: Jesse Williamson <jwilliamson@suse.de>
 2017-03-31 01:22:59 -07:00
Kefu Chai
9ca7ccf5f1 tasks/workunit.py: specify the branch name when cloning a branch 
c1309fb failed to specify a branch when cloning using --depth=1, which
by default clones the HEAD. and we can not "git checkout" a specific
sha1 if it is not HEAD, after cloning using '--depth=1', so in this
change, we dispatch "tag", "branch", "HEAD" using three Refspec classes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Dan Mick <dan.mick@redhat.com>
 2017-03-30 20:30:09 -07:00
Sage Weil
578b0f7cfc Merge pull request #13617 from liewegas/wip-mgr-commands 
mon,mgr: tag some commands for ceph-mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-03-30 17:12:00 -05:00
Sage Weil
31419d0e0f mon/MgrMonitor: health warn/err if no active mgr 
Start warning once mons are luminous; start erroring once
require_luminous is set in osdmap.  Allow a grace period for
mgr to restart or standby to take over before we turn a warning
into an error.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-30 17:57:34 -04:00
Ilya Dryomov
8d8cd4e4d5 qa/vstart_runner: amend ps invocation 
"ps -xwwu<id>" is parsed as BSD, because -x is not a UNIX option.
"u" is a BSD option for user-oriented format, so the <id> ends up being
parsed as an old-style "select by pid".  The only reason this command
doesn't dump other user's processes is that the BSD "only yourself"
restriction is in effect.

I'm not sure what's wrong with a simple "ps xww", but if we want to
select by euid, let's do it right.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2017-03-30 19:36:43 +02:00
Vasu Kulkarni
1947648669 Fix distro's, point to latest version 
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-03-29 10:30:59 -07:00
Vasu Kulkarni
7b587304a5 Add reboot case for systemd test 
test systemd units restart after reboot

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-03-29 10:30:49 -07:00
Sage Weil
5dc9b8d026 qa/tasks/dump_stuck.py: stop making assertions about 'health' report 
Health comes from teh mon, while the pg stats come from teh mgr, so they
may be out of sync.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:27 -04:00
Sage Weil
8e61e1cfcf qa/suites/upgrade/jewel-x: don't initially start mgr daemons 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:26 -04:00
Sage Weil
2a073941a8 qa/releases/luminous.yaml: set up mgr key; start mgr 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:26 -04:00
Sage Weil
d403d42ac8 qa/suites/rados/upgrade: don't initially start mgr daemon 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:26 -04:00
Sage Weil
fa0b2164ad qa/tasks/ceph.py: add 'skip_mgr_daemons' option 
For upgrades

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:26 -04:00
Sage Weil
7edca203d8 qa/tasks/ceph.py: give everyone mgr caps 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:26 -04:00
Sage Weil
271a7588b5 qa/suites: run mgr daemon(s) 
Everything up upgrade/, which will be slightly tricky.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:26 -04:00
Sage Weil
accfd6ce88 qa/workunits/cephtool/test.sh: test_auth_profiles must include mgr 
For 'pg ...' commands

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:26 -04:00
Sage Weil
83b19dd1f1 qa/workunits/ceph-helpers: start and stop mgr daemons 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-29 11:39:25 -04:00
John Spray
f134b8f417 qa: whitelist another fullness log message 
Missed one in 03c996a9!

Fixes: http://tracker.ceph.com/issues/19253
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-29 11:27:58 +01:00
Dan Mick
c1309fbef3 tasks/workunit.py: when cloning, use --depth=1 
Help avoid killing git.ceph.com.  A depth 1 clone takes about
7 seconds, whereas a full one takes about 3:40 (much of it
waiting for the server to create a huge compressed pack)

Signed-off-by: Dan Mick <dan.mick@redhat.com>
 2017-03-28 20:09:44 -07:00
John Spray
2d1817e097 qa/suites: check dirfrag counter in cephfs workunits 
(just the ones which really do do enough work to generate
some fragmentation)

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-28 23:26:34 +01:00
John Spray
e90e37690a qa/tasks: add check_counter.py 
We need this for CephFS, to verify that workloads
we expect to do a particular thing (like directory fragmentation
or metadata exports) are really doing it.

This is for giving us confidence in our coverage of these
features rather than testing them per se.

Fixes: http://tracker.ceph.com/issues/16523
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-28 23:26:34 +01:00
Sage Weil
29a19dce30 qa/suites: add objectstore facet where it was missing 
There are places where we were testing xfs vs btrfs on
filestore and now want to cover both filestore and bluestore.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-28 12:03:41 -04:00
Sage Weil
73981ad807 qa/suites: remove 'fs' facet from all tests 
The objectstore facet now covers bluestore, filestore(xfs),
and filestore(btrfs).

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-28 11:57:21 -04:00
Sage Weil
208675afb1 qa/objectstore: split filestore into xfs and btrfs variants 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-28 11:54:56 -04:00
Sage Weil
35b60ae057 Merge pull request #13984 from liewegas/wip-osdmap-remap 
mon,osd: explicitly remap some pgs

Reviewed-by: Josh Durgin <jduring@redhat.com>
 2017-03-28 10:47:22 -05:00
Sage Weil
2a08cbbed5 qa/tasks/thrashosds,ceph_manager: thrash pg_remap[_items] 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-28 10:12:10 -04:00
John Spray
31fa2fe35f Merge pull request #13915 from jcsp/wip-19253 
qa: whitelist new fullness messages in fs tests
 2017-03-27 10:22:43 -04:00
Kefu Chai
1a9eae1b23 Merge pull request #13903 from wjwithagen/wip-wjw-run-classes-sed 
test: sed on FreeBSD requires "-i extension", so use gsed

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-03-23 16:08:22 +08:00
John Spray
03c996a9e8 qa: whitelist new fullness messages in fs tests 
Fixes: http://tracker.ceph.com/issues/19253
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-21 12:09:19 -04:00
Casey Bodley
e3e3a71d1f qa: rgw task uses period instead of region-map 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-03-20 11:50:03 -04:00
Willem Jan Withagen
0a91b76f2f test: use gsed on FreeBSD for inplace editting 
- FreeBSD sed(1) requires a extension on -i
   so replace the usuage with GNU sed: gsed

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2017-03-19 18:02:26 +01:00
Tamilarasi Muthamizhan
9885915e45 Merge pull request #13951 from smithfarm/wip-drop-obsolete-bt 
tests: drop obsolete Perl scripts
 2017-03-16 10:40:24 -07:00
Kefu Chai
bd36f13163 doc: fix the links to http://ceph.com/docs 
they should point to http://docs.ceph.com/docs/master/.. instead

Fixes: http://tracker.ceph.com/issues/19090
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-03-15 16:40:07 +08:00
John Spray
6586f32f35 Merge branch 'wip-omap-getkeys-mds' 2017-03-14 11:51:51 +00:00
Sage Weil
ecff8c6ce0 qa/suites/fs/basic: vary omap osd-side limit 
Ensure that the omap looping paths are exercised.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-14 11:51:25 +00:00
Josh Durgin
7852b80613 Merge pull request #13805 from tchaikov/wip-qa-upgrade-tiering 
qa/suites/upgrade: add tiering test to hammer-jewel-x

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-03-13 15:26:58 -07:00
Nathan Cutler
8c8af16a5d tests: drop obsolete Perl scripts 
None of these appear to be used by any tests currently in "master".

Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2017-03-13 23:19:43 +01:00
Yehuda Sadeh
515db13970 qa/tasks/radosgw_admin: adjust test to new bucket structure 
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-03-09 09:18:56 -08:00
Dan Mick
edeedf0256 qa/suites/upgrade/kraken-x: do not thrash cluster full during upgrade 
Same thing as 39fdc53fe5

Fixes: http://tracker.ceph.com/issues/19232
Signed-off-by: Dan Mick <dan.mick@redhat.com>
 2017-03-08 14:40:36 -08:00
Josh Durgin
12c4981087 Merge pull request #13852 from liewegas/wip-19133 
qa/suites: fix upgrade tests vs cluster full thrashing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-03-08 07:47:49 -08:00
Sage Weil
deab3e783c Merge pull request #13711 from tmuthamizhan/wip-add-supported-distros 
qa: add supported distros for ceph-ansible

Reviewed-by: Yuri Weinstein <yweinstei@redhat.com>
 2017-03-08 09:35:50 -06:00
John Spray
41f8ded3e7 qa: update TestDamage for PurgeQueue 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-08 10:27:03 +00:00
John Spray
1a1951002d qa: update TestFlush for changed stray perf counters 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-08 10:27:03 +00:00
John Spray
6cf9c2956c qa: add TestStrays.test_purge_queue_op_rate 
For ensuring that the PurgeQueue code is not generating
too many extra IOs.

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-08 10:27:02 +00:00
John Spray
3e66de2182 mds: create purge queue if it's not found 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-08 10:26:59 +00:00
John Spray
f826c7e8aa qa/cephfs: add TestStrays.test_purge_on_shutdown 
...and change test_migration_on_shutdown to
specifically target non-purgeable strays (i.e.
hardlink-ish things).

Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-08 10:26:55 +00:00
John Spray
3970502c9b qa: update test_strays for purgequeue 
Signed-off-by: John Spray <john.spray@redhat.com>
 2017-03-08 10:20:59 +00:00
Nathan Cutler
799fd70ee3 Merge pull request #12506 from SUSE/wip-18259 
Revert "dummy: reduce run time, run user.yaml playbook"

Reviewed-by: Loic Dachary <ldachary@redhat.com>
 2017-03-08 09:33:46 +01:00
Sage Weil
39fdc53fe5 qa/suites/upgrade/jewel-x: do not thrash cluster full during upgrade 
The mon command varies.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-07 22:35:02 -05:00
Sage Weil
582a19f1e0 qa/suite/rados/upgrade: do not thrash full cluster during upgrade 
The mon command varies!

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-07 22:34:37 -05:00
Sage Weil
a68106934c Merge pull request #13615 from liewegas/wip-osd-full 
mon,osd: new mechanism for managing full and nearfull OSDs for luminous

Reviewed-by: David Zafman <dzafman@redhat.com>
 2017-03-07 21:33:14 -06:00
Sage Weil
7fbe8fb085 Merge pull request #13759 from liewegas/wip-19133 
osdc/Objecter: resend RWORDERED ops on full

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2017-03-07 21:31:50 -06:00
Sage Weil
71db343636 Merge pull request #13734 from liewegas/wip-jewel-x 
qa/suite/upgrade/jewel-x: various fixes

Reviewed-by: Yuri Weinstein <yweinstei@redhat.com>
 2017-03-07 21:25:13 -06:00
Sage Weil
296708091c qa/tasks/ceph_manager: use new luminous set-full-ratio etc 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-07 16:39:09 -05:00
Sage Weil
a202b68d18 qa/tasks/thrashosds: chance_thrash_cluster_full 
Induce a momentarily full cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-07 13:33:44 -05:00
Radoslaw Zarzynski
6440750f53 qa/tasks/rgw.py: start Apache before RadosGW. 
At the end of start_rgw() we wait till establishing HTTP connections
with RadosGW become possible. However, if RadosGW uses the FastCGI,
the condition can't be fulfilled without spawning HTTP server first.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
 2017-03-07 17:31:52 +01:00
John Spray
73100305e5 Merge pull request #13262 from batrick/multimds-thrasher 
Add multimds:thrash sub-suite and fix bugs in thrasher for multimds

Reviewed-by: John Spray <john.spray@redhat.com>
 2017-03-07 14:29:18 +00:00
Sage Weil
3c80e15c3b qa/suites/upgrade/jewel-x/parallel: upgrade mons before osds 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-06 22:02:19 -05:00
Sage Weil
1a0ad2b488 qa/suites/upgrade/jewel-x/parallel: expand workload matrix 
These should run independently against a racing upgrade.

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-06 22:02:19 -05:00
Sage Weil
03287f7d22 qa/workunits/cephtool/test.sh: change [near]full_ratio tests 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-06 16:42:34 -05:00
Josh Durgin
3580d224d7 Merge pull request #13755 from liewegas/wip-19131 
osd/osd_internal_types: wake snaptrimmer on put_read lock, too

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2017-03-06 12:48:25 -08:00
Sage Weil
b2d354d563 qa/suites/upgrade/jewel-x/stress-split-erasure-code: box thrashosds 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-06 14:11:53 -05:00
Sage Weil
56f9387736 qa/suites/upgrade/jewel-x/stress-split: finish client.0 upgrade too 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-06 14:07:53 -05:00
Sage Weil
ef6da79502 Merge pull request #13379 from jecluis/wip-mon-luminous-features 
mon: enable luminous monmap feature on full quorum

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2017-03-06 10:46:08 -06:00
Kefu Chai
e8c04a027b qa/suites/upgrade: add tiering test to hammer-jewel-x 
Related: http://tracker.ceph.com/issues/19185
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2017-03-06 19:00:18 +08:00
Kefu Chai
f903f2f3fd Merge pull request #13228 from trociny/wip-qa-rbd_mirror-opts 
qa/workunits/rbd: tweak rbd-mirror config to spead up testing

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2017-03-06 12:07:23 +08:00
Sage Weil
468285b65d qa/suites/upgrade/jewel-x: remove kraken references 
Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-05 14:14:40 -05:00
Sage Weil
8ef5c56ae5 qa/suites/rados/thrash: add no-thrash item to matrix 
Run all of our cases with no thrashing.  This would have uncovered
http://tracker.ceph.com/issues/19131 much sooner!

Signed-off-by: Sage Weil <sage@redhat.com>
 2017-03-03 10:07:43 -06:00