Commit Graph

331 Commits

Author SHA1 Message Date
Loic Dachary
fc39550933 ensure summary is looked for the user we need (part 2)
Move the get_user_summary(out, user) logic to util.rgw so that it can be
shared between radosgw_admin_rest.py and radosgw_admin.py and modify
them accordingly.

http://tracker.ceph.com/issues/11180 Fixes: #11180

Signed-off-by: Loic Dachary <loic@dachary.org>
(cherry picked from commit 97e6d808f0)
2015-03-24 13:37:41 -04:00
Loic Dachary
97e6d808f0 ensure summary is looked for the user we need (part 2)
Move the get_user_summary(out, user) logic to util.rgw so that it can be
shared between radosgw_admin_rest.py and radosgw_admin.py and modify
them accordingly.

http://tracker.ceph.com/issues/11180 Fixes: #11180

Signed-off-by: Loic Dachary <loic@dachary.org>
2015-03-22 21:07:51 +01:00
David Zafman
6c5300552d ceph_manager: Check for exit status 11 from ceph-objectstore-tool import
Fixes: #11139

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-03-20 21:25:41 -07:00
Gregory Meno
798f31d836 Merge pull request #371 from ceph/wip-iso-style
Add support for ISOs to tasks/calamari_setup
2015-03-20 20:33:53 -04:00
Dan Mick
c571e65671 calamari_setup: oops: ice-tools is still where it was on github.com
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-20 17:28:10 -07:00
Alfredo Deza
b6c2e978d6 ensure summary is looked for the user we need
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f7ea0a424a)
2015-03-20 13:23:02 -04:00
Alfredo Deza
f7ea0a424a ensure summary is looked for the user we need
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-03-20 09:27:05 -04:00
Gregory Meno
81c493c99f calamari_setup: add -y to yum localinstall icesetup
also fix a few flake8 things

Signed-off-by: Ubuntu <ubuntu@vpm047.front.sepia.ceph.com>
2015-03-19 20:14:52 +00:00
Dan Mick
93c0b8a0bd calamari_setup: handle iso, preserving support for tar.gz
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-18 18:03:21 -07:00
Dan Mick
da668abb92 calamari_setup: small comment/logmsg fixes, correct git user path
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-18 18:03:18 -07:00
Dan Mick
9087b7da12 calamari_setup: make iceball fetch/creators return path to iceball
Also, widen the concept of "iceball" to include both iso and tar.gz

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-03-18 17:16:53 -07:00
Dan Mick
34e7544e12 calamari_setup: Refactor/simplify in preparation for iso support
Signed-off-by: Gregory Meno <gmeno@redhat.com>
2015-03-18 17:16:41 -07:00
John Spray
7ad8ac63fc tasks/cephfs: clean up core on deliberate crash
To avoid internal.coredump task synthesizing a failure
during teardown from the core we left behind.

Fixes: #10949
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-04 19:13:43 +00:00
Andrew Schoen
d2b52d977b Control the nfs service correctly on rpm-based systems
This fixes issue #11020

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 2e4d884fda)
2015-03-04 10:10:01 -06:00
Andrew Schoen
7402d5f1a9 Fixes #11013, use time.sleep instead of manager.sleep which isn't there.
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 811c02e392)
2015-03-04 10:09:21 -06:00
Andrew Schoen
2e4d884fda Control the nfs service correctly on rpm-based systems
This fixes issue #11020

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2015-03-04 08:57:03 -06:00
Andrew Schoen
811c02e392 Fixes #11013, use time.sleep instead of manager.sleep which isn't there.
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2015-03-03 16:42:59 -06:00
John Spray
1647453d66 Merge pull request #356 from ceph/wip-10948
tasks/cephfs: don't run iptables in parallel

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-03-03 20:25:09 +00:00
John Spray
386b6feaaf Merge pull request #358 from ceph/wip-10712
tasks: fix intermittent failure in TestFlush

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-03-03 11:42:09 +00:00
Andrew Schoen
cdaa11d427 Use an NFS mount instead of virtio-9p in the qemu task
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 93f2bea353)
2015-03-02 15:45:10 -08:00
Greg Farnum
0c9fb0f7be workunit: include /usr/sbin in the PATH for all commands
Fixes: #10600

Backport: hammer, giant, firefly, dumpling

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
(cherry picked from commit 0e53f5f38b)
2015-03-02 11:29:24 -08:00
Alfredo Deza
d25aa7bdc1 rename test to tests, follows best practices for tests dirs
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7b2062602f)
2015-03-02 11:20:35 -08:00
Alfredo Deza
b0ac3516e3 create a new get_acl helper to ensure proper xml is compared
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9b6ff63873)
2015-03-02 11:20:23 -08:00
Alfredo Deza
20a1ae72ef tests for the new acl helper in radosgw_admin
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 3801ac9357)
2015-03-02 11:20:11 -08:00
John Spray
d20d9238cd tasks: fix intermittent failure in TestFlush
This was an overly strict success condition: the
flush operation doesn't promise to leave you an empty
journal, it promises that anything in the journal
before the flush will be flushed.

Fixes: #10712
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-02 12:53:01 +00:00
John Spray
5b2fd3d614 tasks/cephfs: don't run iptables in parallel
Where multiple MDSs were on the same node, trying
to concurrently update their firewall state was
causing an exception because the iptables command
errors out if another instance is already running.

Fixes: #10948
Signed-off-by: John Spray <john.spray@redhat.com>
2015-03-02 12:41:13 +00:00
John Spray
fc4e90930b tasks/cephfs: fix/improve fuse force umount (again)
teuthology helpfully escapes things for us so
the \; didn't need the backslash.  The logic
was still falling over in some cases too.

Additionally, make the FUSE /sys/ abort operation
more surgical by working out the connection name
of our own mount during mount().

Signed-off-by: John Spray <john.spray@redhat.com>
2015-02-26 23:08:33 +00:00
Alfredo Deza
a8a29760f0 remove unused import from repair_test
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 15:04:02 -05:00
Alfredo Deza
9157622ef7 remove unused variable assignment
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9df27f7a10)
2015-02-26 15:02:07 -05:00
Alfredo Deza
3f3ce53fde remove unused import from fuse
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 14:55:02 -05:00
Alfredo Deza
35224e3dda remove uneeded variable assignment for call
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0a65e90db2)
2015-02-26 14:54:14 -05:00
Alfredo Deza
976773a5d0 remove unused import in calamari_setup
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d22cd6917b)
2015-02-26 14:53:35 -05:00
Alfredo Deza
e8e1e7ee5e remove unused imports from populate_rbd
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 959c491462)
2015-02-26 14:52:58 -05:00
Alfredo Deza
28d3075266 remove unused imports from peering_speed
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 6d45352782)
2015-02-26 14:52:40 -05:00
Alfredo Deza
5018e91c1e remove redefined StringIO import
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 3a18cb29a8)
2015-02-26 14:48:53 -05:00
Alfredo Deza
4ed442e44c stdin is no longer a kwarg
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 49a61dc2d2)
2015-02-26 14:48:40 -05:00
Alfredo Deza
33f7982480 add the log object to ceph_manager
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f7c1ca4a1e)
2015-02-26 14:48:30 -05:00
Alfredo Deza
9cdd278d08 add missing mon object to osd_failsafe
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 1673be45c0)
2015-02-26 14:47:35 -05:00
Alfredo Deza
744bc3802e fix undefined var in divergent_priors
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 26c5a82af9)
2015-02-26 14:47:08 -05:00
Alfredo Deza
0a65e90db2 remove uneeded variable assignment for call
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:35:31 -05:00
Alfredo Deza
3a18cb29a8 remove redefined StringIO import
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:35:07 -05:00
Alfredo Deza
49a61dc2d2 stdin is no longer a kwarg
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:34:21 -05:00
Alfredo Deza
f7c1ca4a1e add the log object to ceph_manager
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:33:47 -05:00
Alfredo Deza
920552a266 remove unused import from repair test
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:32:09 -05:00
Alfredo Deza
1673be45c0 add missing mon object to osd_failsafe
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:31:31 -05:00
Alfredo Deza
959c491462 remove unused imports from populate_rbd
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:27:11 -05:00
Alfredo Deza
6d45352782 remove unused imports from peering_speed
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:26:42 -05:00
Alfredo Deza
9df27f7a10 remove unused variable assignment
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:26:15 -05:00
Alfredo Deza
d22cd6917b remove unused import in calamari_setup
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:25:12 -05:00
Alfredo Deza
26c5a82af9 fix undefined var in divergent_priors
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:24:41 -05:00
Alfredo Deza
e4ba81700b fix lint errors on ceph_fuse
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-26 11:20:19 -05:00
Sage Weil
55c11a3b41 ceph: ugh fix syntax
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1922c61bbf)
2015-02-25 11:38:12 -08:00
Sage Weil
1922c61bbf ceph: ugh fix syntax
Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-25 11:37:44 -08:00
Yuri Weinstein
fea2e22774 Fixes #10869, added {role} to the dir name.
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
(cherry picked from commit 9942440ddf9f6847e76de3b49f1ad0d98c62a3d0)
2015-02-25 11:30:59 -08:00
Sage Weil
5be8b8ef17 ceph: fix ps axuf lsof line
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 18307be0ca)
2015-02-25 11:05:42 -08:00
Sage Weil
18307be0ca ceph: fix ps axuf lsof line
Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-25 11:05:13 -08:00
Kefu Chai
64de3cd574 Thrasher: log backtrace of thrown exception
* add a wrapper to log uncaught exception to self.logger, greenlet also
  prints the backtrace and exception to stderr, but teuthology.log does
  not capture stderr. so we need to catch them by ourselves to reveal
  more info to root-cause this issue.
* log uncaught exception thrown by Thrasher.do_thrash() to self.log.

See: #10630
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-02-25 16:10:52 +08:00
Andrew Schoen
93f2bea353 Use an NFS mount instead of virtio-9p in the qemu task
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2015-02-24 12:47:58 -06:00
Sage Weil
1ee621683a ceph: ps axf too before lsof
Specifically, I want to know *who* is running the ceph-osd that is
holding the files open.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit a68281e147)
2015-02-24 06:59:55 -08:00
Sage Weil
a68281e147 ceph: ps axf too before lsof
Specifically, I want to know *who* is running the ceph-osd that is
holding the files open.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-24 06:59:16 -08:00
Greg Farnum
0e53f5f38b workunit: include /usr/sbin in the PATH for all commands
Fixes: #10600

Backport: hammer, giant, firefly, dumpling

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-02-23 21:05:04 -08:00
Sage Weil
508270be76 Merge pull request #313 from armaseg/master
teuthology: some suites still use http://ceph.newdream.net
2015-02-23 21:01:45 -08:00
Sage Weil
0365f8b68d ceph: lsof if umount fails
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 077e917af1)
2015-02-23 17:01:00 -08:00
Sage Weil
97fb9d8ed6 ceph: archive logs at very end
This ensures that we still gather the logs even if the other nested tasks
throw an exception in the finally block.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit ca09683f5f)
2015-02-23 17:00:57 -08:00
Sage Weil
077e917af1 ceph: lsof if umount fails
Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-23 13:52:48 -08:00
Sage Weil
ca09683f5f ceph: archive logs at very end
This ensures that we still gather the logs even if the other nested tasks
throw an exception in the finally block.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-02-23 13:52:48 -08:00
Yuri Weinstein
2df632e54d Fixes #10869, added {role} to the dir name.
Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>

Fixed typo

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
2015-02-13 09:09:36 -08:00
David Zafman
ca04dc65c1 Thrasher: Fix log message
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-02-12 11:54:59 -08:00
Alfredo Deza
7b2062602f rename test to tests, follows best practices for tests dirs
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-11 11:25:45 -05:00
Alfredo Deza
9b6ff63873 create a new get_acl helper to ensure proper xml is compared
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-11 11:24:44 -05:00
Alfredo Deza
3801ac9357 tests for the new acl helper in radosgw_admin
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2015-02-11 11:14:59 -05:00
John Spray
03b0e1064c tasks/cephfs: fix fuse force unmount
This was broken in the case of multiple
mounts, and in the case of stuck mounts.

Fixes: #10702
Signed-off-by: John Spray <john.spray@redhat.com>
2015-02-10 14:58:23 +00:00
Dan Mick
4b6fa9dbb4 tasks/calamari_setup: ice_setup 0.2.0 has added another prompt
Add an extra '\n' to the interaction string to answer it

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2015-02-06 17:33:53 -08:00
Zack Cerza
51f75079e2 Merge pull request #322 from ceph/wip-10753
Add labels to a couple common task failures
2015-02-04 15:02:10 -07:00
Andrew Schoen
a965d6ca14 Add labels to a couple common task failures
The labels will help us quickly determine what the command was trying to
accomplish in log output.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2015-02-04 15:42:40 -06:00
John Spray
8ed4f120d6 Merge pull request #316 from ceph/wip-active-asok-10361
mds_scrub_checks: only direct ops at the active MDS

Reviewed-by: John Spray <john.spray@redhat.com>
2015-01-28 13:59:48 +00:00
Sage Weil
a76f5ce01b Merge pull request #296 from majianpeng/master
rados.py: Add write_fadvise_dontneed field
2015-01-27 12:56:31 -08:00
Sage Weil
4c22dac311 Merge pull request #302 from ceph/wip-crush-tunables
ceph: set crush tunables
2015-01-27 11:26:10 -08:00
Greg Farnum
8d2715eb45 mds_scrub_checks: only direct ops at the active MDS
Change the config option from mds_id to mds_rank to reflect the
fact that it's the rank we want to make use of (and will continue
to want when we're doing stuff like force exporting from one rank
to another).

Fixes: #10361

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-01-27 11:17:04 -08:00
Josh Durgin
333b4445df Merge remote-tracking branch 'origin/next' 2015-01-27 09:37:19 -08:00
Sage Weil
9e9d7c91eb ceph: set crush tunables
Signed-off-by: Sage Weil <sage@redhat.com>
2015-01-26 13:42:56 -08:00
Zack Cerza
695f6c22f0 Merge pull request #314 from ceph/wip-wait-for-failure
ceph: test pg removal interruption; add ceph daemon failur einjection support
2015-01-26 12:26:14 -07:00
Gregory Farnum
7e5619dc2c Merge pull request #303 from ceph/wip-10388
tasks/mds_flush: use new stray/purge perfcounters

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-01-23 17:10:06 -08:00
Greg Farnum
41a99f58cc mds_flush: fix the flush test output expectations
Fixes: #10620

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-01-23 15:24:02 -08:00
Sage Weil
cb74060cd4 ceph: no need to stop() before restart()
restart() will stop if the daemon is running.  This will get rid of the
spurious error

2015-01-23 15:19:36,828.828 ERROR:tasks.ceph.osd.0:tried to stop a non-running daemon

when the daemon isn't already running.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-01-23 15:21:31 -08:00
Sage Weil
83dd3d58a1 ceph: add wait_for_failure command
Expect and then ignore a daemon failure.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-01-23 15:20:50 -08:00
Armando Segnini
9ace238e87 teuthology: some suites still use http://ceph.newdream.net
This probably redirects to http://ceph.com but ceph.newdream.net still appears in some places

http://tracker.ceph.com/issues/9922 Fixes: #9922

Signed-off-by: Armando Segnini  <armando.segnini@telecom-bretagne.eu>
2015-01-23 11:13:11 +01:00
David Zafman
e5876126a9 Formatting changes 2015-01-21 09:08:44 -08:00
David Zafman
14e27650a6 Fix wrapped line 2015-01-21 09:08:44 -08:00
David Zafman
bff2358373 Fix objectstore name changed to keyvaluestore
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
b239dadc02 ceph_manager: Fix Thrasher kill_osd() to ignore pool going away
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
4eda2967a4 ceph_manager: Thrasher fixes to run() calls to set check_status = False
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
e0b0d41e4c ceph_manager: Re-enable Thrasher ceph-objectstore-tool testing
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
4a195c78c1 ceph_manager: In Thrasher randomly remove past intervals
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
David Zafman
f9e088fcbc ceph_manager: In Thrasher disable ceph_objectstore_tool tests if old release missing command
Require ceph-objectstore-tool to be available on all OSD nodes
Log a message when tool is not available

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-01-21 09:08:44 -08:00
John Spray
a6b8e823f4 tasks/mds_flush: use new stray/purge perfcounters
Where previously we only tracked RADOS-level delete
ops during deletion, now also verify that they
correspond to the right number of MDS-level purge
operations.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-19 22:00:53 +00:00
John Spray
2c1cef6b5d tasks/mds_journal_repair: add test_table_tool
Explicit test of the tool's various modes, to
complement the places it's used in other tests.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-19 19:36:34 +00:00
John Spray
bf13a4e062 tasks/mds_journal_repair: create new test
This tests the new #9883 repair functionality
where we selectively scrape dentries out of
the journal while the MDS is offline.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-01-19 19:36:34 +00:00
Alfredo Deza
a6bca74722 Merge pull request #298 from ceph/wip-bi-sharding-3
Wip bi sharding 3
2015-01-19 12:17:27 -05:00
Andrew Schoen
b1d9f602c4 Merge pull request #288 from dmick/master
Tweaks to calamari-setup
2015-01-15 16:01:30 -06:00