Commit Graph

2645 Commits

Author SHA1 Message Date
Yuri Weinstein
db8db6bf38 Merge pull request #316 from ceph/wip-9183-wusui
Fix return from schedule_suite.
2014-08-20 14:55:55 -07:00
Warren Usui
171cb69f13 Fix return from schedule_suite.
Schedule_suite returns the number of jobs scheduled (accounting for
filters).  Information displayed also indicates how many jobs were
run and how many were filtered out.

Fixes: 9183
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-20 13:19:13 -07:00
Zack Cerza
684e4a6fc4 Merge pull request #309 from ceph/wip-8954-wusui
Add filter and filter-out options to suites.
2014-08-19 12:54:12 -06:00
Sage Weil
fe32e2210d valgrind: make trusty tcmalloc supporession more general
To capture this:

  <kind>SyscallParam</kind>
  <what>Syscall param msync(start) points to unaddressable byte(s)</what>
  <stack>
    <frame>
      <ip>0x5081B3D</ip>
      <obj>/lib/x86_64-linux-gnu/libpthread-2.19.so</obj>
      <dir>/build/buildd/eglibc-2.19/nptl/../sysdeps/unix</dir>
      <file>syscall-template.S</file>
      <line>81</line>
    </frame>
    <frame>
      <ip>0x76BA123</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BCEF6</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BE151</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BE4E8</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BAA30</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
      <fn>_ULx86_64_step</fn>
    </frame>
    <frame>
      <ip>0x5C42052</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>GetStackTrace(void**, int, int)</fn>
    </frame>
    <frame>
      <ip>0x5C349F4</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>tcmalloc::PageHeap::GrowHeap(unsigned long)</fn>
    </frame>
    <frame>
      <ip>0x5C34D02</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>tcmalloc::PageHeap::New(unsigned long)</fn>
    </frame>
    <frame>
      <ip>0x5C25D0C</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
    </frame>
    <frame>
      <ip>0x5C46378</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>operator new[](unsigned long)</fn>
    </frame>

Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-19 11:16:22 -07:00
Zack Cerza
0526c6bc6b Use suite_path, if set, for one-off jobs as well
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-19 11:54:13 -06:00
Warren Usui
8346ac4363 Add filter and filter-off suite options.
Filter only runs suite jobs that contain the text passed as part of
their description or in the names of the composite set of yaml files.
Filter-off only runs suite jobs that do not contain the text passed
as either their description or in the names of the composite set of
yaml files.
Fixes: 8954
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-18 20:55:01 -07:00
Zack Cerza
9cfa67edec Merge pull request #313 from ceph/wip-rhel
install: use rhel builder for rhel
2014-08-18 13:49:54 -06:00
Zack Cerza
a9274e08b2 Merge pull request #315 from ceph/wip-8877
Skip nuke and just destroy VPS if nuke is --unlock
2014-08-18 13:11:46 -06:00
Sandon Van Ness
d9f3c9f690 Skip nuke and just destroy VPS if nuke is --unlock
If the machine is being unlocked after than we definitely want to
just destroy it. This way nukes will always suceed with --unlock
even if the guest is down or in a borked state.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-08-18 11:51:26 -07:00
Sage Weil
21dd85acc4 install: use rhel builder for rhel
Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-16 15:01:34 -07:00
Sage Weil
d462c7a4e7 Merge pull request #312 from ceph/wip-tls-leak
valgrind: ignore TLS leak in glibc
2014-08-15 21:03:28 -07:00
Sage Weil
c014ff949f valgrind: suppress eglibc leak of TLS
<error>
  <unique>0xf9</unique>
  <tid>1</tid>
  <kind>Leak_PossiblyLost</kind>
  <xwhat>
    <text>320 bytes in 1 blocks are possibly lost in loss record 248 of 289</text>
    <leakedbytes>320</leakedbytes>
    <leakedblocks>1</leakedblocks>
  </xwhat>
  <stack>
    <frame>
      <ip>0x4C29DB4</ip>
      <obj>/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so</obj>
      <fn>calloc</fn>
    </frame>
    <frame>
      <ip>0x4012074</ip>
      <obj>/lib/x86_64-linux-gnu/ld-2.15.so</obj>
      <fn>_dl_allocate_tls</fn>
      <dir>/build/buildd/eglibc-2.15/elf</dir>
      <file>dl-tls.c</file>
      <line>297</line>
    </frame>
    <frame>
      <ip>0x5289ABC</ip>
      <obj>/lib/x86_64-linux-gnu/libpthread-2.15.so</obj>
      <fn>pthread_create@@GLIBC_2.2.5</fn>
      <dir>/build/buildd/eglibc-2.15/nptl</dir>
      <file>allocatestack.c</file>
      <line>571</line>
    </frame>
    <frame>
      <ip>0xA6A89A</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>Thread::try_create(unsigned long)</fn>
      <dir>/srv/autobuild-ceph/gitbuilder.git/build/out~/ceph-0.83-444-ge74ad5f/src/common</dir>
      <file>Thread.cc</file>
      <line>112</line>
    </frame>
    <frame>
      <ip>0xA6A94E</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>Thread::create(unsigned long)</fn>
      <dir>/srv/autobuild-ceph/gitbuilder.git/build/out~/ceph-0.83-444-ge74ad5f/src/common</dir>
      <file>Thread.cc</file>
      <line>122</line>
    </frame>

...

ubuntu@teuthology:/a/teuthology-2014-08-13_23:04:01-fs-next-testing-basic-multi/423897

Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-15 06:28:19 -07:00
Zack Cerza
7418cc1bfd Perform some sanity checks on --name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-14 10:20:40 -06:00
Zack Cerza
5f82596c98 Make --name required
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-14 10:20:27 -06:00
Zack Cerza
1d605c22d9 Don't fetch the suite if we can already find it
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-13 13:39:00 -06:00
Zack Cerza
da1e40d2fd Attach FileHandlers to the RootLogger object
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-13 13:10:15 -06:00
Zack Cerza
591b511fdc Don't remove lockfiles
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:28:20 -06:00
Zack Cerza
db92ae3b9a Add retries to fetch_teuthology()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:13:29 -06:00
Zack Cerza
ebf3cb3a24 Add BootstrapError
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:07:39 -06:00
Zack Cerza
dd9ee971d7 If bootstrap fails, remove the virtualenv
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:02:04 -06:00
Zack Cerza
a948baaf62 Fix another variable name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 12:54:05 -06:00
Zack Cerza
663060dd5a Add message to exception log
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 10:46:29 -06:00
Zack Cerza
b25b095ff3 Add retries to fetch_qa_suite()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 10:41:23 -06:00
Zack Cerza
dda184b578 Use GitError instead of RuntimeError
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 10:38:00 -06:00
Zack Cerza
36a7e69a75 Add GitError
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 10:36:51 -06:00
Zack Cerza
f34edd744d Fix some variable naming
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 10:26:34 -06:00
Zack Cerza
d32890de42 Merge pull request #310 from ceph/wip-valgrind
misc: pass premable through when no valgrind
2014-08-12 10:24:58 -06:00
Sage Weil
a5bb9d9552 misc: pass premable through when no valgrind
Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-11 17:31:57 -07:00
Zack Cerza
293c2bd49c Be more informative if owner info is missing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-11 14:55:49 -06:00
Zack Cerza
edfeffe3dd Fix format string
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-11 14:20:33 -06:00
Zack Cerza
2e7cf59395 Don't redefine 'remote'
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-11 14:18:50 -06:00
Zack Cerza
1720eee33d Don't import from inside functions
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-11 14:14:45 -06:00
Zack Cerza
e09a6ebdce Attempt fetches on init, before running jobs
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-08 13:20:25 -06:00
Zack Cerza
32485e7503 Also rmtree on RuntimeError
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-08 13:18:44 -06:00
Zack Cerza
35b82675a5 Disable pyc removal for now
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-08 13:11:52 -06:00
Zack Cerza
7b9db2f41b Bump all log levels to info
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-08 11:43:46 -06:00
Zack Cerza
28535846d0 Default to using the master branch of teuthology
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 12:11:13 -06:00
Zack Cerza
1f957a6a9e For non-scheduled jobs, check out the suite repo.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
7912fd5742 After resetting a repo, remove all pyc files
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
ba7a2dad39 Make teuthology-{suite,worker} share repo code
Repo-fetching code, that is.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
f7d882c24e Reimplement the file locker as a context manager
Also give it a 'noop' flag to enable its callers to optionally not use
locking.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
14015af475 Move exception into a new exceptions module
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:42 -06:00
Zack Cerza
6807a10d27 Move functions into repo_utils
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:41 -06:00
Zack Cerza
76a93fd3e1 Fix NameError
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-07 11:13:23 -06:00
Zack Cerza
a677b4f2a9 Correctly find both internal and external tasks
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-06 10:06:35 -06:00
Zack Cerza
5b5f02ecd2 Remove most ceph-specific tasks. They are in ceph-qa-suite now.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-06 10:06:34 -06:00
Zack Cerza
d5f26aaf6a Merge pull request #306 from ceph/wip-9024
ignore errors if 'ps aux' fails
2014-08-06 09:42:49 -06:00
Alfredo Deza
f9aa9c1e64 ignore errors if 'ps aux' fails
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-08-06 10:53:21 -04:00
Zack Cerza
b93abaf5d3 Merge pull request #305 from ceph/wip-8640
implement `--version` and improve `setup.py`
2014-08-04 14:38:29 -06:00
Alfredo Deza
fe6f46114a create a --version flag for teuthology
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-08-04 15:12:06 -04:00