Commit Graph

2676 Commits

Author SHA1 Message Date
Zack Cerza
9ac40cc72a Use new vm_host attribute
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:39 -06:00
Zack Cerza
92157d2b78 Don't dump all vm_host details when listing
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:39 -06:00
Zack Cerza
213bdc8b86 Reflect updated field names
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:39 -06:00
Zack Cerza
f5a6ed3b7a Update provision module to use new lock server
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
b8cb0890a2 Use Remote.shortname instead of regex
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
4eda1d3273 Add unlock_many() and use it when possible
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
e6e393239b Update internal task to use new lockserver
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
b9d7a9dec0 Make far less requests when simply locking
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
40c1ee0442 Optimize some list_locks() calls
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
e0aca2e6d7 Properly query for multiple machine types
...in list_locks()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
fb96923304 Use consistent URI for lock server
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
24efd83dfc Remove old lock server
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
c406985268 Change default lock server to paddles
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
aef78f4b3d Use /nodes/ as the lock server endpoint
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
96b0a1c026 Update to use new ssh-keyscan API
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
b170345bda Rewrite ssh public key updating
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
1c04c7aff3 Use new ssh_keyscan() function
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
5e5c32ef79 No need to be passing ctx to update_lock()
... or update_keys() or scan_for_locks()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
8048dc348c Add new ssh_keyscan() method
This is just a cleaner implementation that will replace the existing
one(s).

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
1d1697213f Re-order functions in module
This is for readability.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
0f772222a4 keyscan_check(): don't require ctx to be passed
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
bdc9e6e8c9 Update lock_many(), update_lock(), and main()
Also remove lockstatus.send_request()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
f5f1115881 Fix PEP-8 issues
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
53a2c2f2d5 Refactoring
Create a new teuthology.provision module and move virtual machine
functions there. Move hostname manipulation functions to
teuthology.misc.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
af2a03a8a5 Update do_summary()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
533a5c5d8c Rewrite list_locks()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Zack Cerza
121fd02671 Make (de)canonicalize_hostname() work without user
Add tests proving they still work *with* usernames as well.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Zack Cerza
fe4bf33262 Add unit tests for (de)canonicalize_hostname()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Zack Cerza
04b319d847 Update/rewrite several functions to use paddles
Functions updated: lock.lock_one(), lock.unlock_one(),
lock.destroy_if_vm(), lockstatus.get_status()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Sage Weil
692e5a1db9 ceph.conf: mon reweight min pgs per osd = 4
So teh cephtool reweight-by-pg test will pass with mini clusters.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-22 15:14:58 -07:00
Zack Cerza
8dbb1d5fb9 Add --suite-path
Slightly less ugly than setting PYTHONPATH

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-21 16:11:19 -06:00
Yuri Weinstein
db8db6bf38 Merge pull request #316 from ceph/wip-9183-wusui
Fix return from schedule_suite.
2014-08-20 14:55:55 -07:00
Warren Usui
171cb69f13 Fix return from schedule_suite.
Schedule_suite returns the number of jobs scheduled (accounting for
filters).  Information displayed also indicates how many jobs were
run and how many were filtered out.

Fixes: 9183
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-20 13:19:13 -07:00
Zack Cerza
684e4a6fc4 Merge pull request #309 from ceph/wip-8954-wusui
Add filter and filter-out options to suites.
2014-08-19 12:54:12 -06:00
Sage Weil
fe32e2210d valgrind: make trusty tcmalloc supporession more general
To capture this:

  <kind>SyscallParam</kind>
  <what>Syscall param msync(start) points to unaddressable byte(s)</what>
  <stack>
    <frame>
      <ip>0x5081B3D</ip>
      <obj>/lib/x86_64-linux-gnu/libpthread-2.19.so</obj>
      <dir>/build/buildd/eglibc-2.19/nptl/../sysdeps/unix</dir>
      <file>syscall-template.S</file>
      <line>81</line>
    </frame>
    <frame>
      <ip>0x76BA123</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BCEF6</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BE151</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BE4E8</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
    </frame>
    <frame>
      <ip>0x76BAA30</ip>
      <obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
      <fn>_ULx86_64_step</fn>
    </frame>
    <frame>
      <ip>0x5C42052</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>GetStackTrace(void**, int, int)</fn>
    </frame>
    <frame>
      <ip>0x5C349F4</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>tcmalloc::PageHeap::GrowHeap(unsigned long)</fn>
    </frame>
    <frame>
      <ip>0x5C34D02</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>tcmalloc::PageHeap::New(unsigned long)</fn>
    </frame>
    <frame>
      <ip>0x5C25D0C</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
    </frame>
    <frame>
      <ip>0x5C46378</ip>
      <obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
      <fn>operator new[](unsigned long)</fn>
    </frame>

Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-19 11:16:22 -07:00
Zack Cerza
0526c6bc6b Use suite_path, if set, for one-off jobs as well
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-19 11:54:13 -06:00
Warren Usui
8346ac4363 Add filter and filter-off suite options.
Filter only runs suite jobs that contain the text passed as part of
their description or in the names of the composite set of yaml files.
Filter-off only runs suite jobs that do not contain the text passed
as either their description or in the names of the composite set of
yaml files.
Fixes: 8954
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-18 20:55:01 -07:00
Zack Cerza
9cfa67edec Merge pull request #313 from ceph/wip-rhel
install: use rhel builder for rhel
2014-08-18 13:49:54 -06:00
Zack Cerza
a9274e08b2 Merge pull request #315 from ceph/wip-8877
Skip nuke and just destroy VPS if nuke is --unlock
2014-08-18 13:11:46 -06:00
Sandon Van Ness
d9f3c9f690 Skip nuke and just destroy VPS if nuke is --unlock
If the machine is being unlocked after than we definitely want to
just destroy it. This way nukes will always suceed with --unlock
even if the guest is down or in a borked state.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-08-18 11:51:26 -07:00
Sage Weil
21dd85acc4 install: use rhel builder for rhel
Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-16 15:01:34 -07:00
Sage Weil
d462c7a4e7 Merge pull request #312 from ceph/wip-tls-leak
valgrind: ignore TLS leak in glibc
2014-08-15 21:03:28 -07:00
Sage Weil
c014ff949f valgrind: suppress eglibc leak of TLS
<error>
  <unique>0xf9</unique>
  <tid>1</tid>
  <kind>Leak_PossiblyLost</kind>
  <xwhat>
    <text>320 bytes in 1 blocks are possibly lost in loss record 248 of 289</text>
    <leakedbytes>320</leakedbytes>
    <leakedblocks>1</leakedblocks>
  </xwhat>
  <stack>
    <frame>
      <ip>0x4C29DB4</ip>
      <obj>/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so</obj>
      <fn>calloc</fn>
    </frame>
    <frame>
      <ip>0x4012074</ip>
      <obj>/lib/x86_64-linux-gnu/ld-2.15.so</obj>
      <fn>_dl_allocate_tls</fn>
      <dir>/build/buildd/eglibc-2.15/elf</dir>
      <file>dl-tls.c</file>
      <line>297</line>
    </frame>
    <frame>
      <ip>0x5289ABC</ip>
      <obj>/lib/x86_64-linux-gnu/libpthread-2.15.so</obj>
      <fn>pthread_create@@GLIBC_2.2.5</fn>
      <dir>/build/buildd/eglibc-2.15/nptl</dir>
      <file>allocatestack.c</file>
      <line>571</line>
    </frame>
    <frame>
      <ip>0xA6A89A</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>Thread::try_create(unsigned long)</fn>
      <dir>/srv/autobuild-ceph/gitbuilder.git/build/out~/ceph-0.83-444-ge74ad5f/src/common</dir>
      <file>Thread.cc</file>
      <line>112</line>
    </frame>
    <frame>
      <ip>0xA6A94E</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>Thread::create(unsigned long)</fn>
      <dir>/srv/autobuild-ceph/gitbuilder.git/build/out~/ceph-0.83-444-ge74ad5f/src/common</dir>
      <file>Thread.cc</file>
      <line>122</line>
    </frame>

...

ubuntu@teuthology:/a/teuthology-2014-08-13_23:04:01-fs-next-testing-basic-multi/423897

Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-15 06:28:19 -07:00
Zack Cerza
7418cc1bfd Perform some sanity checks on --name
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-14 10:20:40 -06:00
Zack Cerza
5f82596c98 Make --name required
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-14 10:20:27 -06:00
Zack Cerza
1d605c22d9 Don't fetch the suite if we can already find it
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-13 13:39:00 -06:00
Zack Cerza
da1e40d2fd Attach FileHandlers to the RootLogger object
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-13 13:10:15 -06:00
Zack Cerza
591b511fdc Don't remove lockfiles
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:28:20 -06:00
Zack Cerza
db92ae3b9a Add retries to fetch_teuthology()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:13:29 -06:00
Zack Cerza
ebf3cb3a24 Add BootstrapError
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:07:39 -06:00