Zack Cerza
f5a6ed3b7a
Update provision module to use new lock server
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
b8cb0890a2
Use Remote.shortname instead of regex
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
4eda1d3273
Add unlock_many() and use it when possible
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
e6e393239b
Update internal task to use new lockserver
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
b9d7a9dec0
Make far less requests when simply locking
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
40c1ee0442
Optimize some list_locks() calls
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
e0aca2e6d7
Properly query for multiple machine types
...
...in list_locks()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
fb96923304
Use consistent URI for lock server
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
24efd83dfc
Remove old lock server
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
c406985268
Change default lock server to paddles
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
aef78f4b3d
Use /nodes/ as the lock server endpoint
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:38 -06:00
Zack Cerza
96b0a1c026
Update to use new ssh-keyscan API
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
b170345bda
Rewrite ssh public key updating
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
1c04c7aff3
Use new ssh_keyscan() function
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
5e5c32ef79
No need to be passing ctx to update_lock()
...
... or update_keys() or scan_for_locks()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
8048dc348c
Add new ssh_keyscan() method
...
This is just a cleaner implementation that will replace the existing
one(s).
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
1d1697213f
Re-order functions in module
...
This is for readability.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
0f772222a4
keyscan_check(): don't require ctx to be passed
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
bdc9e6e8c9
Update lock_many(), update_lock(), and main()
...
Also remove lockstatus.send_request()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
f5f1115881
Fix PEP-8 issues
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
53a2c2f2d5
Refactoring
...
Create a new teuthology.provision module and move virtual machine
functions there. Move hostname manipulation functions to
teuthology.misc.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
af2a03a8a5
Update do_summary()
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:37 -06:00
Zack Cerza
533a5c5d8c
Rewrite list_locks()
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Zack Cerza
121fd02671
Make (de)canonicalize_hostname() work without user
...
Add tests proving they still work *with* usernames as well.
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Zack Cerza
fe4bf33262
Add unit tests for (de)canonicalize_hostname()
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Zack Cerza
04b319d847
Update/rewrite several functions to use paddles
...
Functions updated: lock.lock_one(), lock.unlock_one(),
lock.destroy_if_vm(), lockstatus.get_status()
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-25 11:14:36 -06:00
Sage Weil
692e5a1db9
ceph.conf: mon reweight min pgs per osd = 4
...
So teh cephtool reweight-by-pg test will pass with mini clusters.
Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-22 15:14:58 -07:00
Zack Cerza
8dbb1d5fb9
Add --suite-path
...
Slightly less ugly than setting PYTHONPATH
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-21 16:11:19 -06:00
Yuri Weinstein
db8db6bf38
Merge pull request #316 from ceph/wip-9183-wusui
...
Fix return from schedule_suite.
2014-08-20 14:55:55 -07:00
Warren Usui
171cb69f13
Fix return from schedule_suite.
...
Schedule_suite returns the number of jobs scheduled (accounting for
filters). Information displayed also indicates how many jobs were
run and how many were filtered out.
Fixes: 9183
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-20 13:19:13 -07:00
Zack Cerza
684e4a6fc4
Merge pull request #309 from ceph/wip-8954-wusui
...
Add filter and filter-out options to suites.
2014-08-19 12:54:12 -06:00
Sage Weil
fe32e2210d
valgrind: make trusty tcmalloc supporession more general
...
To capture this:
<kind>SyscallParam</kind>
<what>Syscall param msync(start) points to unaddressable byte(s)</what>
<stack>
<frame>
<ip>0x5081B3D</ip>
<obj>/lib/x86_64-linux-gnu/libpthread-2.19.so</obj>
<dir>/build/buildd/eglibc-2.19/nptl/../sysdeps/unix</dir>
<file>syscall-template.S</file>
<line>81</line>
</frame>
<frame>
<ip>0x76BA123</ip>
<obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
</frame>
<frame>
<ip>0x76BCEF6</ip>
<obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
</frame>
<frame>
<ip>0x76BE151</ip>
<obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
</frame>
<frame>
<ip>0x76BE4E8</ip>
<obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
</frame>
<frame>
<ip>0x76BAA30</ip>
<obj>/usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1</obj>
<fn>_ULx86_64_step</fn>
</frame>
<frame>
<ip>0x5C42052</ip>
<obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
<fn>GetStackTrace(void**, int, int)</fn>
</frame>
<frame>
<ip>0x5C349F4</ip>
<obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
<fn>tcmalloc::PageHeap::GrowHeap(unsigned long)</fn>
</frame>
<frame>
<ip>0x5C34D02</ip>
<obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
<fn>tcmalloc::PageHeap::New(unsigned long)</fn>
</frame>
<frame>
<ip>0x5C25D0C</ip>
<obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
</frame>
<frame>
<ip>0x5C46378</ip>
<obj>/usr/lib/libtcmalloc.so.4.1.2</obj>
<fn>operator new[](unsigned long)</fn>
</frame>
Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-19 11:16:22 -07:00
Zack Cerza
0526c6bc6b
Use suite_path, if set, for one-off jobs as well
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-19 11:54:13 -06:00
Warren Usui
8346ac4363
Add filter and filter-off suite options.
...
Filter only runs suite jobs that contain the text passed as part of
their description or in the names of the composite set of yaml files.
Filter-off only runs suite jobs that do not contain the text passed
as either their description or in the names of the composite set of
yaml files.
Fixes: 8954
Signed-off-by: Warren Usui <warren.usui@inktank.com>
2014-08-18 20:55:01 -07:00
Zack Cerza
9cfa67edec
Merge pull request #313 from ceph/wip-rhel
...
install: use rhel builder for rhel
2014-08-18 13:49:54 -06:00
Zack Cerza
a9274e08b2
Merge pull request #315 from ceph/wip-8877
...
Skip nuke and just destroy VPS if nuke is --unlock
2014-08-18 13:11:46 -06:00
Sandon Van Ness
d9f3c9f690
Skip nuke and just destroy VPS if nuke is --unlock
...
If the machine is being unlocked after than we definitely want to
just destroy it. This way nukes will always suceed with --unlock
even if the guest is down or in a borked state.
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-08-18 11:51:26 -07:00
Sage Weil
21dd85acc4
install: use rhel builder for rhel
...
Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-16 15:01:34 -07:00
Sage Weil
d462c7a4e7
Merge pull request #312 from ceph/wip-tls-leak
...
valgrind: ignore TLS leak in glibc
2014-08-15 21:03:28 -07:00
Sage Weil
c014ff949f
valgrind: suppress eglibc leak of TLS
...
<error>
<unique>0xf9</unique>
<tid>1</tid>
<kind>Leak_PossiblyLost</kind>
<xwhat>
<text>320 bytes in 1 blocks are possibly lost in loss record 248 of 289</text>
<leakedbytes>320</leakedbytes>
<leakedblocks>1</leakedblocks>
</xwhat>
<stack>
<frame>
<ip>0x4C29DB4</ip>
<obj>/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so</obj>
<fn>calloc</fn>
</frame>
<frame>
<ip>0x4012074</ip>
<obj>/lib/x86_64-linux-gnu/ld-2.15.so</obj>
<fn>_dl_allocate_tls</fn>
<dir>/build/buildd/eglibc-2.15/elf</dir>
<file>dl-tls.c</file>
<line>297</line>
</frame>
<frame>
<ip>0x5289ABC</ip>
<obj>/lib/x86_64-linux-gnu/libpthread-2.15.so</obj>
<fn>pthread_create@@GLIBC_2.2.5</fn>
<dir>/build/buildd/eglibc-2.15/nptl</dir>
<file>allocatestack.c</file>
<line>571</line>
</frame>
<frame>
<ip>0xA6A89A</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>Thread::try_create(unsigned long)</fn>
<dir>/srv/autobuild-ceph/gitbuilder.git/build/out~/ceph-0.83-444-ge74ad5f/src/common</dir>
<file>Thread.cc</file>
<line>112</line>
</frame>
<frame>
<ip>0xA6A94E</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>Thread::create(unsigned long)</fn>
<dir>/srv/autobuild-ceph/gitbuilder.git/build/out~/ceph-0.83-444-ge74ad5f/src/common</dir>
<file>Thread.cc</file>
<line>122</line>
</frame>
...
ubuntu@teuthology:/a/teuthology-2014-08-13_23:04:01-fs-next-testing-basic-multi/423897
Signed-off-by: Sage Weil <sage@redhat.com>
2014-08-15 06:28:19 -07:00
Zack Cerza
7418cc1bfd
Perform some sanity checks on --name
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-14 10:20:40 -06:00
Zack Cerza
5f82596c98
Make --name required
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-14 10:20:27 -06:00
Zack Cerza
1d605c22d9
Don't fetch the suite if we can already find it
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-13 13:39:00 -06:00
Zack Cerza
da1e40d2fd
Attach FileHandlers to the RootLogger object
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-13 13:10:15 -06:00
Zack Cerza
591b511fdc
Don't remove lockfiles
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:28:20 -06:00
Zack Cerza
db92ae3b9a
Add retries to fetch_teuthology()
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:13:29 -06:00
Zack Cerza
ebf3cb3a24
Add BootstrapError
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:07:39 -06:00
Zack Cerza
dd9ee971d7
If bootstrap fails, remove the virtualenv
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 17:02:04 -06:00
Zack Cerza
a948baaf62
Fix another variable name
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 12:54:05 -06:00
Zack Cerza
663060dd5a
Add message to exception log
...
Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
2014-08-12 10:46:29 -06:00