38fc24d0ed
Fix targetpool_test.go and other tests.
...
Change-Id: I91a4dd1d39e01f174e1aaae653ce1ed7aecaa624
2014-11-25 17:08:26 +01:00
7f5d3c2c29
Fix and improve the fp locker.
...
Benchmark:
$ go test -bench 'Fingerprint' -test.run 'Fingerprint' -test.cpu=1,2,4
OLD
BenchmarkFingerprintLockerParallel 500000 3618 ns/op
BenchmarkFingerprintLockerParallel-2 100000 12257 ns/op
BenchmarkFingerprintLockerParallel-4 500000 10164 ns/op
BenchmarkFingerprintLockerSerial 10000000 283 ns/op
BenchmarkFingerprintLockerSerial-2 10000000 284 ns/op
BenchmarkFingerprintLockerSerial-4 10000000 288 ns/op
NEW
BenchmarkFingerprintLockerParallel 1000000 1018 ns/op
BenchmarkFingerprintLockerParallel-2 1000000 1164 ns/op
BenchmarkFingerprintLockerParallel-4 2000000 910 ns/op
BenchmarkFingerprintLockerSerial 50000000 56.0 ns/op
BenchmarkFingerprintLockerSerial-2 50000000 47.9 ns/op
BenchmarkFingerprintLockerSerial-4 50000000 54.5 ns/op
Change-Id: I3c65a43822840e7e64c3c3cfe759e1de51272581
2014-11-25 17:07:45 +01:00
8fba3302bc
Bold changes to concurrency.
...
(WIP. Probably doesn't work yet.)
Change-Id: Id1537dfcca53831a1d428078a5863ece7bdf4875
2014-11-25 17:07:45 +01:00
fcdf5a8ee7
Fix bugs in chunk evict code.
...
Also, simplify code by re-looking up metric in metric map.
Change-Id: Ib2092f9184374e5a543e87d3a9f4a74fda64b193
2014-11-25 17:07:45 +01:00
7e6a03fbf9
Fix a few concurrency issues before starting to use the new fp locker.
...
Change-Id: I8615e8816e79ef0882e123163ee590c739b79d12
2014-11-25 17:07:45 +01:00
db92620163
Instrument eviction and purge durations.
...
Change-Id: Ia5b2319363ad2644674c9b7a94162a89bcc296fb
2014-11-25 17:07:45 +01:00
01dd618a20
Fix a locking bug.
...
Change-Id: I183780785991d0b4165ce9186f53eb8201fb3ed5
2014-11-25 17:07:44 +01:00
aea32b0b4b
Avoid redundant fingerprint calculation.
...
Change-Id: Ief8a165dcfa5030226953346ec9dfe4a7787df1f
2014-11-25 17:07:44 +01:00
e9ff29c547
Comment/code cleanup.
...
Change-Id: I38736e3d0fec79759a2bafa35aecf914480ff810
2014-11-25 17:07:44 +01:00
c7aad110fb
Add an indexing queue and batch the ops.
...
Some other improvements on the way, in particular codec -> codable
renaming and addition of LookupSet methods.
Change-Id: I978f8f3f84ca8e4d39a9d9f152ae0ad274bbf4e2
2014-11-25 17:07:44 +01:00
71206dbc06
More code cleanups.
...
Add license text everywhere.
And others....
Change-Id: I11ccde267a2ef7eb366c4788ba7aeae14ba7545c
2014-11-25 17:07:44 +01:00
f0d5d4bda3
Fix bug around index purging.
...
Change-Id: I8cea00e03f72bbeead2cbd2d26b34d986059ced0
2014-11-25 17:07:44 +01:00
630b5a087a
Also consider on-disk fingerprints during purge.
...
This reintroduces LevelDB iterators so that we can iterate through all
the on-disk fingerprints.
Change-Id: I007ee4638d038d2a4461bbda27f30fcaad411474
2014-11-25 17:07:35 +01:00
f5f9f3514a
Major code cleanup.
...
- Make it go-vet and golint clean.
- Add comments, TODOs, etc.
Change-Id: If1392d96f3d5b4cdde597b10c8dff1769fcfabe2
2014-11-25 17:02:53 +01:00
3592dc2359
Implement series eviction.
...
Change-Id: I7a503e0ba78aae3761d032851b06f2807122b085
2014-11-25 17:02:52 +01:00
bbf49200ab
Implement methods in persistence.go.
...
Change-Id: I804cdd0b30420e171825fd86fe1281eca0d5e638
2014-11-25 17:02:23 +01:00
5a128a04a9
Major reorganization of the storage.
...
Most important, the heads file will now persist all the chunk descs,
too. Implicitly, it will serve as the persisted form of the
fp-to-series map.
Change-Id: Ic867e78f2714d54c3b5733939cc5aef43f7bd08d
2014-11-25 17:02:01 +01:00
4770cf76a4
Make index package more self-contained.
...
Moved interna from diskPersistence into the indexer.
TotalIndexer now called diskIndexer.
Change-Id: I6c8c62cb171f12bbd8a5474773af7786d71ba388
2014-11-25 17:02:01 +01:00
af77d5ef0b
Added a few missing implementations in index.go.
...
Also, added closing of persistence and mem storage.
Change-Id: Iacf0d22c3520dd2584d9546984c1f8a5ed6cd54e
2014-11-25 17:02:01 +01:00
cca7ebe906
Some more cleanups / obsolete code removals.
...
Change-Id: I584144ceeeedafdb114266d8a6d2513e67b1d010
2014-11-25 17:02:00 +01:00
7e85711df0
Beginnings of a tiered index implementation.
...
This reintroduces a LevelDB-based metrics index.
Change-Id: I4111540301c52255a07b2f570761707a32f72c05
2014-11-25 17:02:00 +01:00
ecdf5ab14f
Index-persistence switched from gob to a hand-coded solution.
...
Change-Id: Ib4ec42535bd08df16d34d4774bb638e35c5a1841
2014-11-25 17:02:00 +01:00
e7ed39c9a6
Initial experimental snapshot of next-gen storage.
...
Change-Id: Ifb8709960dbedd1d9f5efd88cdd359ee9fa9d26d
2014-11-25 17:02:00 +01:00
Bjoern Rabenstein
Julius Volz