63e12807da
Don't update head postings mapper on every append
2017-01-06 16:43:18 +01:00
96c2bd249f
Handle compaction trigger and reinitializing in DB
2017-01-06 13:03:23 +01:00
3ed2c2a14b
Rename Partition to regular DB, DB to PartitionedDB
2017-01-06 11:40:09 +01:00
4590b61343
Rename shard to partition
2017-01-06 08:08:02 +01:00
9790aa98ac
Add postings wrapper that emits head postings in label set order
...
This adds a position mapper that takes series from a head block
in the order they were appended and creates a mapping representing
them in order of their label sets.
Write-repair of the postings list would cause very expensive writing.
Hence, we keep them as they are and only apply the postition mapping
at the very end, after a postings list has been sufficienctly reduced
through intersections etc.
2017-01-05 16:05:42 +01:00
40cf215fba
Hotfix missing sorting of head block series index
2017-01-04 09:47:20 +01:00
ec99f99d3d
Fix and test bug in shardSeriesSet
2017-01-03 19:02:42 +01:00
62b8ded0a5
Rename iterator value getters to At()
2017-01-02 13:33:06 +01:00
5c45a1cc6f
Remove shardSeriesSet caching
2017-01-02 12:05:52 +01:00
beb842a856
Change block interface
...
This changes the block interface to directly expose index
and series readers rather than the direct querier
2017-01-02 11:12:28 +01:00
c00d17e691
Modify IndexReader API to accomodate compaction
...
This changes the IndexReader API to expose plain labels
and chunk meta information instead of a Series interface.
Dropping of irrelevant chunks is moved into the querier.
A LabelIndices method is added to query for existing label
value indices.
2016-12-31 16:24:04 +01:00
a009247ab7
Add matching of empty label
2016-12-30 19:36:28 +01:00
3a5468f251
Lock shards during querying and shutdown
2016-12-28 11:41:44 +01:00
286293802b
Add merge postings
2016-12-28 11:02:19 +01:00
dd72b52098
Add postings intersection
2016-12-27 11:32:10 +01:00
f8111cef0e
Fix chunk series iterator seeking
2016-12-26 16:55:44 +01:00
5efe1d178e
labels: add Compare and String methods
2016-12-24 13:49:35 +01:00
869cccf080
Test and fixes for buffered iterator
2016-12-21 16:06:33 +01:00
0a94f58f1a
Fix test import of labels, simplify constructor names
2016-12-21 15:12:26 +01:00
da2beb3e6d
Fix zero division, add buffer series iterator
2016-12-21 13:04:51 +01:00
ede733ab6c
Extract labels package
2016-12-21 09:39:01 +01:00
cddc29fa17
Fix labels comparison, fetch correct labels
2016-12-20 14:54:52 +01:00
ce7f4106c2
Reda correct label number, fix buffered iterator panic
2016-12-20 14:21:50 +01:00
d9ca4b47f5
Fix offset errors, fix persisted postings order
2016-12-20 13:14:55 +01:00
282d9ae6e2
Implement label value queries in all layers.
2016-12-19 12:26:25 +01:00
aabb21f4b9
Add shard series set test
2016-12-19 11:44:11 +01:00
b08f82fa4e
Pre-select relevant chunks on series access.
...
This adds interval metadata to indexed chunks. The queried interval
is used to filter chunks when queried from the index to save
unnecessary accesses of the chunks file.
This is especially relevant for series that come and go often and larger
files.
2016-12-16 12:13:17 +01:00
bd77103a49
Add stats serialization, load querier of all blocks
2016-12-15 16:14:33 +01:00
1a35e54450
Add chained iterator, skipping seek added
2016-12-15 15:23:15 +01:00
5424a0cf75
Rename SeriesShard to Shard
2016-12-15 08:36:09 +01:00
d56b281006
Rename Iterator to Postings
2016-12-15 07:05:29 +01:00
c1acd3fe85
Advance buffered iterator correctly on seek
2016-12-14 21:43:27 +01:00
e561c91d53
Implement proper buffered iterator
...
This adds a proper duration based lookback buffer for series iterators
to allow advancing sequentially while remaining able to calculate time
aggregating functions such as `rate` backwards.
It uses an array ring buffer to minimize heap allocations for
potentially hundreds of thousands of series for a single query.
2016-12-14 21:14:44 +01:00
ca89080128
Misc fixes for initial Prometheus integration
2016-12-14 18:38:46 +01:00
725385ea05
Fix compareLabels, add test
2016-12-14 15:47:05 +01:00
fc992fafc2
Change querier interface, initial implementations
2016-12-14 15:39:23 +01:00
6eeb0ef01c
Add queriers and partial mocks
2016-12-13 15:26:58 +01:00
9b400b4c58
Add chunk based series iterator
2016-12-12 19:12:55 +01:00
b334c3ade8
Write chunk skiplist and add series reader
2016-12-12 15:39:55 +01:00
14dbc59f2b
cleanup and switching removal of unsafe calls.
2016-12-10 18:09:57 +01:00
6f93a699e6
wipe
2016-12-02 17:49:05 +01:00
3ad4db56aa
Remove Prometheus internal metric type from interface
2016-11-15 11:43:34 +01:00
f9f11c4a08
Add main db implementation
2016-11-15 10:34:25 +01:00
Fabian Reinartz