47afc8e00f
Reduce test timeout on Travis
2017-07-14 08:00:18 +02:00
9c4235532e
Fix compaction selection after creating new heads
...
This fixes the case where between block creations no compaction
plans are ran. We were not compacting anything in these
cases since the on creation the most recent head block always had
a high timestamp of 0.
2017-07-13 16:15:13 +02:00
5d7b5994d6
Fix compaction range selection
2017-07-13 16:13:59 +02:00
3c22488157
Merge pull request #108 from Gouthamve/compact-large-dels-2
...
Recompact blocks with large number of tombstones
2017-07-12 18:54:01 +02:00
401bdfd4a6
Make Chunks return the number of samples inside
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-07-12 18:45:12 +02:00
1263a68875
Recompact blocks with large number of tombstones
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-07-12 18:27:31 +02:00
7b9c536883
Merge pull request #103 from Gouthamve/block-ranges
...
Compaction implementation for block-ranges
2017-07-12 17:32:49 +02:00
9a2ab732b5
Choose ranges by retention and min-block-duration
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-07-12 17:30:34 +02:00
969c407335
Merge pull request #106 from Gouthamve/snapshot-time
...
Persist the right MaxTime when snapshotting
2017-07-12 13:54:31 +02:00
f1ae239c20
Persist the right MaxTime when snapshotting
...
This is because we cut a new block from where the snapshotted block ends
if we restore from backups and highTimestamp would be where we should be
starting from.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-07-12 13:48:13 +02:00
ce23adb579
Initial compaction implementation for block-ranges
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-07-07 16:32:18 +02:00
bc3fee4820
Add benchmark for mergedSeriesSet
2017-07-05 16:19:28 +02:00
d492bfd973
Merge pull request #101 from prometheus/chunkit
...
Fix omitting of chunk on Seek()
2017-06-30 15:17:34 +02:00
344a50b9d8
Merge pull request #100 from prometheus/fullness
...
Compact head block early
2017-06-30 15:07:22 +02:00
bda3ed20ac
Fix omitting of chunk on Seek()
2017-06-30 15:06:27 +02:00
1e74c155eb
Return empty string to signal non-caching
2017-06-26 14:58:00 +02:00
3410559c1b
Compact head block early
...
Let older head blocks be compacted once the newest once has samples at
50% of its total range. This allows the memory of the compacted blocks
to be released and garbage collected before a new head block gets
created. Thereby the number of head blocks is 1 or 2 instead of 2 or 3
and memory spikes are reduced.
2017-06-26 08:52:59 +02:00
60c823c663
Fix broken test ( #99 )
2017-06-22 15:24:38 +01:00
a2948f3c5f
Merge pull request #97 from Gouthamve/nit
...
Fix bug with Seek() and optimise bounding params.
2017-06-13 10:11:10 +02:00
3a36551b90
Merge pull request #98 from prometheus/balance
...
Properly balance k-way operations
2017-06-13 10:09:55 +02:00
a280169427
Add regression test
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-06-13 13:21:22 +05:30
eb8c9759fc
Properly balance k-way operations
2017-06-13 08:25:13 +02:00
9e1f34dae3
Fix bug with Seek() and optimise bounding params.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-06-13 11:24:04 +05:30
9963a4c7c3
Merge pull request #95 from Gouthamve/wal-ahead
...
Fix race condition for 2 appenders having same ts
2017-06-12 11:17:49 +02:00
73cc5bae51
Colocate defer statements near relevant functions
...
Signed-off-by: Goutham Veeramachaneni <goutham@boomerangcommerce.com>
2017-06-12 14:37:58 +05:30
0ec9456675
Merge pull request #96 from prometheus/fdleak
...
Fix directory file descriptor leak.
2017-06-12 10:56:48 +02:00
03f95ee096
Fix directory file descriptor leak.
2017-06-12 00:05:04 +02:00
b51a05044e
Fix race condition for 2 appenders having same ts
...
Race:
Suppose we have 100 existing series inside a HeadBlock.
Now we open two appenders in two routines A1, A2 and append 30 new series and
60 new series respectively with some common series.
Both try to commit at the same time and the following happens in the given order:
A2 executes createSeries()
A1 executes createSeries() (with its common series referencing the ids from A2)
A1 persists its newlabels, samples
A2 persists its newlabels, samples
Now when reading it back, we read A1's samples which reference A2's id and
thereby fail.
Ref: prometheus/promtheus#2795
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-06-08 16:26:25 +05:30
d4cb579443
Add DB.Dir method
2017-06-08 12:14:13 +02:00
7e4368e6c3
Merge pull request #94 from prometheus/cutchunk
...
Improve heuristic to spread chunks across block
2017-06-08 11:30:49 +02:00
05e411a8eb
Improve heuristic to spread chunks across block
2017-06-08 11:30:32 +02:00
f006e2d1ab
Merge pull request #92 from prometheus/sources
...
Add list of source head blocks to meta.json
2017-06-07 11:50:44 +02:00
683b4c8c2a
Add list of source head blocks to meta.json
2017-06-07 11:06:45 +02:00
357e33bd1e
Merge pull request #88 from Gouthamve/backups-1
...
Snapshot support
2017-06-06 20:35:47 +02:00
ff4ccb6eb0
Remove unnecessary error from ToggleCompaction fns
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-06-06 23:45:23 +05:30
261cd9f393
Incorporate feedback.
...
Move back to {Enable, Disable}Compactions.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-06-06 20:23:20 +05:30
a110a64abd
Add full Snapshot support
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-06-06 18:15:54 +05:30
a1c8425357
Initial implementation of HeadBlock Snapshots
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-06-05 13:48:31 +05:30
3a5ae6b1a4
Merge pull request #82 from Gouthamve/deletes-1
...
Implement deletions
2017-05-27 22:06:45 +05:30
29c73f05f2
Make sure that mint and maxt are not modified.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-27 21:59:49 +05:30
44e9ae38b5
Incorporate PR feedback.
...
* Expose Stone as it is used in an exported method.
* Move from tombstoneReader to []Stone for the same reason as above.
* Make WAL reading a little cleaner.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-26 21:26:31 +05:30
2a940a591a
Merge pull request #85 from prometheus/metrics
...
Add and fix metrics
2017-05-26 16:24:23 +02:00
b3b9245ad6
Add and fix metrics
2017-05-26 15:13:03 +02:00
6febabeb28
Final delete fixes.
...
* Make sure no reads happen on the block when delete is in progress.
* Fix bugs in compaction.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-26 16:31:45 +05:30
c211ec4f49
Fix concurrent map access.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-24 16:58:04 +05:30
bacb143b7e
Simplify tombstone and WAL Delete formats.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-24 13:42:56 +05:30
f29fb62fba
Make TombstoneReader a Getter.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-24 11:24:24 +05:30
9bf7aa9af1
Misc. fixes incorporating feedback.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-23 18:13:30 +05:30
31cf939448
Add NumTombstones to BlockMeta.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-23 17:37:04 +05:30
9d388941ef
Add checksums and magic number to the tombstones.
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-05-23 17:27:45 +05:30
Fabian Reinartz
Goutham Veeramachaneni
Brian Brazil
Goutham Veeramachaneni