2018-11-30 14:46:16 +00:00
## master / unreleased
2019-04-30 07:17:07 +00:00
- [BUGFIX] Calling `Close` more than once on a querier returns an error instead of a panic.
2019-04-10 11:58:20 +00:00
2019-04-24 12:20:45 +00:00
## 0.7.1
- [ENHANCEMENT] Reduce memory usage in mergedPostings.Seek
2019-04-10 11:58:20 +00:00
## 0.7.0
2019-04-03 08:16:54 +00:00
- [CHANGE] tsdb now requires golang 1.12 or higher.
2019-03-14 13:05:40 +00:00
- [REMOVED] `chunks.NewReader` is removed as it wasn't used anywhere.
2019-03-06 09:12:28 +00:00
- [REMOVED] `FromData` is considered unused so was removed.
2019-03-25 23:38:12 +00:00
- [FEATURE] Added option WALSegmentSize -1 to disable the WAL.
2019-04-08 12:27:06 +00:00
- [BUGFIX] Bugfix in selectOverlappingDirs. Only return the first overlapping blocks.
2019-04-01 13:23:45 +00:00
- [BUGFIX] Fsync the meta file to persist it on disk to avoid data loss in case of a host crash.
2019-04-03 08:34:04 +00:00
- [BUGFIX] Fix fd and vm_area leak on error path in chunks.NewDirReader.
- [BUGFIX] Fix fd and vm_area leak on error path in index.NewFileReader.
2019-04-10 11:58:20 +00:00
- [BUGFIX] Force persisting the tombstone file to avoid data loss in case of a host crash.
- [BUGFIX] Keep series that are still in WAL in checkpoints.
- [ENHANCEMENT] Fast path for EmptyPostings cases in Merge, Intersect and Without.
Be smarter in how we look at matchers. (#572)
* Add unittests for PostingsForMatcher.
* Selector methods are all stateless, don't need a reference.
* Be smarter in how we look at matchers.
Look at all matchers to see if a label can be empty.
Optimise Not handling, so i!="2" is a simple lookup
rather than an inverse postings list.
All all the Withouts together, rather than
having to subtract each from all postings.
Change the pre-expand the postings logic to always do it before doing a
Without only. Don't do that if it's already a list.
The initial goal here was that the oft-seen pattern
i=~"something.+",i!="foo",i!="bar" becomes more efficient.
benchmark old ns/op new ns/op delta
BenchmarkHeadPostingForMatchers/n="1"-4 5888 6160 +4.62%
BenchmarkHeadPostingForMatchers/n="1",j="foo"-4 7190 6640 -7.65%
BenchmarkHeadPostingForMatchers/j="foo",n="1"-4 6038 5923 -1.90%
BenchmarkHeadPostingForMatchers/n="1",j!="foo"-4 6030884 4850525 -19.57%
BenchmarkHeadPostingForMatchers/i=~".*"-4 887377940 230329137 -74.04%
BenchmarkHeadPostingForMatchers/i=~".+"-4 490316101 319931758 -34.75%
BenchmarkHeadPostingForMatchers/i=~""-4 594961991 130279313 -78.10%
BenchmarkHeadPostingForMatchers/i!=""-4 537542388 318751015 -40.70%
BenchmarkHeadPostingForMatchers/n="1",i=~".*",j="foo"-4 10460243 8565195 -18.12%
BenchmarkHeadPostingForMatchers/n="1",i=~".*",i!="2",j="foo"-4 44964267 8561546 -80.96%
BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-4 42244885 29137737 -31.03%
BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-4 35285834 32774584 -7.12%
BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-4 8951047 8379024 -6.39%
BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-4 63813335 30672688 -51.93%
BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.*",j="foo"-4 45381112 44924397 -1.01%
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
2019-04-09 10:59:45 +00:00
- [ENHANCEMENT] Be smarter in how we look at matchers.
- [ENHANCEMENT] PostListings and NotMatcher now public.
2019-03-05 13:51:38 +00:00
## 0.6.1
2019-03-05 13:48:55 +00:00
- [BUGFIX] Update `last` after appending a non-overlapping chunk in `chunks.MergeOverlappingChunks` . [#539 ](https://github.com/prometheus/tsdb/pull/539 )
2019-03-01 20:57:53 +00:00
2019-03-02 13:54:49 +00:00
## 0.6.0
- [CHANGE] `AllowOverlappingBlock` is now `AllowOverlappingBlocks` .
2019-03-01 20:57:53 +00:00
## 0.5.0
2019-02-27 10:55:35 +00:00
- [FEATURE] Time-ovelapping blocks are now allowed. [#370 ](https://github.com/prometheus/tsdb/pull/370 )
- Disabled by default and can be enabled via `AllowOverlappingBlock` option.
2019-02-14 13:29:41 +00:00
- Added `MergeChunks` function in `chunkenc/xor.go` to merge 2 time-overlapping chunks.
- Added `MergeOverlappingChunks` function in `chunks/chunks.go` to merge multiple time-overlapping Chunk Metas.
- Added `MinTime` and `MaxTime` method for `BlockReader` .
2019-02-27 10:55:35 +00:00
- [FEATURE] New `dump` command to tsdb tool to dump all samples.
2019-03-25 23:38:12 +00:00
- [FEATURE] New `encoding` package for common binary encoding/decoding helpers.
2019-02-27 10:55:35 +00:00
- Added to remove some code duplication.
2018-12-07 23:06:48 +00:00
- [ENHANCEMENT] When closing the db any running compaction will be cancelled so it doesn't block.
2019-02-27 10:55:35 +00:00
- `NewLeveledCompactor` takes a context.
2019-03-01 20:57:53 +00:00
- [CHANGE] `prometheus_tsdb_storage_blocks_bytes_total` is now `prometheus_tsdb_storage_blocks_bytes` .
- [BUGFIX] Improved Postings Merge performance. Fixes a regression from the the previous release.
- [BUGFIX] LiveReader can get into an infinite loop on corrupt WALs.
2019-02-27 10:55:35 +00:00
2019-01-18 08:42:59 +00:00
## 0.4.0
2018-12-18 18:56:51 +00:00
- [CHANGE] New `WALSegmentSize` option to override the `DefaultOptions.WALSegmentSize` . Added to allow using smaller wal files. For example using tmpfs on a RPI to minimise the SD card wear out from the constant WAL writes. As part of this change the `DefaultOptions.WALSegmentSize` constant was also exposed.
2019-01-18 08:35:16 +00:00
- [CHANGE] Empty blocks are not written during compaction [#374 ](https://github.com/prometheus/tsdb/pull/374 )
2019-01-16 10:03:52 +00:00
- [FEATURE] Size base retention through `Options.MaxBytes` . As part of this change:
2019-02-14 13:29:41 +00:00
- Added new metrics - `prometheus_tsdb_storage_blocks_bytes_total` , `prometheus_tsdb_size_retentions_total` , `prometheus_tsdb_time_retentions_total`
- New public interface `SizeReader: Size() int64`
- `OpenBlock` signature changed to take a logger.
2018-12-28 18:13:02 +00:00
- [REMOVED] `PrefixMatcher` is considered unused so was removed.
2018-12-28 17:42:46 +00:00
- [CLEANUP] `Options.WALFlushInterval` is removed as it wasn't used anywhere.
2019-01-16 18:09:08 +00:00
- [FEATURE] Add new `LiveReader` to WAL pacakge. Added to allow live tailing of a WAL segment, used by Prometheus Remote Write after refactor. The main difference between the new reader and the existing `Reader` is that for `LiveReader` a call to `Next()` that returns false does not mean that there will never be more data to read.
2018-12-13 14:02:32 +00:00
## 0.3.1
2018-12-28 17:42:46 +00:00
- [BUGFIX] Fixed most windows test and some actual bugs for unclosed file readers.
2018-12-04 13:50:11 +00:00
## 0.3.0
- [CHANGE] `LastCheckpoint()` used to return just the segment name and now it returns the full relative path.
- [CHANGE] `NewSegmentsRangeReader()` can now read over miltiple wal ranges by using the new `SegmentRange{}` struct.
- [CHANGE] `CorruptionErr{}` now also exposes the Segment `Dir` which is added when displaying any errors.
2019-03-25 23:38:12 +00:00
- [CHANGE] `Head.Init()` is changed to `Head.Init(minValidTime int64)`
2018-12-04 13:50:11 +00:00
- [CHANGE] `SymbolTable()` renamed to `SymbolTableSize()` to make the name consistent with the `Block{ symbolTableSize uint64 }` field.
- [CHANGE] `wal.Reader{}` now exposes `Segment()` for the current segment being read and `Offset()` for the current offset.
2019-02-14 13:29:41 +00:00
- [FEATURE] tsdbutil analyze subcomand to find churn, high cardinality, etc.
