Bryan Boreham
b2fa1c9524
TSDB benchmarks: Commit periodically to speed up init
...
When creating dummy data for benchmarks, call `Commit()` periodically to
avoid growing the appender to enormous size.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-30 17:42:56 +00:00
Bryan Boreham
2dfb4fdafb
Merge pull request #15723 from machine424/eng-clos
...
fix(main.go): avoid closing the query engine until it is guaranteed to no longer be in use.
2024-12-30 11:16:20 +00:00
TJ Hoplock
4cbd9ffb91
docs: update required go version in readme to 1.22 ( #15447 )
...
It was bumped during 3.0 with the adoption of log/slog and other dep
updates.
```
~/go/src/github.com/prometheus/prometheus (main [ ]) -> grep '^go' go.mod
go 1.22.0
```
Signed-off-by: TJ Hoplock <t.hoplock@gmail.com>
2024-12-30 09:46:17 +01:00
machine424
9823a93c42
fix(main.go): avoid closing the query engine until it is guaranteed to no longer be in use.
...
partially reverts https://github.com/prometheus/prometheus/pull/14064
fixes https://github.com/prometheus/prometheus/issues/15232
supersedes https://github.com/prometheus/prometheus/pull/15533
reusing Engine.Close() outside of tests will require more consideration.
Signed-off-by: machine424 <ayoubmrini424@gmail.com>
2024-12-30 05:14:44 +01:00
dependabot[bot]
08c81b721a
chore(deps): bump actions/setup-go from 5.1.0 to 5.2.0 ( #15581 )
...
Bumps [actions/setup-go](https://github.com/actions/setup-go ) from 5.1.0 to 5.2.0.
- [Release notes](https://github.com/actions/setup-go/releases )
- [Commits](41dfa10bad...3041bf56c9
2024-12-29 17:08:18 +00:00
pinglanlu
6a61efcfc3
discovery: use a more direct and less error-prone return value ( #15347 )
...
Signed-off-by: pinglanlu <pinglanlu@outlook.com>
2024-12-29 18:03:06 +01:00
johncming
061400e31b
tsdb: export CheckpointPrefix constant ( #15636 )
...
Exported the CheckpointPrefix constant to be used in other packages.
Updated references to the constant in db.go and checkpoint.go files.
This change improves code readability and maintainability.
Signed-off-by: johncming <johncming@yahoo.com>
Co-authored-by: johncming <conjohn668@gmail.com>
2024-12-29 17:54:45 +01:00
dependabot[bot]
2c5502c114
chore(deps): bump actions/setup-go from 5.1.0 to 5.2.0 in /scripts ( #15580 )
...
Bumps [actions/setup-go](https://github.com/actions/setup-go ) from 5.1.0 to 5.2.0.
- [Release notes](https://github.com/actions/setup-go/releases )
- [Commits](41dfa10bad...3041bf56c9
2024-12-29 17:50:30 +01:00
dependabot[bot]
4d2c1c1d06
chore(deps): bump actions/cache from 4.1.2 to 4.2.0 ( #15583 )
...
Bumps [actions/cache](https://github.com/actions/cache ) from 4.1.2 to 4.2.0.
- [Release notes](https://github.com/actions/cache/releases )
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md )
- [Commits](6849a64899...1bd1e32a3b
2024-12-29 17:50:09 +01:00
dependabot[bot]
43fd40cae0
chore(deps): bump github/codeql-action from 3.27.5 to 3.27.7 ( #15582 )
...
Bumps [github/codeql-action](https://github.com/github/codeql-action ) from 3.27.5 to 3.27.7.
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](f09c1c0a94...babb554ede
2024-12-29 17:49:51 +01:00
bwplotka
281306765e
scrape: Unified scrape loop benchmark.
...
Signed-off-by: bwplotka <bwplotka@gmail.com>
2024-12-29 15:19:06 +00:00
Bryan Boreham
bc9210e393
[TESTS] Scrape: make caching work in benchmark
...
Returning 0 from Append means 'unknown', so the series is never cached.
Return arbitrary numbers instead.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-29 15:13:47 +00:00
Bryan Boreham
b4ef38cfc8
Scraping: Add benchmark for protobuf format
...
Extract helper function textToProto().
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-29 15:13:38 +00:00
Bryan Boreham
8f4557b0b1
Scraping benchmark: more realistic test
...
Don't repeat type and help text.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-29 15:11:39 +00:00
Carrie Edwards
1508149184
Update benchmark test and comment
2024-12-27 09:09:13 -08:00
Bartlomiej Plotka
30967330ca
Merge pull request #14755 from prometheus/arthursens/appendct-prwv2
...
Append CT as zero sample from PRWv2
2024-12-27 12:44:54 +01:00
Arthur Silva Sens
2ffaff82c8
Merge pull request #15710 from aknuds1/arve/otel-units
...
OTLP receiver: Allow colons in non-standard units
2024-12-23 10:11:09 -03:00
Arve Knudsen
475b7ff256
OTLP receiver: Allow colons in non-standard units
...
Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>
2024-12-21 18:53:14 +01:00
Arve Knudsen
5e7f804eeb
otlptranslator: Remove unused function TrimPromSuffixes ( #15709 )
...
Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>
2024-12-21 18:51:40 +01:00
Bryan Boreham
7b03796d0f
Scraping: stop storing discovered labels ( #15261 )
...
Instead of storing discovered labels on every target, recompute them if
required. The `Target` struct now needs to hold some more data required
to recompute them, such as ScrapeConfig.
This moves the load from every Prometheus all of the time, to just when
someone views Service Discovery in the UI.
The way `PopulateLabels` is used changes; you are no longer expected to
call it with a part-populated `labels.Builder`.
The signature of `Target.Labels` changes to take a `labels.Builder`
instead of a `ScratchBuilder`, for consistency with `DiscoveredLabels`.
This will save a lot of work when many targets are filtered out in
relabeling. Combine with `keep_dropped_targets` to avoid ever computing
most labels for dropped targets.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-21 13:33:08 +00:00
Bryan Boreham
cfa32f3d28
TSDB: Move merge of head postings into index
...
This enables it to take advantage of a more compact data structure
since all postings are known to be `*ListPostings`.
Remove the `Get` member which was not used for anything else, and fix up
tests.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-20 19:22:30 +00:00
Bryan Boreham
0a8779f46d
TSDB: Make mergedPostings generic
...
Now we can call it with more specific types which is more efficient than
making everything go through the `Postings` interface.
Benchmark the concrete type.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-20 17:09:21 +00:00
Bryan Boreham
1b22242024
TSDB BenchmarkMerge: run fewer sizes
...
As long as we run small and big sizes, we don't need all the sizes inbetween.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-20 17:09:21 +00:00
Bryan Boreham
e630ffdbed
TSDB: extend BenchmarkMemPostings_PostingsForLabelMatching to check merge speed
...
We need to create more postings entries so the merger has some work to do.
Not material for the regexp ones as they match so few series.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-20 17:09:21 +00:00
Arthur Silva Sens
b7a5e280df
Inline conditionals and CT handling
...
Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>
2024-12-20 10:48:46 -03:00
Arthur Silva Sens
3380809b68
fix linter
...
Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>
2024-12-20 10:48:46 -03:00
Arthur Silva Sens
3ffc3bf6a3
handle histogram CT
...
Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>
2024-12-20 10:48:46 -03:00
Arthur Silva Sens
6571d97e70
Handle histogram's created timestamp
...
Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>
2024-12-20 10:48:46 -03:00
Arthur Silva Sens
3b97a6397c
Put PRWv2 created timestamp ingestion behing feature-flag
...
Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>
2024-12-20 10:48:46 -03:00
Arthur Silva Sens
11e4673e0b
Support ingesting PWRv2's Created Timestamp as 0 samples
...
Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>
2024-12-20 10:48:46 -03:00
Björn Rabenstein
5b5fee08af
Merge pull request #15702 from prometheus/beorn7/histogram
...
PromQL: improve some test comments
2024-12-20 11:19:59 +01:00
beorn7
f7373a1f91
PromQL: improve some test comments
...
This amends #15686 .
Signed-off-by: beorn7 <beorn@grafana.com>
2024-12-19 23:56:37 +01:00
Neeraj Gartia
8d5236f927
PromQL: Adds tests for delta with histograms ( #15674 )
...
PromQL: Adds tests for delta with histograms
Signed-off-by: Neeraj Gartia <neerajgartia211002@gmail.com>
--------
Signed-off-by: Neeraj Gartia <neerajgartia211002@gmail.com>
2024-12-19 23:52:26 +01:00
Neeraj Gartia
0e99ca3e8c
[BUGFIX] PromQL: Fix deriv, predict_linear and double_exponential_smoothing with histograms ( #15686 )
...
PromQL: Fix deriv, predict_linear and double_exponential_smoothing with histograms
Signed-off-by: Neeraj Gartia <neerajgartia211002@gmail.com>
---------
Signed-off-by: Neeraj Gartia <neerajgartia211002@gmail.com>
2024-12-19 23:50:28 +01:00
Bartlomiej Plotka
804ab49cfc
Merge pull request #15695 from prometheus/rm-funcbench
...
ci: We removed funbench functionality from the test-infra, removing CI job for it.
2024-12-19 18:20:54 +01:00
Bryan Boreham
993acdfbb7
Merge pull request #15700 from bboreham/pin-fsnotify
...
[DEPS] Pin fsnotify to avoid deadlock bug
2024-12-19 16:03:51 +00:00
Bryan Boreham
5122ff2f59
[DEPS] Pin fsnotify to avoid deadlock bug
...
Bug filed upstream at https://github.com/fsnotify/fsnotify/issues/656
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-19 15:41:50 +00:00
Björn Rabenstein
318d6bc4bf
Merge pull request #15548 from TinfoilSubmarine/fix/386-test-failures
...
test: fixes for 32-bit archs
2024-12-18 15:49:30 +01:00
Bryan Boreham
b8c0907ff1
Merge pull request #15696 from prometheus/merge-release-3.0-into-main
...
Merge release 3.0.1 into main
2024-12-18 14:44:50 +00:00
Bryan Boreham
e4d00ec22e
Merge pull request #15694 from prometheus/update-go-deps2
...
Update go dependencies
2024-12-18 14:36:34 +00:00
Bryan Boreham
504968f11f
Merge remote-tracking branch 'origin/release-3.0' into merge-release-3.0-into-main
2024-12-18 14:25:33 +00:00
bwplotka
221f50e413
ci: We removed funbench functionality from test-infra, removing CI job too.
...
Signed-off-by: bwplotka <bwplotka@gmail.com>
2024-12-18 14:11:33 +00:00
Bryan Boreham
6641f11216
Update go dependencies
...
Preparation for release 3.1.
Did not update Kubernetes as it forces Go to version 1.23, and we like to support 2 latest versions.
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
2024-12-18 12:15:12 +00:00
Bryan Boreham
b4331f0272
Merge pull request #15592 from prometheus/dependabot/go_modules/go-opentelemetry-io-84fb557ae6
...
chore(deps): bump the go-opentelemetry-io group with 2 updates
2024-12-18 11:24:29 +00:00
Bryan Boreham
1eaa40c062
Merge pull request #15606 from prometheus/dependabot/go_modules/github.com/docker/docker-27.4.0incompatible
...
chore(deps): bump github.com/docker/docker from 27.3.1+incompatible to 27.4.0+incompatible
2024-12-18 11:23:23 +00:00
Bartlomiej Plotka
4ed997aa07
Merge pull request #15691 from neozhao98/dev
...
[DEPS] upgrade crypto to address reported vulnerability
2024-12-18 10:05:43 +01:00
Julius Volz
8e9aff75e9
Merge pull request #15677 from prometheus/juliusv/rule-pagination
...
Paginate rule groups, add infinite scroll to rules within groups
2024-12-18 08:13:25 +01:00
root
6d1b933cc1
upgrade crypto to fix vulnerability issue
...
Signed-off-by: neozhao98 <zxzhao@ustc.edu>
Signed-off-by: root <root@localhost.localdomain>
2024-12-18 12:49:31 +08:00
Julien Duchesne
615195372d
Ruler: Move inner eval function ( #15688 )
...
Refactoring in prevision of https://github.com/prometheus/prometheus/pull/15681
By moving the `eval` function outside of the for loop, we can modify the rule execution order more easily (without huge git changes)
Signed-off-by: Julien Duchesne <julien.duchesne@grafana.com>
2024-12-17 21:11:55 +00:00
Björn Rabenstein
ff398062cb
Merge pull request #15679 from colega/update-comment-on-mempostings-lvs
...
Update comment on MemPostings.lvs
2024-12-17 19:41:56 +01:00
