Go to file
Bartlomiej Plotka 9981b3f3ee
labels: Reduce allocated memory and latency of Hash method; Added tests. (#8025)
* labels: Reduce allocated memory by Hash method in edge cases; Added tests.

Old:
/tmp/___BenchmarkLabels_Hash_in_github_com_prometheus_prometheus_pkg_labels -test.v -test.bench ^\QBenchmarkLabels_Hash\E$ -test.run ^$
goos: linux
goarch: amd64
pkg: github.com/prometheus/prometheus/pkg/labels
BenchmarkLabels_Hash
BenchmarkLabels_Hash/typical_labels_under_1KB
BenchmarkLabels_Hash/typical_labels_under_1KB-12         	 5366161	       259 ns/op	       0 B/op	       0 allocs/op
BenchmarkLabels_Hash/bigger_labels_over_1KB
BenchmarkLabels_Hash/bigger_labels_over_1KB-12           	 1700371	       767 ns/op	    2048 B/op	       1 allocs/op
BenchmarkLabels_Hash/extremely_large_label_value_10MB
BenchmarkLabels_Hash/extremely_large_label_value_10MB-12 	     356	   3743115 ns/op	10523442 B/op	       1 allocs/op
PASS

New:
/tmp/___BenchmarkLabels_Hash_in_github_com_prometheus_prometheus_pkg_labels -test.v -test.bench ^\QBenchmarkLabels_Hash\E$ -test.run ^$
goos: linux
goarch: amd64
pkg: github.com/prometheus/prometheus/pkg/labels
BenchmarkLabels_Hash
BenchmarkLabels_Hash/typical_labels_under_1KB
BenchmarkLabels_Hash/typical_labels_under_1KB-12         	 4758883	       259 ns/op	       0 B/op	       0 allocs/op
BenchmarkLabels_Hash/bigger_labels_over_1KB
BenchmarkLabels_Hash/bigger_labels_over_1KB-12           	 3324492	       357 ns/op	      80 B/op	       1 allocs/op
BenchmarkLabels_Hash/extremely_large_label_value_10MB
BenchmarkLabels_Hash/extremely_large_label_value_10MB-12 	    1087	   1083949 ns/op	    9734 B/op	       1 allocs/op
PASS

Process finished with exit code 0

Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>

* Addressed Kemal's comment.

Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>

* Moved to v2 xxhash for improvements.

New:

/tmp/___BenchmarkLabels_Hash_in_github_com_prometheus_prometheus_pkg_labels -test.v -test.bench ^\QBenchmarkLabels_Hash\E$ -test.run ^$ -test.benchtime 10s
goos: linux
goarch: amd64
pkg: github.com/prometheus/prometheus/pkg/labels
BenchmarkLabels_Hash
BenchmarkLabels_Hash/typical_labels_under_1KB
BenchmarkLabels_Hash/typical_labels_under_1KB-12         	53447894	       221 ns/op	       0 B/op	       0 allocs/op
BenchmarkLabels_Hash/bigger_labels_over_1KB
BenchmarkLabels_Hash/bigger_labels_over_1KB-12           	42341754	       326 ns/op	       0 B/op	       0 allocs/op
BenchmarkLabels_Hash/extremely_large_label_value_10MB
BenchmarkLabels_Hash/extremely_large_label_value_10MB-12 	   10000	   1248546 ns/op	       0 B/op	       0 allocs/op
PASS

Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>

* Removed old xxhash package.

Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>

* Pined minor version.

Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>
2020-10-15 11:31:28 +01:00
.circleci .circleci/config.yml: check mixins (#6895) 2020-08-25 15:59:41 +02:00
.github Update prombench workflows to incorporate new naming convention 2020-08-24 01:04:19 +05:30
cmd Merge pull request #8044 from prometheus/beorn7/metrics 2020-10-12 23:32:02 +02:00
config Default to bigger remote_write sends (#5267) 2020-09-09 14:00:23 -06:00
console_libraries Update various UI components (#7807) 2020-08-15 22:31:30 +02:00
consoles Update console template example metric names. (#5678) 2019-06-17 12:13:29 +01:00
discovery Add UserAgent to Hetzner Robot SD (#8008) 2020-10-05 13:34:41 +02:00
docs React UI: Implement missing TSDB head stats section (#7876) 2020-09-29 22:05:33 +02:00
documentation Merge pull request #8054 from simonpasquier/improve-not-ingesting-samples-alert 2020-10-15 12:29:39 +02:00
notifier Invert service discovery dependencies (#7701) 2020-08-20 13:48:26 +01:00
pkg labels: Reduce allocated memory and latency of Hash method; Added tests. (#8025) 2020-10-15 11:31:28 +01:00
prompb web: Remove APIv2 (#7935) 2020-09-15 09:30:55 +02:00
promql promql: Organize legacy tests into appropriate files (#7989) 2020-10-07 10:09:20 +01:00
rules Add a rule_group_samples metric (#7977) 2020-09-25 16:48:38 +01:00
scrape Fix wordings 2020-10-07 21:44:36 +02:00
scripts web: Remove APIv2 (#7935) 2020-09-15 09:30:55 +02:00
storage storage/remote/intern_test.go: Fix linting errors 2020-10-08 09:50:37 +02:00
template Add unit test case to improve test coverage for template.go (#7537) 2020-07-09 09:43:32 +01:00
tsdb labels: Reduce allocated memory and latency of Hash method; Added tests. (#8025) 2020-10-15 11:31:28 +01:00
util Add more Go leak tests (#7652) 2020-07-24 10:10:20 +01:00
vendor labels: Reduce allocated memory and latency of Hash method; Added tests. (#8025) 2020-10-15 11:31:28 +01:00
web Implement series API query hint to not hit chunks (#8050) 2020-10-14 14:36:17 +05:30
.dockerignore Add image build for ppc64le architecture 2020-04-06 18:03:58 -03:00
.gitignore add tsdb cmds into promtool (#6088) 2020-07-23 19:35:50 +01:00
.gitpod.yml Gitpod config (#7749) 2020-08-14 17:23:55 +02:00
.golangci.yml golangci: Use depguard to prevent using restricted packages (#7825) 2020-08-21 11:37:21 +02:00
.promu.yml Update to go 1.15 (#7798) 2020-08-15 23:49:11 +02:00
CHANGELOG.md *: Cut v2.22.0-rc.0 2020-10-08 13:52:40 +02:00
CODE_OF_CONDUCT.md Improve repo sync script 2020-06-17 17:12:36 +02:00
CONTRIBUTING.md Gitpod config (#7749) 2020-08-14 17:23:55 +02:00
Dockerfile Integrate beginning of React UI (#5694) 2019-10-17 14:38:09 +02:00
LICENSE Clean up license issues. 2015-01-21 20:07:45 +01:00
MAINTAINERS.md Add Bartek as maintainer for TSDB (#7690) 2020-07-29 20:25:14 +05:30
Makefile Merge pull request #7067 from carlosedp/ppc64le 2020-08-05 18:16:59 +02:00
Makefile.common Bump promu version (#7880) 2020-09-02 17:03:52 +01:00
NOTICE Update NOTICE for the XORChunk (#7415) 2020-06-18 15:12:35 +05:30
README.md Add the "assets" make target and change directory note in readme (#7908) 2020-09-16 15:01:48 +02:00
RELEASE.md Reflect automatic docs publishing in the release process (#8056) 2020-10-15 11:06:42 +02:00
VERSION *: Cut v2.22.0-rc.0 2020-10-08 13:52:40 +02:00
fuzzit.sh Fix fuzzit job (#6005) 2019-09-11 09:08:20 +02:00
go.mod labels: Reduce allocated memory and latency of Hash method; Added tests. (#8025) 2020-10-15 11:31:28 +01:00
go.sum *: Update go dependencies 2020-10-08 09:29:12 +02:00

README.md

Prometheus

CircleCI Docker Repository on Quay Docker Pulls Go Report Card CII Best Practices fuzzit Gitpod ready-to-code

Visit prometheus.io for the full documentation, examples and guides.

Prometheus, a Cloud Native Computing Foundation project, is a systems and service monitoring system. It collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts if some condition is observed to be true.

Prometheus's main distinguishing features as compared to other monitoring systems are:

  • a multi-dimensional data model (timeseries defined by metric name and set of key/value dimensions)
  • PromQL, a powerful and flexible query language to leverage this dimensionality
  • no dependency on distributed storage; single server nodes are autonomous
  • timeseries collection happens via a pull model over HTTP
  • pushing timeseries is supported via an intermediary gateway
  • targets are discovered via service discovery or static configuration
  • multiple modes of graphing and dashboarding support
  • support for hierarchical and horizontal federation

Architecture overview

Install

There are various ways of installing Prometheus.

Precompiled binaries

Precompiled binaries for released versions are available in the download section on prometheus.io. Using the latest production release binary is the recommended way of installing Prometheus. See the Installing chapter in the documentation for all the details.

Docker images

Docker images are available on Quay.io or Docker Hub.

You can launch a Prometheus container for trying it out with

$ docker run --name prometheus -d -p 127.0.0.1:9090:9090 prom/prometheus

Prometheus will now be reachable at http://localhost:9090/.

Building from source

To build Prometheus from the source code yourself you need to have a working Go environment with version 1.13 or greater installed. You will also need to have Node.js and Yarn installed in order to build the frontend assets.

You can directly use the go tool to download and install the prometheus and promtool binaries into your GOPATH:

$ go get github.com/prometheus/prometheus/cmd/...
$ prometheus --config.file=your_config.yml

However, when using go get to build Prometheus, Prometheus will expect to be able to read its web assets from local filesystem directories under web/ui/static and web/ui/templates. In order for these assets to be found, you will have to run Prometheus from the root of the cloned repository. Note also that these directories do not include the new experimental React UI unless it has been built explicitly using make assets or make build.

An example of the above configuration file can be found here.

You can also clone the repository yourself and build using make build, which will compile in the web assets so that Prometheus can be run from anywhere:

$ mkdir -p $GOPATH/src/github.com/prometheus
$ cd $GOPATH/src/github.com/prometheus
$ git clone https://github.com/prometheus/prometheus.git
$ cd prometheus
$ make build
$ ./prometheus --config.file=your_config.yml

The Makefile provides several targets:

  • build: build the prometheus and promtool binaries (includes building and compiling in web assets)
  • test: run the tests
  • test-short: run the short tests
  • format: format the source code
  • vet: check the source code for common errors
  • docker: build a docker container for the current HEAD
  • assets: build the new experimental React UI

React UI Development

For more information on building, running, and developing on the new React-based UI, see the React app's README.md.

More information

  • The source code is periodically indexed: Prometheus Core.
  • You will find a CircleCI configuration in .circleci/config.yml.
  • See the Community page for how to reach the Prometheus developers and users on various communication channels.

Contributing

Refer to CONTRIBUTING.md

License

Apache License 2.0, see LICENSE.