2017-10-26 13:53:27 +00:00
|
|
|
---
|
|
|
|
title: Recording rules
|
2017-10-27 07:47:38 +00:00
|
|
|
sort_rank: 2
|
2017-10-26 13:53:27 +00:00
|
|
|
---
|
|
|
|
|
|
|
|
# Defining recording rules
|
|
|
|
|
|
|
|
## Configuring rules
|
|
|
|
|
|
|
|
Prometheus supports two types of rules which may be configured and then
|
|
|
|
evaluated at regular intervals: recording rules and [alerting
|
2017-10-27 07:47:38 +00:00
|
|
|
rules](alerting_rules.md). To include rules in Prometheus, create a file
|
|
|
|
containing the necessary rule statements and have Prometheus load the file via
|
|
|
|
the `rule_files` field in the [Prometheus configuration](configuration.md).
|
2017-11-01 12:58:32 +00:00
|
|
|
Rule files use YAML.
|
2017-10-26 13:53:27 +00:00
|
|
|
|
|
|
|
The rule files can be reloaded at runtime by sending `SIGHUP` to the Prometheus
|
|
|
|
process. The changes are only applied if all rule files are well-formatted.
|
|
|
|
|
|
|
|
## Syntax-checking rules
|
|
|
|
|
|
|
|
To quickly check whether a rule file is syntactically correct without starting
|
2021-02-15 20:59:32 +00:00
|
|
|
a Prometheus server, you can use Prometheus's `promtool` command-line utility
|
|
|
|
tool:
|
2017-10-26 13:53:27 +00:00
|
|
|
|
|
|
|
```bash
|
2017-11-01 12:58:32 +00:00
|
|
|
promtool check rules /path/to/example.rules.yml
|
2017-10-26 13:53:27 +00:00
|
|
|
```
|
|
|
|
|
2021-02-15 20:59:32 +00:00
|
|
|
The `promtool` binary is part of the `prometheus` archive offered on the
|
|
|
|
project's [download page](https://prometheus.io/download/).
|
|
|
|
|
2017-10-26 13:53:27 +00:00
|
|
|
When the file is syntactically valid, the checker prints a textual
|
|
|
|
representation of the parsed rules to standard output and then exits with
|
|
|
|
a `0` return status.
|
|
|
|
|
2017-11-01 15:35:50 +00:00
|
|
|
If there are any syntax errors or invalid input arguments, it prints an error
|
|
|
|
message to standard error and exits with a `1` return status.
|
2017-10-26 13:53:27 +00:00
|
|
|
|
|
|
|
## Recording rules
|
|
|
|
|
|
|
|
Recording rules allow you to precompute frequently needed or computationally
|
|
|
|
expensive expressions and save their result as a new set of time series.
|
|
|
|
Querying the precomputed result will then often be much faster than executing
|
|
|
|
the original expression every time it is needed. This is especially useful for
|
|
|
|
dashboards, which need to query the same expression repeatedly every time they
|
|
|
|
refresh.
|
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
Recording and alerting rules exist in a rule group. Rules within a group are
|
2020-12-03 10:32:10 +00:00
|
|
|
run sequentially at a regular interval, with the same evaluation time.
|
|
|
|
The names of recording rules must be
|
|
|
|
[valid metric names](https://prometheus.io/docs/concepts/data_model/#metric-names-and-labels).
|
2020-11-18 19:29:01 +00:00
|
|
|
The names of alerting rules must be
|
|
|
|
[valid label values](https://prometheus.io/docs/concepts/data_model/#metric-names-and-labels).
|
2017-10-26 13:53:27 +00:00
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
The syntax of a rule file is:
|
2017-10-26 13:53:27 +00:00
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
```yaml
|
|
|
|
groups:
|
|
|
|
[ - <rule_group> ]
|
|
|
|
```
|
|
|
|
|
|
|
|
A simple example rules file would be:
|
|
|
|
|
|
|
|
```yaml
|
|
|
|
groups:
|
|
|
|
- name: example
|
2017-11-14 15:22:25 +00:00
|
|
|
rules:
|
2017-11-01 12:58:32 +00:00
|
|
|
- record: job:http_inprogress_requests:sum
|
2020-05-02 11:52:24 +00:00
|
|
|
expr: sum by (job) (http_inprogress_requests)
|
2017-11-01 12:58:32 +00:00
|
|
|
```
|
|
|
|
|
|
|
|
### `<rule_group>`
|
|
|
|
```
|
|
|
|
# The name of the group. Must be unique within a file.
|
|
|
|
name: <string>
|
|
|
|
|
|
|
|
# How often rules in the group are evaluated.
|
|
|
|
[ interval: <duration> | default = global.evaluation_interval ]
|
|
|
|
|
2021-09-15 07:48:26 +00:00
|
|
|
# Limit the number of alerts and series individual rules can produce.
|
|
|
|
# 0 is no limit.
|
|
|
|
[ limit: <int> | default = 0 ]
|
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
rules:
|
|
|
|
[ - <rule> ... ]
|
|
|
|
```
|
|
|
|
|
|
|
|
### `<rule>`
|
2017-10-26 13:53:27 +00:00
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
The syntax for recording rules is:
|
2017-11-08 10:38:03 +00:00
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
```
|
|
|
|
# The name of the time series to output to. Must be a valid metric name.
|
|
|
|
record: <string>
|
|
|
|
|
|
|
|
# The PromQL expression to evaluate. Every evaluation cycle this is
|
|
|
|
# evaluated at the current time, and the result recorded as a new set of
|
|
|
|
# time series with the metric name as given by 'record'.
|
|
|
|
expr: <string>
|
|
|
|
|
|
|
|
# Labels to add or overwrite before storing the result.
|
|
|
|
labels:
|
|
|
|
[ <labelname>: <labelvalue> ]
|
|
|
|
```
|
|
|
|
|
|
|
|
The syntax for alerting rules is:
|
2017-11-08 10:38:03 +00:00
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
```
|
2020-07-06 21:00:16 +00:00
|
|
|
# The name of the alert. Must be a valid label value.
|
2017-11-01 12:58:32 +00:00
|
|
|
alert: <string>
|
|
|
|
|
|
|
|
# The PromQL expression to evaluate. Every evaluation cycle this is
|
|
|
|
# evaluated at the current time, and all resultant time series become
|
|
|
|
# pending/firing alerts.
|
|
|
|
expr: <string>
|
|
|
|
|
|
|
|
# Alerts are considered firing once they have been returned for this long.
|
|
|
|
# Alerts which have not yet fired for long enough are considered pending.
|
|
|
|
[ for: <duration> | default = 0s ]
|
2017-10-26 13:53:27 +00:00
|
|
|
|
2017-11-01 12:58:32 +00:00
|
|
|
# Labels to add or overwrite for each alert.
|
|
|
|
labels:
|
|
|
|
[ <labelname>: <tmpl_string> ]
|
|
|
|
|
|
|
|
# Annotations to add to each alert.
|
|
|
|
annotations:
|
|
|
|
[ <labelname>: <tmpl_string> ]
|
|
|
|
```
|
2017-10-26 13:53:27 +00:00
|
|
|
|