Docs

Volcengine Managed Service for Prometheus

Alert center

Alert overview

VMP provides Alert Center, which offers various features and enables you to quickly configure alerts for monitoring objects. This topic describes the common glossary of Alert Center.

Usage Process

Create a notification template: Specify the type, channel, style, and other settings of message notifications to make them consistent and easy to read.

Create an alert notification policy: Specify the notification methods, recipients, templates, and other settings for alerts of different levels when they are triggered or recovered.

Create an alert aggregation policy: Configure an aggregation interval to group alerts into a single notification. This prevents frequently triggered alerts from generating numerous messages within a short period and causing an alert storm.

Create an alert silence policy: Suppress frequent but unimportant alerts to prevent them from overwhelming more important alert notifications, allowing recipients to focus on issues that truly matter.

Create alert rules: Configure alert trigger rules and notification policies. When an alert is triggered, notification messages will be sent to the specified contacts.

View alert events: When a monitored resource reaches the threshold configured in an alert rule, the system triggers an alert and sends a notification. The system also records alert events and notification history to facilitate traceability and troubleshooting.

Alert rules

VMP allows you to configure alert rules at multiple levels. In this way, you can specify different urgency levels by using different durations and thresholds. The system runs the alert PromQL calculation every minute and generates alert events based on the results at different points in time and the alert-level configurations specified in the alert rule. The following figure shows the transitions between multiple alert levels.

tip

Alert event: PromQL statements configured in alert rules can generate many time series. If a time series reaches both the alert threshold and the alert duration during alert evaluation, it is referred to as an alert event.

After alerts are generated, VMP determines whether to send alert notifications based on the alert aggregation policies bound to the corresponding alert rules. After VMP determines sending alert notifications, the corresponding alerts will not be sent if the alerts match alert silence policies. The alert notifications will be sent through different channels based on the configured alert notification policies.

Alert rule template

The alert rule template is used to reuse a set of variables and alert rule configurations and apply them to workspaces in batches. When the preset templates provided by VMP do not meet your requirements, the system allows you to create custom alert rule templates. For details, see Custom alert rule templates.

Alert notification policy

The alert notification policy is used to specify contact groups that will receive alerts when alerts at different levels are triggered. For more details, see Creating alert notification policies.

Notification template

If the default notification template provided by VMP does not meet your business requirements, the system allows you to create custom alert notification templates. For more details, see Creating notification templates.

Alert aggregation strategy

Aggregation dimension: You can aggregate alerts only by alert rules. In this way, when an alert notification is sent, all alerts in the notification originate from the same alert rule.

Aggregation interval: When an alert rule generates its first alert event, the system starts checking at each alert aggregation interval for new alert events or recovery events. If the system detects a new event, it sends an alert notification at the end of the interval.

Notification interval: If no alert event changes within an alert rule, the system sends another alert notification at the configured notification interval.

Time when the first alert notification is sent: The time when the first alert event is generated plus the waiting time maintained by VMP.

Alert Level
First notification waiting time
P0
30s
P1/P2
60s

Alert silence policies

If you do not want to be disturbed by alert notifications because of known issues, you can use an alert silence policy to silence alert notifications on these resources within a specific period of time. For example, if you want to silence notifications on alerts generated by pod: doc in namespace: doc, you can create an alert silence policy by using the following method.

Last updated: 2026.09.14 17:25:01

Alert Level	First notification waiting time
P0	30s
P1/P2	60s