Prometheus Alerting

https://github.com/prometheus-operator/prometheus-operator/blob/master/Documentation/user-guides/alerting.md

这里我在自己的dashboard中创建了两个 panel

添加一个 notification channel 这里绑定到了 teams

rate(node_network_transmit_bytes_total{job="node-exporter", instance="10.0.2.7:9100", device!="lo"}[$__interval])
1- sum(increase(node_cpu_seconds_total{mode="idle"}[5m])) by (instance)/sum(increase(node_cpu_seconds_total[5m])) by (instance)

配置alert

用 wrk 触发之后可以得到