如何在 stable/prometheus 图表 values.yaml 中设置 prometheus 规则？

Question

使用官方Prometheus图表stable/prometheus。

自定义其values.yaml文件以设置alertmanager.yml文件和serverFiles区域。

rules: {}:

https://github.com/kubernetes/charts/blob/master/stable/prometheus/values.yaml#L598

它是{}。这里如何写真正的警报规则为official format？

例如，我试过：

  serverFiles:
    alerts: {}
    rules:
    # Alert for any instance that is unreachable for >5 minutes.
    - alert: InstanceDown
      expr: up == 0
      for: 5m
      labels:
        severity: page
      annotations:
        summary: "Instance {{ $labels.instance }} down"
      description: "{{ $labels.instance }} of job {{ $labels.job }} has been down for more than 5 minutes."

然后跑了$ helm install my_prometheus。然后 pod 得到这个错误：

PersistentVolumeClaim is not bound: "sweet-terrier-prometheus-server"
Back-off restarting failed container
Error syncing pod

Answer 1

serverFiles:
  alerts:
    groups:
    - name: NodeAlerts
      rules:
      - alert: NodeCPUUsage
        expr: (100 - (avg(irate(node_cpu{mode="idle"}[5m])) BY (instance) * 100)) > 75
        for: 2m
        labels:
          severity: alert
        annotations:
          description: '{{$labels.instance}}: CPU usage is above 75% (current value is:
            {{ $value }})'
          summary: '{{$labels.instance}}: High CPU usage detect

rules 用于记录规则，alert 用于警报规则。

https://prometheus.io/docs/practices/rules/