prometheus监控docker并实现grafana可视化

一、cAdvisor(Container Advisor)

cAdvisor：用于收集正在运行的容器资源使用和性能信息

二、启动用于收集容器性能信息的cAdvisor

vim docker-compose.yml

version: '3'
services:
  cadvisor:
    container_name: cadvisor
    image: google/cadvisor
    restart: always
    ports:
      - "8088:8080"
    volumes:
      - /:/rootfs:ro
      - /var/run/:/var/run:rw
      # centos7挂载配置为cpu,cpuacct，其他系统可能没有cpu,cpuacct则配置为cpuacct,cpu
      - /sys/fs/cgroup/cpu,cpuacct:/sys/fs/cgroup/cpuacct,cpu
      - /var/lib/docker/:/var/lib/docker:ro
      - /dev/disk/:/dev/disk:ro
    networks:
      - proxy

networks:
  proxy:
    external: true

启动后访问http://xxx.xxx.xxx.xxx:8088/metrics，看数据是否可以成功捕获

记得开放8088端口

三、配置prometheus，添加docker监控

1、编辑配置文件

vim prometheus/prometheus.yml

global:
  scrape_interval:     15s # By default, scrape targets every 15 seconds.


  # Attach these labels to any time series or alerts when communicating with
  # external systems (federation, remote storage, Alertmanager).
  external_labels:
    monitor: 'codelab-monitor'

remote_write:
  - url: "http://xxx.xxx.xxx.xxx:8086/api/v1/prom/write?db=prometheus&u=admin&p=***"

remote_read:
  - url: "http://xxx.xxx.xxx.xxx:8086/api/v1/prom/read?db=prometheus&u=admin&p=***"

rule_files:
  - "./rules/*.yml"

alerting:
  alertmanagers:
  - static_configs:
    - targets: ['localhost:9093']

# A scrape configuration containing exactly one endpoint to scrape:
# Here it's Prometheus itself.
scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # Override the global default and scrape targets from this job every 5 seconds.
    scrape_interval: 5s

    static_configs:
      - targets: ['localhost:9090']

  - job_name: 'agent'
    basic_auth:
      username: admin
      password: ***

    static_configs:
      - targets: ['xxx.xxx.xxx.xxx:9100']
      
  # 添加traefik监控
  - job_name: 'traefik'
    basic_auth:
      username: admin
      password: ***
    static_configs:
      - targets: ['xxx.xxx.xxx.xxx:8080']
      
  # 添加mysql监控      
  - job_name: 'mysql'
    static_configs:
      - targets: ['xxx.xxx.xxx.xxx:9104']

  # 添加docker监控
  - job_name: 'docker'
  static_configs:
    - targets: ['xxx.xxx.xxx.xxx:8088']

2、重启prometheus

docker-compose restart

四、grafana添加docker监控仪表盘

导入mysql监控仪表盘，左边菜单栏点击import，输入193，点击load即可

导入193仪表盘.png
docker监控仪表盘.png