美文网首页
Flink JobHistoryServer on K8s

Flink JobHistoryServer on K8s

作者: john瀚 | 来源:发表于2021-07-13 11:27 被阅读0次
    apiVersion: v1
    kind: ConfigMap
    metadata:
      name: flink-job-history-server-config
    data:
      flink-conf.yaml: |
        # 指定由JobManager归档的作业信息所存放的目录,这里使用的是HDFS
        jobmanager.archive.fs.dir: hdfs:///flink/completed-jobs/
        # 指定History Server扫描哪些归档目录,多个目录使用逗号分隔
        historyserver.archive.fs.dir: hdfs:///flink/completed-jobs/
        # 指定History Server间隔多少毫秒扫描一次归档目录
        historyserver.archive.fs.refresh-interval: 10000
        # History Server所绑定的ip,0.0.0.0代表允许所有ip访问
        historyserver.web.address: 0.0.0.0
        # 指定History Server所监听的端口号
        historyserver.web.port: 8082
    ---
    apiVersion: apps/v1
    kind: Deployment
    metadata:
      name: flink-job-history-server-deployment
    spec:
      selector:
        matchLabels:
          app: flink-job-history-server
      replicas: 1
      template:
        metadata:
          labels:
            app: flink-job-history-server
        spec:
          dnsConfig:
            nameservers:
              - 10.52.44.1
            searches:
              - oppo.internal
          volumes:
            - configMap:
                items:
                  - key: flink-conf.yaml
                    path: flink-conf.yaml
                name: flink-job-history-server-config
              name: flink-config-volume
            - configMap:
                name: ad-hadoop-config
              name: hadoop-config-volume
          containers:
            - name: history-server
              image: flink:1.13.1-scala_2.11
              command: ["/opt/flink/bin/historyserver.sh","start-foreground"]
              ports:
                - containerPort: 8082
              env:
                - name: HADOOP_USER_NAME
                  value: "hdfs"
                - name: HADOOP_CONF_DIR
                  value: /opt/hadoop/conf
              resources:
                requests:
                  memory: "100Mi"
                  cpu: "100m"
              volumeMounts:
                - mountPath: /opt/hadoop/conf
                  name: hadoop-config-volume
                - mountPath: /opt/flink/conf
                  name: flink-config-volume
    ---
    apiVersion: v1
    kind: Service
    metadata:
      name: flink-job-history-server-service
    spec:
      selector:
        app: flink-job-history-server
      ports:
        - protocol: TCP
          port: 8082
          targetPort: 8082
    ---
    apiVersion: networking.k8s.io/v1
    kind: Ingress
    metadata:
      name: flink-job-history-server-ingress
      annotations:
        kubernetes.io/ingress.class: "nginx"
        nginx.ingress.kubernetes.io/rewrite-target: /$2
    spec:
      rules:
      - host: "long-stream-flink.com"
        http:
          paths:
          - pathType: Prefix
            path: /history(/|$)(.*)
            backend:
              service:
                name: flink-job-history-server-service
                port:
                  number: 8082
    

    相关文章

      网友评论

          本文标题:Flink JobHistoryServer on K8s

          本文链接:https://www.haomeiwen.com/subject/lyhypltx.html