Flink JobHistoryServer on K8s
作者:
john瀚 | 来源:发表于
2021-07-13 11:27 被阅读0次apiVersion: v1
kind: ConfigMap
metadata:
name: flink-job-history-server-config
data:
flink-conf.yaml: |
# 指定由JobManager归档的作业信息所存放的目录,这里使用的是HDFS
jobmanager.archive.fs.dir: hdfs:///flink/completed-jobs/
# 指定History Server扫描哪些归档目录,多个目录使用逗号分隔
historyserver.archive.fs.dir: hdfs:///flink/completed-jobs/
# 指定History Server间隔多少毫秒扫描一次归档目录
historyserver.archive.fs.refresh-interval: 10000
# History Server所绑定的ip,0.0.0.0代表允许所有ip访问
historyserver.web.address: 0.0.0.0
# 指定History Server所监听的端口号
historyserver.web.port: 8082
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: flink-job-history-server-deployment
spec:
selector:
matchLabels:
app: flink-job-history-server
replicas: 1
template:
metadata:
labels:
app: flink-job-history-server
spec:
dnsConfig:
nameservers:
- 10.52.44.1
searches:
- oppo.internal
volumes:
- configMap:
items:
- key: flink-conf.yaml
path: flink-conf.yaml
name: flink-job-history-server-config
name: flink-config-volume
- configMap:
name: ad-hadoop-config
name: hadoop-config-volume
containers:
- name: history-server
image: flink:1.13.1-scala_2.11
command: ["/opt/flink/bin/historyserver.sh","start-foreground"]
ports:
- containerPort: 8082
env:
- name: HADOOP_USER_NAME
value: "hdfs"
- name: HADOOP_CONF_DIR
value: /opt/hadoop/conf
resources:
requests:
memory: "100Mi"
cpu: "100m"
volumeMounts:
- mountPath: /opt/hadoop/conf
name: hadoop-config-volume
- mountPath: /opt/flink/conf
name: flink-config-volume
---
apiVersion: v1
kind: Service
metadata:
name: flink-job-history-server-service
spec:
selector:
app: flink-job-history-server
ports:
- protocol: TCP
port: 8082
targetPort: 8082
---
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: flink-job-history-server-ingress
annotations:
kubernetes.io/ingress.class: "nginx"
nginx.ingress.kubernetes.io/rewrite-target: /$2
spec:
rules:
- host: "long-stream-flink.com"
http:
paths:
- pathType: Prefix
path: /history(/|$)(.*)
backend:
service:
name: flink-job-history-server-service
port:
number: 8082
本文标题:Flink JobHistoryServer on K8s
本文链接:https://www.haomeiwen.com/subject/lyhypltx.html
网友评论