美文网首页
flink部署

flink部署

作者: sknfie | 来源:发表于2024-02-16 11:25 被阅读0次

下载

https://archive.apache.org/dist/flink/flink-1.8.0/flink-1.8.0-bin-scala_2.11.tgz

上传

上传flink-1.8.0-bin-scala_2.11.tgz到服务器

解压

tar -zxvf flink-1.8.0-bin-scala_2.11.tgz

创建软连接

ln -s flink-1.8.0 flink

启动

bin/start-cluster.sh
使用jps可以查看到下面两个进程

25073 TaskManagerRunner
24619 StandaloneSessionClusterEntrypoint

打开ui:

overview

slot在Flink里面可以认为是资源组,Flink是通过将任务(Task)分成子任务(SubTask)并且将这些子任务分配到slot来并行执行程序。

流计算:WordCount

1.开启终端

nc -lk 9999

2.运行流式应用

bin/flink run --class org.apache.flink.streaming.examples.wordcount.WordCount examples/streaming/WordCount.jar --host http://node1.itcast.cn --port 9999
completed job

3.批处理:WordCount

bin/flink run examples/batch/WordCount.jar --input /tmp/words.txt
运行结果:
Starting execution of program
Printing result to stdout. Use --output to specify output path.
(11111111111111111,1)
Program execution finished
Job with JobID 0f957952d8d6360f9be2b8e416733940 has finished.
Job Runtime: 628 ms
Accumulator Results:
- c1764dfda80c85f87f91d0d45028e692 (java.util.ArrayList) [1 elements]
批处理

相关文章

网友评论

      本文标题:flink部署

      本文链接:https://www.haomeiwen.com/subject/zivyadtx.html