美文网首页
flink部署

flink部署

作者: sknfie | 来源:发表于2024-02-16 11:25 被阅读0次

    下载

    https://archive.apache.org/dist/flink/flink-1.8.0/flink-1.8.0-bin-scala_2.11.tgz

    上传

    上传flink-1.8.0-bin-scala_2.11.tgz到服务器

    解压

    tar -zxvf flink-1.8.0-bin-scala_2.11.tgz

    创建软连接

    ln -s flink-1.8.0 flink

    启动

    bin/start-cluster.sh
    使用jps可以查看到下面两个进程

    25073 TaskManagerRunner
    24619 StandaloneSessionClusterEntrypoint
    

    打开ui:

    overview

    slot在Flink里面可以认为是资源组,Flink是通过将任务(Task)分成子任务(SubTask)并且将这些子任务分配到slot来并行执行程序。

    流计算:WordCount

    1.开启终端

    nc -lk 9999
    

    2.运行流式应用

    bin/flink run --class org.apache.flink.streaming.examples.wordcount.WordCount examples/streaming/WordCount.jar --host http://node1.itcast.cn --port 9999
    
    completed job

    3.批处理:WordCount

    bin/flink run examples/batch/WordCount.jar --input /tmp/words.txt
    运行结果:
    Starting execution of program
    Printing result to stdout. Use --output to specify output path.
    (11111111111111111,1)
    Program execution finished
    Job with JobID 0f957952d8d6360f9be2b8e416733940 has finished.
    Job Runtime: 628 ms
    Accumulator Results:
    - c1764dfda80c85f87f91d0d45028e692 (java.util.ArrayList) [1 elements]
    
    批处理

    相关文章

      网友评论

          本文标题:flink部署

          本文链接:https://www.haomeiwen.com/subject/zivyadtx.html