美文网首页BigData技术学习
flink-cdh-parcel测试安装

flink-cdh-parcel测试安装

作者: sunTengSt | 来源:发表于2020-03-27 23:19 被阅读0次

    先上flink-cdh-parcel测试安装效果图:

    clipboard1.png clipboard22.png clipboard33.png

    下载地址:https://archive.cloudera.com/csa/1.0.0.0

    一:将FLINK-1.9.0-csa1.0.0.0-cdh6.3.0.jar放置到如下:

    clipboard.png

    二:重启cloudera-server

    clipboard1.png

    三:下载parcel到httpd服务目录

    clipboard2.png clipboard3.png

    四:打开cdh设置,添加地址

    clipboard4.png

    五:刷新-下载-分配-激活-使用

    clipboard5.png clipboard6.png clipboard7.png clipboard8.png clipboard9.png clipboard10.png clipboard11.png

    六:添加服务flink

    clipboard12.png clipboard13png.png clipboard14.png

    七:重启cms

    clipboard16.png

    八:查看flink

    clipboard18.png clipboard22.png clipboard23.png clipboard33.png

    九:flink使用:

    clipboard44.png clipboard55.png

    十:需要解决的问题:

    • web界面上传jar按钮没出来,加载的时候有,加载完没了


      clipboard66.png
    clipboard77.png
    • 客户端执行flink命令报错
    The program finished with the following exception:
    
    org.apache.flink.util.FlinkException: Failed to retrieve job list.
        at org.apache.flink.client.cli.CliFrontend.listJobs(CliFrontend.java:445)
        at org.apache.flink.client.cli.CliFrontend.lambda$list$0(CliFrontend.java:427)
        at org.apache.flink.client.cli.CliFrontend.runClusterAction(CliFrontend.java:956)
        at org.apache.flink.client.cli.CliFrontend.list(CliFrontend.java:424)
        at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1024)
        at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1096)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
        at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
        at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1096)
    Caused by: java.util.concurrent.TimeoutException
        at org.apache.flink.runtime.concurrent.FutureUtils$Timeout.run(FutureUtils.java:998)
        at org.apache.flink.runtime.concurrent.DirectExecutorService.execute(DirectExecutorService.java:211)
        at org.apache.flink.runtime.concurrent.FutureUtils.lambda$orTimeout$14(FutureUtils.java:416)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
    

    十一:网上手动生成flink-parcel参考:

    <meta charset="utf-8">

    http://blog.51yip.com/hadoop/2362.html

    相关文章

      网友评论

        本文标题:flink-cdh-parcel测试安装

        本文链接:https://www.haomeiwen.com/subject/ctrduhtx.html