美文网首页HBase™
Flink中NotSerializableException问题

Flink中NotSerializableException问题

作者: 8e7f75130086 | 来源:发表于2018-12-03 22:34 被阅读0次

    所有自定义类要实现serializable接口,否则在集群中无法生效
    Making it static final is preferred option

    错误信息

    2018-12-03 19:51:49,041 ERROR com.yunzong.taoist.jaeger.flink.TracingAnalysisStreaming      - TaoistJaegerFlinkBootstrap error
    org.apache.flink.api.common.InvalidProgramException: The implementation of the FlatMapFunction is not serializable. The object probably contains or references non serializable fields.
            at org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:99)
            at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.clean(StreamExecutionEnvironment.java:1560)
            at org.apache.flink.streaming.api.datastream.DataStream.clean(DataStream.java:185)
            at org.apache.flink.streaming.api.datastream.DataStream.flatMap(DataStream.java:609)
            at com.yunzong.taoist.jaeger.flink.TracingAnalysisStreaming.analysis(TracingAnalysisStreaming.java:90)
            at com.yunzong.taoist.jaeger.flink.TaoistJaegerFlinkBootstrap.main(TaoistJaegerFlinkBootstrap.java:15)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:498)
            at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:529)
            at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:421)
            at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:83)
            at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:78)
            at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:120)
            at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$getJobGraphAsync$10(JarRunHandler.java:226)
            at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
            at java.lang.Thread.run(Thread.java:748)
    Caused by: java.io.NotSerializableException: org.hbase.async.HBaseClient
            at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
            at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
            at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
            at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
            at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
            at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
            at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
            at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
            at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
            at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
            at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
            at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
            at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
            at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
            at org.apache.flink.util.InstantiationUtil.serializeObject(InstantiationUtil.java:512)
            at org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:81)
            ... 19 more
    

    解决办法

    Making it static final

    相关文章

      网友评论

        本文标题:Flink中NotSerializableException问题

        本文链接:https://www.haomeiwen.com/subject/ztaqfqtx.html