美文网首页
Spark Streaming

Spark Streaming

作者: clive0x | 来源:发表于2019-10-16 22:27 被阅读0次

    spark.streaming.receiver.writeAheadLog.enable   config to enable receiver's write ahead long,then data received from streaming will writed to block manager && write ahead log,must first config checkpoint 

    spark.streaming.blockInterval:200ms  Every 200ms spark will generator block,see BlockGenerator.scala.

    相关文章

      网友评论

          本文标题:Spark Streaming

          本文链接:https://www.haomeiwen.com/subject/ftspmctx.html