spark.streaming.receiver.writeAheadLog.enable config to enable receiver's write ahead long,then data received from streaming will writed to block manager && write ahead log,must first config checkpoint
spark.streaming.blockInterval:200ms Every 200ms spark will generator block,see BlockGenerator.scala.
网友评论