line.spl...">
美文网首页
Spark 简单的wordcount

Spark 简单的wordcount

作者: RoronoaZoro丶 | 来源:发表于2017-07-21 09:14 被阅读0次

sc.textFile("/input/words.txt")

.flatMap(line => line.split(" "))

.map(word => (word, 1))

.reduceByKey((x, y) => x + y)

.collect

sc.textFile("/input/words.txt")

.flatMap(_.split(" "))

.map((_, 1))

.reduceByKey(_ + _)

.collect

相关文章

网友评论

      本文标题:Spark 简单的wordcount

      本文链接:https://www.haomeiwen.com/subject/nxpskxtx.html