line.spl...">
美文网首页
Spark 简单的wordcount

Spark 简单的wordcount

作者: RoronoaZoro丶 | 来源:发表于2017-07-21 09:14 被阅读0次

    sc.textFile("/input/words.txt")

    .flatMap(line => line.split(" "))

    .map(word => (word, 1))

    .reduceByKey((x, y) => x + y)

    .collect

    sc.textFile("/input/words.txt")

    .flatMap(_.split(" "))

    .map((_, 1))

    .reduceByKey(_ + _)

    .collect

    相关文章

      网友评论

          本文标题:Spark 简单的wordcount

          本文链接:https://www.haomeiwen.com/subject/nxpskxtx.html