美文网首页
黑猴子的家:Kylin 快速入门之Hive 和 Kylin 性能

黑猴子的家:Kylin 快速入门之Hive 和 Kylin 性能

作者: 黑猴子的家 | 来源:发表于2020-02-07 14:14 被阅读0次

    1、Hive查询

    hive> select dname,sum(sal) from emp e join dept d on e.deptno = d.deptno group by dname;
    Query ID = yinggu_20200206182830_de4886e0-02c9-4286-9eab-c9051f2680bc
    Total jobs = 1
    Execution log at: /tmp/yinggu/yinggu_20200206182830_de4886e0-02c9-4286-9eab-c9051f2680bc.log
    2020-02-06 18:28:58     Starting to launch local task to process map join;      maximum memory = 477626368
    2020-02-06 18:29:07     Dump the side-table for tag: 1 with group count: 4 into file: file:/tmp/yinggu/77548f6b-12a9-4ecf-b8c5-98f8ff460154/hive_2020-02-06_18-28-30_364_7879875538827550657-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile11--.hashtable
    2020-02-06 18:29:08     Uploaded 1 File to: file:/tmp/yinggu/77548f6b-12a9-4ecf-b8c5-98f8ff460154/hive_2020-02-06_18-28-30_364_7879875538827550657-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile11--.hashtable (373 bytes)
    2020-02-06 18:29:08     End of local task; Time Taken: 9.387 sec.
    Execution completed successfully
    MapredLocal task succeeded
    Launching Job 1 out of 1
    Number of reduce tasks not specified. Estimated from input data size: 1
    In order to change the average load for a reducer (in bytes):
      set hive.exec.reducers.bytes.per.reducer=<number>
    In order to limit the maximum number of reducers:
      set hive.exec.reducers.max=<number>
    In order to set a constant number of reducers:
      set mapreduce.job.reduces=<number>
    Starting Job = job_1580972908133_0011, Tracking URL = http://hadoop103:8088/proxy/application_1580972908133_0011/
    Kill Command = /opt/module/hadoop-2.8.2/bin/hadoop job  -kill job_1580972908133_0011
    Hadoop job information for Stage-2: number of mappers: 1; number of reducers: 1
    2020-02-06 18:29:38,164 Stage-2 map = 0%,  reduce = 0%
    2020-02-06 18:29:47,695 Stage-2 map = 100%,  reduce = 0%, Cumulative CPU 1.59 sec
    2020-02-06 18:29:58,386 Stage-2 map = 100%,  reduce = 100%, Cumulative CPU 3.72 sec
    MapReduce Total cumulative CPU time: 3 seconds 720 msec
    Ended Job = job_1580972908133_0011
    MapReduce Jobs Launched: 
    Stage-Stage-2: Map: 1  Reduce: 1   Cumulative CPU: 3.72 sec   HDFS Read: 13180 HDFS Write: 48 SUCCESS
    Total MapReduce CPU Time Spent: 3 seconds 720 msec
    OK
    ACCOUNTING      8750.0
    RESEARCH        10875.0
    SALES   9400.0
    Time taken: 94.225 seconds, Fetched: 3 row(s)
    

    2、Kylin 查询

    1)查询时间
    2)数据图表展示以及导出
    3)图表展示之条形图
    4)图表展示之饼图

    相关文章

      网友评论

          本文标题:黑猴子的家:Kylin 快速入门之Hive 和 Kylin 性能

          本文链接:https://www.haomeiwen.com/subject/osmmxhtx.html