1、Hive查询
hive> select dname,sum(sal) from emp e join dept d on e.deptno = d.deptno group by dname;
Query ID = yinggu_20200206182830_de4886e0-02c9-4286-9eab-c9051f2680bc
Total jobs = 1
Execution log at: /tmp/yinggu/yinggu_20200206182830_de4886e0-02c9-4286-9eab-c9051f2680bc.log
2020-02-06 18:28:58 Starting to launch local task to process map join; maximum memory = 477626368
2020-02-06 18:29:07 Dump the side-table for tag: 1 with group count: 4 into file: file:/tmp/yinggu/77548f6b-12a9-4ecf-b8c5-98f8ff460154/hive_2020-02-06_18-28-30_364_7879875538827550657-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile11--.hashtable
2020-02-06 18:29:08 Uploaded 1 File to: file:/tmp/yinggu/77548f6b-12a9-4ecf-b8c5-98f8ff460154/hive_2020-02-06_18-28-30_364_7879875538827550657-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile11--.hashtable (373 bytes)
2020-02-06 18:29:08 End of local task; Time Taken: 9.387 sec.
Execution completed successfully
MapredLocal task succeeded
Launching Job 1 out of 1
Number of reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
Starting Job = job_1580972908133_0011, Tracking URL = http://hadoop103:8088/proxy/application_1580972908133_0011/
Kill Command = /opt/module/hadoop-2.8.2/bin/hadoop job -kill job_1580972908133_0011
Hadoop job information for Stage-2: number of mappers: 1; number of reducers: 1
2020-02-06 18:29:38,164 Stage-2 map = 0%, reduce = 0%
2020-02-06 18:29:47,695 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 1.59 sec
2020-02-06 18:29:58,386 Stage-2 map = 100%, reduce = 100%, Cumulative CPU 3.72 sec
MapReduce Total cumulative CPU time: 3 seconds 720 msec
Ended Job = job_1580972908133_0011
MapReduce Jobs Launched:
Stage-Stage-2: Map: 1 Reduce: 1 Cumulative CPU: 3.72 sec HDFS Read: 13180 HDFS Write: 48 SUCCESS
Total MapReduce CPU Time Spent: 3 seconds 720 msec
OK
ACCOUNTING 8750.0
RESEARCH 10875.0
SALES 9400.0
Time taken: 94.225 seconds, Fetched: 3 row(s)
网友评论