美文网首页
“Application rejected by queue p

“Application rejected by queue p

作者: Anan9527 | 来源:发表于2018-11-09 01:05 被阅读0次
    hive> select count(*) from kylin_sales limit 10;
    Query ID = root_20181108175454_275f4f71-f877-43e0-8d51-b9b53a439a4b
    Total jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks determined at compile time: 1
    In order to change the average load for a reducer (in bytes):
      set hive.exec.reducers.bytes.per.reducer=<number>
    In order to limit the maximum number of reducers:
      set hive.exec.reducers.max=<number>
    In order to set a constant number of reducers:
      set mapreduce.job.reduces=<number>
    java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_154167062 YARN : Application rejected by queue placement policy
            at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:336)
            at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)
            at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
    

    排查问题
    1.上面的报错与队列相关
    2.CDH yarn界面问题排查队列生成的样子异常


    image.png 让我想到了集群动态资源池放置规则,我打开集群动态资源池配置的放置规则一看果然是因为无法创建资源池或者没指定队列造成的异常。进行如下配置即可。 image.png

    相关文章

      网友评论

          本文标题:“Application rejected by queue p

          本文链接:https://www.haomeiwen.com/subject/tsfgxqtx.html