美文网首页
Yarn ACL(fair-scheduler)

Yarn ACL(fair-scheduler)

作者: 专职掏大粪 | 来源:发表于2021-06-17 11:13 被阅读0次

    yarn-site.xml 添加如下内容

    <property>
       <name>yarn.acl.enable</name>
       <value>true</value>
    </property>
    
    <property>
       <name>yarn.admin.acl</name>
       <value>root root</value>
    </property>
    

    fair-scheduler.xml 完整的demo

    <?xml version="1.0"?>
    <allocations>
    
    <queue name="root">
     <aclSubmitApps> </aclSubmitApps>
     <aclAdministerApps> </aclAdministerApps>
    
    <queue name="default">
     <aclSubmitApps></aclSubmitApps>
     <aclAdministerApps> </aclAdministerApps>
     <minResources>1024 mb,1 vcores</minResources>
     <maxResources>983040 mb,720 vcores</maxResources>
     <maxRunningApps>100</maxRunningApps> <!-- 可以同时运行的作业数 -->
     <weight>5.0</weight> <!-- 权值 -->
     <schedulingPolicy>fifo</schedulingPolicy>
    </queue>
    
    <queue name="test">
     <minResources>1024 mb,1 vcores</minResources>
     <maxResources>6029312 mb,2944 vcores</maxResources>
     <aclSubmitApps>bibo</aclSubmitApps>
     <maxRunningApps>100</maxRunningApps> <!-- 可以同时运行的作业数 -->
     <weight>4.0</weight> <!-- 权值 -->
     <schedulingPolicy>fifo</schedulingPolicy>
    </queue>
    
    </queue>
    
    </allocations>
    

    参考资料

    YARN 中公平调度程序的 ACL 不起作用

    https://www.alibabacloud.com/help/zh/doc-detail/62958.htm
    https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-site/FairScheduler.html#Queue_Access_Control_Lists

    相关文章

      网友评论

          本文标题:Yarn ACL(fair-scheduler)

          本文链接:https://www.haomeiwen.com/subject/ktxcyltx.html