美文网首页玩转大数据程序员
Azkaban 设置 Multiple Executor Mod

Azkaban 设置 Multiple Executor Mod

作者: 虾米在海飘 | 来源:发表于2016-12-01 16:24 被阅读983次

    设置multiple Executor mode

    即在azkaban-web-server中的azkaban.properties添加:

    Multiple Executor Mode

    azkaban.use.multiple.executors=true
    azkaban.executorselector.filters=StaticRemainingFlowSize,MinimumFreeMemory,CpuStatus
    azkaban.executorselector.comparator.NumberOfAssignedFlowComparator=1
    azkaban.executorselector.comparator.Memory=1
    azkaban.executorselector.comparator.LastDispatched=1
    azkaban.executorselector.comparator.CpuUsage=1

    比较因子为NumberOfAssignedFlowComparator、Memory、LastDispatched、CpuUsage 默认权重都是1
    同时在数据库中插入Executor:

    insert into executors(host,port) values("ExecutorIP",12321);

    重启 AzkabanWebServer 进程

    相关文章

      网友评论

        本文标题:Azkaban 设置 Multiple Executor Mod

        本文链接:https://www.haomeiwen.com/subject/eenxmttx.html