美文网首页玩转大数据程序员
Azkaban 设置 Multiple Executor Mod

Azkaban 设置 Multiple Executor Mod

作者: 虾米在海飘 | 来源:发表于2016-12-01 16:24 被阅读983次

设置multiple Executor mode

即在azkaban-web-server中的azkaban.properties添加:

Multiple Executor Mode

azkaban.use.multiple.executors=true
azkaban.executorselector.filters=StaticRemainingFlowSize,MinimumFreeMemory,CpuStatus
azkaban.executorselector.comparator.NumberOfAssignedFlowComparator=1
azkaban.executorselector.comparator.Memory=1
azkaban.executorselector.comparator.LastDispatched=1
azkaban.executorselector.comparator.CpuUsage=1

比较因子为NumberOfAssignedFlowComparator、Memory、LastDispatched、CpuUsage 默认权重都是1
同时在数据库中插入Executor:

insert into executors(host,port) values("ExecutorIP",12321);

重启 AzkabanWebServer 进程

相关文章

网友评论

    本文标题:Azkaban 设置 Multiple Executor Mod

    本文链接:https://www.haomeiwen.com/subject/eenxmttx.html