Hadoop问题

version: 2.7.3

Kill a hadoop job:

yarn application -kill $ApplicationId

You can get a list of all ApplicationId's doing:

yarn application -list

MapReduce jobs get stuck in Accepted state:

A job stuck in accepted state on YARN is usually because of free resources are not enough. You can check it at http://resourcemanager:port/cluster/scheduler:

if Memory Used + Memory Reserved >= Memory Total, memory is not enough
if VCores Used + VCores Reserved >= VCores Total, VCores is not enough

It may also be limited by parameters such as maxAMShare.
See more: http://stackoverflow.com/questions/20200636/mapreduce-jobs-get-stuck-in-accepted-state

查看scheduler发现Memory Total为0，htop发现内存已被chrome几乎用尽，关闭chrome，重启了yarn，完美运行job