• Hadoop YARN: 1/1 local-dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir; 1/1 log-dirs are bad: /var/log/hadoop-yarn/containers hdfs硬盘90% yarn unhealthy


    1/1 local-dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir; 1/1 log-dirs are bad: /var/log/hadoop-yarn/containers

    yarn-rm-unhealty

    Node Manager logs

    1
    2
    3
    yarn.server.nodemanager.DirectoryCollection: Directory /var/lib/hadoop-yarn/cache/yarn/nm-local-dir error, used space above threshold of 90.0%, removing from list of valid directories
    2014-11-17 17:45:00,713 WARN org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection: Directory /var/log/hadoop-yarn/containers error, used space above threshold of 90.0%, removing from list of valid directories
    2014-11-17 17:45:00,713 INFO org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService: Disk(s) failed: 1/1 local-dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir; 1/1 log-dirs are bad: /var/log/hadoop

    Resource Manager logs

    1
    2014-11-17 16:57:07,301 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Node localhost:34650 reported UNHEALTHY with details: 1/1 local-dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir; 1/1 log-dirs are bad: /var/log/hadoop-yarn/containers
     
     
     
     

    遇到上面这样的问题,我的解决办法是:

    在yarn-site.xml 里面配置

    yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage
    95.0

    重启yarn即可解决!

    yarn-daemon.sh stop nodemanager

    yarn-daemon.sh start nodemanager

  • 相关阅读:
    c#一次性队列
    WinDbg
    async/wait
    JS 同步任务和异步任务
    VS Code格式设置
    ES6模块化导入导出
    Promise
    Spring配置
    AtCoder Beginner Contest 241 F Skate(bfs、STL)
    牛客寒假算法基础集训营6 G 迷宫2(01bfs)
  • 原文地址:https://www.cnblogs.com/tnsay/p/5917459.html
Copyright © 2020-2023  润新知