• hdfs对namenode format 之后 应该首先检查内存消耗情况,以判断是否支持开启yarn


    http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml  3.0.0

    yarn.scheduler.minimum-allocation-mb 1024 The minimum allocation for every container request at the RM in MBs. Memory requests lower than this will be set to the value of this property. Additionally, a node manager that is configured to have less memory than this value will be shut down by the resource manager.
    yarn.scheduler.maximum-allocation-mb 8192 The maximum allocation for every container request at the RM in MBs. Memory requests higher than this will throw an InvalidResourceRequestException.

    http://hadoop.apache.org/docs/r2.7.5/hadoop-yarn/hadoop-yarn-common/yarn-default.xml

    yarn.scheduler.minimum-allocation-mb 1024 The minimum allocation for every container request at the RM, in MBs. Memory requests lower than this will throw a InvalidResourceRequestException.
    yarn.scheduler.maximum-allocation-mb 8192 The maximum allocation for every container request at the RM, in MBs. Memory requests higher than this will throw a InvalidResourceRequestException.

    Additionally, a node manager that is configured to have less memory than this value will be shut down by the resource manager.

    【1】shutdown -r

    【2】cd /usr/local/hadoop; 

    ./root_rm_logs_mydn-nn_roottmp.sh; 

    [root@bigdata-server-02 hadoop]# cat root_rm_logs_mydn-nn_roottmp.sh
    ssh bigdata-server-01 'cd /usr/local/hadoop;rm -rf {mydatanode,mynamenode}/*;rm -rf /tmp/*;rm -rf logs/*';
    ssh bigdata-server-02 'cd /usr/local/hadoop;rm -rf {mydatanode,mynamenode}/*;rm -rf /tmp/*;rm -rf logs/*';
    ssh bigdata-server-03 'cd /usr/local/hadoop;rm -rf {mydatanode,mynamenode}/*;rm -rf /tmp/*;rm -rf logs/*';
    【3】./bin/hdfs namenode -format;

    该步后应该检查内存消耗情况,以判断是否支持开启yarn

    【4】free -m;

    [root@bigdata-server-02 hadoop]# free -m
    total used free shared buff/cache available
    Mem: 1839 782 667 0 389 906
    Swap: 0 0 0

  • 相关阅读:
    Spring sprint @ ninth day
    微软面试:找水王问题
    Spring sprint @ first day
    软件工程概论 购书最低价格问题
    网络助手的NABCD分析
    记初学net-SNMP
    求二维数组联通子数组和的最大值 (联通涂色) beta!
    二维数组环状最大子矩阵
    一维数组中的最大子数组(环状)
    图书助手冲刺第七天
  • 原文地址:https://www.cnblogs.com/rsapaper/p/8111516.html
Copyright © 2020-2023  润新知