• service to hadoop01/hadoop01:8020 Datanode denied communication with namenode because the host is not in the include-list


    Hadoop新增节点报错:

    2021-06-28 16:02:12,489 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool BP-433041383-192.168.10.249-1494331993586 (Datanode Uuid 1e3d6ada-e61d-46fd-840b-1de724dd4aa0) service to yz-tpl-hadoop-10-251/192.168.10.251:8020 beginning handshake with NN
    2021-06-28 16:02:12,492 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool BP-433041383-192.168.10.249-1494331993586 (Datanode Uuid 1e3d6ada-e61d-46fd-840b-1de724dd4aa0) service to yz-tpl-hadoop-10-251/192.168.10.251:8020 Datanode denied communication with namenode because the host is not in the include-list: DatanodeRegistration(192.168.10.252:50010, datanodeUuid=1e3d6ada-e61d-46fd-840b-1de724dd4aa0, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-2d472729-3f74-4306-91f4-359b84bf2e26;nsid=652116751;c=0)
            at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.registerDatanode(DatanodeManager.java:876)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.registerDatanode(FSNamesystem.java:4529)
            at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.registerDatanode(NameNodeRpcServer.java:1279)
            at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.registerDatanode(DatanodeProtocolServerSideTranslatorPB.java:95)
            at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:28539)
            at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
            at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
            at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
            at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
            at java.security.AccessController.doPrivileged(Native Method)
            at javax.security.auth.Subject.doAs(Subject.java:415)
            at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
            at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
    

      

    根据报错显示,初始化失败,新增节点不在include-list文件列表中,查看hadoop  hdfs-site.xml配置文件,确定指定的include文件是哪一个,检验新增节点是否在该配置文件中。如果不存在则加入,然后在namenode重新刷新DataNode节点;

    命令:hdfs dfsadmin -fs hdfs://xx.xxx.x.xxx:8020 -refreshNodes   //其中xx.xxx.x.xxx是active/standby namenode的IP(具体是哪个IP可根据报错节点,或者配置不对的节点进行操作);

    参考:

    https://blog.csdn.net/qq_34477362/article/details/84584381

  • 相关阅读:
    【Android测试】Android截图的深水区
    【Android测试】UI自动化代码优化之路
    网页爬虫小试牛刀
    【Android测试】【第十九节】Espresso——API详解
    【iOS测试】【随笔】帧率FPS评测
    【iOS测试】【随笔】崩溃日志获取
    【后台测试】Linux下小试jmeter
    【后台测试】手把手教你jmeter压测
    【行业交流】2016 TiD质量竞争力大会——移动互联网测试到质量的转变之路
    【Android测试】【第十八节】Espresso——环境搭建
  • 原文地址:https://www.cnblogs.com/-courage/p/14945058.html
Copyright © 2020-2023  润新知