• 【异常】org.apache.hadoop.hdfs.server.common.InconsistentFSStateException


    1 异常信息

    05-30 07:53:45,204 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Maximum size of an xattr: 16384
    2019-05-30 07:53:45,204 WARN org.apache.hadoop.hdfs.server.common.Storage: Storage directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name does not exist
    2019-05-30 07:53:45,223 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Encountered exception loading fsimage
    org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:377)
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:228)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1152)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:799)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)
    2019-05-30 07:53:45,272 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:50070
    2019-05-30 07:53:45,273 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...
    2019-05-30 07:53:45,274 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.
    2019-05-30 07:53:45,274 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.
    2019-05-30 07:53:45,274 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
    org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /mnt/software/hadoop-2.6.0-cdh5.16.1/data/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:377)
            at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:228)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1152)
            at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:799)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
            at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)
    2019-05-30 07:53:45,275 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
    2019-05-30 07:53:45,279 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1
    ************************************************************/

    2 原因

      因为core-site.xml 和 hdfs-site.xml配置了不一致的Hadoop.tmp.dir 目录,导致总是出现问题,删除掉core-site.xml中的tmp.dir配置,统一配置到hdfs-site.xml中

      hdfs-site.xml中的dir配置

    <property>
            <name>dfs.namenode.name.dir</name>
            <value>file:///mnt/software/hadoop-2.6.0-cdh5.16.1/data/dfs/name</value>
        </property>
        <property>
            <name>dfs.datanode.data.dir</name>
            <value>file:///mnt/software/hadoop-2.6.0-cdh5.16.1/data/dfs/data</value>
        </property>
    

      

  • 相关阅读:
    .Net 4.0新特性之Dynamic 动态类型(转载)
    三种提高Google Analytics效率的方法(转载)
    PowerBuilder 12使.NET的应用开发更快捷
    .Net 之匿名类(AnonymousType)(转载)
    ASP.NET MVC学习笔记一(转载)
    js动态获取虚拟目录名称 相当于服务端ResolveUrl("")方法(转载)
    CSS 备忘(转载)
    ASP.NET4与VS2010开发Ajax Library特征(转载)
    POJ1988 Cube Stacking
    HDU3694 Fermat Point in Quadrangle
  • 原文地址:https://www.cnblogs.com/QuestionsZhang/p/10952101.html
Copyright © 2020-2023  润新知