• hadoop报错


    19/11/24 08:29:08 INFO qlh.MyMapreduce: ================this is job=================
    19/11/24 08:29:09 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    19/11/24 08:29:10 INFO client.RMProxy: Connecting to ResourceManager at hadoop12.zhulifei.com/192.168.253.12:8032
    19/11/24 08:29:11 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
    19/11/24 08:29:11 INFO input.FileInputFormat: Total input paths to process : 1
    19/11/24 08:29:11 INFO mapreduce.JobSubmitter: number of splits:1
    19/11/24 08:29:12 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1574550271305_0001
    19/11/24 08:29:12 INFO impl.YarnClientImpl: Submitted application application_1574550271305_0001
    19/11/24 08:29:12 INFO mapreduce.Job: The url to track the job: http://hadoop12.zhulifei.com:8088/proxy/application_1574550271305_0001/
    19/11/24 08:29:12 INFO mapreduce.Job: Running job: job_1574550271305_0001
    19/11/24 08:29:24 INFO mapreduce.Job: Job job_1574550271305_0001 running in uber mode : false
    19/11/24 08:29:24 INFO mapreduce.Job:  map 0% reduce 0%
    19/11/24 08:29:25 INFO mapreduce.Job: Task Id : attempt_1574550271305_0001_m_000000_0, Status : FAILED
    Container launch failed for container_1574550271305_0001_01_000002 : org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container. 
    This token is expired. current time is 1574555364735 found 1574551368400
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
        at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
        at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
    
    19/11/24 08:29:26 INFO mapreduce.Job: Task Id : attempt_1574550271305_0001_m_000000_1, Status : FAILED
    Container launch failed for container_1574550271305_0001_01_000003 : org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container. 
    This token is expired. current time is 1574555366356 found 1574551370479
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
        at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
        at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
    
    19/11/24 08:29:28 INFO mapreduce.Job: Task Id : attempt_1574550271305_0001_m_000000_2, Status : FAILED
    Container launch failed for container_1574550271305_0001_01_000004 : org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container. 
    This token is expired. current time is 1574555368387 found 1574551372526
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
        at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
        at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
        at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

     namenode,datanode时间不同步问题

    解决方法

    方法一:

    1.重新启动,重新执行

    方法二:  我用了第二种方法

    如果提示西面的提示

    [root@Slave2 mapreduce]# ntpdate pool.ntp.org -bash: ntpdate: command not found

    需要下载  yum install -y ntp

     

    2.    多个datanode与namenode进行时间同步,在每台服务器执行如下两个命令进行同步

        1)输入“cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime”

        2)输入“ntpdate pool.ntp.org”  或者是   ntpdate s2c.time.edu.cn

    方法三

    #crontab -e
    编辑0 1 * * * /usr/sbin/ntpdate cn.pool.ntp.org
    wq保存
    
    #/usr/sbin/ntpdate cn.pool.ntp.org
    报错:……the NTP socket is in use, exiting
    
    (停止服务)
    
    #  service ntpd stop
    (设置开机不启动)
    
    # chkconfig ntpd off
    然后执行: 
    
    # /usr/sbin/ntpdate cn.pool.ntp.org
    成功:
    
    adjust time server 5.79.108.34 offset -0.001357 sec
    
    即时生效暴力方法:
    
    #  date -s 00:00:00

     

     

  • 相关阅读:
    2018.08.02
    加油。
    2018.07.08
    2018.06.22
    LeetCode #169. Majority Element 数组 摩尔投票法
    LeetCode #119 Pascal's Triangle II 数组 滚动数组
    LeetCode #845 Longest Mountain in Array 数组 线性DP
    LeetCode #41 First Missing Positive 数组
    LeetCode #384 Shuffle an Array 数组 洗牌算法
    LeetCode #189 Rotate Array 数组 双变量 双指针
  • 原文地址:https://www.cnblogs.com/zhulina-917/p/11939811.html
Copyright © 2020-2023  润新知