• oozie执行报错日志


    Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
    java.io.IOException: Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
        at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:93)
        at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:55)
        at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:39)
        at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:227)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.io.IOException: error=2, 没有那个文件或目录
        at java.lang.UNIXProcess.forkAndExec(Native Method)
        at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
        at java.lang.ProcessImpl.start(ProcessImpl.java:134)
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
        ... 17 more
    
    Log Type: stdout
    
    Log Length: 81310
    
    Showing 4096 bytes of 81310 total. Click here for the full log.
    
    odule/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/common/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/common/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/hdfs/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/hdfs/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/yarn/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/yarn/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/mapreduce/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/mapreduce/lib/*:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002/*:
    SSH_CONNECTION=192.168.192.103 40453 192.168.192.102 22:
    HADOOP_TOKEN_FILE_LOCATION=/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002/container_tokens:
    HADOOP_NFS3_OPTS=:
    HADOOP_NAMENODE_OPTS=-Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender :
    QTDIR=/usr/lib64/qt-3.3:
    NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat:
    OOZIE_ACTION_CONF_XML=/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002/action.xml:
    YARN_NICENESS=0:
    QTLIB=/usr/lib64/qt-3.3/lib:
    HOME=/home/:
    CONTAINER_ID=container_1560704889158_0005_01_000002:
    HADOOP_PORTMAP_OPTS=-Xmx512m -Xmx512m :
    MALLOC_ARENA_MAX=4:
    =================================================================
    
    >>> Invoking Shell command line now >>
    
    
    <<< Invocation of Main class completed <<<
    
    Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
    java.io.IOException: Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
        at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:93)
        at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:55)
        at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:39)
        at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:227)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.io.IOException: error=2, 没有那个文件或目录
        at java.lang.UNIXProcess.forkAndExec(Native Method)
        at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
        at java.lang.ProcessImpl.start(ProcessImpl.java:134)
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
        ... 17 more
    
    Oozie Launcher failed, finishing Hadoop job gracefully
    
    Oozie Launcher, uploading action data to HDFS sequence file: hdfs://hadoop102:8020/user/lxl/oozie-lxl/0000000-190617051500311-oozie-lxl-W/shell-node--shell/action-data.seq
    
    Oozie Launcher ends
  • 相关阅读:
    【Redis】简介与安装
    【JAVA】 Java 连接池的工作原理
    【异常】ORA-01536: space quota exceeded for tablespace
    【Oracle】Oracle 序列步长问题
    【ORACLE】常用脚本
    【ORACLE】特殊的NULL
    【JAVA】Runtime
    【JAVA】Calendar
    出现脚本错误或者未正确调用 Page()
    小程序出现 “2 not found” 解决方案
  • 原文地址:https://www.cnblogs.com/LXL616/p/11037255.html
Copyright © 2020-2023  润新知