• troubleshooting-执行导数shell脚本抛异常error=2, No such file or directory


    Cannot run program "order_log.sh" (in directory "/data/yarn/nm/usercache/chenweidong/appcache/application_1536202736675_0048/container_1536202736675_0048_01_000001"): error=2, No such file or directory

    原因分析

    1)shell脚本格式不是 unix格式

    处理:

    vi shell.sh 

    :set ff=unix

    保存退出

    ff = fileformat

    本次说明是第二种情况

    2)hue webUI执行workflow 中缺失 file 标签

    解决方法

    <shell xmlns="uri:oozie:shell-action:0.1">
    <job-tracker>master.prodcdh.com:8032</job-tracker>
    <name-node>hdfs://master.prodcdh.com:8020</name-node>
    <exec>/user/chenweidong/order_log.sh</exec>
    <file>/user/chenweidong/order_log.sh#order_log.sh</file>
    <argument>user_bank</argument>
    <capture-output />
    <configuration />
    </shell>

    异常日志

    2018-09-07 17:19:06,080 INFO org.apache.oozie.action.hadoop.ShellActionExecutor: SERVER[master.prodcdh.com] USER[chenweidong] GROUP[-] TOKEN[] APP[My Workflow] JOB[0000001-180907154815305-oozie-oozi-W] ACTION[0000001-180907154815305-oozie-oozi-W@shell-9e1d] action completed, external ID [application_1536202736675_0048]
    2018-09-07 17:19:06,080 WARN org.apache.oozie.action.hadoop.ShellActionExecutor: SERVER[master.prodcdh.com] USER[chenweidong] GROUP[-] TOKEN[] APP[My Workflow] JOB[0000001-180907154815305-oozie-oozi-W] ACTION[0000001-180907154815305-oozie-oozi-W@shell-9e1d] Launcher ERROR, reason: Cannot run program "order_log.sh" (in directory "/data/yarn/nm/usercache/chenweidong/appcache/application_1536202736675_0048/container_1536202736675_0048_01_000001"): error=2, No such file or directory
    2018-09-07 17:19:06,080 WARN org.apache.oozie.action.hadoop.ShellActionExecutor: SERVER[master.prodcdh.com] USER[chenweidong] GROUP[-] TOKEN[] APP[My Workflow] JOB[0000001-180907154815305-oozie-oozi-W] ACTION[0000001-180907154815305-oozie-oozi-W@shell-9e1d] Launcher exception: Cannot run program "order_log.sh" (in directory "/data/yarn/nm/usercache/chenweidong/appcache/application_1536202736675_0048/container_1536202736675_0048_01_000001"): error=2, No such file or directory
    java.io.IOException: Cannot run program "order_log.sh" (in directory "/data/yarn/nm/usercache/chenweidong/appcache/application_1536202736675_0048/container_1536202736675_0048_01_000001"): error=2, No such file or directory
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
    at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:114)
    at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:73)
    at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
    at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:63)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:410)
    at org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:55)
    at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:223)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
    at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:217)
    at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
    at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
    Caused by: java.io.IOException: error=2, No such file or directory
    at java.lang.UNIXProcess.forkAndExec(Native Method)
    at java.lang.UNIXProcess.(UNIXProcess.java:247)
    at java.lang.ProcessImpl.start(ProcessImpl.java:134)
    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
    ... 20 more

  • 相关阅读:
    5、打断点(bpu)
    4、post请求(json)
    3、get请求(url详解)
    2、接口测试(Composer)
    1、Fiddler基础
    常规测试、安全测试、渗透测试-区别
    记录一次python的mysqlclient依赖库报错问题
    airflow当触发具有多层subDAG的任务的时候,出现[Duplicate entry ‘xxxx’ for key dag_id]的错误的问题处理
    Python3并发写文件
    python hash 每次调用结果不一样
  • 原文地址:https://www.cnblogs.com/chwilliam85/p/9693302.html
Copyright © 2020-2023  润新知