• 报错:org.apache.sqoop.common.SqoopException Message: CLIENT_0001:Server has returned exception NoClassDefFoundError: org/codehaus/jackson/map/JsonMappingException


    报错背景:

    CDH集成sqoop2服务之后,创建好link和job之后,执行job的时候报错。

    报错现象:

    sqoop:000> start job -j 1
    Exception has occurred during processing command 
    Exception: org.apache.sqoop.common.SqoopException Message: CLIENT_0001:Server has returned exception - <html><head><title>Apache Tomcat/6.0.53 - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}A.name {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 500 - Servlet execution threw an exception</h1><HR size="1" noshade="noshade"><p><b>type</b> Exception report</p><p><b>message</b> <u>Servlet execution threw an exception</u></p><p><b>description</b> <u>The server encountered an internal error that prevented it from fulfilling this request.</u></p><p><b>exception</b> <pre>javax.servlet.ServletException: Servlet execution threw an exception
        org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:631)
        org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:301)
        org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:579)
    </pre></p><p><b>root cause</b> <pre>java.lang.NoClassDefFoundError: org/codehaus/jackson/map/JsonMappingException
        org.apache.hadoop.mapreduce.Job.getJobSubmitter(Job.java:1291)
        org.apache.hadoop.mapreduce.Job.submit(Job.java:1302)
        org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submitToCluster(MapreduceSubmissionEngine.java:274)
        org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:255)
        org.apache.sqoop.driver.JobManager.start(JobManager.java:288)
        org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:380)
        org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:116)
        org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:96)
        org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:79)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
        org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:631)
        org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:301)
        org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:579)
    </pre></p><p><b>root cause</b> <pre>java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
        java.net.URLClassLoader.findClass(URLClassLoader.java:382)
        java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        org.apache.hadoop.mapreduce.Job.getJobSubmitter(Job.java:1291)
        org.apache.hadoop.mapreduce.Job.submit(Job.java:1302)
        org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submitToCluster(MapreduceSubmissionEngine.java:274)
        org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:255)
        org.apache.sqoop.driver.JobManager.start(JobManager.java:288)
        org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:380)
        org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:116)
        org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:96)
        org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:79)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
        org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:631)
        org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:301)
        org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:579)
    </pre></p><p><b>note</b> <u>The full stack trace of the root cause is available in the Apache Tomcat/6.0.53 logs.</u></p><HR size="1" noshade="noshade"><h3>Apache Tomcat/6.0.53</h3></body></html>
    
    Stack trace:
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:140)  
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179)  
         at  org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112)  
         at  org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154)  
         at  org.apache.sqoop.client.SqoopClient (SqoopClient.java:460)  
         at  org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80)  
         at  org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51)  
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127)  
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103)  
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)  
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101)  
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)  
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)  
         at  java.lang.reflect.Method (Method.java:498)  
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)  
         at  groovy.lang.MetaMethod (MetaMethod.java:233)  
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)  
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)  
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)  
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)  
         at  java.lang.reflect.Method (Method.java:498)  
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)  
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)  
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141)  
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121)  
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114)  
         at  org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1)  
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88)  
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)  
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)  
         at  java.lang.reflect.Method (Method.java:498)  
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)  
         at  groovy.lang.MetaMethod (MetaMethod.java:233)  
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)  
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)  
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)  
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)  
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)  
         at  java.lang.reflect.Method (Method.java:498)  
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267)  
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)  
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137)  
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57)  
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)  
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)  
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)  
         at  java.lang.reflect.Method (Method.java:498)  
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)  
         at  groovy.lang.MetaMethod (MetaMethod.java:233)  
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)  
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)  
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)  
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66)  
         at  java_lang_Runnable$run (null:-1)  
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)  
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108)  
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112)  
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463)  
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402)  
         at  org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128)  
    sqoop:000> 

    报错原因:

    (1) 查看详细报错情况

    sqoop:000> set option --name verbose --value true

    (2) 发现报错日志里面有这么一句话

    java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException

    (3) 可以判断出没有这个jar包

    可以试着将这jar包拷进sqoop2的jar包目录。

    报错解决:

    (1) 进入到CDH存放jar包的目录

    cd /opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/jars/

    (2) 将 jackson-core-asl-1.8.8.jar   和   jackson-mapper-asl-1.8.8.jar 复制到安装sqoop2服务器下 /var/lib/sqoop2

    cp jackson-core-asl-1.8.8.jar  jackson-mapper-asl-1.8.8.jar /var/lib/sqoop2

    (3) 重启sqoop2服务,报错解决。

  • 相关阅读:
    洛谷 P2590 [ZJOI2008]树的统计
    如何让文件夹隐藏起来,保护自己的隐私
    SharePoint入门——创建一个网站
    SharePoint 解决管理员密码修改后各种问题的来袭
    .NET创建一个即是可执行程序又是Windows服务的程序
    C#——WebApi 接口参数传参详解
    C#中对Web.Config、App.Config字符串加密与解密的方法
    邮件服务器常用地址和端口信息
    Unity3d 5.x搭载VS2013使用
    系统性能优化- Session丢失
  • 原文地址:https://www.cnblogs.com/chuijingjing/p/10855724.html
Copyright © 2020-2023  润新知