• hive表导出到mysql报错


    Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject

    hadoop@hadoop-virtual-machine:~/app/sqoop-1.4.6-cdh5.7.0$ bin/sqoop export --connect jdbc:mysql://localhost:3306/dbtaobao --username root --password 110110110 --table user_log --export-dir '/user/hive/warehouse/dbtaobao.db/inner_user_log' --fields-terminated-by ',';
    Warning: /home/hadoop/app/hbase does not exist! HBase imports will fail.
    Please set $HBASE_HOME to the root of your HBase installation.
    Warning: /home/hadoop/app/sqoop-1.4.6-cdh5.7.0/../hcatalog does not exist! HCatalog jobs will fail.
    Please set $HCAT_HOME to the root of your HCatalog installation.
    Warning: /home/hadoop/app/sqoop-1.4.6-cdh5.7.0/../accumulo does not exist! Accumulo imports will fail.
    Please set $ACCUMULO_HOME to the root of your Accumulo installation.
    Warning: /home/hadoop/app/sqoop-1.4.6-cdh5.7.0/../zookeeper does not exist! Accumulo imports will fail.
    Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
    18/09/13 07:35:48 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.7.0
    18/09/13 07:35:48 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
    18/09/13 07:35:48 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
    18/09/13 07:35:48 INFO tool.CodeGenTool: Beginning code generation
    Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
    18/09/13 07:35:49 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_log` AS t LIMIT 1
    18/09/13 07:35:49 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_log` AS t LIMIT 1
    18/09/13 07:35:49 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/hadoop/app/hadoop-2.6.0-cdh5.7.0
    注: /tmp/sqoop-hadoop/compile/93c07aefc0d6cf53115cac026f3ec442/user_log.java使用或覆盖了已过时的 API。
    注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
    18/09/13 07:35:56 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/93c07aefc0d6cf53115cac026f3ec442/user_log.jar
    18/09/13 07:35:56 INFO mapreduce.ExportJobBase: Beginning export of user_log
    Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject
    	at org.apache.sqoop.util.SqoopJsonUtil.getJsonStringforMap(SqoopJsonUtil.java:42)
    	at org.apache.sqoop.SqoopOptions.writeProperties(SqoopOptions.java:742)
    	at org.apache.sqoop.mapreduce.JobBase.putSqoopOptionsToConfiguration(JobBase.java:369)
    	at org.apache.sqoop.mapreduce.JobBase.createJob(JobBase.java:355)
    	at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:417)
    	at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
    	at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:81)
    	at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
    	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
    	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
    	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
    	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
    	at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
    Caused by: java.lang.ClassNotFoundException: org.json.JSONObject
    	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
    	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    	... 14 more
    

    解决:

    这是因为sqoop缺少java-json.jar包.

    下载java-json.jar包:

    http://www.java2s.com/Code/Jar/j/Downloadjavajsonjar.htm

    把java-json.jar添加到../sqoop/lib目录

  • 相关阅读:
    自动化运维 Expect
    C 语言Struct 实现运行类型识别 RTTI
    Mac 安装配置rz、sz
    Mac Vim + ctags 实现多目录跳转
    Mac 使用Sublime Text 3 搭建C开发环境
    this.$createElement用法
    判断一个数字在数组中出现次数
    iview的table:自定义table表格中列头的标题和点击事件(renderHeader)
    js计算不精确问题
    js 日期时间的格式化
  • 原文地址:https://www.cnblogs.com/zhangguangxiang/p/14232637.html
Copyright © 2020-2023  润新知