• cannot find class org.apache.hudi.hadoop.HoodieParquetInputFormat


    Error: java.io.IOException: cannot find class org.apache.hudi.hadoop.HoodieParquetInputFormat at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:673) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:169) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

    临时方案:

    set xxx;
    
    add jar hdfs://dw/tmp/wangyh/hudi/jar/hudi-hadoop-mr-bundle-0.10.0.jar;
    
    insert  ...

    平安方案:

      添加hudi-hadoop-mr-bundle-0.5.3.jar 到HIVE lib目录 重启Hive metastore 和hiveserver2

  • 相关阅读:
    C语言第四章
    C第三章,指代数据
    DES+MD5加密
    时间选择器
    百度地图定位
    Httputils请求网络数据
    xStream解析xml文件
    pulltorefresh
    slidingmenu的应用
    Duutils创建数据库
  • 原文地址:https://www.cnblogs.com/LIAOBO/p/16071911.html
Copyright © 2020-2023  润新知