• 安装hive 个人遇到的问题小问题


                               仅供个人学习记录。

    1. 异常错误信息:java.io.exception : Filesystem closed.

      解决方法:

      进入所安装的Hive的conf目录,找到hive-site.xml,(若没修改,则是hive-default.xml.template)。

      <property>

         <name>hive.metastore.schema.verification</name>

          <value>true</value>

           <description>

           Enforce metastore schema version consistency.

           True: Verify that version information stored in metastore matches with one from Hive jars.  Also disable automatic

                 schema migration attempt. Users are required to manully migrate schema after Hive upgrade which ensures

                 proper metastore schema migration. (Default)

           False: Warn if the version information stored in metastore doesn't match with one from in Hive jars.

           </description>

      </property>

       改为

      <property>

          <name>hive.metastore.schema.verification</name>

          <value>false</value>

           <description>

           Enforce metastore schema version consistency.

           True: Verify that version information stored in metastore matches with one from Hive jars.  Also disable automatic

                schema migration attempt. Users are required to manully migrate schema after Hive upgrade which ensures

                proper metastore schema migration. (Default)

           False: Warn if the version information stored in metastore doesn't match with one from in Hive jars.

           </description>

      </property>

      hive.metastore.schema.verification:强制metastore的schema一致性,开启的话会校验在metastore中存储的信息的版本和hive的jar包中的版本一致性,并且关闭自动schema

      迁移,用户必须手动的升级hive并且迁移schema,关闭的话只会在版本不一致时给出警告,默认是false不开启;

    2. the root scratch dir : /tmp/hive in hdfs should be writable. current permissions are : rwx--x--x

      解决方法:

      hadoop fs -chmod -R 777 /tmp

      原因:从The root scratch dir: /tmp/hive on HDFS should be writable. Currentpermissions are: rwxr-xr-x可以看出。系统要求在hdfs上用户应该具备写权限,而从报错可以看出

      只有所有者具有写权限,所有组合其他用户不具备。

  • 相关阅读:
    dfs模板
    24点
    个人阅读三
    个人阅读作业2:关于项目经历的心得
    代码复审
    Pair Project1:电梯控制程序
    第二次个人项目——阅读经典教材
    THE First Individual Project
    个人阅读作业3
    个人阅读作业2
  • 原文地址:https://www.cnblogs.com/wangzhaoshuang/p/7412740.html
Copyright © 2020-2023  润新知