• hadoop、hbase、hive、zookeeper版本对应关系


    本文引用自:http://www.aboutyun.com/blog-61-62.html

    最新版本:

    hadoop和hbase版本对应关系:

    Hbase    Hadoop

    0.92.0  1.0.0

    0.92.1  1.0.0

    0.92.2  1.0.0

    0.94.0  1.0.2

    0.94.1  1.0.3

    0.94.2  1.0.3

    0.94.3  1.0.4

    0.94.4  1.0.4

    0.94.5  1.0.4

    0.94.9  1.2.0

    0.95.0  1.2.0

    Hadoop与hive版本对应关系

    hive版本  1.1.0    支持hadoop版本

    Hadoop 1.x.y 2.x.y

    hive版本 1.0.0   支持hadoop版本

    hadoop1.x.y,2.x.y

    hive版本0.13.1    支持hadoop版本

    hadoop0.20.x,0.23.x.y,1.x.y 2.x.y

    hive版本0.13.0  支持hadoop版本

    hadoop0.20.x,0.23.x.y,1.x.y,2.x.y

    hive版本0.12.0      支持hadoop版本

    hadoop0.20.x,0.23.x.y,1.x.y,2.x.y

    hive版本0.11.0      支持hadoop版本

    hadoop0.20.x,0.23.x.y,1.x.y,2.x.y

    hive版本0.10.0  支持hadoop版本

    hadoop 0.20.x,0.23.x.y,1.x.y,2.x.y

    网址:http://hive.apache.org/downloads.html

    补充一些内容:

    hive、hbase、zookeeper的关系

    分布式平台软件选型(hadoop)
    软件名  最新版(高手) 稳定版三(推荐) 稳定版二(官方) 稳定版一(官方)
    Hadoop  2.5.0 2.2.0 1.2.1 0.20.2
    HBase 0.98.5  0.96.0 0.98.5 0.90.3
    Zookeeper 3.4.6 3.4.5 3.4.6 3.3.3
    Pig 0.13.0   0.13.0 0.9.0
    Hive   0.13.1 0.12.0 0.13.1 0.7.1
    sqoop 1.4.5 1.4.2    

                               说明:红色为必选。建议采用最新版

    hadoop1.2+hbase0.95.0+hive0.11.0会产生hbase+hive的不兼容,创建hive+hbase的关联表就会报pair对异常。

    hadoop1.2+hbase0.94.9+hive0.10.0没问题,解决了上个版本的不兼容问题。

    hadoop-1.0.3+hive-0.9.0+hive0.92.0兼容

    hadoop2.2+hbase0.96+hive0.12兼容(有些小问题,可能需要一些补丁)

    hadoop2.2+hbase0.96+hive0.13兼容(应该兼容)

    Hadoop与hbase支持版本

    S=支持并且测试

    X=不支持

    NT=应该可以,但是没有测试


    HBase-0.92.x
    HBase-0.94.xHBase-0.96.xHBase-0.98.x[a]HBase-1.0.x[b]
    Hadoop-0.20.205 S X X X X
    Hadoop-0.22.x S X X X X
    Hadoop-1.0.0-1.0.2[c] X X X X X
    Hadoop-1.0.3+ S S S X X
    Hadoop-1.1.x NT S S X X
    Hadoop-0.23.x X S NT X X
    Hadoop-2.0.x-alpha X NT X X X
    Hadoop-2.1.0-beta X NT S X X
    Hadoop-2.2.0 X NT [d] S S NT
    Hadoop-2.3.x X NT S S NT
    Hadoop-2.4.x X NT S S S
    Hadoop-2.5.x X NT S S S

    [a] Support for Hadoop 1.x is deprecated.

    [b] Hadoop 1.x is NOT supported

    [c] HBase requires hadoop 1.0.3 at a minimum; there is an issue where we cannot find KerberosUtil compiling against earlier versions of Hadoop.

    [d] To get 0.94.x to run on hadoop 2.2.0, you need to change the hadoop 2 and protobuf versions in the pom.xml: Here is a diff with pom.xml changes:

    $ svn diff pom.xml Index: pom.xml =================================================================== --- pom.xml (revision 1545157) +++ pom.xml (working copy) @@ -1034,7 +1034,7 @@ <slf4j.version>1.4.3</slf4j.version> <log4j.version>1.2.16</log4j.version> <mockito-all.version>1.8.5</mockito-all.version> - <protobuf.version>2.4.0a</protobuf.version> + <protobuf.version>2.5.0</protobuf.version> <stax-api.version>1.0.1</stax-api.version> <thrift.version>0.8.0</thrift.version> <zookeeper.version>3.4.5</zookeeper.version> @@ -2241,7 +2241,7 @@ </property> </activation> <properties> - <hadoop.version>2.0.0-alpha</hadoop.version> + <hadoop.version>2.2.0</hadoop.version> <slf4j.version>1.6.1</slf4j.version> </properties> <dependencies>

    The next step is to regenerate Protobuf files and assuming that the Protobuf has been installed:

    • Go to the hbase root folder, using the command line;

    • Type the following commands:

      $ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/hbase.proto$ protoc -Isrc/main/protobuf --java_out=src/main/java src/main/protobuf/ErrorHandling.proto

    Building against the hadoop 2 profile by running something like the following command:

    $ mvn clean install assembly:single -Dhadoop.profile=2.0 -DskipTests
    Replace the Hadoop Bundled With HBase!

    Because HBase depends on Hadoop, it bundles an instance of the Hadoop jar under its lib directory. The bundled jar is ONLY for use in standalone mode. In distributed mode, it is critical that the version of Hadoop that is out on your cluster match what is under HBase. Replace the hadoop jar found in the HBase lib directory with the hadoop jar you are running on your cluster to avoid version mismatch issues. Make sure you replace the jar in HBase everywhere on your cluster. Hadoop version mismatch issues have various manifestations but often all looks like its hung up.

    更新内容:

    Hadoop version support matrix

    ·         "S" = supported

    ·         "X" = not supported

    ·         "NT" = Not tested

     

    HBase-0.92.x

    HBase-0.94.x

    HBase-0.96.x

    HBase-0.98.x (Support for Hadoop 1.1+ is deprecated.)

    HBase-1.0.x (Hadoop 1.x is NOT supported)

    Hadoop-0.20.205

    S

    X

    X

    X

    X

    Hadoop-0.22.x

    S

    X

    X

    X

    X

    Hadoop-1.0.x

    X

    X

    X

    X

    X

    Hadoop-1.1.x

    NT

    S

    S

    NT

    X

    Hadoop-0.23.x

    X

    S

    NT

    X

    X

    Hadoop-2.0.x-alpha

    X

    NT

    X

    X

    X

    Hadoop-2.1.0-beta

    X

    NT

    S

    X

    X

    Hadoop-2.2.0

    X

    NT

    S

    S

    NT

    Hadoop-2.3.x

    X

    NT

    S

    S

    NT

    Hadoop-2.4.x

    X

    NT

    S

    S

    S

    Hadoop-2.5.x

    X

    NT

    S

    S

    S

     

  • 相关阅读:
    ie6动态创建iframe无法显示内容的bug
    时间字符串解析
    自定义时间格式转换代码
    MySql存储过程异常处理示例
    解析数字签名的Substring结构
    自动输出类的字段及值
    深复制与浅复制的实现
    ie版本过低提示升级ie的示例
    Web安全攻防TCP/IP安全篇
    不同网段相互通信实验
  • 原文地址:https://www.cnblogs.com/jingblogs/p/5500357.html
Copyright © 2020-2023  润新知