• AWS-CDH5.5安装-软件下载


    1.下载安装介质

    下载CM安装文件:

    [root@ip-172-31-30-175 cm5.5.0]# wget -c -r -nd -np -k -L -A rpm http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
    --2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
    Resolving archive-primary.cloudera.com... 54.237.90.33
    Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:55:01 (369 MB/s) - ?.ndex.html?.saved [2831/2831]
    
    Loading robots.txt; please ignore errors.
    --2015-12-01 07:55:01--  http://archive-primary.cloudera.com/robots.txt
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 404 Not Found
    2015-12-01 07:55:01 ERROR 404: Not Found.
    
    Removing index.html since it should be rejected.
    
    --2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=D
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=N;O=D?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:55:01 (731 MB/s) - ?.ndex.html?C=N;O=D?.saved [2831/2831]
    
    Removing index.html?C=N;O=D since it should be rejected.
    
    --2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=A
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=M;O=A?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:55:02 (761 MB/s) - ?.ndex.html?C=M;O=A?.saved [2831/2831]
    
    Removing index.html?C=M;O=A since it should be rejected.
    
    --2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=A
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=S;O=A?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:55:02 (758 MB/s) - ?.ndex.html?C=S;O=A?.saved [2831/2831]
    
    Removing index.html?C=S;O=A since it should be rejected.
    
    --2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=A
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=D;O=A?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:55:02 (744 MB/s) - ?.ndex.html?C=D;O=A?.saved [2831/2831]
    
    Removing index.html?C=D;O=A since it should be rejected.
    
    --2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 4897544 (4.7M) [application/x-redhat-package-manager]
    Saving to: ?.loudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?
    
    100%[=====================================================================================================================================================================>] 4,897,544   3.09M/s   in 1.5s    
    
    2015-12-01 07:55:03 (3.09 MB/s) - ?.loudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [4897544/4897544]
    
    --2015-12-01 07:55:03--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 533925676 (509M) [application/x-redhat-package-manager]
    Saving to: ?.loudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?
    
    100%[=====================================================================================================================================================================>] 533,925,676 3.90M/s   in 1m 58s  
    
    2015-12-01 07:57:02 (4.30 MB/s) - ?.loudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [533925676/533925676]
    
    --2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 8388 (8.2K) [application/x-redhat-package-manager]
    Saving to: ?.loudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?
    
    100%[=====================================================================================================================================================================>] 8,388       --.-K/s   in 0s      
    
    2015-12-01 07:57:02 (170 MB/s) - ?.loudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [8388/8388]
    
    --2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 10128 (9.9K) [application/x-redhat-package-manager]
    Saving to: ?.loudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?
    
    100%[=====================================================================================================================================================================>] 10,128      --.-K/s   in 0s      
    
    2015-12-01 07:57:02 (165 MB/s) - ?.loudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [10128/10128]
    
    --2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/enterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 979964 (957K) [application/x-redhat-package-manager]
    Saving to: ?.nterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?
    
    100%[=====================================================================================================================================================================>] 979,964     4.88M/s   in 0.2s    
    
    2015-12-01 07:57:02 (4.88 MB/s) - ?.nterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [979964/979964]
    
    --2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/jdk-6u31-linux-amd64.rpm
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 71204325 (68M) [application/x-redhat-package-manager]
    Saving to: ?.dk-6u31-linux-amd64.rpm?
    
    100%[=====================================================================================================================================================================>] 71,204,325  4.58M/s   in 15s     
    
    2015-12-01 07:57:18 (4.39 MB/s) - ?.dk-6u31-linux-amd64.rpm?.saved [71204325/71204325]
    
    --2015-12-01 07:57:18--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 142039186 (135M) [application/x-redhat-package-manager]
    Saving to: ?.racle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm?
    
    100%[=====================================================================================================================================================================>] 142,039,186 4.59M/s   in 30s     
    
    2015-12-01 07:57:48 (4.58 MB/s) - ?.racle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm?.saved [142039186/142039186]
    
    --2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=A
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=N;O=A?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:57:48 (834 MB/s) - ?.ndex.html?C=N;O=A?.saved [2831/2831]
    
    Removing index.html?C=N;O=A since it should be rejected.
    
    --2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=D
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=M;O=D?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:57:48 (827 MB/s) - ?.ndex.html?C=M;O=D?.saved [2831/2831]
    
    Removing index.html?C=M;O=D since it should be rejected.
    
    --2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=D
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=S;O=D?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:57:48 (806 MB/s) - ?.ndex.html?C=S;O=D?.saved [2831/2831]
    
    Removing index.html?C=S;O=D since it should be rejected.
    
    --2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=D
    Reusing existing connection to archive-primary.cloudera.com:80.
    HTTP request sent, awaiting response... 200 OK
    Length: 2831 (2.8K) [text/html]
    Saving to: ?.ndex.html?C=D;O=D?
    
    100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      
    
    2015-12-01 07:57:48 (804 MB/s) - ?.ndex.html?C=D;O=D?.saved [2831/2831]
    
    Removing index.html?C=D;O=D since it should be rejected.
    
    FINISHED --2015-12-01 07:57:48--
    Downloaded: 16 files, 718M in 2m 45s (4.35 MB/s)
    Converted 0 files in 0 seconds.
    [root@ip-172-31-30-175 cm5.5.0]# 

    检查下载文件与官网大小是否一致,经常会发生在传输过程中出差,所以务必要检查您的安装文件和Cloudera官网上的大小一致:

    [root@ip-172-31-30-175 cm5.5.0]# ls -l
    total 735432
    -rw-r--r-- 1 root root   4897544 Nov 17 05:29 cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    -rw-r--r-- 1 root root 533925676 Nov 17 05:29 cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    -rw-r--r-- 1 root root      8388 Nov 17 05:29 cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    -rw-r--r-- 1 root root     10128 Nov 17 05:29 cloudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    -rw-r--r-- 1 root root    979964 Nov 17 05:29 enterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
    -rw-r--r-- 1 root root  71204325 Nov 17 05:29 jdk-6u31-linux-amd64.rpm
    -rw-r--r-- 1 root root 142039186 Nov 17 05:29 oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm

    2.下载CDH parcel及manifest文件:

    [root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
    --2015-12-01 08:08:43-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
    Resolving archive-primary.cloudera.com... 54.237.90.33
    Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 1485836821 (1.4G)
    Saving to: ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?

    100%[===================================================================================================================================================================>] 1,485,836,821 5.26M/s in 4m 44s

    2015-12-01 08:13:27 (5.00 MB/s) - ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?.saved [1485836821/1485836821]

    [root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
    --2015-12-01 08:16:29-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
    Resolving archive-primary.cloudera.com... 54.237.90.33
    Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 49710 (49K) [application/json]
    Saving to: ?.anifest.json?

    100%[=====================================================================================================================================================================>] 49,710 --.-K/s in 0.1s

    2015-12-01 08:16:30 (347 KB/s) - ?.anifest.json?.saved [49710/49710]

     检查文件大小:

    [root@ip-172-31-30-175 cdh5.5.0]# ll
    total 1451072
    -rw-r--r-- 1 root root 1485836821 Nov 12 19:32 CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
    -rw-r--r-- 1 root root      49710 Nov 12 19:32 manifest.json
    [root@ip-172-31-30-175 cdh5.5.0]# 

    3.下载MySQL5.6和JDBC Driver

    [root@ip-172-31-30-175 cloudera]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
    --2015-12-01 08:18:13--  http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
    Resolving dev.mysql.com... 137.254.60.11
    Connecting to dev.mysql.com|137.254.60.11|:80... connected.
    HTTP request sent, awaiting response... 302 Found
    Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm [following]
    --2015-12-01 08:18:13--  http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
    Resolving cdn.mysql.com... 23.198.164.152
    Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 55950588 (53M) [application/x-redhat-package-manager]
    Saving to: ?.ySQL-server-5.6.27-1.el6.x86_64.rpm?
    
    100%[=====================================================================================================================================================================>] 55,950,588  4.98M/s   in 11s     
    
    2015-12-01 08:18:24 (5.08 MB/s) - ?.ySQL-server-5.6.27-1.el6.x86_64.rpm?.saved [55950588/55950588]



    [root@ip-172-31-30-175 mysql]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
    --2015-12-01 08:24:01-- http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
    Resolving dev.mysql.com... 137.254.60.11
    Connecting to dev.mysql.com|137.254.60.11|:80... connected.
    HTTP request sent, awaiting response... 302 Found
    Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm [following]
    --2015-12-01 08:24:01-- http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
    Resolving cdn.mysql.com... 23.198.164.152
    Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 18596528 (18M) [application/x-redhat-package-manager]
    Saving to: ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?

    100%[=====================================================================================================================================================================>] 18,596,528 15.5M/s in 1.1s

    2015-12-01 08:24:03 (15.5 MB/s) - ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?.saved [18596528/18596528]

    [root@ip-172-31-30-175 mysql]# wget http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
    --2015-12-01 08:20:50--  http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
    Resolving dev.mysql.com... 137.254.60.11
    Connecting to dev.mysql.com|137.254.60.11|:80... connected.
    HTTP request sent, awaiting response... 302 Found
    Location: http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz [following]
    --2015-12-01 08:20:50--  http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
    Resolving cdn.mysql.com... 23.198.164.152
    Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 3928553 (3.7M) [application/x-tar-gz]
    Saving to: ?.ysql-connector-java-5.1.37.tar.gz?
    
    100%[=====================================================================================================================================================================>] 3,928,553   --.-K/s   in 0.1s    
    
    2015-12-01 08:20:50 (29.7 MB/s) - ?.ysql-connector-java-5.1.37.tar.gz?.saved [3928553/3928553]

    检查大小:

    [root@ip-172-31-30-175 mysql]# ll
    total 76644
    -rw-r--r-- 1 root root 18596528 Sep 21 16:32 MySQL-client-5.6.27-1.el6.x86_64.rpm
    -rw-r--r-- 1 root root 3928553 Oct 6 13:24 mysql-connector-java-5.1.37.tar.gz
    -rw-r--r-- 1 root root 55950588 Sep 21 16:33 MySQL-server-5.6.27-1.el6.x86_64.rpm

     注意:这里还需要下载两个文件:MySQL-devel-5.6.27-1.el6.x86_64.rpm  MySQL-shared-compat-5.6.27-1.el6.x86_64.rpm,最后的文件目录应该如下:

    [root@ip-172-31-30-175 mysql]# ls 
    MySQL-client-5.6.27-1.el6.x86_64.rpm  mysql-connector-java-5.1.37.zip      MySQL-server-5.6.27-1.el6.x86_64.rpm
    mysql-connector-java-5.1.37           MySQL-devel-5.6.27-1.el6.x86_64.rpm  MySQL-shared-compat-5.6.27-1.el6.x86_64.rpm
  • 相关阅读:
    014Linux几种虚拟网络比较
    013Docker几种存储驱动比较(转发)
    005文件系统压测工具iozone
    016SNAT和DNAT区别
    012docker四种网络模式区别
    001CPU个数/物理核数/逻辑核数/vCPU数之间的区别
    009Ubuntu关闭掉终端或jet公司烦人的bell音
    Java 微信小程序imgSecCheck接口示例-校验一张图片是否含有违法违规内容
    提升NginxTLS/SSL HTTPS 性能的7条优化建议
    MySQL复合索引探究
  • 原文地址:https://www.cnblogs.com/littlesuccess/p/5010474.html
Copyright © 2020-2023  润新知