• CentOS 6.7安装Sqoop 1.4.6


    之前已经在CentOS 6.7上安装部署Hadoop 2.7.2http://blog.csdn.net/noob_f/article/details/53366756),并正常启动Hadoop集群。


    master

    [root@master ~]# wget https://mirrors.tuna.tsinghua.edu.cn/apache/sqoop/1.4.6/sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz
    [root@master ~]# tar -zxvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz
    [root@master ~]# mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha /usr/local/
    

    配置MySQL连接器

    [root@master ~]# cp mysql-connector-java-5.1.40/mysql-connector-java-5.1.40-bin.jar /usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/lib/

    Sqoop环境变量

    [root@master ~]# vi /etc/profile.d/sqoop.sh

    添加

    export SQOOP_HOME=/usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha
    export PATH=$PATH:$SQOOP_HOME/bin
    

    保存退出

    [root@master ~]# source /etc/profile.d/sqoop.sh

    配置

    [root@master ~]# cp /usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/conf/sqoop-env-template.sh /usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/conf/sqoop-env.sh
    [root@master ~]# vi /usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/conf/sqoop-env.sh
    

    修改

    #Set path to where bin/hadoop is available
    #export HADOOP_COMMON_HOME=
    
    #Set path to where hadoop-*-core.jar is available
    #export HADOOP_MAPRED_HOME=
    
    #set the path to where bin/hbase is available
    #export HBASE_HOME=
    
    #Set the path to where bin/hive is available
    #export HIVE_HOME=
    
    #Set the path for where zookeper config dir is
    #export ZOOCFGDIR=
    

    #Set path to where bin/hadoop is available
    export HADOOP_COMMON_HOME=/usr/local/hadoop-2.7.2
    
    #Set path to where hadoop-*-core.jar is available
    export HADOOP_MAPRED_HOME=/usr/local/hadoop-2.7.2
    
    #set the path to where bin/hbase is available
    export HBASE_HOME=/usr/local/hbase-0.98.23-hadoop2
    
    #Set the path to where bin/hive is available
    export HIVE_HOME=/usr/local/apache-hive-1.2.1-bin
    
    #Set the path for where zookeper config dir is
    export ZOOCFGDIR=/usr/local/zookeeper-3.4.9
    

    保存退出

    启动并验证Sqoop

    [root@master ~]# /usr/local/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/bin/sqoop help

    这里写图片描述

    [root@master ~]# echo $?
    0
    
  • 相关阅读:
    暑假自学(19)
    暑假自学(18)
    暑假自学(17)
    暑假自学(16)
    暑假自学(15)
    rsync简介
    10.Go语言-面向对象简单了解
    dp 数字三角形
    P1359租用游艇(dp+dfs)
    油田问题 bfs
  • 原文地址:https://www.cnblogs.com/Genesis2018/p/8304704.html
Copyright © 2020-2023  润新知