• 3步在Linux虚拟机搭建Hadoop


    1.虚拟机环境准备

    (1)克隆虚拟机;
    (2)配置mac:
    在这里插入图片描述
    配置mac:

    vim /etc/udev/rules.d/70-persistent-net.rules 
    SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="00:50:56:21:7F:7E", ATTR{type}=="1", KERNEL=="eth*", NAME="eth0"
    

    删除 /etc/udev/rules.d/70-persistent-net.rules,重启,若还是不可以正常使用,则可以把70-persistent-net.rules和70-persistent-cd.rules一同删除,重启之后系统会重新生成文件,就可以使用新克隆的虚拟机了。

    配置网卡:

    vim /etc/sysconfig/network-scripts/ifcfg-eth0 
    DEVICE="eth0"
    BOOTPROTO="dhcp"
    ONBOOT="yes"
    

    重启网卡服务:

    service network restart
    

    (3)修改主机名;
    ①临时有效:无需重启

    hostname NEW_NAME   
    

    ②永久有效

    [root@liupeng ~]# vim /etc/hosts
    ...  hadoop 
    

    (4)关闭防火墙;
    ①重启后生效
    开启: chkconfig iptables on
    关闭: chkconfig iptables off
    ② 即时生效,重启后失效
    开启: service iptables start
    关闭: service iptables stop

    (5)创建hadoop用户;

    # 创建用户
    adduser hadoop
    passwd hadoop
    输入2次密码
    

    (6)配置hadoop用户具有root权限:

    方法1,去井号,赋予root组权限

    vim /etc/sudoers
    ## Allows people in group wheel to run all commands
     %wheel	ALL=(ALL)	ALL
    
    usermod -g root hadoop
    

    修改完毕,现在可以用hadoop帐号登录,然后用命令 su – ,即可获得root权限进行操作。

    方法2:加一行

    vim /etc/sudoers
    ## Allow root to run any commands anywhere 
    root	ALL=(ALL) 	ALL
    hadoop ALL=(ALL) ALL
    

    修改完毕,现在可以用hadoop帐号登录,然后用命令 sudo – ,即可获得root权限进行操作。

    方法3:修改 /etc/passwd 文件

    hadoop:x:0:501::/home/hadoop:/bin/bash
    

    (7)用hadoop用户,在/opt目录下创建文件夹 module、software;

    sudo mkdir module
    sudo mkdir software
    

    修改module、software目录的所有者:

    sudo chown hadoop:hadoop module/ software/
    

    2.安装jdk1.8

    (1)卸载当前低于1.7的jdk
    判断jdk是否安装(显示版本号等信息,说明已经安装)

    which java(查看JDK的安装路径) 
    

    卸载:

    rm -rf JDK地址(卸载JDK) 
    

    查看是否卸载完毕:

    java -version
    java
    javac
    

    删除配置的环境变量,至此JDK卸载完毕:

    vi /etc/profile
    删除JAVA_HOME=...
    

    (2)安装jdk:
    从官网下载:jdk-8u251-linux-x64.tar.gz,上传到/opt/software目录;
    解压到/opt/module:

    tar -xzvf jdk-8u251-linux-x64.tar.gz -C /opt/module/
    

    配置JDK环境变量:
    ①获取JDK路径:

    [hadoop@hadoop jdk1.8.0_251]$ pwd
    /opt/module/jdk1.8.0_251
    

    ②配置/etc/profile,添加:

    [hadoop@hadoop jdk1.8.0_251]$ sudo vim /etc/profile
    export JAVA_HOME=/opt/module/jdk1.8.0_251
    export PATH=$PATH:$JAVA_HOME/bin   
    

    ③让修改后的文件生效(即加载环境变量):

    [hadoop@hadoop jdk1.8.0_251]$ source /etc/profile
    

    ④验证是否安装成功:

    [hadoop@hadoop jdk1.8.0_251]$ java -version
    java version "1.8.0_251"
    Java(TM) SE Runtime Environment (build 1.8.0_251-b08)
    Java HotSpot(TM) 64-Bit Server VM (build 25.251-b08, mixed mode)
    [hadoop@hadoop jdk1.8.0_251]$ 
    

    3.安装Hadoop

    (1)官网下载:hadoop-2.7.2.tar.gz,并上传到虚拟机的/opt/software;
    (2)解压到/opt/software:

    [hadoop@hadoop software]$ tar -xzvf hadoop-2.7.2.tar.gz -C /opt/module/
    

    (3)将Hadoop添加到环境变量:

    [hadoop@hadoop hadoop-2.7.2]$ pwd
    /opt/module/hadoop-2.7.2
    [hadoop@hadoop hadoop-2.7.2]$ sudo vim /etc/profile
     #HADOOP_HOME                        
    export HADOOP_HOME=/opt/module/hadoop-2.7.2
    export PATH=$PATH:$HADOOP_HOME/bin  
    export PATH=$PATH:$HADOOP_HOME/sbin  
    

    (4)让修改后的文件生效(即加载环境变量):

    [hadoop@hadoop hadoop-2.7.2]$ source /etc/profile
    

    (5)测试安装是否成功:

    [hadoop@hadoop hadoop-2.7.2]$ hadoop version
    Hadoop 2.7.2
    Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r b165c4fe8a74265c792ce23f546c64604acf0e41
    Compiled by jenkins on 2016-01-26T00:08Z
    Compiled with protoc 2.5.0
    From source with checksum d0fda26633fa762bff87ec759ebe689c
    This command was run using /opt/module/hadoop-2.7.2/share/hadoop/common/hadoop-common-2.7.2.jar
    [hadoop@hadoop hadoop-2.7.2]$ 
    

    注:hadoop version执行不对的话,重启虚拟机即可。

  • 相关阅读:
    C#调用C++ ---参数传递
    Retained Mode Versus Immediate Mode
    mind map in latex
    vk example
    基本环境
    [转]ld 和 ld.gold 和 ld.bfd
    [转] c++11 int&& 右值引用
    [转] c++11列表初始化
    [转] c++ const, volatile, mutable用法
    [转] c++11 模板元编程
  • 原文地址:https://www.cnblogs.com/lpeng94/p/12937524.html
Copyright © 2020-2023  润新知