• hadoop2.5的伪分布式安装配置


    一.windows环境下安装

    根据博主写的一次性安装成功了:

    http://blog.csdn.net/antgan/article/details/52067441

    二.linux环境下(centos6.5,JDK1.7)

    1.主机名与IP的映射

    2.关闭防火墙

    3.vi hadoop2.5/etc/hadoop/hadoop-env.sh

        配置JDK路径

    4.core-site.xml

     <configuration>

       <property>
        <name>fs.defaultFS</name>
        <value>hdfs://master-qian:8020</value>
       </property>

       <property>
        <name>hadoop.tmp.dir</name>
        <value>/opt/modules/hadoop-2.5/data/tmp</value>
       </property>

     </configuration>

    5.hdfs-site.xml

      <configuration>

        <property>
          <name>dfs.replication</name>
          <value>1</value>
        </property>
        <property>
          <name>dfs.namenode.secondary.http-address</name>
          <value>master-qian:50090</value>
        </property>
        <property>
          <name>dfs.permissions.enabled</name>
          <value>false</value>
        </property>

      </configuration>

    6.mapred-site.xml

    <configuration>

    <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
    </property>
    <property>
    <name>mapreduce.jobhistory.address</name>
    <value>master-qian:10020</value>
    </property>
    <property>
    <name>mapreduce.jobhistory.webapp.address</name>
    <value>master-qian:19888</value>
    </property>
    </configuration>

    7.yarn-site.xml

    <configuration>

    <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>master-qian</value>
    </property>
    <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
    </property>

    </configuration>

      

  • 相关阅读:
    Leetcode.11 Container with Most Water
    Leetcode.19 Remove Nth Node From End of List
    Leetcode23. Merge K sorted List
    leetcode287. Find the duplicate Number
    LeetCode234. Palindrome Linked List
    leetcode.142 LinkedList Cycle II
    UINavigationController
    UITableView的性能优化1
    iOS触摸事件
    UITableView的性能优化
  • 原文地址:https://www.cnblogs.com/feiyumo/p/7340137.html
Copyright © 2020-2023  润新知