• hbase distributed setup and configuration


    1 ensure the same operating system , authentication , JDK installation path on every mainframe computers
    2 vim /etc/hosts, add ip hostname in the shape of key/value,hostname should be unique,localhost should be deleted(!!important)
    3 open ssh service,ensure all the mainframe computers can access each other without password
    4 setup hadoop
      Export HADOOP_HOME=hadoop installation path
      Export PATH=$HADOOP_HOME/bin:$PATH


    5 hadoop configuration
      (1) conf/hadoop-env.sh
          export JAVA_HOME=JDK installation path
      (2) add master ip into conf/masters,each ip at single line
          add slave ip into conf/slaves,each ip at single line
      (3) core-site.xml
     <configuration>
      <property>
       <name>hadoop.tmp.dir</name>
       <value>hadoop installation path</value>
      </property>
      <property>
       <name>fs.default.name</name>
       <value>hdfs://masterIP:9000(any not used port)</value>
      </property>
     </configuration>
    (4) hdfs-site.xml
     <configuration>
      <property>
       <name>dfs.replication</name>
       <value>datanode num</value>
      </property>
      <property>
       <name>dfs.name.dir</name>
       <value>/tmp/dfs/name</value>
      </property>
      <property>
       <name>dfs.data.dir</name>
       <value>/tmp/dfs/data</value>
      </property> 
     </configuration>
     (5) mapred-site.xml
     <configuration>
      <property>
       <name>mapred.job.tracker</name>
       <value>masterIP:9001</value>
      </property>
     </configuration>


    6 hbase configuration
      (1)conf/regionservers insert data like slaves configuration in hadoop
      (2)hbase-env.sh
         export JAVA_HOME=JDK installation path
         export HBASE_MANAGES_ZK=true
      (3)hbase-site.xml
     <configuration>
       <property>
      <name>hbase.rootdir</name>
      <value>hdfs://hadoopmasterip:9000/hbase</value>
       </property>
       <property>
      <name>hbase.cluster.distributed</name>
      <value>true</value>
       </property>
       <property>
      <name>hbase.master</name>
      <value>hbasemasterip:60000</value>
       </property>
       <property>
      <name>hbase.zookeeper.quorum</name>
      <value>any one regionserversIP(num should be odd)</value>
       </property>
     </configuration>

    notice
      1 software version
         hadoop-1.0.4 hbase-0.94.7
      2 how to get jdk installation path
         update-alternatives --display java
         java_home /usr/lib/jvm/jre-1.6.0-openjdk.x86_64
      3 how to stop hbase
         on slave ./hbase-daemon.sh stop regionserver
         on master ./stop-hbase.sh

  • 相关阅读:
    用PHP实现 HTTP断点续传、分块下载文件(Socket)
    织梦cms 判断当前页面是否为首页和栏目页高亮
    Go Exec 僵尸与孤儿进程
    Nginx 配置 SSL,很系统!很完整!解决 Nginx 报错 nginx: [emerg] unknown directive "ssl" in /usr/local/nginx/conf/nginx.conf
    CentOS7安装及配置 Zabbix Server全步骤,超详细教程
    CentOS7安装及配置 Zabbix Agent全步骤,超详细教程
    top查看cpu消耗最高线程
    Kisso 使用笔记(个人总结,一直在更新)
    Android问题总汇
    关于Vue中checkbox复选框的双向数据绑定问题
  • 原文地址:https://www.cnblogs.com/ai464068163/p/3064554.html
Copyright © 2020-2023  润新知