• cdh_host


    ----测试环境平台
    别名 操作系统 地址 用户名 密码 部署系统cpu(core) 内存(G) 硬盘(G)
    fvt-d-worker-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.157 jboss Qhiptt_9 4 16 200
    fvt-d-worker-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.158 jboss Qhiptt_9 4 16 200
    fvt-d-worker-03 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.159 jboss Qhiptt_9 4 16 200
    fvt-d-worker-04 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.160 jboss Qhiptt_9 4 16 200
    fvt-d-worker-05 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.161 jboss Qhiptt_9 4 16 200
    fvt-d-worker-06 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.162 jboss Qhiptt_9 4 16 200
    fvt-d-worker-07 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.163 jboss Qhiptt_9 4 16 200
    fvt-d-worker-08 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.164 jboss Qhiptt_9 4 16 200
    fvt-d-worker-09 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.165 jboss Qhiptt_9 4 16 200
    fvt-d-master-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.166 jboss Qhiptt_9 4 16 200
    fvt-d-master-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.167 jboss Qhiptt_9 4 16 200
    fvt-d-utility-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.168 jboss Qhiptt_9 4 16 200
    fvt-d-utility-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.169 jboss Qhiptt_9 4 16 200
    fvt-d-mgmt-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.170 jboss Qhiptt_9 2 8 100+40
    fvt-d-mgmt-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.60.81.171 jboss Qhiptt_9 2 8 100+40



    ---生产环境平台
    08 - PRD 数据平台服务器
    • 服务器信息
    • 负载均衡信息
    服务器信息
    区域 别名 操作系统 地址 用户名 密码 部署系统 cpu(core) 内存(G) 硬盘(G) 角色
    核心 prd-d-worker-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.40 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-worker-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.41 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yautilityrn-NodeManager
    impala-daemon
    prd-d-worker-03 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.42 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-worker-04 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.43 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-worker-05 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.44 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-worker-06 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.45 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-worker-07 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.46 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-worker-08 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.47 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-worker-09 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.48 jboss Qhiptt_9 4 16 200 cm-agent
    hdfs-DataNode
    yarn-NodeManager
    impala-daemon
    prd-d-master-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.49 jboss Qhiptt_9 4 16 200 cm-agent
    zk-server
    hdfs-JournalNode
    hdfs-NameNode
    hdfs-FailoverController
    yarn-ResourceManager
    yarn-JobHistoryServer
    prd-d-master-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.50 jboss Qhiptt_9 4 16 200 cm-agent
    zk-server
    hdfs-JournalNode
    hdfs-NameNode
    hdfs-FailoverController
    yarn-ResourceManager
    spark-HistoryServer
    prd-d-utility-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.51 jboss Qhiptt_9 4 16 200 cm-agent
    zk-server
    hdfs-JournalNode
    hive-metastore
    hive-hiveserver2
    impala-statestore
    oozie-server
    hue-server
    solr
    prd-d-utility-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.52 jboss Qhiptt_9 4 16 200 cm-agent
    hive-metastore
    hive-hiveserver2
    impala-catalog
    oozie-server
    hue-server
    solr
    prd-d-mgmt-01 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.53 jboss Qhiptt_9 2 8 100+40 cm-agent
    prd-d-mgmt-02 Red Hat Enterprise Linux Server release 6.5 (Santiago) 10.70.8.54 jboss Qhiptt_9 2 8 100+40 cm-server
    cm-agent
    cm-management service

    单用户模式:cloudera-scm/cdh123,密码修改为scm@2018

    负载均衡信息
    应用 负载均衡地址 上游 备注 用户
    cm server 浮动IP,双机冷备份(暂未实施)
    地址:http://10.70.8.54:7180/cmf/login
    admin/admin

    hue 10.70.8.52:8889 10.70.8.51:8888
    10.70.8.52:8888 验证:使用http://10.70.8.52:8889访问hue的web页面

    impala-shell 10.70.8.52:21000 10.70.8.40:21000
    10.70.8.41:21000
    10.70.8.42:21000 验证:impala-shell -i 10.70.8.52:21000
    impala-jdbc 10.70.8.52:21050 10.70.8.40:21050
    10.70.8.41:21050
    10.70.8.42:21050 修改impala的Impala Daemons Load Balancer为:10.70.8.52:21050
    验证:查看hue的impala配置为上述地址,hue能够正常使用impala
    hiveserver2 10.70.8.52:10001 10.70.8.51:10000
    10.70.8.52:10000 修改hive的HiveServer2 Load Balancer为:10.70.8.52:10001
    验证:beeline -u jdbc:hive2://10.70.8.52:10001 -n cloudera-scm -p cloudera-scm
    oozie 10.70.8.52:11002 10.70.8.51:11000
    10.70.8.52:11000 修改oozie的Oozie Load Balancer为:10.70.8.52:11002
    验证:使用浏览器访问http://10.70.8.52:11002/oozie/

    solr 10.70.8.52:8986 10.70.8.51:8983
    10.70.8.52:8983 修改solr的Solr Load Balancer为:10.70.8.52:8986
    验证:使用浏览器访问http://10.70.8.52:8986/solr

  • 相关阅读:
    [System.currentTimeMillis]/[Calendar.getInstance().getTimeInMillis()]/[new Date().getTime()]
    [Maven]告警[WARNING] Unable to create Maven project from repository.
    通过设置JDK解决存在多个Gradle后台进程的问题
    使用OpenSSL实现X25519秘钥协商功能
    C++代码质量度量工具大阅兵
    Java代码质量度量工具大阅兵
    计算两个时间的时间差(天、小时、分钟、秒数)
    上传文件进度条 (已上传大小、总大小、速度、剩余时间、已用时间)
    table 表格自适应
    谷歌浏览器input框添加了黄色 背景色
  • 原文地址:https://www.cnblogs.com/heguoxiu/p/10900444.html
Copyright © 2020-2023  润新知