• Hadoop分布式远程Debug方式


    1、进入目录修改配置文件

    cd /cloud/hadoop-2.2.0/etc/hadoop
    vim hadoop-env.sh
    2、加入内容(文本最后):
    #远程调试NameNode
    export HADOOP_NAMENODE_OPTS="-agentlib:jdwp=transport=dt_socket,address=8888,server=y,suspend=y"
    #远程调试DataNode
    export HADOOP_DataNode_OPTS="-agentlib:jdwp=transport=dt_socket,address=9888,server=y,suspend=y"

    注意其他可配置的参数:

    hadoop远程debug配置
    在/cloud/hadoop-2.2.0/etc/hadoop/hadoop-env.sh的最后面添加如下内容(可根据情况选择一个或多个)
    #远程调试NameNode
    export HADOOP_NAMENODE_OPTS="-agentlib:jdwp=transport=dt_socket,address=8888,server=y,suspend=y"
    #远程调试DataNode
    export HADOOP_DataNode_OPTS="-agentlib:jdwp=transport=dt_socket,address=9888,server=y,suspend=y"
    #远程调试ResourceManager
    export YARN_RESOURCEMANAGER_OPTS="-agentlib:jdwp=transport=dt_socket,address=10888,server=y,suspend=y"
    #远程调试NodeManager
    export YARN_NODEMANAGER_OPTS="-agentlib:jdwp=transport=dt_socket,address=11888,server=y,suspend=y"

    3、退出到/root/cloud/hadoop-2.2.0/sbin目录下
    A、cd sbin/ 目录下执行启动

    B、启动方式:
    (1)NameNode的启动命令
    ./hadoop-daemon.sh start namenode
    成功返回:
    starting namenode, logging to /root/cloud/hadoop-2.2.0/logs/hadoop-root-namenode-northbigpenguin.out
    Listening for transport dt_socket at address: 8888

    (2)DataNode的启动方式
    ./hadoop-daemon.sh start datanode
    成功返回:
    starting datanode, logging to /root/cloud/hadoop-2.2.0/logs/hadoop-root-datanode-northbigpenguin.out
    Listening for transport dt_socket at address: 9888
    C、关闭方式:
    ./hadoop-daemon.sh stop namenode
    ./hadoop-daemon.sh stop datanode

    (1)设置断点 ,双击行号位置

      

    (2)选择项目,找到需要调试的类,然后选择debug----->Debug Congratulation

     (3)进入如图位置,然后按照如图的参数进行配置,然后选择Apply----->Debug,就可以开始Debug了

  • 相关阅读:
    C#中的转义字符verbatim string
    how to use Inspector in fiddler
    how to use composer in fiddler
    CodeWars上的JavaScript技巧积累
    What's the difference between using “let” and “var” to declare a variable in JavaScript?
    Loop through an array in JavaScript
    Why does typeof array with objects return “Object” and not “Array”?
    Owin and Startup class
    Qt Widgets、QML、Qt Quick的区别
    飞舞的蝴蝶(GraphicsView框架)
  • 原文地址:https://www.cnblogs.com/liuyangfirst/p/6279613.html
Copyright © 2020-2023  润新知