• 【Hadoop离线基础总结】Hue与oozie集成



    • 1.停止oozie与hue的进程

      bin/oozied.sh stop

    • 2.修改oozie的配置文件

      (老版本的bug,新版本已经不需要了)这一步我们都不需要做了
      修改oozie-site.xml

      <property>    
      	<name>oozie.service.WorkflowAppService.system.libpath</name>
          <value>/user/oozie/share/lib</value>
      </property>
      <property>
      	<name>oozie.use.system.libpath</name>
      	<value>true</value>
      </property>
      

      重新上传所有的jar包到hdfs的/user/oozie/share/lib路径下去

      cd /export/servers/oozie-4.1.0-cdh5.14.0
      bin/oozie-setup.sh  sharelib create -fs hdfs://node01:8020 -locallib oozie-sharelib-4.1.0-cdh5.14.0-yarn.tar.gz
      
    • 3.修改hue的配置文件

      vim hue.ini

      [liboozie]
        # The URL where the Oozie service runs on. This is required in order for
        # users to submit jobs. Empty value disables the config check.
        oozie_url=http://node03.hadoop.com:11000/oozie
      
        # Requires FQDN in oozie_url if enabled
        ## security_enabled=false
      
        # Location on HDFS where the workflows/coordinator are deployed when submitted.
        remote_deployement_dir=/user/root/oozie_works
      
      修改oozie的配置文件大概在1151行左右的样子
      [oozie]
        # Location on local FS where the examples are stored.
        # local_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/apps
      
        # Location on local FS where the data for the examples is stored.
        # sample_data_dir=/export/servers/oozie-4.1.0-cdh5.14.0/examples/input-data
      
        # Location on HDFS where the oozie examples and workflows are stored.
        # Parameters are $TIME and $USER, e.g. /user/$USER/hue/workspaces/workflow-$TIME
        # remote_data_dir=/user/root/oozie_works/examples/apps
      
        # Maximum of Oozie workflows or coodinators to retrieve in one API call.
        oozie_jobs_count=100
      
        # Use Cron format for defining the frequency of a Coordinator instead of the old frequency number/unit.
        enable_cron_scheduling=true
      
        # Flag to enable the saved Editor queries to be dragged and dropped into a workflow.
        enable_document_action=true
      
        # Flag to enable Oozie backend filtering instead of doing it at the page level in Javascript. Requires Oozie 4.3+.
        enable_oozie_backend_filtering=true
      
        # Flag to enable the Impala action.
        enable_impala_action=true
      
      [filebrowser]
        # Location on local filesystem where the uploaded archives are temporary stored.
        archive_upload_tempdir=/tmp
      
        # Show Download Button for HDFS file browser.
        show_download_button=true
      
        # Show Upload Button for HDFS file browser.
        show_upload_button=true
      
        # Flag to enable the extraction of a uploaded archive in HDFS.
        enable_extract_uploaded_archive=true
      
    • 4.启动hue与oozie的进程

      启动hue进程

      cd /export/servers/hue-3.9.0-cdh5.14.0
      build/env/bin/supervisor
      

      启动oozie进程

      cd /export/servers/oozie-4.1.0-cdh5.14.0
      bin/oozied.sh start
      
    • 5.页面访问hue

      http://node03.hadoop.com:8888/
      在这里插入图片描述
      在这里插入图片描述

  • 相关阅读:
    RCTF 2019 web
    php花式读取文件
    PHP审计基础
    《笼中鸟——精神病人的生存现状》观后的一点思考
    python一些小trick
    Appium+Python入门学习总结
    解决windows下 Python中 matplotlib 做图中文不显示的问题
    py3.5 telnet的实例(在远程机器上批量创建用户)
    关于pycharm的一个imoprt的随笔
    LookupError: unknown encoding: idna 的处理方法
  • 原文地址:https://www.cnblogs.com/zzzsw0412/p/12772454.html
Copyright © 2020-2023  润新知