• Oozie与Coordinator调度讲解及系统时区配置与定时触发两种配置方式


    1:修改本地linux时区

      查看时区

       - 号代表西  + 号 代表东 北京时间是东八区

        设置时区的配置文件所在位置

    1 cd /usr/share/zoneinfo/

        选择以亚洲的上海 的时区为基址

        删除本地配置文件

    1 rm -r /etc/localtime 

        创建一个硬连接

    1  ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

       时区变成东八区了

       设置时间

    2:设置oozie的时区   在oozie-site.xml修改  oozie默认使用UTC 等同于GMT 服务器上是CST  要设置成GMT+0800

      

    1  <!-- Time Zone -->
    2  <property>
    3      <name>oozie.processing.timezone</name>
    4      <value>GMT+0800</value>
    5   </property>

      

    1  <property>
    2      <name>oozie.service.coord.check.maximum.frequency</name>
    3      <value>false</value>
    4   </property>

     

    上面设置只是设置oozie调度的时间   oozie的web控制台时间也需要改

    修改 oozie-console.js

    在179行  getTimeZone

     启动之前要先清除缓存

    3:拷贝模板

    4:修改job.properties

     1 #
     2 # Licensed to the Apache Software Foundation (ASF) under one
     3 # or more contributor license agreements.  See the NOTICE file
     4 # distributed with this work for additional information
     5 # regarding copyright ownership.  The ASF licenses this file
     6 # to you under the Apache License, Version 2.0 (the
     7 # "License"); you may not use this file except in compliance
     8 # with the License.  You may obtain a copy of the License at
     9 #
    10 #      http://www.apache.org/licenses/LICENSE-2.0
    11 #
    12 # Unless required by applicable law or agreed to in writing, software
    13 # distributed under the License is distributed on an "AS IS" BASIS,
    14 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    15 # See the License for the specific language governing permissions and
    16 # limitations under the License.
    17 #
    18 
    19 nameNode=hdfs://hadoop:8020
    20 jobTracker=hadoop:8032
    21 queueName=default
    22 oozieAppsRoot=user/root/oozie-apps
    23 oozieDataRoot=user/root/oozie/datas
    24 
    25 oozie.coord.application.path=${nameNode}/${oozieAppsRoot}/cron-schedule
    26 start=2015-10-11T20:25+0800
    27 end=2015-10-11T20:30+0800
    28 workflowAppUri=${nameNode}/${oozieAppsRoot}/cron-schedule

     5:修改coordinator.xml

     1 <!--
     2   Licensed to the Apache Software Foundation (ASF) under one
     3   or more contributor license agreements.  See the NOTICE file
     4   distributed with this work for additional information
     5   regarding copyright ownership.  The ASF licenses this file
     6   to you under the Apache License, Version 2.0 (the
     7   "License"); you may not use this file except in compliance
     8   with the License.  You may obtain a copy of the License at
     9 
    10        http://www.apache.org/licenses/LICENSE-2.0
    11 
    12   Unless required by applicable law or agreed to in writing, software
    13   distributed under the License is distributed on an "AS IS" BASIS,
    14   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    15   See the License for the specific language governing permissions and
    16   limitations under the License.
    17 -->
    18 <coordinator-app name="cron-coord" frequency="${coord:minutes(1)}" 
    19                 start="${start}" end="${end}" timezone="GMT+0800"
    20                 xmlns="uri:oozie:coordinator:0.4">
    21         <action>
    22         <workflow>
    23             <app-path>${workflowAppUri}</app-path>
    24             <configuration>
    25                 <property>
    26                     <name>jobTracker</name>
    27                     <value>${jobTracker}</value>
    28                 </property>
    29                 <property>
    30                     <name>nameNode</name>
    31                     <value>${nameNode}</value>
    32                 </property>
    33                 <property>
    34                     <name>queueName</name>
    35                     <value>${queueName}</value>
    36                 </property>
    37             </configuration>
    38         </workflow>
    39     </action>
    40 </coordinator-app>

     6.把文件上传至hdfs

    1 bin/hdfs dfs -put /opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6/oozie-apps/cron-schedule oozie-apps/

     

     7:启动运行

  • 相关阅读:
    PostgreSQL备份工具-pg_probackup
    Multi-Master Replication Solutions for PostgreSQL
    PostgreSQL高可用:多主复制解决方案
    Postgressql高可用(pgpool+异步流复制)转
    AudioFlinger
    GPIO口配置为上拉,下拉输入
    转【Qualcomm高通音频】音效调试_录音文件播放有杂音,如何定位原因?
    转【Qualcomm高通音频】如何使用QXDM、QCAT、CoolEditor音频日志抓取、解析和分析?
    转【Qualcomm高通音频】调试工具QACT_如何新增一套音效
    转【Qualcomm高通音频】调试工具QACT_如何更换音效的音频拓扑
  • 原文地址:https://www.cnblogs.com/xuyou551/p/8075711.html
Copyright © 2020-2023  润新知