• 【原创】大叔经验分享(75)常用组件日志清理


    包括cloudera-manager、hdfs、impala、kudu、oozie以及系统日志等;

    #cloudera-service-monitor log
    /bin/rm /var/lib/cloudera-service-monitor/ts/*/partition*/* -rf
    /bin/rm /var/lib/cloudera-host-monitor/ts/*/partition*/* -rf
    
    #hdfs log
    /bin/rm /var/log/hadoop-hdfs/*.out.*
    /bin/rm /var/log/hadoop-hdfs/hdfs-audit.log.*
    
    #impala log
    num=`ls /var/log/impalad/|grep 'impala.log.INFO'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.INFO'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    num=`ls /var/log/impalad/|grep 'impala.log.WARNING'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.WARNING'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    num=`ls /var/log/impalad/|grep 'impala.log.ERROR'|wc -l`
    ls /var/log/impalad/|grep 'impala.log.ERROR'|sed $num'd'|xargs -i /bin/rm /var/log/impalad/{}
    
    num=`ls /var/log/impalad/profiles/|wc -l`
    ls /var/log/impalad/profiles/|sed $num'd'|xargs -i /bin/rm /var/log/impalad/profiles/{}
    
    #kudu log
    num=`ls /var/log/kudu/|grep 'log.INFO'|wc -l`
    ls /var/log/kudu/|grep 'log.INFO'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.ERROR'|wc -l`
    ls /var/log/kudu/|grep 'log.ERROR'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.FATAL'|wc -l`
    ls /var/log/kudu/|grep 'log.FATAL'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    num=`ls /var/log/kudu/|grep 'log.WARNING'|wc -l`
    ls /var/log/kudu/|grep 'log.WARNING'|sed $num'd'|xargs -i /bin/rm /var/log/kudu/{}
    /bin/rm /var/log/kudu/*.gz #oozie log num=`ls /var/log/oozie/|grep 'log.out-'|wc -l` ls /var/log/oozie/|grep 'log.out-'|sed $num'd'|xargs -i /bin/rm /var/log/oozie/{} /bin/rm /var/log/oozie/oozie-instrumentation.log.* #system journal /bin/rm /var/log/journal/*/system@00000000000000000000000000000000-*.journal /bin/rm -rf /var/log/messages-*
  • 相关阅读:
    神秘现象?多种情况比较
    [备忘]C++BUILDER的文件操作
    缘起
    [备忘]一个二维数组的冒泡排序
    无可救药地买入NDSL
    递归的实质
    [网游计划第九、十天]能力有限,做些小品
    大学有救
    struts2+convertion实现struts.xml的零配置
    BSD下的超级终端
  • 原文地址:https://www.cnblogs.com/barneywill/p/11127383.html
Copyright © 2020-2023  润新知