• 利用python 提取log 文件里的关键句子,并进行统计分析


    利用python开发了一个提取sim.log 中的各个关键步骤中的时间并进行统计的程序:

    #!/usr/bin/python2.6
    import re,datetime
    file_name='/home/alzhong/logs/qtat1/R2860.01.13/sim-applycommitrollback-bld1.log'
    file=open(file_name,'r')
    acnum=[];time_res=[];lnum=0
    def trans_time(time):
        t1=datetime.datetime.strptime(time,'%y/%m/%d %H:%M:%S')
        return t1
    for (num,line) in enumerate(file):
    
        if(re.search(r'^(.*)BEGINNING SIM PROCEDURE(.*)$',line)):
            m=re.search(r'^(.*)BEGINNING SIM PROCEDURE(.*)$',line)
            print 'Step %d:'%(lnum), m.group(0);lnum+=1
            acnum.append(trans_time(line[0:17]))
        elif(re.search(r'^(.*)CP_W(.*)$', line)):
            m=re.search(r'^(.*)CP_W(.*)$', line)
            print 'Step %d:'%(lnum), m.group(0);lnum+=1
            acnum.append(trans_time(line[0:17]))
        elif(re.search(r"^(.*)VERIFY_S(.*)$", line)):
            m=re.search(r"^(.*)VERIFY_S(.*)$", line)
            print 'Step %d:'%(lnum), m.group(0);lnum+=1
            acnum.append(trans_time(line[0:17]))
        elif(re.search(r"^(.*)--action commit(.*)$",line)):
            m=re.search(r"^(.*)--action commit(.*)$",line)
            print 'Step %d:'%(lnum), m.group(0);lnum+=1
            acnum.append(trans_time(line[0:17]))
        elif(re.search(r"^(.*)COMPLETED SIM PROCEDURE(.*)$",line)):
            m=re.search(r"^(.*)COMPLETED SIM PROCEDURE(.*)$",line)
            print 'Step %d:'%(lnum), m.group(0);lnum+=1
            acnum.append(trans_time(line[0:17]))
        elif(re.search(r"^(.*)RESUMING SIM PROCEDURE(.*)$",line)):
            m=re.search(r"^(.*)RESUMING SIM PROCEDURE(.*)$",line)
            print 'Step %d:'%(lnum), m.group(0);lnum+=1
            acnum.append(trans_time(line[0:17]))
    
    file.close()
    if(re.search(r"^(.*)backout(.*)$",file_name)):
        time_res.append((acnum[2]-acnum[0]).seconds/60)
        time_res.append((acnum[4]-acnum[3]).seconds/60)
        time_res.append((acnum[6]-acnum[5]).seconds/60)
        time_res.append(((acnum[8]-acnum[7])+(acnum[10]-acnum[9])+(acnum[13]-acnum[11])).seconds/60)
        print "
    3). sim --proc update --action apply to "CP_WARNING" %s mins" %(time_res[0])
        print "4). sim --proc update --action resume to  "VERIFY_SOFTWARE" %s mins"%(time_res[1])
        print "5). sim --proc update --action resume to  "COMMIT" %s mins"%(time_res[2])
        print "8). Backout from RXX to RXX  %s mins"%(time_res[3])
    elif(re.search(r"^(.*)rollback(.*)$",file_name)):
        time_res.append((acnum[2]-acnum[0]).seconds/60)
        time_res.append((acnum[4]-acnum[3]).seconds/60)
        time_res.append((acnum[6]-acnum[5]).seconds/60)
        time_res.append((acnum[8]-acnum[7]).seconds/60)
        time_res.append(((acnum[10]-acnum[9])+(acnum[12]-acnum[11])+(acnum[15]-acnum[13])).seconds/60)
        print "
    3). sim --proc update --action apply to "CP_WARNING" %s mins" %(time_res[0])
        print "4). sim --proc update --action resume to  "VERIFY_SOFTWARE" %s mins"%(time_res[1])
        print "5). sim --proc update --action resume to  "COMMIT" %s mins"%(time_res[2])
        print "6). sim --proc update --action commit to end of Patch %s mins"%(time_res[3])
        print "8). Rollback from RXX to RXX %s mins" %(time_res[4])
    if __name__ == '__main__':
        pass
    :q!
    <lsslogin1-alzhong>/home/alzhong/tools: ls
    simt
    <lsslogin1-alzhong>/home/alzhong/tools: ./simt
    Step 0: 14/06/16 12:31:32 BEGINNING SIM PROCEDURE 'update apply' type=hot ...
    Step 1: 14/06/16 13:18:42 RESUMING SIM PROCEDURE 'update apply' type=hot ...
    Step 2: 14/06/16 13:30:43 SIM0317 PAUSE_REQUEST: (PROCEDURE) [PAUSE(CP_WARNING): Use 'sim --proc update --action resume' to continue...] (update:1435)
    Step 3: 14/06/16 13:43:40 RESUMING SIM PROCEDURE 'update apply' type=hot ...
    Step 4: 14/06/16 13:47:49 SIM0343 PAUSE_REQUEST: (PROCEDURE) [PAUSE(VERIFY_SOFTWARE): Use 'sim --proc update --action resume' to continue...] (update:1634)
    Step 5: 14/06/16 13:54:26 RESUMING SIM PROCEDURE 'update apply' type=hot ...
    Step 6: 14/06/16 14:25:41 SIM0496 PAUSE_REQUEST: (COMMIT) [PAUSE(COMMIT): Use 'sim --proc update --action commit' to continue...] (update:2579)
    Step 7: 14/06/16 14:41:51 RESUMING SIM PROCEDURE 'update commit' type=hot ...
    Step 8: 14/06/16 15:18:34 COMPLETED SIM PROCEDURE 'update commit' type=hot
    Step 9: 14/06/16 15:31:35 BEGINNING SIM PROCEDURE 'update rollback' type=hot level=9999 ...
    Step 10: 14/06/16 15:47:34 SIM0091 PAUSE_REQUEST: (PROCEDURE) [PAUSE(CP_WARNING): Use 'sim --proc update --action resume' to continue...] (update_rlbk:421)
    Step 11: 14/06/16 15:53:30 RESUMING SIM PROCEDURE 'update rollback' type=hot level=9999 ...
    Step 12: 14/06/16 16:02:03 SIM0135 PAUSE_REQUEST: (PROCEDURE) [PAUSE(VERIFY_SOFTWARE): Use 'sim --proc update --action resume' to continue...] (update_rlbk:564)
    Step 13: 14/06/16 16:04:22 RESUMING SIM PROCEDURE 'update rollback' type=hot level=9999 ...
    Step 14: 14/06/16 16:09:42 RESUMING SIM PROCEDURE 'update rollback' type=hot level=9999 ...
    Step 15: 14/06/16 16:26:56 COMPLETED SIM PROCEDURE 'update rollback' type=hot level=9999
    
    3). sim --proc update --action apply to "CP_WARNING" 59 mins
    4). sim --proc update --action resume to  "VERIFY_SOFTWARE" 4 mins
    5). sim --proc update --action resume to  "COMMIT" 31 mins
    6). sim --proc update --action commit to end of Patch 36 mins
    8). Rollback from RXX to RXX 47 mins
    


  • 相关阅读:
    .netcore持续集成测试篇之Xunit结合netcore内存服务器发送post请求
    .netcore持续集成测试篇之搭建内存服务器进行集成测试一
    .netcore持续集成测试篇之Xunit数据驱动测试
    .netcore持续集成测试篇之开篇简介及Xunit基本使用
    .net持续集成测试篇之Nunit 测试配置
    .net持续集成测试篇之Nunit参数化测试
    .net持续集成测试篇之Nunit that断言
    .net持续集成测试篇之Nunit文件断言、字符串断言及集合断言
    .net持续集成测试篇之Nunit常见断言
    .net持续集成单元测试篇之单元测试简介以及在visual studio中配置Nunit使用环境
  • 原文地址:https://www.cnblogs.com/yxwkf/p/5078568.html
Copyright © 2020-2023  润新知