• python性能分析工具line_profiler的简单使用


    一、前言

      在我们在使用python进行编码的时候,写出高质量性能好的代码是一个比较好的习惯,line_profiler可很好的帮助我们

    二、安装

      1、下载

      下载地址:https://www.lfd.uci.edu/~gohlke/pythonlibs/#line_profiler

      下载想要安装的版本,比如,我这里的python版本是3.7x的,下载的whl就是对应的cp37

       2、使用pip安装

        格式:pip install XXX.whl

      3、执行结果

    (CloudStorage) D:learnIOTCloudStorage>pip install C:Usersdurant.zengDesktop2.8.0line_profiler-3.1.0-cp37-cp37m-win_amd64.whl
    Processing c:usersdurant.zengdesktop2.8.0line_profiler-3.1.0-cp37-cp37m-win_amd64.whl
    Collecting IPython (from line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/c9/b1/82cbe2b856386f44f37fdae54d9b425813bd86fe33385c9d658d64826098/ipython-7.22.0-py3-none-any.whl (78
    5kB)
        100% |████████████████████████████████| 788kB 389kB/s
    Collecting prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0 (from IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/eb/e6/4b4ca4fa94462d4560ba2f4e62e62108ab07be2e16a92e594e43b12d3300/prompt_toolkit-3.0.18-py3-none-any.
    whl (367kB)
        100% |████████████████████████████████| 368kB 367kB/s
    Collecting decorator (from IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/ed/1b/72a1821152d07cf1d8b6fce298aeb06a7eb90f4d6d41acec9861e7cc6df0/decorator-4.4.2-py2.py3-none-any.wh
    l
    Collecting pygments (from IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/3a/80/a52c0a7c5939737c6dca75a831e89658ecb6f590fb7752ac777d221937b9/Pygments-2.8.1-py3-none-any.whl (98
    3kB)
        100% |████████████████████████████████| 993kB 420kB/s
    Requirement already satisfied: colorama; sys_platform == "win32" in d:python3.7.2libsite-packages (from IPython->line-profiler==3.1.0) (0.4.4)
    Requirement already satisfied: setuptools>=18.5 in d:python3.7.2libsite-packages (from IPython->line-profiler==3.1.0) (40.6.2)
    Collecting backcall (from IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/4c/1c/ff6546b6c12603d8dd1070aa3c3d273ad4c07f5771689a7b69a550e8c951/backcall-0.2.0-py2.py3-none-any.whl
    
    Collecting jedi>=0.16 (from IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/f9/36/7aa67ae2663025b49e8426ead0bad983fee1b73f472536e9790655da0277/jedi-0.18.0-py2.py3-none-any.whl (1
    .4MB)
        100% |████████████████████████████████| 1.4MB 445kB/s
    Collecting pickleshare (from IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/9a/41/220f49aaea88bc6fa6cba8d05ecf24676326156c23b991e80b3f2fc24c77/pickleshare-0.7.5-py2.py3-none-any.
    whl
    Collecting traitlets>=4.2 (from IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/f6/7d/3ecb0ebd0ce8dcdfa7bd47ab85c1d4a521e6770ef283d0824f5804994dfe/traitlets-5.0.5-py3-none-any.whl (1
    00kB)
        100% |████████████████████████████████| 102kB 373kB/s
    Collecting wcwidth (from prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0->IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/59/7c/e39aca596badaf1b78e8f547c807b04dae603a433d3e7a7e04d67f2ef3e5/wcwidth-0.2.5-py2.py3-none-any.whl
    Collecting parso<0.9.0,>=0.8.0 (from jedi>=0.16->IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/ad/f0/ef6bdb1eba2dbfda60c985cd8d7b47b6ed8c6a1f5d212f39ff50b64f172c/parso-0.8.1-py2.py3-none-any.whl (9
    3kB)
        100% |████████████████████████████████| 102kB 397kB/s
    Collecting ipython-genutils (from traitlets>=4.2->IPython->line-profiler==3.1.0)
      Downloading https://files.pythonhosted.org/packages/fa/bc/9bd3b5c2b4774d5f33b2d544f1460be9df7df2fe42f352135381c347c69a/ipython_genutils-0.2.0-py2.py3-none
    -any.whl
    Installing collected packages: wcwidth, prompt-toolkit, decorator, pygments, backcall, parso, jedi, pickleshare, ipython-genutils, traitlets, IPython, line-
    profiler
    Successfully installed IPython-7.22.0 backcall-0.2.0 decorator-4.4.2 ipython-genutils-0.2.0 jedi-0.18.0 line-profiler-3.1.0 parso-0.8.1 pickleshare-0.7.5 pr
    ompt-toolkit-3.0.18 pygments-2.8.1 traitlets-5.0.5 wcwidth-0.2.5

      4、验证是否安装ok

       import line_profiler,无报错

    (CloudStorage) D:learnIOTCloudStorage>python
    Python 3.7.2 (tags/v3.7.2:9a3ffc0492, Dec 23 2018, 23:09:28) [MSC v.1916 64 bit (AMD64)] on win32
    Type "help", "copyright", "credits" or "license" for more information.
    >>>
    >>>
    >>>
    >>> import line_profiler
    >>>

     三、简单使用

      测试案例

    #!/usr/bin/python3
    # -*- coding: UTF-8 -*-
    """
    @author:durant.zeng
    @Description:描述
    @file:yy.py
    @time:2021/03/30
    """
    import sys
    import time
    import line_profiler
    
    @line_profiler
    def test():
        li = []
        li_3 = []
        li_x = []
        for i in range(1000):
            if i % 2 == 0:
                li.append(i)
            elif i % 3 == 0:
                li_3.append(i)
                time.sleep(0.1)
    
            elif i % 5 == 0:
                x = i * [i for i in range(1000000)][1000]
                li_x.append(x)
                print(li_x)
    
            elif (i % 3 in [i for i in range(300000)]) or (i in [i for i in range(100000)]):
                print(i)
                print('--end--')
    
    profile = line_profiler.LineProfiler(test)  # 把函数传递到性能分析器
    profile.enable()  # 开始分析
    test()
    profile.disable()  # 停止分析
    profile.print_stats(sys.stdout)  # 打印出性能分析结果

      执行结果:

    Total time: 44.4552 s
    File: D:/learn/IOT/CloudStorage/test/yy.py
    Function: test at line 14
    
    Line #      Hits         Time  Per Hit   % Time  Line Contents
    ==============================================================
        14                                           def test():
        15         1          5.0      5.0      0.0      li = []
        16         1          2.0      2.0      0.0      li_3 = []
        17         1          2.0      2.0      0.0      li_x = []
        18      1001      13184.0     13.2      0.0      for i in range(1000):
        19      1000       9276.0      9.3      0.0          if i % 2 == 0:
        20       500       7372.0     14.7      0.0              li.append(i)
        21       500       4638.0      9.3      0.0          elif i % 3 == 0:
        22       167        566.0      3.4      0.0              li_3.append(i)
        23       167   52138310.0 312205.4     37.6              time.sleep(0.1)
        24                                           
        25       333       2463.0      7.4      0.0          elif i % 5 == 0:
        26        67   35984802.0 537086.6     26.0              x = i * [i for i in range(1000000)][1000]
        27        67       1090.0     16.3      0.0              li_x.append(x)
        28        67      11033.0    164.7      0.0              print(li_x)
        29                                           
        30       266   50385155.0 189417.9     36.4          elif (i % 3 in [i for i in range(300000)]) or (i in [i for i in range(100000)]):
        31       266      37276.0    140.1      0.0              print(i)
        32       266       6726.0     25.3      0.0              print('--end--')
    • Total Time:测试代码的总运行时间
    • Line:代码行号
    • Hits:表示每行代码运行的次数
    • Time:每行代码运行的总时间
    • Per Hits:每行代码运行一次的时间
    • % Time:每行代码运行时间的百分比
    • 从分析结果可以看出:第23行代码运行时间最长

    参考博客:https://blog.csdn.net/craftsman2020/article/details/109523731

    知道、想到、做到、得到
  • 相关阅读:
    大数据DDos检测——DDos攻击本质上是时间序列数据,t+1时刻的数据特点和t时刻强相关,因此用HMM或者CRF来做检测是必然! 和一个句子的分词算法CRF没有区别!
    什么是私有密钥密码技术——密钥加密算法采用同一把密钥进行加密和解密
    条件随机场——时间序列(句子单词序列也算),其特征函数必须要考虑前一刻的数据
    隐形马尔可夫模型——前向算法就是条件概率
    MySQL添加字段和修改字段的方法
    shell脚本操作mysql数据库
    mysql 如何修改、添加、删除表主键
    shell按行合并文件
    MySQL主键添加/删除
    MySQL 添加列,修改列,删除列
  • 原文地址:https://www.cnblogs.com/Durant0420/p/14597220.html
Copyright © 2020-2023  润新知