• 【python】selenium获取http请求头信息


    # 以获取API商城 - IP查询服务的timestamp签名为例
    # 是
    seleniumwire 不是 selenium
    import time
    from seleniumwire import webdriver
    driver = webdriver.Chrome()
    
    driver.get('https://apis.baidu.com/store/aladdin/land?cardType=ipSearch')
    driver.find_element_by_xpath('//*[@id="app"]/div[2]/div/div/div[2]/input').send_keys("112.10.36.59")
    driver.find_element_by_xpath('//*[@id="app"]/div[2]/div/div/div[2]/div').click()
    time.sleep(1)
    # Access requests via the `requests` attribute
    for request in driver.requests:
        if request.response and "timestamp" in request.headers:
            print(request.headers["timestamp"])
    
    driver.close()

     

    第二种办法就是用代理了

    https://stackoverflow.com/questions/36744627/network-capturing-with-selenium-phantomjs/36769922#36769922

    第三种办法是过滤日志

    https://gist.github.com/lorey/079c5e178c9c9d3c30ad87df7f70491d

    https://www.rkengler.com/how-to-capture-network-traffic-when-scraping-with-selenium-and-python/      

    转载注明出处 一支小白 - 博客园http://www.cnblogs.com/startnow/ - 联系:tungshuaishuai@sina.com
  • 相关阅读:
    c++ static_cast和dynamic_cast详解
    python 字符串格式化 format
    python zip() 函数
    零零散散的python笔记 2
    PAT 1017
    PAT 1016
    PAT 1015
    Jordan Lecture Note-8: The Sequential Minimal Optimization Algorithm (SMO).
    Jordan Lecture Note-7: Soft Margin SVM
    PAT 1014
  • 原文地址:https://www.cnblogs.com/startnow/p/14635147.html
Copyright © 2020-2023  润新知