• BeautifulSoup实例


    #coding:utf8
    
    from bs4 import BeautifulSoup
    
    html__doc = """
    <html><head><title>The Dormouse's story</title></head>
    <body>
    <p class="title"><b>The Dormouse's story</b></p>
    
    <p class="story">Once upon a time there were three little sisters; and their names were
    <a href="http://example.com/elsie" class="sister" id="link1">Elsie</a>,
    <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
    <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
    and they lived at the bottom of a well.</p>
    
    <p class="story">...</p>
    """
    soup = BeautifulSoup(html__doc, 'html.parser', from_encoding='utf-8')
    links = soup.find_all('a')
    for link in links:
        print (link.name, link['href'], link.get_text())

    beautifulsoup的参数:文档字符串、解析器、编码;

    创建好soup对象后,获取所有链接(含字符串‘a’);

    得到节点的名称、url、文字

    运行显示:

    (u'a', u'http://example.com/elsie', u'Elsie')
    (u'a', u'http://example.com/lacie', u'Lacie')
    (u'a', u'http://example.com/tillie', u'Tillie')

    print '获取lacie的链接'
    link_node = soup.find('a', href='http://example.com/lacie')
    print link_node.name, link_node['href'], link_node.get_text()

    运行显示:

    获取lacie的链接
    a http://example.com/lacie Lacie

    print '正则匹配'
    link_node = soup.find('a', href=re.compile(r"ill"))
    print link_node.name, link_node['href'], link_node.get_text()

    运行显示:

    正则匹配
    a http://example.com/tillie Tillie

    print '获取p段落文字'
    p_node = soup.find('p', class_="title")
    print p_node.name, p_node.get_text()

    运行显示:

    获取p段落文字
    p The Dormouse's story

  • 相关阅读:
    NPOI json转Excel DataTable转Excel ,Excel转DataTable
    sqlhelper;
    C# DataSet数据导入Excel 修正版- .net FrameWork 4.0以上
    asp.net core 教程(七)-异常处理、静态文件
    asp.net core 教程(六)-中间件
    asp.net core 教程(五)-配置
    jQuery_3_过滤选择器
    jQuery_2_常规选择器-高级选择器2
    jQuery_2_常规选择器-高级选择器
    jQuery_2_常规选择器-进阶选择器
  • 原文地址:https://www.cnblogs.com/strawqqhat/p/10602398.html
Copyright © 2020-2023  润新知