需要使用 python BeautifulSoup 从 html 中获取文本

Question

我卡住了，无法获取所需的数据，这是 html 代码

<div role="tabpanel" class="tab-pane active" id="final-results">
<div class="container-fluid">
    <div class="row">
        <div class="col-xs-12 instruction">
            <h4>Final and Return</h4>
        </div>
        <div class="col-xs-12 col-sm-3 non-printable">
            <img class="img-responsive rotate-card" src= "...">
        </div>
        <div class="col-xs-12 col-sm-3 text-center">
            <div class="data-box">
                <div class="name">Final Ending</div>
                <div class="value">123456789</div>
            </div>
        </div>
        <div class="col-xs-12 col-sm-3 text-center">
            <div class="data-box">
                <div class="name">Available Phase</div>
                <div class="value">250</div>
            </div>
        </div>
        <div class="col-xs-12 col-sm-3 text-center">
            <div class="data-box">
                <div class="name">Initial Phase</div>
                <div class="value">500</div>
            </div>

        </div>

这是我的python代码：

soup = BeautifulSoup(form_resp.content, features="html.parser")

    avail_phase = soup.find("div", text="Available Phase").find_parent("div", class_="value").text

    initial_phase = soup.find("div", text="Initial phase").find_parent("div", class_="value").text

    logger.info("Success! Final Number: {}".format(avail_phase))

    return {"initial_phase": initial_phase, "available_phase": avail_phase}

无论我做什么，我都会遇到同样的错误“最后一个错误：'NoneType' 对象没有属性'find_parent'”

请寻求帮助

Answer 1

如果您想从class='value' 行中抓取数据，那么您可以使用find_next_sibling，因为我看到class='value' 是您最初搜索的文本的兄弟（Available Phase 和@987654325 @)

我必须告诉你，我只是在查看代码的基础上提供这个解决方案，因为我认为我目前没有办法对此进行测试。所以，试试这段代码，看看它是否有效。

avail_phase = soup.find("div", text="Available Phase").find_next_sibling("div", class_="value").text


initial_phase = soup.find("div", text="Initial phase").find_next_sibling("div", class_="value").text

Answer 2

会发生什么？

1. 您尝试使用find_parent("div", class_="value") 选择父级，但没有符合此条件的父级标记。

2. 您选择的soup.find("div", text="Initial phase") 找不到标签，因为它需要与Initial phase 完全匹配

如何解决？

1. 更改为.find_next("div", class_="value").text或.find_next("div").text或.find_next_sibling("div").text以获取下一个<div>的文本

2. 将text="Initial phase"更改为text="Initial Phase"以找到正确的<div>

示例

from bs4 import BeautifulSoup

html='''
<div class="col-xs-12 instruction">
            <h4>Final and Return</h4>
        </div>
        <div class="col-xs-12 col-sm-3 non-printable">
            <img class="img-responsive rotate-card" src= "...">
        </div>
        <div class="col-xs-12 col-sm-3 text-center">
            <div class="data-box">
                <div class="name">Final Ending</div>
                <div class="value">123456789</div>
            </div>
        </div>
        <div class="col-xs-12 col-sm-3 text-center">
            <div class="data-box">
                <div class="name">Available Phase</div>
                <div class="value">250</div>
            </div>
        </div>
        <div class="col-xs-12 col-sm-3 text-center">
            <div class="data-box">
                <div class="name">Initial Phase</div>
                <div class="value">500</div>
            </div>

        </div>
'''

soup = BeautifulSoup(html, features="html.parser")

avail_phase = soup.find("div", text="Available Phase").find_next("div", class_="value").text
initial_phase = soup.find("div", text="Initial Phase").find_next("div", class_="value").text

print({"initial_phase": initial_phase, "available_phase": avail_phase})

输出

{'initial_phase': '500', 'available_phase': '250'}