Python - BeautifulSoup - 无法提取跨度值

Question

我有一个包含多个 Div 类/跨度类的 XML，我正在努力提取文本值。

   <div class="line">
     <span class="html-tag">
       "This is a Heading that I dont want"
     </span>
     <span>This is the text I want</span>

到目前为止，我已经写了这个：

    html = driver.page_source
    soup = BeautifulSoup(html, "lxml")
    spans = soup.find_all('span', attrs={'class': 'html-tag'})[29]
    print(spans.text)

不幸的是，这只会打印出“这是我不想要的标题”值，例如

This is the heading I dont want

代码中的数字[29]是我需要的文字总会出现的位置。

我不确定如何检索我需要的跨度值。

请您帮忙。谢谢

Answer 1

您可以通过<div class="line">搜索，然后选择第二个<span>。

例如：

txt = '''
   # line 1

   <div class="line">
     <span class="html-tag">
       "This is a Heading that I dont want"
     </span>
     <span>This is the text I dont want</span>
   </div>

   # line 2

   <div class="line">
     <span class="html-tag">
       "This is a Heading that I dont want"
     </span>
     <span>This is the text I dont want</span>
   </div>

   # line 3

   <div class="line">
     <span class="html-tag">
       "This is a Heading that I dont want"
     </span>
     <span>This is the text I want</span>   <--- this is I want
   </div>'''


soup = BeautifulSoup(txt, 'html.parser')
s = soup.select('div.line')[2].select('span')[1]    # select 3rd line 2nd span

print(s.text)

打印：

This is the text I want