美汤文章刮

Question

我正在尝试获取文章正文中的所有 p 标签。我想知道是否有人可以解释为什么我的代码错误以及如何改进它。下面是文章的网址和相关代码。感谢您提供的任何见解。

网址：http://www.france24.com/en/20140310-libya-seize-north-korea-crude-oil-tanker-rebels-port-rebels/

import urllib2
from bs4 import BeautifulSoup

# Ask user to enter URL
url = raw_input("Please enter a valid URL: ")

soup = BeautifulSoup(urllib2.urlopen(url).read())

# retrieve all of the paragraph tags
body = soup.find("div", {'class':'bd'}).get_text()
for tag in body:
    p = soup.find_all('p')
    print str(p) + '\n' + '\n'

Answer 1

问题是页面上有多个带有class="bd" 的div 标签。看起来您需要包含实际文章的文章 - 它位于 article 标签内：

import urllib2
from bs4 import BeautifulSoup

# Ask user to enter URL
url = raw_input("Please enter a valid URL: ")

soup = BeautifulSoup(urllib2.urlopen(url))

# retrieve all of the paragraph tags
paragraphs = soup.find('article').find("div", {'class': 'bd'}).find_all('p')
for paragraph in paragraphs:
    print paragraph.text

打印：

Libyan government forces on Monday seized a North Korea-flagged tanker after...
...

希望对您有所帮助。