beautifulsoup 从未排序的列表中获取 href

Question

为什么这段代码没有输出三个链接到搜索引擎找到的三个点击？

from bs4 import BeautifulSoup

from urllib import urlopen

import urllib2
opener = urllib2.build_opener()
opener.addheaders = [('User-agent', 'Mozilla/5.0')]
url = "https://www.conrad.de/de/Search.html?search=mosfet+driver"
page = opener.open(url)
soup = BeautifulSoup(page, "html5lib")
#print soup.prettify


result = soup.find_all('ul', class_="ccpProductList")

products  = result[0].find_all('a', class_="ccpProductListItem__title")

for product in products:
    print product.href

输出为“无”三倍。

Answer 1

我认为您的问题是最后一行print product.href。我认为您需要print product['href']。下面的代码做我认为你想要的：

from bs4 import BeautifulSoup
import urllib2

url = 'https://www.conrad.de/de/Search.html?search=mosfet+driver'
req = urllib2.Request(url)
response = urllib2.urlopen(req)
page = response.read()
soup = BeautifulSoup(page,'html.parser')
#print soup.prettify

result = soup.find_all('ul', class_="ccpProductList")
products = result[0].find_all('a', class_="ccpProductListItem__title")
for p in products:
    print p['href']