【发布时间】:2021-05-04 05:20:04
【问题描述】:
按照 youtube 上的教程,我可以尝试这些行(这些行只工作一次)
from bs4 import BeautifulSoup
import requests
import csv
headers = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3'}
source = requests.get('https://www.amazon.in/s?k=Laptops&ref=nb_sb_noss_2', headers = headers).text
soup = BeautifulSoup(source, 'lxml')
# print(soup.prettify())
Names = []
Prices = []
# for loop
for i in soup.find_all('a', class_='a-link-normal a-text-normal'):
string = i.text
Names.append( string.strip() )
for i in soup.find_all('span', class_='a-price-whole'):
Prices.append(i.text)
file_name = 'Laptops.csv'
with open(file_name, 'w', newline='') as file:
writer = csv.writer(file)
writer.writerow(['Sr.No', 'Laptop Name', 'Prices'])
for i in range(len(Names)):
#print(i, Names[i], Prices[i])
writer.writerow([i, Names[i], Prices[i]])
但是当我再次尝试运行它时,我得到了以下错误:
IndexError Traceback(最近一次调用最后一次) 在 31 for i in range(len(Names)): 32 #print(i,名称[i],价格[i]) ---> 33 writer.writerow([i, Names[i], Price[i]])
IndexError: 列表索引超出范围
【问题讨论】:
-
Prices的数量很可能少于Names。在写入 csv 文件之前尝试打印出len(Names)和len(Prices)。
标签: python beautifulsoup python-requests