Web Scrape：如何从所有这些链接中获取所有名称和价格？

Question

你好朋友，我正在尝试获取所有数据，例如名称价格和来自此所有链接的其他数据我在 python 中获取所有 href 链接，但我不知道如何立即获取我正在尝试的所有名称和价格获取但我收到错误我只能打印此代码中的所有链接，但我需要此链接中的所有数据（名称、价格、另一个），请帮助我如何做到这一点，这是我的代码。

url='https://m.autocentrum.pl/nowe/'
response = requests.get(url)
soup = BeautifulSoup(response.text, 'html.parser')

# To download the whole data set, let's do a for loop through all a tags
for i in range(80,len(soup.findAll('a'))+1): #'a' tags are for links
    one_a_tag = soup.findAll('a')[i]
    link = one_a_tag['href']
    download_url = 'http://m.autocentrum.pl'+ link

#    urllib.request.urlretrieve(download_url,+link[link.find("div", class_="car-offer")+1:]) 



#     for i in range(len(soup1.findall("div"))):
#         name = download_url.find("div", class_="new-car-header")[i]
#         print(name)
#     page = requests.get(download_url)
#     soup = BeautifulSoup(page.text, 'html.parser')

#     rating = soup.find_all("div", class_="car-offer") # this is the main div inside this div all data it is so how to export in csv file

#     last_links = soup.find(class_='car-offer')
#     last_links.decompose()
    #name = soup.find(class_='new-car-header')
#     last_links = download_url.find(class_='car-offer')
#     last_links.decompose()
#     name = download_url.find(class_='new-car-header')
#     price = download_url.find(class_='mobile-car-price')
#     extra = more-info
#     artist_name_list_items = artist_name_list.find_all('a')

#urllib.request.urlretrieve(download_url,'./'+link[link.find('/turnstile_')+1:]) 
    print(download_url)
    time.sleep(1) #pause the code for a sec

Answer 1

一种可能性是使用 CSS 选择器选择正确的元素并使用 zip() 函数将它们绑定在一起：

import requests
from bs4 import BeautifulSoup

soup = BeautifulSoup(requests.get('https://www.autocentrum.pl/nowe/').text, 'html.parser')

print('{:<20}{}'.format('Name', 'Price'))
print('-' * 30)
for name, price in zip(soup.select('.car-offer h2'), soup.select('.car-offer div.price .number')):
    name, price = name.get_text(strip=True), price.get_text(strip=True, separator=' ')
    print('{:<20}{}'.format(name, price))

打印：

Name                Price
------------------------------
Opel Astra          85 200 PLN
Fiat Doblo          84 800 PLN
Nissan NV200        57 310 PLN