【发布时间】:2021-04-11 10:35:36
【问题描述】:
我刚刚开始使用 Scrapy。我想从this page 抓取所有职位并将其保存在 CSV 文件中。但是当我运行命令时:
scrapy 抓取jobscraper -o file.csv
它创建了一个空文件。我做错了什么?
import scrapy
class JobScraper(scrapy.Spider):
name = "jobscraper"
start_urls = [
'https://www.pracuj.pl/praca/it%20-%20rozw%c3%b3j%20oprogramowania;cc,5016/%c5%82%c3%b3dzkie;r,5?rd=0',
]
def parse(self, response):
for offer in response.xpath('//div[contains(@class, "offer__info")]'):
data = {
'title': offer.xpath('//a[@class="offer-details__title-link]').extract_first()
}
yield data
【问题讨论】:
标签: python web-scraping xpath scrapy