【发布时间】:2021-01-23 23:06:33
【问题描述】:
我正在从 bing 获取搜索结果。除了输出到 csv 文件外,一切正常。我也尝试过 pandas,但似乎无法正确输出。我需要相应链接旁边的 A 列中的“url”和 B 列中的“名称”。
def scrape():
urls = WebDriverWait(driver, 10).until(EC.visibility_of_all_elements_located((By.CLASS_NAME, "b_algo")))
url = [div.find_element_by_tag_name('a').get_attribute('href') for div in urls]
names = WebDriverWait(driver, 10).until(EC.visibility_of_all_elements_located((By.CLASS_NAME, "b_algo")))
name = [div.find_element_by_tag_name('h2 > a').get_attribute('innerHTML').split('-')[0].strip() for div in names]
x1 = [url]
x2 = [name]
pp.pprint([url,name])
with open(bing_parameters.file_name, 'a', newline='\n', encoding='utf-8') as f:
wr = csv.writer(f)
for items in x1:
wr.writerow([x1,x2])
scrape()
【问题讨论】:
标签: python-3.x selenium csv export-to-csv