如何在不显示“\n”的情况下将响应保存为 csv？

Question

这个脚本的输出有问题。返回响应时，“详细信息”响应始终包含短语“\n”。如何在没有“\n”的情况下将响应保存为 csv？感谢您的任何建议。

from requests_html import HTMLSession

def getPrice(url):
    s = HTMLSession()
    r = s.get(url)
    r.html.render(sleep=1)

    product = {
        'title': r.html.xpath('//*[@id="productTitle"]', first=True).text,
        'price': r.html.xpath('//*[@id="priceblock_ourprice"]', first=True).text,
        'details': r.html.xpath('//*[@id="prodDetails"]/div/div[1]/div', first=True).text
    }

    print(product)
    return product

getPrice('https://www.amazon.com/dp/B07HXN1V51')

追溯

{'title': 'Charades Party Game – Speed Charades Board Game – Fast-Paced Party Game - Perfect for Groups and Family Game Nights', 'price': '$24.99', 'details': 'Product Dimensions\n10.25 x 8.5 x 2.6 inches\nItem Weight\n1.75 pounds\nASIN\nB07HXN1V51\nItem model number\n8291\nManufacturer recommended age\n13 years and up\nBest Sellers Rank\n#2,811 in Toys & Games (See Top 100 in Toys & Games)\n#191 in Board Games (Toys & Games)\n\nCustomer Reviews\n/* * Fix for UDP-1061. Average customer reviews has a small extra line on hover * https://omni-grok.amazon.com/xref/src/appgroup/websiteTemplates/retail/SoftlinesDetailPageAssets/udp-intl-lock/src/legacy.css?indexName=WebsiteTemplates#40 */ .noUnderline a:hover { text-decoration: none; }\n4.7 out of 5 stars 682 ratings P.when(\'A\', \'ready\').execute(function(A) { A.declarative(\'acrLink-click-metrics\', \'click\', { "allowLinkDefault" : true }, function(event){ if(window.ue) { ue.count("acrLinkClickCount", (ue.count("acrLinkClickCount") || 0) + 1); } }); }); P.when(\'A\', \'cf\').execute(function(A) { A.declarative(\'acrStarsLink-click-metrics\', \'click\', { "allowLinkDefault" : true }, function(event){ if(window.ue) { ue.count("acrStarsLinkWithPopoverClickCount", (ue.count("acrStarsLinkWithPopoverClickCount") || 0) + 1); } }); });\n\n4.7 out of 5 stars\nIs Discontinued By Manufacturer\nNo\nMfg Recommended age\n13 year and up\nManufacturer\nThe GAME CHEF'}

Answer 1

假设您的字典值只是字符串，那么我将使用替换。

举例

res = {}
for key in list(product):
    res[key] = product[key].replace('\n',' ')

print(res)
return res

关于替换方法的更多信息：

也许可以就地进行转换，我不记得字典是否允许这样做。

编辑

保存为 csv：

import pandas as pd

df = pd.DataFrame(products)
df.to_csv('my_products_csv.csv')

Answer 2

试试这个来摆脱由脚本和样式标签产生的乱码。此外，换行问题已得到处理。我将bs4 库与requests_html 结合使用来剔除不需要的标签。

from requests_html import HTMLSession
from bs4 import BeautifulSoup

def getPrice(url):
    s = HTMLSession()
    r = s.get(url)
    r.html.render(sleep=1)
    soup = BeautifulSoup(r.html.raw_html,"html.parser")

    [script.extract() for script in soup.select("script,style")]

    product = {
        'title': soup.select_one('span#productTitle').get_text(strip=True),
        'price': soup.select_one('#priceblock_ourprice').get_text(strip=True),
        'details': ' '.join(soup.select_one('table[class$="prodDetTable"]').text.split())
    }

    return product

print(getPrice('https://www.amazon.com/dp/B07HXN1V51'))

编辑：

我不确定这是否是您的意思：

try:
    title = soup.select_one('span#productTitle').get_text(strip=True)
except AttributeError: title = ''
try:
    price = soup.select_one('#priceblock_ourprice').get_text(strip=True)
except AttributeError: price = ''
try:
    details = ' '.join(soup.select_one('table[class$="prodDetTable"]').text.split())
except AttributeError: details = ''

product = {
    'title': title,
    'price': price,
    'details': details
}