Pandas 返回下载日期的 NaN 值 (read_html)答案

【问题标题】：Pandas returns NaN Values for downlaoded Dates (read_html)Pandas 返回下载日期的 NaN 值 (read_html)
【发布时间】：2022-02-03 02:13:25
【问题描述】：

我需要下载一些大学的股票数据并获取日期的 NaN 值。有人可以帮忙吗？

header = {
      "User-Agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.75 Safari/537.36",
      "X-Requested-With": "XMLHttpRequest"
    }  



 def house_stock_trading():
        url = 'https://www.quiverquant.com/sources/housetrading'
              
        r = requests.get(url, headers=header)       
        df = pd.read_html(r.text)[0]
        df.to_excel("data/house_stock_trading.xlsx" , index = False)

表格看起来不错，但我仍然得到日期的 NaN 值。有什么想法吗？

【问题讨论】：

标签： python html pandas web-scraping nan

【解决方案1】：

尝试在.read_html()方法中指定flavor="html5lib"属性：

import requests
import pandas as pd


header = {
    "User-Agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.75 Safari/537.36",
    "X-Requested-With": "XMLHttpRequest",
}


def house_stock_trading():
    url = "https://www.quiverquant.com/sources/housetrading"
    r = requests.get(url, headers=header)
    df = pd.read_html(
        r.text,
        flavor="html5lib",
    )[0]
    return df


print(house_stock_trading().head())

打印：

  Stock * Date Disclosed                       Rep. Purchase / Sale          Amount District
0      SQ       2/1/2022  Donald Sternoff Beyer Jr.            Sale  $1,001-$15,000     VA08
1     PEP       2/1/2022  Donald Sternoff Beyer Jr.        Purchase  $1,001-$15,000     VA08
2     PEP       2/1/2022  Donald Sternoff Beyer Jr.        Purchase  $1,001-$15,000     VA08
3    CYRX       2/1/2022  Donald Sternoff Beyer Jr.            Sale  $1,001-$15,000     VA08
4     BBH       2/1/2022  Donald Sternoff Beyer Jr.            Sale  $1,001-$15,000     VA08

【讨论】：