您可以将 API 调用直接拉入 Pandas Dataframe 吗？

Question

我正在构建一个小程序来绘制一些 API 数据。我已将其设置为提取数据，然后创建一个本地 json，然后我从中创建一个数据框。

有没有办法跳过本地文件并将数据直接拉入数据框？

如您所见，我正在使用的示例是爱尔兰，但我希望最终得到可以引用任何国家/地区的内容，并希望避免创建文件。

# Import the libraries
import requests
import json
from datetime import datetime

import matplotlib.pyplot as plt

import pandas as pd
import numpy as np
from pandas import Series, DataFrame

# Save the current API call as a JSON file
# countryStatusdDayOne

# 1. Make an API call and store the response.
url = 'https://api.covid19api.com/total/dayone/country/ireland'
data = requests.get(url)

# Store the API response in a variable.
available_data = data.json()

filename = 'data/covid_call__ireland_day_one_workable.json'
with open(filename, 'w') as f:
    json.dump(available_data, f, indent=4)

# read the json
ireland = pd.read_json('data/covid_call__ireland_day_one_workable.json')

# create a dataframe 
df_ire = pd.DataFrame(ireland)

这对我来说都是全新的，所以任何关于如何格式化或改进我的代码的建议也非常欢迎！

Answer 1

IIUC，您可以使用pd.json_normalize 从内存中读取数据，而无需在磁盘上创建文件。

如果您正在阅读多个国家/地区，则可以将所有值保存在字典中。

import requests
import json
from datetime import datetime

import matplotlib.pyplot as plt

import pandas as pd
import numpy as np
from pandas import Series, DataFrame

# Save the current API call as a JSON file
# countryStatusdDayOne

country = 'ireland'

# 1. Make an API call and store the response.
url = f'https://api.covid19api.com/total/dayone/country/{country}'
data = requests.get(url)

# Store the API response in a variable.
available_data = data.json()

dfs = {}

dfs[f'{country}'] = pd.json_normalize(available_data)

---

print(dfs['ireland'])

    Country CountryCode Province City CityCode Lat Lon  Confirmed  Deaths  \
0   Ireland                                      0   0          1       0   
1   Ireland                                      0   0          1       0   
2   Ireland                                      0   0          1       0   
3   Ireland                                      0   0          2       0   
4   Ireland                                      0   0          6       0   
..      ...         ...      ...  ...      ...  ..  ..        ...     ...   
62  Ireland                                      0   0      20833    1265   
63  Ireland                                      0   0      21176    1286   
64  Ireland                                      0   0      21506    1303   
65  Ireland                                      0   0      21772    1319   
66  Ireland                                      0   0      21983    1339   

    Recovered  Active                  Date  
0           0       1  2020-02-29T00:00:00Z  
1           0       1  2020-03-01T00:00:00Z  
2           0       1  2020-03-02T00:00:00Z  
3           0       2  2020-03-03T00:00:00Z  
4           0       6  2020-03-04T00:00:00Z  
..        ...     ...                   ...  
62      13386    6182  2020-05-01T00:00:00Z  
63      13386    6504  2020-05-02T00:00:00Z  
64      13386    6817  2020-05-03T00:00:00Z  
65      13386    7067  2020-05-04T00:00:00Z  
66      13386    7258  2020-05-05T00:00:00Z  

Answer 2

你可以使用json_normalize：

import requests
import pandas as pd
from pandas.io.json import json_normalize


url = 'https://api.covid19api.com/total/dayone/country/ireland'
data = requests.get(url)

# Store the API response in a variable.
available_data = data.json()
df = json_normalize(available_data)
print(df.head())