从 API 输出创建 CSV答案

【问题标题】：Create CSV from API output从 API 输出创建 CSV
【发布时间】：2019-09-16 02:41:44
【问题描述】：

我正在尝试从我使用 python 执行的一些 API 调用创建一个 CSV 文件。

我已经让它工作了，但这不是解决我的问题的一种非常实用的方法。

基本上我想做的是：

    csv_headers = ['Switch','Switchport Number','Port Name','VLAN']
    writer = csv.DictWriter(csv_file, fieldnames=csv_headers)
    writer.writeheader()
    get_devices = requests.get(base_url + '/networks/' + net_id + '/devices/', headers=headers).json()#Get all devices
    for device in get_devices:
        model = device['model']
        if 'MS' in model:
            serial = device['serial']
            name = device['name']
            switch_info = requests.get(base_url + '/devices/' + serial + '/switchPorts', headers=headers).json()#Get SwitchPortNumber, SwitchPortName and VLAN
            for switch_item in switch_info:
                switch_port = switch_item['number']
                switch_port_name = switch_item['name']
                vlan = switch_item['vlan']
                writer.writerow({csv_headers[0]:name,csv_headers[1]:switch_port,csv_headers[2]:switch_port_name,csv_headers[3]:vlan})

csv_headers2 = ['Switch Port','IP Address','Mac Address','Manufactor']
    writer2 = csv.DictWriter(csv_file2, fieldnames=csv_headers2)
    writer2.writeheader()
    get_client = requests.get(base_url + '/devices/' + serial + '/clients?timespan=180', headers=headers).json()
    for client_item in get_client:
        ip = client_item['ip']
        mac = client_item['mac']
        sp = int(client_item['switchport'])
        vendor = requests.get('https://api.macvendors.com/' + client_item['mac'])
        vendor = (format(str(vendor.text)))
        vendor = vendor.replace(",","")
        time.sleep(1)
        writer2.writerow({csv_headers2[0]:sp,csv_headers2[1]:ip,csv_headers2[2]:mac,csv_headers2[3]:vendor})
#CREATE CLIENT OUTPUT CSV#

#CREATE DATAFRAMES AND RENAME COLUMNS#
df1 = pd.read_csv(dirname+'/temp_switch.csv')
df2 = pd.read_csv(dirname+'/temp_client.csv')
df2.rename(columns={"Switch Port": "Switchport Number"}, inplace=True)
#CREATE DATAFRAMES AND RENAME COLUMNS#

#MERGE DATAFRAMES#
merged_df = pd.merge(df1, df2, on=["Switchport Number"], how="left")
#MERGE DATAFRAMES#

#REPLACE NO VALUES WITH DEFAULT VALUES#
default_values = {"IP Address": "No IP Address found", "Mac Address": "No MAC Address found", "Manufactor": "Could not resolve vendor"}
merged_df.fillna(value=default_values, inplace=True)
#REPLACE NO VALUES WITH DEFAULT VALUES#

#CREATE FINAL OUTPUT CSV
merged_df.to_csv(dirname+'/SwitchOutput-'+datetime.datetime.now().strftime("%d-%m-%y-%H-%M-%S")+'.csv', index=False)
#CREATE FINAL OUTPUT CSV

#REMOVE TEMP FILES#
os.remove(dirname+'/temp_switch.csv')
os.remove(dirname+'/temp_client.csv')

如您所见，我正在尝试进行一些 API 调用并将该数据“存储”在临时 csv 文件中。搜索该数据，如果交换机端口有 IP，则合并该数据，如果 != 则打印 No data found。

我可以将我的数据存储在 pandas 的 DataFrame 中吗？类似的东西

import pandas as pd
import requests

headers = ['Switch','Switchport Number','Port Name','VLAN',IP Address','Mac Address','Manufactory']



df1 = pd.DataFrame(output from switch_info)
df2 = pd.DataFrame(output from client_info)

compare data from df1 with df2 and create df3

merged_df.to_csv('output.csv')

希望有人可以帮助我！

提前致谢。

【问题讨论】：

标签： python pandas api csv for-loop

【解决方案1】：

根据您的代码，我假设您的 API 有正确的 JSON 响应。为此，您可以使用

创建 2 个数据框

get_devices = requests.get(base_url + '/networks/' + net_id + '/devices/', headers=headers).json()#Get all devices
get_client = requests.get(base_url + '/devices/' + serial + '/clients?timespan=180', headers=headers).json()
df1 = pd.read_json(get_devices)
df2 = pd.read_json(get_client)

并应用相应的操作，例如

df1 = df1[df1['model'=='MS']]

在设备和客户端之间加入等等。

【讨论】：