无法在 Python 中读取和加载 JSON 文件，JSON 格式不同

Question

我有以下格式的 JSON，我无法读取和加载 JSON 文件。出现额外数据错误。请帮忙

{"From":{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"e203b3e0-0b89- 11ea-b608-f5b0a8eb5137","name":"Bot","aadObjectId":null,"role":"bot"},"To": 
{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"deb09575-8edb-411f-b875-418e7944a315","name":"User","aadObjectId":null,"role":"user"},"Text":""}
{"From":{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137","name":"Bot","aadObjectId":null,"role":"bot"},"To": 
{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"a23f6775-c557-489d-996a-d6d3b329a234","name":"User","aadObjectId":null,"role":"user"},"Text":"Let me know if there’s anything else you need."}
{"From":{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137","name":"Bot","aadObjectId":null,"role":"bot"},"To": 
{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"a9f3d513-e4d2-48dc-996a-df3c292e707c","name":"User","aadObjectId":null,"role":"user"},"Text":"I’m here if you need anything else."}
{"From":{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137","name":"Bot","aadObjectId":null,"role":"bot"},"To": 
{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"b08c1237-82cb-4550-8b19-cef5a8e87439","name":"User","aadObjectId":null,"role":"user"},"Text":""}
{"From":{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137","name":"Bot","aadObjectId":null,"role":"bot"},"To": 
{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"7eb76928-1a0e-4e31-80b2-519be0315d56","name":"User","aadObjectId":null,"role":"user"},"Text":""}

代码：

import json
import pandas as pd
from datetime import datetime
import dateutil.parser

##Date Format
date_format = "%Y-%m-%dT%H:%M:%S:%M" 

#ft = 'C:/Users/abc/Desktop/xyz/pqr/aaa/Data5.json'
#data = json.dumps(ft)
#data = json.load(json.dumps(ft))

##Read the JSON file
with open('C:/Users/abc/Desktop/xyz/pqr/aaa/Data5.json',encoding= "utf-8") as f:
    #data = json.loads(json.dumps([f]))
    data = json.load(f)

错误

raise JSONDecodeError("Extra data", s, end)
JSONDecodeError: Extra data

Answer 1

如果将json对象放入数组中，并用逗号正确分隔对象：

[
{"From":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"e203b3e0-0b89- 11ea-b608-f5b0a8eb5137",
      "name":"Bot","aadObjectId":null,
      "role":"bot"},
  "To":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"deb09575-8edb-411f-b875-418e7944a315",
      "name":"User",
      "aadObjectId":null,
      "role":"user"},
  "Text":""},
{"From":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137",
      "name":"Bot",
      "aadObjectId":null,
      "role":"bot"},
  "To":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"a23f6775-c557-489d-996a-d6d3b329a234",
      "name":"User",
      "aadObjectId":null,
      "role":"user"},
  "Text":"Let me know if there’s anything else you need."},
{"From":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137",
      "name":"Bot",
      "aadObjectId":null,
      "role":"bot"},
  "To":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"a9f3d513-e4d2-48dc-996a-df3c292e707c",
      "name":"User",
      "aadObjectId":null,
      "role":"user"},
  "Text":"I’m here if you need anything else."},
{"From":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137",
      "name":"Bot",
      "aadObjectId":null,
      "role":"bot"},
  "To":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"b08c1237-82cb-4550-8b19-cef5a8e87439",
      "name":"User",
      "aadObjectId":null,
      "role":"user"},
  "Text":""},
{"From":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"e203b3e0-0b89-11ea-b608-f5b0a8eb5137",
      "name":"Bot",
      "aadObjectId":null,
      "role":"bot"},
  "To":
    {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema",
      "id":"7eb76928-1a0e-4e31-80b2-519be0315d56",
      "name":"User",
      "aadObjectId":null,
      "role":"user"},
  "Text":""}
]

Answer 2

这是一个有效的 json：

{"From":{"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"e203b3e0-0b89- 11ea-b608-f5b0a8eb5137","name":"Bot","aadObjectId":null,"role":"bot"},"To":
   {"$type":"Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema","id":"deb09575-8edb-411f-b875-418e7944a315","name":"User","aadObjectId":null,"role":"user"},"Text":""}

但是你有很多，所以 json 在读取一个对象后仍然会找到数据并窒息。

事实上，您可以一次读取文件 2 行：

   ...
   ##Read the JSON file
   with open('C:/Users/abc/Desktop/xyz/pqr/aaa/Data5.json',encoding= "utf-8") as f:
       data = []            # initialize an empty list
       for line in f:
           line += next(f)  # concatenate every second line
           data.append(json.loads(line))

Answer 3

看看这是否产生了你需要的数据。

>>> new_data = '[' + re.sub(r"\}\s*\{", "}, {", data) + ']'
>>> json_data = json.loads(new_data)

只需要稍微煮一下数据。假设这是几个 JSON 数据包的串联，我们可以用适当的语法将它们分开，并用方括号将其组成一个 JSON 兼容列表。

>>> json_data[2]['From']['$type']
'Microsoft.Bot.Schema.ChannelAccount, Microsoft.Bot.Schema'