我收到此错误 AttributeError: 'NoneType' object has no attribute 'word_index'

Question

即使当我打印句子时，它也会打印由逗号分隔的字符串数 这是我的代码：-

from tensorflow.keras.preprocessing.text import Tokenizer
from tensorflow.keras.preprocessing.sequence import pad_sequences
import json

sentence = []
urls = []
labels = []

data = [json.loads(line) for line in open('Sarcasm_Headlines_Dataset.json', 'r')]
for item in data:
    sentence.append(item["headline"])
    urls.append(item['article_link'])
    labels.append(item['is_sarcastic'])
    
print(sentence)
tokenizer = Tokenizer(oov_token="<00V>")
tokenizer = tokenizer.fit_on_texts(sentence)
word_index =tokenizer.word_index

Answer 1

fit_on_texts 是就地操作，它会返回None

代替：

tokenizer = tokenizer.fit_on_texts(sentence)

使用：

tokenizer = Tokenizer(oov_token="<00V>")
tokenizer.fit_on_texts(sentence)
word_index =tokenizer.word_index