WordListCorpusReader 不可迭代

Question

所以，我是使用 Python 和 NLTK 的新手。我有一个名为 reviews.csv 的文件，其中包含从亚马逊提取的 cmets。我已经标记了这个 csv 文件的内容并将其写入一个名为 csvfile.csv 的文件中。这是代码：

from nltk.tokenize import sent_tokenize, word_tokenize
from nltk.stem import PorterStemmer
import csv #CommaSpaceVariable
from nltk.corpus import stopwords
ps = PorterStemmer()
stop_words = set(stopwords.words("english"))
with open ('reviews.csv') as csvfile:
    readCSV = csv.reader(csvfile,delimiter='.')    
    for lines in readCSV:
        word1 = word_tokenize(str(lines))
        print(word1)
    with open('csvfile.csv','a') as file:
        for word in word1:
            file.write(word)
            file.write('\n')
    with open ('csvfile.csv') as csvfile:
        readCSV1 = csv.reader(csvfile)
    for w in readCSV1:
        if w not in stopwords:
            print(w)

我正在尝试对 csvfile.csv 执行词干提取。但我得到这个错误：

  Traceback (most recent call last):<br>
  File "/home/aarushi/test.py", line 25, in <module> <br>
   if w not in stopwords: <br>
  TypeError: argument of type 'WordListCorpusReader' is not iterable

Answer 1

什么时候做的

from nltk.corpus import stopwords

stopwords 是指向nltk 中的CorpusReader 对象的变量。

您正在查找的实际停用词（即停用词列表）会在您执行此操作时被实例化：

stop_words = set(stopwords.words("english"))

因此，在检查标记列表中的单词是否为停用词时，您应该这样做：

from nltk.corpus import stopwords
stop_words = set(stopwords.words("english"))
for w in tokenized_sent:
    if w not in stop_words:
        pass # Do something.

为避免混淆，我通常将停用词的实际列表命名为stoplist：

from nltk.corpus import stopwords
stoplist = set(stopwords.words("english"))
for w in tokenized_sent:
    if w not in stoplist:
        pass # Do something.