UnicodeDecodeError utf-8 无法解码字节

Question

combined_csv = pd.concat([pd.read_csv(f) for f in all_filenames]) 无法正常显示

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 12: invalid start byte

全部代码如下：

import os
import glob
import pandas as pd
os.chdir("S/Last Processed Data")

extension = 'csv'
all_filenames = [i for i in glob.glob('*.{}'.format(extension))]

combined_csv = pd.concat([pd.read_csv(f) for f in all_filenames])

combined_csv.to_csv( "combined_csv.csv", index=False, encoding='utf-8-sig')

Answer 1

读取文件时需要传递编码参数：

combined_csv = pd.concat([pd.read_csv(f, encoding=...) for f in all_filenames])

如果utf-8 不起作用，请尝试ISO-8859-1。