Python - 试图将文件从一个位置提取到另一个位置

Question

我正在尝试从服务器中提取一组文件并存储在我本地的一个文件夹中。下面的代码很适合这个任务。但是，如果任何文件为空，它会在该点停止并且不会继续。

list_ = []
for file_ in allFiles:
    try:
        df = pd.read_csv(file_, index_col=None, delim_whitespace=True)
        list_.append(df)
        temp = pd.concat(list_)
    except EmptyDataError:
        df = pd.DataFrame()
        return df

谁能建议我如何绕过这些空文件并继续从服务器中提取其他文件。谢谢

更新：

下面是我要执行的功能

list_ = []
for file_ in allFiles:
    try:
        df = pd.read_csv(file_, index_col=None, header=None, delim_whitespace=True)
        list_.append(df)
        temp = pd.concat(list_)
    except pd.errors.EmptyDataError:
        continue
df_v1 = [pd.read_csv(fp, delim_whitespace=True).assign(FileName=os.path.basename(fp)) for fp in allFiles]  <<-- Error thrown on this line as per trackback
df = pd.concat(df_v1, ignore_index=True, sort=False)

引用：

Traceback (most recent call last):
  File "/Users/PycharmProjects/venv/try.py", line 102, in <module>
s3_func("stores","store_a", "2018-10-03", "2018-10-05")
  File "/Users/PycharmProjects/venv/try.py", line 86, in s3_func
df_v1 = [pd.read_csv(fp, delim_whitespace=True).assign(FileName=os.path.basename(fp)) for fp in allFiles]
  File "/Users/PycharmProjects/venv/try.py", line 86, in <listcomp>
df_v1 = [pd.read_csv(fp, delim_whitespace=True).assign(FileName=os.path.basename(fp)) for fp in allFiles]
  File "/Users/PycharmProjects/venv/lib/python3.6/site-packages/pandas/io/parsers.py", line 678, in parser_f
return _read(filepath_or_buffer, kwds)
  File "/Users/PycharmProjects/venv/lib/python3.6/site-packages/pandas/io/parsers.py", line 440, in _read
parser = TextFileReader(filepath_or_buffer, **kwds)
  File "/Users/PycharmProjects/venv/lib/python3.6/site-packages/pandas/io/parsers.py", line 787, in __init__
self._make_engine(self.engine)
  File "/Users/PycharmProjects/venv/lib/python3.6/site-packages/pandas/io/parsers.py", line 1014, in _make_engine
self._engine = CParserWrapper(self.f, **self.options)
  File "/Users/PycharmProjects/venv/lib/python3.6/site-packages/pandas/io/parsers.py", line 1708, in __init__
self._reader = parsers.TextReader(src, **kwds)
  File "pandas/_libs/parsers.pyx", line 542, in pandas._libs.parsers.TextReader.__cinit__
pandas.errors.EmptyDataError: No columns to parse from file

Answer 1

您的循环在达到return 条件时退出。 如果您想在发生异常时继续迭代，您可以执行以下操作：

list_ = []
for file_ in allFiles:
    try:
        df = pd.read_csv(file_, index_col=None, delim_whitespace=True)
        list_.append(df)
        temp = pd.concat(list_)
    except EmptyDataError:
        df = pd.DataFrame()
        continue  # Changed return with continue, since return breaks the loop.

我还看到您在异常时创建了空数据框。你用那个空数据框做什么？您需要它以备将来使用吗？

如果您将来需要空数据框，也可以考虑将它们附加到列表中

except EmptyDataError:
            df = pd.DataFrame()
            list_.append(df)  # Appending empty dataframes to the list
            continue