【问题标题】:How to read a .xlsx file using the pandas Library in iPython?如何在 iPython 中使用 pandas 库读取 .xlsx 文件?
【发布时间】:2013-05-29 03:22:17
【问题描述】:

我想使用 Python 的 Pandas 库读取 .xlsx 文件并将数据移植到 postgreSQL 表。

到目前为止,我能做的只有:

import pandas as pd
data = pd.ExcelFile("*File Name*")

现在我知道该步骤已成功执行,但我想知道如何解析已读取的 excel 文件,以便了解 excel 中的数据如何映射到变量数据中的数据。
如果我没记错的话,我了解到数据是一个 Dataframe 对象。那么如何解析这个数据框对象以逐行提取每一行。

【问题讨论】:

标签: python pandas ipython ipython-notebook dataframe


【解决方案1】:

我通常为每张纸创建一个包含DataFrame 的字典:

xl_file = pd.ExcelFile(file_name)

dfs = {sheet_name: xl_file.parse(sheet_name) 
          for sheet_name in xl_file.sheet_names}

更新:在 pandas 版本 0.21.0+ 中,您将通过将 sheet_name=None 传递给 read_excel 更清晰地获得此行为:

dfs = pd.read_excel(file_name, sheet_name=None)

在 0.20 及之前的版本中,这是 sheetname 而不是 sheet_name(现在已弃用,取而代之的是上述):

dfs = pd.read_excel(file_name, sheetname=None)

【讨论】:

  • 谢谢安迪。这行得通。现在我的下一步是将其写入 postgreSQL 数据库。哪个库最好用? SQLAlchemy?
  • 嗯,如果你说mysql - I'd know the answer,postgres 可能 只是工作类似......虽然不是 100%。 (这是个好问题。)
  • 我知道该怎么做。我使用了 Sqlalchemy。你是对的,它与mysql非常相似。它涉及创建一个引擎,然后收集元数据并使用数据。再次感谢安迪! :) 感谢您的帮助。
  • pandas.DataFrame.to_sql 可能会有所帮助。对于阅读,您可以使用 dp.py 返回 Pandas DataFrame 对象。
  • 请使用openpyxl 引擎更新此答案,如here 所述。
【解决方案2】:

以下内容对我有用:

from pandas import read_excel
my_sheet = 'Sheet1' # change it to your sheet name, you can find your sheet name at the bottom left of your excel file
file_name = 'products_and_categories.xlsx' # change it to the name of your excel file
df = read_excel(file_name, sheet_name = my_sheet)
print(df.head()) # shows headers with top 5 rows

【讨论】:

    【解决方案3】:
    pd.read_excel(file_name) 
    

    有时此代码会为 xlsx 文件提供错误:XLRDError:Excel xlsx file; not supported

    你可以使用openpyxl引擎来读取excel文件。

    df_samples = pd.read_excel(r'filename.xlsx', engine='openpyxl')
    

    【讨论】:

    • 尝试其他答案后,只有这个有效。谢谢。
    【解决方案4】:

    DataFrame 的read_excel 方法类似于read_csv 方法:

    dfs = pd.read_excel(xlsx_file, sheetname="sheet1")
    
    
    Help on function read_excel in module pandas.io.excel:
    
    read_excel(io, sheetname=0, header=0, skiprows=None, skip_footer=0, index_col=None, names=None, parse_cols=None, parse_dates=False, date_parser=None, na_values=None, thousands=None, convert_float=True, has_index_names=None, converters=None, true_values=None, false_values=None, engine=None, squeeze=False, **kwds)
        Read an Excel table into a pandas DataFrame
    
        Parameters
        ----------
        io : string, path object (pathlib.Path or py._path.local.LocalPath),
            file-like object, pandas ExcelFile, or xlrd workbook.
            The string could be a URL. Valid URL schemes include http, ftp, s3,
            and file. For file URLs, a host is expected. For instance, a local
            file could be file://localhost/path/to/workbook.xlsx
        sheetname : string, int, mixed list of strings/ints, or None, default 0
    
            Strings are used for sheet names, Integers are used in zero-indexed
            sheet positions.
    
            Lists of strings/integers are used to request multiple sheets.
    
            Specify None to get all sheets.
    
            str|int -> DataFrame is returned.
            list|None -> Dict of DataFrames is returned, with keys representing
            sheets.
    
            Available Cases
    
            * Defaults to 0 -> 1st sheet as a DataFrame
            * 1 -> 2nd sheet as a DataFrame
            * "Sheet1" -> 1st sheet as a DataFrame
            * [0,1,"Sheet5"] -> 1st, 2nd & 5th sheet as a dictionary of DataFrames
            * None -> All sheets as a dictionary of DataFrames
    
        header : int, list of ints, default 0
            Row (0-indexed) to use for the column labels of the parsed
            DataFrame. If a list of integers is passed those row positions will
            be combined into a ``MultiIndex``
        skiprows : list-like
            Rows to skip at the beginning (0-indexed)
        skip_footer : int, default 0
            Rows at the end to skip (0-indexed)
        index_col : int, list of ints, default None
            Column (0-indexed) to use as the row labels of the DataFrame.
            Pass None if there is no such column.  If a list is passed,
            those columns will be combined into a ``MultiIndex``
        names : array-like, default None
            List of column names to use. If file contains no header row,
            then you should explicitly pass header=None
        converters : dict, default None
            Dict of functions for converting values in certain columns. Keys can
            either be integers or column labels, values are functions that take one
            input argument, the Excel cell content, and return the transformed
            content.
        true_values : list, default None
            Values to consider as True
    
            .. versionadded:: 0.19.0
    
        false_values : list, default None
            Values to consider as False
    
            .. versionadded:: 0.19.0
    
        parse_cols : int or list, default None
            * If None then parse all columns,
            * If int then indicates last column to be parsed
            * If list of ints then indicates list of column numbers to be parsed
            * If string then indicates comma separated list of column names and
              column ranges (e.g. "A:E" or "A,C,E:F")
        squeeze : boolean, default False
            If the parsed data only contains one column then return a Series
        na_values : scalar, str, list-like, or dict, default None
            Additional strings to recognize as NA/NaN. If dict passed, specific
            per-column NA values. By default the following values are interpreted
            as NaN: '', '#N/A', '#N/A N/A', '#NA', '-1.#IND', '-1.#QNAN', '-NaN', '-nan',
        '1.#IND', '1.#QNAN', 'N/A', 'NA', 'NULL', 'NaN', 'nan'.
        thousands : str, default None
            Thousands separator for parsing string columns to numeric.  Note that
            this parameter is only necessary for columns stored as TEXT in Excel,
            any numeric columns will automatically be parsed, regardless of display
            format.
        keep_default_na : bool, default True
            If na_values are specified and keep_default_na is False the default NaN
            values are overridden, otherwise they're appended to.
        verbose : boolean, default False
            Indicate number of NA values placed in non-numeric columns
        engine: string, default None
            If io is not a buffer or path, this must be set to identify io.
            Acceptable values are None or xlrd
        convert_float : boolean, default True
            convert integral floats to int (i.e., 1.0 --> 1). If False, all numeric
            data will be read in as floats: Excel stores all numbers as floats
            internally
        has_index_names : boolean, default None
            DEPRECATED: for version 0.17+ index names will be automatically
            inferred based on index_col.  To read Excel output from 0.16.2 and
            prior that had saved index names, use True.
    
        Returns
        -------
        parsed : DataFrame or Dict of DataFrames
            DataFrame from the passed in Excel file.  See notes in sheetname
            argument for more information on when a Dict of Dataframes is returned.
    

    【讨论】:

      【解决方案5】:

      我使用参数 index_col (index_col =0 第一张)

      import pandas as pd
      file_name = 'some_data_file.xlsx' 
      df = pd.read_excel(file_name, index_col=0)
      print(df.head()) # print the first 5 rows
      

      【讨论】:

      • 您也可以使用sheet_name=0 或将工作表命名为 0。
      • 对,它可以工作。它虽然需要依赖 xlrd。 (pip3.7.4.exe在Windows上安装xlrd)
      【解决方案6】:

      将电子表格文件名分配给file

      加载电子表格

      打印工作表名称

      按名称将工作表加载到 DataFrame 中:df1

      file = 'example.xlsx'
      xl = pd.ExcelFile(file)
      print(xl.sheet_names)
      df1 = xl.parse('Sheet1')
      

      【讨论】:

        【解决方案7】:

        如果您在使用函数open() 打开的文件上使用read_excel(),请确保将rb 添加到打开函数以避免编码错误

        【讨论】:

          猜你喜欢
          • 2023-02-09
          • 2021-08-27
          • 1970-01-01
          • 2017-04-26
          • 1970-01-01
          • 2021-09-27
          • 1970-01-01
          • 2021-11-05
          • 1970-01-01
          相关资源
          最近更新 更多