如何使用 Linux alpine 3.13 在 Docker 映像上安装 hdf5答案

【问题标题】：How to install hdf5 on Docker image with Linux alpine 3.13如何使用 Linux alpine 3.13 在 Docker 映像上安装 hdf5
【发布时间】：2021-06-16 16:20:59
【问题描述】：

我正在使用 python 3.7.10 (Linux Alpine v3.13) 构建 Docker 映像，但是在使用 docker build . 构建映像时，包 hdf5 将失败在安装过程中。这是我的 Dockerfile：

FROM python:3.7.10-alpine3.13

RUN mkdir /app
WORKDIR /app
COPY requirements.txt /requirements.txt
ENV CRYPTOGRAPHY_DONT_BUILD_RUST=1
RUN apk add --update --no-cache --virtual .tmp gcc libc-dev linux-headers
RUN apk add --no-cache jpeg-dev zlib-dev mariadb-dev libffi-dev openblas-dev libgfortran lapack-dev build-base openssl-dev
RUN apk add --no-cache hdf5 hdf5-dev
RUN pip install -r /requirements.txt
RUN apk --no-cache del build-base

ENV PYTHONUNBUFFERED 1
COPY . /app/

CMD ["uwsgi", "my_app"]

requirements.txt 文件：

h5py==2.10.0
numpy==1.19.2

我尝试过使用和不使用--no-binary 标志，但仍然没有运气。有人能在这个 Alpine 版本上安装那个库吗？

错误日志：

    17858 |   __pyx_t_1 = H5Ovisit_by_name(__pyx_v_loc_id, __pyx_v_obj_name, __pyx_v_idx_type, __pyx_v_order, __pyx_v_op, __pyx_v_op_data, __pyx_v_lapl_id); if (unlikely(PyErr_Occurred())) __PYX_ERR(0, 1641, __pyx_L1_error)
          |               ^~~~~~~~~~~~~~~~
    In file included from /usr/include/H5Apublic.h:22,
                     from /usr/include/hdf5.h:23,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/api_compat.h:27,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c:654:
    /usr/include/H5Opublic.h:213:15: note: declared here
      213 | H5_DLL herr_t H5Ovisit_by_name3(hid_t loc_id, const char *obj_name,
          |               ^~~~~~~~~~~~~~~~~
    /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c: In function '__pyx_f_4h5py_4defs_H5Pget_driver_info':
    /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c:21768:13: warning: assignment discards 'const' qualifier from pointer target type [-Wdiscarded-qualifiers]
    21768 |   __pyx_t_1 = H5Pget_driver_info(__pyx_v_plist_id); if (unlikely(PyErr_Occurred())) __PYX_ERR(0, 2016, __pyx_L1_error)
          |             ^
    In file included from /usr/include/H5public.h:32,
                     from /usr/include/hdf5.h:22,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/api_compat.h:27,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c:654:
    /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c: In function '__pyx_f_4h5py_4defs_H5Sencode':
    /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c:34528:15: error: too few arguments to function 'H5Sencode2'
    34528 |   __pyx_t_1 = H5Sencode(__pyx_v_obj_id, __pyx_v_buf, __pyx_v_nalloc); if (unlikely(PyErr_Occurred())) __PYX_ERR(0, 3303, __pyx_L1_error)
          |               ^~~~~~~~~
    In file included from /usr/include/hdf5.h:38,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/api_compat.h:27,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c:654:
    /usr/include/H5Spublic.h:129:15: note: declared here
      129 | H5_DLL herr_t H5Sencode2(hid_t obj_id, void *buf, size_t *nalloc, hid_t fapl);
          |               ^~~~~~~~~~
    In file included from /usr/local/lib/python3.7/site-packages/numpy/core/include/numpy/ndarrayobject.h:21,
                     from /usr/local/lib/python3.7/site-packages/numpy/core/include/numpy/arrayobject.h:4,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/api_compat.h:26,
                     from /tmp/pip-install-fkianwj6/h5py_dfa9366c1fdb47e98e9e2e8de85ac21e/h5py/defs.c:654:
    At top level:
    /usr/local/lib/python3.7/site-packages/numpy/core/include/numpy/__multiarray_api.h:1464:1: warning: '_import_array' defined but not used [-Wunused-function]
     1464 | _import_array(void)
          | ^~~~~~~~~~~~~
    error: command 'gcc' failed with exit status 1
    ----------------------------------------

【问题讨论】：

在X86 和ARM64 平台上都可以正常安装requirements.txt。看起来是版本兼容性的问题，但没有你的requirements.txt 是无法重现的。
@jordanvrtanoski 我已经更新了问题，添加了requirements.txt
对我来说，使用提供的 requirements.txt 也可以正常工作。镜像构建日志：pastebin.com/CXXFaqN5
向 jordanvrtanoski 和 @valiano 道歉。我复制了错误的设置，我在使用 h5py==2.10.0 时失败了，但现在使用 h5py==3.2.1 可以完美运行。
不用担心@Ander。很高兴你想通了

标签： python-3.x docker python-3.7 hdf5 alpine

【解决方案1】：

似乎我使用了错误的旧 h5py 版本 (h5py==2.10.0)。在 requirements.txt 中更新到 h5py==3.2.1 时，以下设置运行良好。

FROM python:3.7.10-alpine3.13

RUN mkdir /app
WORKDIR /app
COPY requirements.txt /requirements.txt
ENV CRYPTOGRAPHY_DONT_BUILD_RUST=1
RUN apk add --update --no-cache --virtual .tmp gcc libc-dev linux-headers
RUN apk add --no-cache jpeg-dev zlib-dev mariadb-dev libffi-dev openblas-dev libgfortran lapack-dev build-base openssl-dev
RUN apk add --no-cache hdf5-dev
RUN pip install -r /requirements.txt
RUN apk --no-cache del build-base

ENV PYTHONUNBUFFERED 1
COPY . /app/

CMD ["uwsgi", "my_app"]

requirements.txt 文件：

h5py==3.2.1
numpy==1.20.1

感谢@jordanvrtanoski 和@valiano 的反馈。

【讨论】：