尝试发送 PUT 请求时出现 ConnectionResetError答案

【问题标题】：ConnectionResetError when trying to send PUT request尝试发送 PUT 请求时出现 ConnectionResetError
【发布时间】：2017-11-20 13:08:52
【问题描述】：

我正在尝试使用 PUT REST Api 上传文件，但我收到了 ConnectionResetError。我尝试过将urllib.request.Request() 与urllib.request.urlopen() 以及requests.put() 一起使用。

当我使用 cURL 时它可以正常工作：

$ curl -X PUT http://localhost:5000/root.bar/test/1.0/jre -H 'Content-Type: application/java-archive' -H 'Content-Name: bfg-1.12.16.jar' -H 'Authorization: Basic cm9vdDphbHBpbmU=' -d @C:/Users/niklas/Desktop/bfg-1.12.16.jar

代码的重要部分：

headers = {'Content-Type': args.mime, 'Content-Name': args.name}
if args.auth:
  headers['Authorization'] = build_basicauth(username, password)
url = args.apiurl.rstrip('/') + '/{}/{}/{}/{}'.format(*parts)
if not urllib.parse.urlparse(url).scheme:
  url = 'https://' + url

if args.test:
  command = ['curl', '-X', 'PUT', url]
  for key, value in headers.items():
    command += ['-H', '{}: {}'.format(key, value)]
  command += ['-d', '@' + args.file.name]
  print('$', ' '.join(map(shlex.quote, command)))
  return 0

response = requests.put(url, data=args.file, headers=headers)
print(response)

我错过了 cURL 正在做什么？

（PS：我也尝试通过传递data=args.file.read() 来发送bytes 而不是使用requests.put() 的类文件对象）

完整的追溯：

$ python -m fatartifacts.web.cli http://localhost:5000 root.bar:test:1.0:jre ~/Desktop/bfg-1.12.16.jar  -m application/java-archive -u root:alpine
Traceback (most recent call last):
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\urllib3\connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\urllib3\connectionpool.py", line 357, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1065, in _send_output
    self.send(chunk)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 986, in send
    self.sock.sendall(data)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\requests\adapters.py", line 440, in send
    timeout=timeout
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\urllib3\connectionpool.py", line 639, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\urllib3\util\retry.py", line 357, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\urllib3\packages\six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\urllib3\connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\urllib3\connectionpool.py", line 357, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 1065, in _send_output
    self.send(chunk)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\http\client.py", line 986, in send
    self.sock.sendall(data)
urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "c:\users\niklas\appdata\local\programs\python\python36\Lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "C:\Users\niklas\repos\fatartifacts\fatartifacts\web\cli.py", line 106, in <module>
    main_and_exit()
  File "C:\Users\niklas\repos\fatartifacts\fatartifacts\web\cli.py", line 102, in main_and_exit
    sys.exit(main())
  File "C:\Users\niklas\repos\fatartifacts\fatartifacts\web\cli.py", line 97, in main
    response = requests.put(url, data=args.file, headers=headers)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\requests\api.py", line 126, in put
    return request('put', url, data=data, **kwargs)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\requests\api.py", line 58, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\requests\sessions.py", line 508, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\requests\sessions.py", line 618, in send
    r = adapter.send(request, **kwargs)
  File "C:\Users\niklas\.virtualenvs\fatartifacts-LoWBpE4v\lib\site-packages\requests\adapters.py", line 490, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))

REST API 通过flask 和flask-restful 实现。这个异常似乎发生在

使用 Python 发出请求（urllib.request，requests）
API 使用 flask.abort() 返回非 200 状态代码

【问题讨论】：

如果您使用print(url)，URL 究竟会是什么样子？
@Torxed 正是您在 CURL 请求中看到的内容（因为它是使用您在上面看到的代码生成的）。如果您选择找出它是bytes 还是str 对象，那么我可以告诉您它是str。 :)
这很奇怪 Niklas，考虑到 CURL 请求中的输出是 HTTPS，并且代码显示为 http://。您还调用了shlex.quote，这可能会为您带来魔力，使 CURL 能够工作，但请求中的套接字不能。这就是为什么我问您是否可以在请求声明之前进行打印。
@Torxed 你在哪里看到 HTTPS？问题中的 CURL 命令包含一个 HTTP URL，python -m fatartifacts.web.cli 调用也是如此。 print(url) 在请求给出http://localhost:5000/root.bar/test/1.0/jre 之前。 -- https:// 仅在 URL 还没有方案时添加。
@Torxed 解决了问题，请参阅答案。感谢您的帮助

标签： python curl python-requests urllib

【解决方案1】：

问题在于 Flask REST API 没有使用随请求发送的所有内容。在读取flask.request.stream 之前，Flask 应用程序调用了abort(403)。

由于无论如何我不想在请求被拒绝时读取所有数据，我发现调用request.environ['wsgi.input'].close() 会关闭流而不先读取它的内容，这避免了客户端上的ConnectionResetError -一边。

def close_input_stream(func):
  @functools.wraps(func)
  def wrapper(*a, **kw):
    try:
      return func(*a, **kw)
    finally:
      fp = request.environ.get('wsgi.input')
      if fp:
        fp.close()
  return wrapper

【讨论】：