【问题标题】:Scrapy KeyError in Linux Server but not on WindowsLinux 服务器中的 Scrapy KeyError 但在 Windows 上没有
【发布时间】:2017-02-17 03:20:41
【问题描述】:

我的 Scrapy 在我的本地计算机 Windows 上运行良好。然后我尝试在我的 AWS Linux 服务器上运行它,但我得到了这个

Traceback (most recent call last):
  File "run<spider_name>.py", line 12, in <module>
    spider_name).split())
  File "/usr/lib/python2.7/site-packages/scrapy/cmdline.py", line 142, in execute
    _run_print_help(parser, _run_command, cmd, args, opts)
  File "/usr/lib/python2.7/site-packages/scrapy/cmdline.py", line 88, in _run_print_help
    func(*a, **kw)
  File "/usr/lib/python2.7/site-packages/scrapy/cmdline.py", line 149, in _run_command
    cmd.run(args, opts)
  File "/usr/lib/python2.7/site-packages/scrapy/commands/crawl.py", line 57, in run
    self.crawler_process.crawl(spname, **opts.spargs)
  File "/usr/lib/python2.7/site-packages/scrapy/crawler.py", line 162, in crawl
    crawler = self.create_crawler(crawler_or_spidercls)
  File "/usr/lib/python2.7/site-packages/scrapy/crawler.py", line 190, in create_crawler
    return self._create_crawler(crawler_or_spidercls)
  File "/usr/lib/python2.7/site-packages/scrapy/crawler.py", line 194, in _create_crawler
    spidercls = self.spider_loader.load(spidercls)
  File "/usr/lib/python2.7/site-packages/scrapy/spiderloader.py", line 51, in load
    raise KeyError("Spider not found: {}".format(spider_name))
KeyError: 'Spider not found: <spider_name>'

这是为什么呢?如何在我的 Linux 服务器上运行它?

【问题讨论】:

    标签: python linux amazon-web-services scrapy scrapy-spider


    【解决方案1】:

    突然解决了,我自己也糊涂了。

    我通过使用pip install -r requirements.txt 更新所有要求来解决它。我在需求中添加了 Scrapy Splash,但我忘了安装它。

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 1970-01-01
      • 2019-10-07
      • 2019-02-23
      • 2022-01-23
      • 2017-01-13
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多