scrapy 运行报错 builtins.OSError: [Errno 22] Invalid argument

Question

运行scrapy时报错了，之前运行还是正常的，请问这个是什么问题呢

2022-03-21 08:49:29 [scrapy.core.engine] INFO: Spider opened
2022-03-21 08:49:30 [scrapy.core.scheduler] INFO: Resuming crawl (5 requests scheduled)
2022-03-21 08:49:30 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2022-03-21 08:49:30 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
Unhandled Error
Traceback (most recent call last):
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\commands\crawl.py", line 27, in run
    self.crawler_process.start()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\crawler.py", line 327, in start
    reactor.run(installSignalHandlers=False)  # blocking call
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\twisted\internet\base.py", line 1318, in run
    self.mainLoop()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\twisted\internet\base.py", line 1328, in mainLoop
    reactorBaseSelf.runUntilCurrent()
--- <exception caught here> ---
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\twisted\internet\base.py", line 994, in runUntilCurrent
    call.func(*call.args, **call.kw)
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\utils\reactor.py", line 50, in __call__
    return self._func(*self._a, **self._kw)
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\core\engine.py", line 124, in _next_request
    if not self._next_request_from_scheduler(spider):
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\core\engine.py", line 153, in _next_request_from_scheduler
    request = slot.scheduler.next_request()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\core\scheduler.py", line 95, in next_request
    request = self._dqpop()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\core\scheduler.py", line 129, in _dqpop
    return self.dqs.pop()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\pqueues.py", line 94, in pop
    m = q.pop()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\squeues.py", line 61, in pop
    request = super().pop()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\scrapy\squeues.py", line 37, in pop
    s = super().pop()
  File "c:\users\zxhy_dba\anaconda3\lib\site-packages\queuelib\queue.py", line 228, in pop
    self.f.seek(-size - self.SIZE_SIZE, os.SEEK_END)
builtins.OSError: [Errno 22] Invalid argument

Answer 1

因为无法复现，建议查看下是否磁盘空间问题。