新手请教
当前环境
pip 18.0 from /usr/local/lib/python3.7/site-packages/pip (python 3.7)
spyider文件为github内803版本的,已替换关键词的
pycurl也重装了
网上办法试了个遍最后弹如下错误。。。
有大神知道怎么解决么
报错信息
$ pyspider all
phantomjs fetcher running on port 25555
Traceback (most recent call last):
File "/usr/local/bin/pyspider", line 11, in <module>
sys.exit(main())
File "/usr/local/lib/python3.7/site-packages/pyspider/run.py", line 754, in main
cli()
File "/usr/local/lib/python3.7/site-packages/click/core.py", line 722, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/click/core.py", line 697, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.7/site-packages/click/core.py", line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.7/site-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/click/decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/pyspider/run.py", line 497, in all
ctx.invoke(webui, **webui_config)
File "/usr/local/lib/python3.7/site-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/click/decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/pyspider/run.py", line 333, in webui
app = load_cls(None, None, webui_instance)
File "/usr/local/lib/python3.7/site-packages/pyspider/run.py", line 48, in load_cls
return utils.load_object(value)
File "/usr/local/lib/python3.7/site-packages/pyspider/libs/utils.py", line 369, in load_object
module = __import__(module_name, globals(), locals(), [object_name])
File "/usr/local/lib/python3.7/site-packages/pyspider/webui/__init__.py", line 8, in <module>
from . import app, index, debug, task, result, login
File "/usr/local/lib/python3.7/site-packages/pyspider/webui/app.py", line 95
'fetch': lambda x: tornado_fetcher.Fetcher(None, None, async=False).fetch(x),
^
SyntaxError: invalid syntax
问题已解决,主要报错 'fetch': lambda x: tornado_fetcher.Fetcher(None, None, async=False).fetch(x),
SyntaxError: invalid syntax
对对应文件路径下把所有async修改个其他名字,不能和系统变量名冲突即可运行。[I 181031 08:51:40 result_worker:49] result_worker starting...
[I 181031 08:51:40 processor:211] processor starting...
[I 181031 08:51:40 scheduler:647] scheduler starting...
[I 181031 08:51:40 tornado_fetcher:638] fetcher starting...
[I 181031 08:51:40 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333
[I 181031 08:51:40 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 181031 08:51:40 app:76] webui running on 0.0.0.0:5000
[I 181031 08:52:40 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 181031 08:53:40 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 181031 08:54:40 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 181031 08:55:40 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0
[I 181031 08:56:40 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0