用Python 采集为什么获取不到数据呢,谢谢?

import re
import requests

headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36',
    'Referer': 'http://cq.jiaoyubao.cn/',
    'Host': 'cq.jiaoyubao.cn',
    'Upgrade-Insecure-Requests': '1',
}

r = requests.get('http://cq.jiaoyubao.cn/cn/xiaoxue/', headers=headers)

print(r.status_code)
print(r.text)

以上运行结果为:

</script></div><script src="http://chat.jiaoyubao.cn/js/mchat.js"></script><script src="http://chat.jiaoyubao.cn/js/online.js?style=1"></script><script type="text/javascript" src="http://static.jiaoyubao.cn/js/share4.js"></script><script src="/bottom/js/bottom.js"></script><script type="text/javascript" src="http://static.jiaoyubao.cn/js/p.js"></script></body></html>

并没有获得有用的内容,代码初步看没什么问题,请问如何解决,谢谢

阅读 2.1k
1 个回答
pip install bs4
pip install lxml
import re
import requests
from bs4 import BeautifulSoup
headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36',
    'Referer': 'http://cq.jiaoyubao.cn/',
    'Host': 'cq.jiaoyubao.cn',
    'Upgrade-Insecure-Requests': '1',
}

r = requests.get('http://cq.jiaoyubao.cn/cn/xiaoxue/', headers=headers)

soup = BeautifulSoup(r.content, 'lxml')
print(soup.prettify())
撰写回答
你尚未登录,登录后可以
  • 和开发者交流问题的细节
  • 关注并接收问题和回答的更新提醒
  • 参与内容的编辑和改进,让解决方法与时俱进
推荐问题