python3爬链家utf8页面，中文全部是“南京小区二手房(南京链家网)”

Question

练习爬虫，抓取链家页面信息，链家页面是utf-8，print出来后中文乱码

import requests
from bs4 import BeautifulSoup

url = 'http://nj.lianjia.com/xiaoqu/'
html = requests.get(url)
soup = BeautifulSoup(html.text,'lxml')
title = soup.title.get_text()
print(title)

得到的是“南京小区二手房(南京链家网)”这玩意，请问如何能正常显示中文？

Answer 1

# -*- coding: utf-8 -*-


import requests
from bs4 import BeautifulSoup

url = 'http://nj.lianjia.com/xiaoqu/'
html = requests.get(url)
soup = BeautifulSoup(html.text.encode(html.encoding), 'lxml', from_encoding='utf-8')
title = soup.title.get_text()
print(title)

1) 加 # -- coding: utf-8 --声明
2) 正确的处理返回的response的编码

Answer 2

楼上没错，实际上你也可以用Latin1编码来解码这段文字。

import requests
from bs4 import BeautifulSoup

url = 'http://nj.lianjia.com/xiaoqu/'
html = requests.get(url)
soup = BeautifulSoup(html.text, 'lxml')
title = soup.title.get_text()
print(title.encode('latin1').decode('utf-8'))