如何更加智能化获得数据？

发布于
2023-03-13 海南

更新于
2023-03-13

这个网页有a+h的股票数据
https://vip.stock.finance.sina.com.cn/mkt/#hsgs_hgt_ah
通过浏览器的inspect--network可以看到三个get请求，获得服务器端的数据。

GET /rn=pnlvy&list=HKDCNY,sh600036,hk03968,sh601318,hk02318,sh600690,hk06690,sh601888,hk01880,sh601899,hk02899,sh601658,hk01658,sh603259,hk02359,sh688235,hk06160,sh600585,hk00914,sh600660,hk03606,sh601328,hk03328,sh601398,hk01398,sh601288,hk01288,sh601916,hk02016,sh600377,hk00177,sh601988,hk03988,sh600012,hk00995,sh601088,hk01088,sh600028,hk00386,sh601939,hk00939,sh600030,hk06030,sh601601,hk02601,sh601857,hk00857,sh600016,hk01988,sh600548,hk00548,sh601919,hk01919,sh601818,hk06818,sh603993,hk03993,sh601077,hk03618,sh600547,hk01787,sh600332,hk00874,sh600600,hk00168,sh601898,hk01898,sh600029,hk01055,sh601390,hk00390,sh601998,hk00998,sh601600,hk02600,sh601607,hk02607,sh688428,hk09969,sh600188,hk01171,sh601688,hk06886,sh688339,hk02402,sh688187,hk03898,sh601766,hk01766,sh600196,hk02196,sh601298,hk06198,sh601828,hk01528,sh688331,hk09995,sh601111,hk00753,sh600941 HTTP/1.1
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-GB,en-US;q=0.9,en;q=0.8
Connection: keep-alive
Host: hq.sinajs.cn
Referer: https://vip.stock.finance.sina.com.cn/
Sec-Fetch-Dest: script
Sec-Fetch-Mode: no-cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36
sec-ch-ua: "Chromium";v="106", "Google Chrome";v="106", "Not;A=Brand";v="99"
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: "Linux"

我可以写三个get请求，但是如果A+H的公司发生变化，我又要手动改写get请求的list=HKDCNY。。。。。部分。
请问，有无更智能化的方式获得数据呢？

python3 爬虫

阅读 2.3k

2 个回答

得票最新

Suka

333117

发布于
2023-03-17 湖北

更新于
2023-03-17

✓ 已被采纳

先获取这些公司的code，再去获取详细数据信息。

看了一下页面，前端调用的是这个接口，你可以再去分析一下。
https://vip.stock.finance.sina.com.cn/quotes_service/api/json_v2.php/Market_Center.getANHData?page=1&num=80&sort=hrap&asc=0&node=hgt_ah&_s_r_a=init

[{"a":"sh600011","h":"00902"},{"a":"sh600012","h":"00995"},{"a":"sh600016","h":"01988"},{"a":"sh600026","h":"01138"},{"a":"sh600027","h":"01071"},{"a":"sh600028","h":"00386"},{"a":"sh600029","h":"01055"},{"a":"sh600030","h":"06030"},{"a":"sh600036","h":"03968"},{"a":"sh600115","h":"00670"},{"a":"sh600188","h":"01171"},{"a":"sh600196","h":"02196"},{"a":"sh600332","h":"00874"},{"a":"sh600362","h":"00358"},{"a":"sh600377","h":"00177"},{"a":"sh600547","h":"01787"},{"a":"sh600548","h":"00548"},{"a":"sh600585","h":"00914"},{"a":"sh600600","h":"00168"},{"a":"sh600635","h":"01635"},{"a":"sh600660","h":"03606"},{"a":"sh600685","h":"00317"},{"a":"sh600688","h":"00338"},{"a":"sh600690","h":"06690"},{"a":"sh600775","h":"00553"},{"a":"sh600801","h":"06655"},{"a":"sh600808","h":"00323"},{"a":"sh600837","h":"06837"},{"a":"sh600860","h":"00187"},{"a":"sh600871","h":"01033"},{"a":"sh600874","h":"01065"},{"a":"sh600875","h":"01072"},{"a":"sh600876","h":"01108"},{"a":"sh600938","h":"00883"},{"a":"sh600941","h":"00941"},{"a":"sh600956","h":"00956"},{"a":"sh600958","h":"03958"},{"a":"sh600999","h":"06099"},{"a":"sh601005","h":"01053"},{"a":"sh601038","h":"00038"},{"a":"sh601066","h":"06066"},{"a":"sh601068","h":"02068"},{"a":"sh601077","h":"03618"},{"a":"sh601088","h":"01088"},{"a":"sh601107","h":"00107"},{"a":"sh601111","h":"00753"},{"a":"sh601186","h":"01186"},{"a":"sh601211","h":"02611"},{"a":"sh601238","h":"02238"},{"a":"sh601288","h":"01288"},{"a":"sh601298","h":"06198"},{"a":"sh601318","h":"02318"},{"a":"sh601319","h":"01339"},{"a":"sh601326","h":"03369"},{"a":"sh601328","h":"03328"},{"a":"sh601330","h":"01330"},{"a":"sh601333","h":"00525"},{"a":"sh601336","h":"01336"},{"a":"sh601375","h":"01375"},{"a":"sh601390","h":"00390"},{"a":"sh601398","h":"01398"},{"a":"sh601456","h":"01456"},{"a":"sh601588","h":"00588"},{"a":"sh601598","h":"00598"},{"a":"sh601600","h":"02600"},{"a":"sh601601","h":"02601"},{"a":"sh601607","h":"02607"},{"a":"sh601618","h":"01618"},{"a":"sh601628","h":"02628"},{"a":"sh601633","h":"02333"},{"a":"sh601658","h":"01658"},{"a":"sh601688","h":"06886"},{"a":"sh601717","h":"00564"},{"a":"sh601727","h":"02727"},{"a":"sh601728","h":"00728"},{"a":"sh601766","h":"01766"},{"a":"sh601788","h":"06178"},{"a":"sh601800","h":"01800"},{"a":"sh601808","h":"02883"},{"a":"sh601811","h":"00811"},{"a":"sh601818","h":"06818"},{"a":"sh601828","h":"01528"},{"a":"sh601857","h":"00857"},{"a":"sh601865","h":"06865"},{"a":"sh601866","h":"02866"},{"a":"sh601868","h":"03996"},{"a":"sh601869","h":"06869"},{"a":"sh601880","h":"02880"},{"a":"sh601881","h":"06881"},{"a":"sh601888","h":"01880"},{"a":"sh601898","h":"01898"},{"a":"sh601899","h":"02899"},{"a":"sh601916","h":"02016"},{"a":"sh601919","h":"01919"},{"a":"sh601939","h":"00939"},{"a":"sh601963","h":"01963"},{"a":"sh601988","h":"03988"},{"a":"sh601991","h":"00991"},{"a":"sh601992","h":"02009"},{"a":"sh601995","h":"03908"},{"a":"sh601998","h":"00998"},{"a":"sh603127","h":"06127"},{"a":"sh603259","h":"02359"},{"a":"sh603993","h":"03993"},{"a":"sh605198","h":"02218"},{"a":"sh688009","h":"03969"},{"a":"sh688180","h":"01877"},{"a":"sh688185","h":"06185"},{"a":"sh688187","h":"03898"},{"a":"sh688235","h":"06160"},{"a":"sh688236","h":"01858"},{"a":"sh688331","h":"09995"},{"a":"sh688339","h":"02402"},{"a":"sh688366","h":"06826"},{"a":"sh688385","h":"01385"},{"a":"sh688428","h":"09969"},{"a":"sh688505","h":"01349"},{"a":"sh688981","h":"00981"}]