浏览器能访问，PHP访问不了，爬取淘宝店铺商品时遇到的问题

Question

如图，直接用浏览器访问是这样的：

用PHP的 file_get_contents 访问是这样的：

期间我也试过加cookie加header都没用

$url = 'https://xyboutique.taobao.com/i/asynSearch.htm?mid=w-16121401649-0&wid=16121401649&path=/category-1340035582.htm&catId=1340035582&scid=1340035582&pageNo=1';
$res = file_get_contents($url);
print_r($res);

Answer 1

还有可能是判断了referer、session之类的，你可以搜搜对应的文章

Answer 2

做了反爬虫，看返回的那个地址啊，在浏览器中打开就是登录页面
试试 反反爬虫措施吧。用curl。试试提交cookie 等

https://xyboutique.taobao.com/__x5__/query.htm?action=QueryAction&event_submit_do_css=ok&smApp=shopsystem&smPolicy=shopsystem-search_asyn_interface-anti_Spider-checklogin&smCharset=GBK&smTag=NDIuMTk5LjEzMy4xNTQsLGViZGM0OWZhNWNiYTQ0YjFhNmE5OWU1M2JiNDM2YzNi&captcha=https%3A%2F%2Fxyboutique.taobao.com%2F__x5__%2Fquery.htm&smReturn=https%3A%2F%2Fxyboutique.taobao.com%2Fi%2FasynSearch.htm%3Fmid%3Dw-16121401649-0%26wid%3D16121401649%26path%3D%2Fcategory-1340035582.htm%26catId%3D1340035582%26scid%3D1340035582%26pageNo%3D1&smSign=N4JNLabwZHwIUVTEO4PzEw%3D%3D