Lived for N hours, sorted out 100+Python crawler projects (with source code)

When it comes to crawlers, I believe that the first reaction of most people is Python. Although other programming languages can write crawlers, in people’s impressions, crawlers seem to be bound to Python. This shows the weight of crawlers in Python. .

Recently, Xiao Er made a free Python crawler project library, and has initially included 100+ Python crawler projects.

Included items:

• Douban Reading Crawler
• User crawler at station B
• Worry-Free Reptile
• You are so dirty reptile
• mm131 crawler
• Know the crawler
• Comic Meow Crawler
• Hornet nest crawler
• Public account crawler
• Iqiyi video barrage crawler
• Jingdong crawler
• Chain Home Crawler
• China Knowledge Network Crawler
• Dark cloud crawler
• QQ group crawler
• Sina Weibo Crawler
• Sina Weibo comment crawler
• hao123 website crawler
• Baidu Cloud Disk Crawler
• Crawler proxy IP pool
• Blog garden crawler
• Circle of friends crawler
• Netease client content crawler
• Air Ticket Crawler (Where and Ctrip)
• QQ space crawler
• King of Glory Reptile
• Cat's eye TOP100 crawler
• Stock data (Shanghai and Shenzhen) crawlers
• League of Legends Skin Crawler
• Douyin Video Crawler
• Simple Book Crawler
• Boss hires crawlers directly
• Xianyu's latest commodity crawler
• TikTok recommended list crawler
• QQ music song crawler
• Netease Cloud Music personally loves playlist crawlers
• Kuwo Music Crawler
• Blind date software review area crawler
• Tencent video crawler
• Reptiles in which wave scenic spot
• Super full crawler toolbox
• ZOL mobile wallpaper crawler
• Zcool+CNU crawler
• Chinese Mainland University List Crawler
• Free crawler
• Iqiyi barrage crawler
• Soul Poison Chicken Soup Reptile
• H piece crawler
• Snowball stock crawler
• Youtube subtitle crawler
• Shellnet rental information crawler
• Reptile
• Simulate landing on major websites
• Taobao commodity crawler
• WeChat message to remind girlfriend
• Tmall commodity data crawler
• The baby data crawler that Taobao has bought
• 5K beautiful wallpaper crawler
• Crawling movie data on Douban rankings
• Tiantian Fund Web Crawler
• QQ personal record crawler
• Chrome history crawler
• WeChat Reading Crawler
• Lianjia net and shell net house price crawler
• Taobao, Tmall commodity crawler
• girl13 crawler
• E gentleman crawler
• Github user and warehouse analysis crawler
• Leetcode crawler
• Linkedin crawler
• 1688 crawler
• DHT network magnetic seed crawler
• Crawlers for zoning codes and urban-rural division codes for national statistics
• Instagram crawler
• Toutiao/Netease/Tencent News Crawler
• JK crawler
• Fried Egg Girl Reptile
• Tmall bra crawler
• Sky Eye Check Reptiles
• Enterprise information crawler
• Mafengwo user footprint crawler
• Hearthstone Reptile
• Comic Meow Crawler
• MM131 Picture Crawler
• Baidu xjj image crawler
• Stackoverflow question and answer crawler
• tumblr crawler
• Baidu Tieba Crawler
• Pixabay image website crawler
• pexels image website crawler
• info crawler
• APP crawler
• 12306 smart ticket booking
• 12306 Ticket Purchase Assistant
• Crawling Pippi Shrimp/Embarassment Encyclopedia/Best Sister Reptile
• Official account crawler based on Sogou WeChat
• Dark Web Chinese Web Monitoring Crawler
• Movie paradise crawler
• Web crawler practice collection
• Little Red Book Note Crawler
• Xiaohongshu WeChat applet crawler
• Douyin/Kaishou/Xiaohongshu Short Video Crawler
• WeChat applet crawler
• Pinduoduo crawler
• E-commerce crawler system: Jingdong / Dangdang / Yihaodian / Gome crawler
• Zhihu/V2EX/Weibo/Tieba/IT Home/Douban/Hupu/Tianya/GitHub and other popular headlines multi-threaded crawler
• NBA rookie reptiles for nearly a decade
• PornHub crawler
• A station video information crawler
• Anjuke's number of listings in various places crawler
• Facebook account information crawler
• Google search engine includes incremental crawlers
• Twitter user information crawler
• Starting point Chinese network novel list crawler
• League of Legends daily match list crawler
• Zhilian Recruitment Crawler

Python crawler project warehouse: https://github.com/ityard/python-fxxk-spider

This content is updated for a long time. If it helps, please give a star and support