lorien/awesome-web-scraping
lorien/awesome-web-scraping has 8,213 GitHub stars and 971 forks. Star changes are not measured yet. Last checked 2026-11-07 02:01 UTC. Last push 2026-11-04.
List of libraries, tools and APIs for web scraping and data processing.
Measured star growth
- in 24h
- Update delayed
- in 7 days
- Collecting history
- in 15 days
- Collecting history
- in 1 month
- Collecting history
Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.
README.md
OriginalAwesome Web Scraping
List of packages, services, and manuals related to web scraping.
Topics
- Python - Python packages
- PHP - PHP packages
- Ruby - Ruby packages
- JavaScript - JavaScript packages
- Go - Go packages
- Command Line Tools - tools with a command line interface
- Web-Scraping Manuals - list of articles and books teaching web scraping
- dhamaniasad / HeadlessBrowsers - list of (almost) all headless web browsers in existence
- DNS over HTTPS providers - list of DNS over HTTPS providers
- Awesome Pastebins - list of pastebin sites
- Awesome Tunneling - List of tunneling software and services. Focus on self-hosting.
Captcha Solving Services
Proxy Server Marketplaces
Telegram Discussion Groups
- @grablab_ru - web-scraping talks in Russian
How to Contribute to This List
Please see the CONTRIBUTING.md document.
Credits
The list is initially based on partial data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript
Explore related projects
freeCodeCamp/freeCodeCamp
freeCodeCamp.org's open-source codebase and curriculum. Learn math, programming, and computer science for free.
458,694 starsdonnemartin/system-design-primer
Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
377,190 starsreact/react
The library for web and native user interfaces.
252,345 starsvuejs/vue
This is the repo for Vue 2. For Vue 3, go to https://github.com/vuejs/core
212,627 stars