Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome
GitHub projects from awesome lists
Search awesome repositories
Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.
- Repos indexed
- 17,489
- Awesome lists tracked
- 126
- Current results
- 17
17 repos shown
firecrawl/firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
AI dev
Stack
GitHub topics
- Updated
- 2026-07-26
- Lists
- 1 list mention
- First commit
- 2024-04-15
- History
- 89 history points
- License
- AGPL-3.0
- Issues
- 445 open
156,541
stars
- Forks
- 8,900
- Commits
- 5,988 commits
- Star growth, last 7 days
- +2,910 +1.9%
- Commit velocity, last 7 days
- +21 +0.4%
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
GitHub topics
- Updated
- 2026-07-26
- Lists
- 1 list mention
- First commit
- 2024-10-13
- History
- 52 history points
- License
- BSD-3-Clause
- Issues
- 0 open
71,362
stars
- Forks
- 7,081
- Commits
- 1,555 commits
- Star growth, last 7 days
- +974 +1.4%
- Commit velocity, last 7 days
- +22 +1.4%
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
GitHub topics
- Updated
- 2026-07-25
- Lists
- 2 list mentions
- First commit
- 2009-05-04
- History
- 38 history points
- License
- BSD-3-Clause
- Issues
- 584 open
63,424
stars
- Forks
- 11,817
- Commits
- 11,231 commits
- Star growth, last 7 days
- +161 +0.3%
- Commit velocity, last 7 days
- +23 +0.2%
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from 3000+ sites
- Updated
- 2026-07-24
- Lists
- 3 list mentions
- First commit
- 2020-01-08
- History
- 4 history points
- License
- MIT
- Issues
- 16 open
35,733
stars
- Forks
- 2,735
- Commits
- 1,467 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
feder-cr/Jobs_Applier_AI_Agent_AIHawk
AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.
Archived
GitHub topics
- Updated
- 2026-05-17
- Lists
- 2 list mentions
- First commit
- 2024-12-05
- History
- 41 history points
- License
- AGPL-3.0
- Issues
- 26 open
- Forks
- 4,601
- Commits
- 63 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
- Updated
- 2026-07-20
- Lists
- 0 list mentions
- First commit
- 2024-01-27
- History
- 34 history points
- License
- MIT
- Issues
- 7 open
28,649
stars
- Forks
- 2,791
- Commits
- 2,891 commits
- Star growth, last 7 days
- +132 +0.5%
- Commit velocity, last 7 days
- 0 0.0%
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
AI dev
GitHub topics
- Updated
- 2026-07-27
- Lists
- 1 list mention
- First commit
- 2024-01-10
- History
- 35 history points
- License
- Apache-2.0
- Issues
- 80 open
9,368
stars
- Forks
- 780
- Commits
- 1,719 commits
- Star growth, last 7 days
- +23 +0.2%
- Commit velocity, last 7 days
- +7 +0.4%
jo-inc/camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
AI dev
Stack
- Updated
- 2026-07-20
- Lists
- 1 list mention
- First commit
- 2026-02-10
- History
- 19 history points
- License
- MIT
- Issues
- 59 open
8,096
stars
- Forks
- 849
- Commits
- 427 commits
- Star growth, last 7 days
- +223 +2.8%
- Commit velocity, last 7 days
- 0 0.0%
adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- Updated
- 2026-07-09
- Lists
- 1 list mention
- First commit
- 2019-04-04
- History
- 8 history points
- License
- Apache-2.0
- Issues
- 73 open
6,290
stars
- Forks
- 395
- Commits
- 1,628 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
jaypyles/Scraperr
Self-hosted webscraper.
Archived
Stack
GitHub topics
- Updated
- 2025-10-12
- Lists
- 0 list mentions
- First commit
- 2024-05-18
- History
- 52 history points
- License
- MIT
- Issues
- 4 open
4,907
stars
- Forks
- 243
- Commits
- 243 commits
- Star growth, last 7 days
- +7 +0.1%
- Commit velocity, last 7 days
- 0 0.0%
d60/twikit
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
- Updated
- 2026-03-10
- Lists
- 0 list mentions
- First commit
- 2024-12-01
- History
- 35 history points
- License
- MIT
- Issues
- 161 open
4,587
stars
- Forks
- 558
- Commits
- 39 commits
- Star growth, last 7 days
- +19 +0.4%
- Commit velocity, last 7 days
- 0 0.0%
simonw/shot-scraper
A CLI utility for taking screenshots of websites, recording video demos and scraping sites using JavaScript
GitHub topics
- Updated
- 2026-07-12
- Lists
- 1 list mention
- First commit
- 2022-03-08
- History
- 2 history points
- License
- Apache-2.0
- Issues
- 56 open
2,528
stars
- Forks
- 125
- Commits
- 291 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
feder-cr/invisible_playwright
Anti-Detect Browser that passes every bot detection test. Drop-in Playwright replacement.
- Updated
- 2026-07-06
- Lists
- 2 list mentions
- First commit
- 2026-05-13
- History
- 5 history points
- License
- MIT
- Issues
- 3 open
1,731
stars
- Forks
- 186
- Commits
- 199 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ai-to-ai/Auto-Gmail-Creator
Open Source Bulk Auto Gmail Creator Bot with Selenium & Seleniumwire ( Python ). Feel free to contact me with Django/Flask, ML, AI, GPT, Automation, Scraping.
GitHub topics
- Updated
- 2024-09-26
- Lists
- 1 list mention
- First commit
- 2023-02-20
- History
- 12 history points
- License
- Unknown
- Issues
- 62 open
1,312
stars
- Forks
- 737
- Commits
- 64 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
neon-mmd/websurfx
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
GitHub topics
- Updated
- 2026-07-01
- Lists
- 1 list mention
- First commit
- 2023-04-22
- History
- 5 history points
- License
- AGPL-3.0
- Issues
- 17 open
1,154
stars
- Forks
- 127
- Commits
- 1,255 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
bellingcat/auto-archiver
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
- Updated
- 2026-07-10
- Lists
- 1 list mention
- First commit
- 2021-01-15
- History
- 5 history points
- License
- MIT
- Issues
- 16 open
1,095
stars
- Forks
- 107
- Commits
- 1,546 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
HasData/hasdata-mcp
HasData MCP server for web scraping and data extraction. 40+ tools including Google Search, Amazon, Zillow, Airbnb, and more.
Stack
GitHub topics
- Updated
- 2026-05-05
- Lists
- 1 list mention
- First commit
- 2026-04-28
- History
- 6 history points
- License
- MIT
- Issues
- 1 open
- Forks
- 0
- Commits
- 22 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
