Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome
GitHub projects from awesome lists
Search awesome repositories
Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.
- Repos indexed
- 18,423
- Awesome lists tracked
- 132
- Current results
- 21
21 repos shown
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
AI dev
GitHub topics
- Updated
- 2026-09-16
- Lists
- 2 list mentions
- First commit
- 2024-04-15
- History
- 146 history points
- License
- AGPL-3.0
- Issues
- 626 open
180,946
stars
- Forks
- 9,811
- Commits
- 6,303 commits
- Star growth, last 7 days
- +2,482 +1.4%
- Commit velocity, last 7 days
- +21 +0.3%
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
GitHub topics
- Updated
- 2026-08-10
- Lists
- 1 list mention
- First commit
- 2024-10-13
- History
- 60 history points
- License
- BSD-3-Clause
- Issues
- 0 open
73,436
stars
- Forks
- 7,333
- Commits
- 1,583 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
GitHub topics
- Updated
- 2026-09-10
- Lists
- 2 list mentions
- First commit
- 2009-05-04
- History
- 46 history points
- License
- BSD-3-Clause
- Issues
- 393 open
64,304
stars
- Forks
- 11,948
- Commits
- 11,461 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from 3000+ sites
- Updated
- 2026-08-21
- Lists
- 3 list mentions
- First commit
- 2020-01-08
- History
- 5 history points
- License
- MIT
- Issues
- 21 open
36,945
stars
- Forks
- 2,861
- Commits
- 1,526 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
AI dev
- Updated
- 2026-09-07
- Lists
- 1 list mention
- First commit
- 2024-01-27
- History
- 42 history points
- License
- MIT
- Issues
- 16 open
30,982
stars
- Forks
- 3,119
- Commits
- 2,955 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
feder-cr/Jobs_Applier_AI_Agent_AIHawk
Open source AI job application toolkit in Python: generate a resume and cover letter tailored to each job posting, and drive a stealth browser from any AI client over MCP.
- Updated
- 2026-09-01
- Lists
- 2 list mentions
- First commit
- 2024-12-05
- History
- 67 history points
- License
- AGPL-3.0
- Issues
- 22 open
- Forks
- 4,646
- Commits
- 107 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
AI dev
GitHub topics
- Updated
- 2026-09-04
- Lists
- 1 list mention
- First commit
- 2016-08-26
- History
- 1 history point
- License
- Apache-2.0
- Issues
- 146 open
25,646
stars
- Forks
- 1,658
- Commits
- 5,689 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
jo-inc/camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
AI dev
Stack
- Updated
- 2026-09-14
- Lists
- 1 list mention
- First commit
- 2026-02-10
- History
- 69 history points
- License
- MIT
- Issues
- 72 open
11,052
stars
- Forks
- 1,093
- Commits
- 549 commits
- Star growth, last 7 days
- +204 +1.9%
- Commit velocity, last 7 days
- +59 +12.0%
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
AI dev
GitHub topics
- Updated
- 2026-09-10
- Lists
- 2 list mentions
- First commit
- 2024-01-10
- History
- 43 history points
- License
- Apache-2.0
- Issues
- 96 open
9,508
stars
- Forks
- 805
- Commits
- 1,836 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- Updated
- 2026-08-28
- Lists
- 2 list mentions
- First commit
- 2019-04-04
- History
- 10 history points
- License
- Apache-2.0
- Issues
- 64 open
6,786
stars
- Forks
- 428
- Commits
- 1,650 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
jaypyles/Scraperr
Self-hosted webscraper.
Archived
GitHub topics
- Updated
- 2025-10-12
- Lists
- 0 list mentions
- First commit
- 2024-05-18
- History
- 60 history points
- License
- MIT
- Issues
- 4 open
4,913
stars
- Forks
- 245
- Commits
- 243 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
d60/twikit
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
- Updated
- 2026-03-10
- Lists
- 0 list mentions
- First commit
- 2024-12-01
- History
- 43 history points
- License
- MIT
- Issues
- 161 open
4,609
stars
- Forks
- 561
- Commits
- 39 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Stack
GitHub topics
- Updated
- 2026-08-11
- Lists
- 1 list mention
- First commit
- 2025-03-29
- History
- 1 history point
- License
- MIT
- Issues
- 5 open
3,447
stars
- Forks
- 366
- Commits
- 432 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
spider-rs/spider
Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust
AI dev
GitHub topics
- Updated
- 2026-09-05
- Lists
- 1 list mention
- First commit
- 2018-01-07
- History
- 1 history point
- License
- MIT
- Issues
- 0 open
2,706
stars
- Forks
- 295
- Commits
- 2,293 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Stack
- Updated
- 2026-08-12
- Lists
- 1 list mention
- First commit
- 2025-04-15
- History
- 1 history point
- License
- MIT
- Issues
- 35 open
2,631
stars
- Forks
- 326
- Commits
- 342 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
simonw/shot-scraper
A CLI utility for taking screenshots of websites, recording video demos and scraping sites using JavaScript
GitHub topics
- Updated
- 2026-07-12
- Lists
- 1 list mention
- First commit
- 2022-03-08
- History
- 3 history points
- License
- Apache-2.0
- Issues
- 59 open
2,550
stars
- Forks
- 128
- Commits
- 291 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
feder-cr/invisible_playwright
Free antidetect browser stealth for Playwright: undetected headless Firefox fingerprint. Python scraping, recaptcha and bot detection bypass. Open source
- Updated
- 2026-09-02
- Lists
- 2 list mentions
- First commit
- 2026-05-13
- History
- 7 history points
- License
- MIT
- Issues
- 5 open
1,962
stars
- Forks
- 231
- Commits
- 580 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ai-to-ai/Auto-Gmail-Creator
Open Source Bulk Auto Gmail Creator Bot with Selenium & Seleniumwire ( Python ). Feel free to contact me with Django/Flask, ML, AI, GPT, Automation, Scraping.
GitHub topics
- Updated
- 2024-09-26
- Lists
- 1 list mention
- First commit
- 2023-02-20
- History
- 30 history points
- License
- Unknown
- Issues
- 62 open
1,383
stars
- Forks
- 756
- Commits
- 64 commits
- Star growth, last 7 days
- +3 +0.2%
- Commit velocity, last 7 days
- 0 0.0%
neon-mmd/websurfx
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
GitHub topics
- Updated
- 2026-09-01
- Lists
- 1 list mention
- First commit
- 2023-04-22
- History
- 7 history points
- License
- AGPL-3.0
- Issues
- 19 open
1,191
stars
- Forks
- 128
- Commits
- 1,255 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
bellingcat/auto-archiver
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
- Updated
- 2026-09-01
- Lists
- 1 list mention
- First commit
- 2021-01-15
- History
- 7 history points
- License
- MIT
- Issues
- 11 open
1,112
stars
- Forks
- 110
- Commits
- 1,548 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
HasData/hasdata-mcp
HasData MCP server for web scraping and data extraction. 50+ tools including Google Search, Amazon, Zillow, Airbnb, and more.
Stack
GitHub topics
- Updated
- 2026-08-24
- Lists
- 1 list mention
- First commit
- 2026-04-28
- History
- 7 history points
- License
- MIT
- Issues
- 0 open
- Forks
- 0
- Commits
- 24 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
