Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome
GitHub projects from awesome lists
Search awesome repositories
Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.
- Repos indexed
- 18,423
- Awesome lists tracked
- 132
- Current results
- 13
13 repos shown
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
AI dev
GitHub topics
- Updated
- 2026-09-16
- Lists
- 2 list mentions
- First commit
- 2024-04-15
- History
- 146 history points
- License
- AGPL-3.0
- Issues
- 626 open
180,946
stars
- Forks
- 9,811
- Commits
- 6,303 commits
- Star growth, last 7 days
- +2,482 +1.4%
- Commit velocity, last 7 days
- +21 +0.3%
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
AI dev
- Updated
- 2026-09-07
- Lists
- 1 list mention
- First commit
- 2024-01-27
- History
- 42 history points
- License
- MIT
- Issues
- 16 open
30,982
stars
- Forks
- 3,119
- Commits
- 2,955 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
AI dev
GitHub topics
- Updated
- 2026-09-04
- Lists
- 1 list mention
- First commit
- 2016-08-26
- History
- 1 history point
- License
- Apache-2.0
- Issues
- 146 open
25,646
stars
- Forks
- 1,658
- Commits
- 5,689 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
AI dev
GitHub topics
- Updated
- 2026-09-10
- Lists
- 2 list mentions
- First commit
- 2024-01-10
- History
- 43 history points
- License
- Apache-2.0
- Issues
- 96 open
9,508
stars
- Forks
- 805
- Commits
- 1,836 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
adithya-s-k/omniparse
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
GitHub topics
- Updated
- 2025-12-12
- Lists
- 1 list mention
- First commit
- 2024-06-04
- History
- 7 history points
- License
- GPL-3.0
- Issues
- 75 open
7,825
stars
- Forks
- 667
- Commits
- 122 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Stack
- Updated
- 2026-09-05
- Lists
- 2 list mentions
- First commit
- 2024-12-06
- History
- 1 history point
- License
- MIT
- Issues
- 129 open
7,399
stars
- Forks
- 873
- Commits
- 465 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
spider-rs/spider
Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust
AI dev
GitHub topics
- Updated
- 2026-09-05
- Lists
- 1 list mention
- First commit
- 2018-01-07
- History
- 1 history point
- License
- MIT
- Issues
- 0 open
2,706
stars
- Forks
- 295
- Commits
- 2,293 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
AI dev
- Updated
- 2026-08-30
- Lists
- 2 list mentions
- First commit
- 2026-03-23
- History
- 10 history points
- License
- AGPL-3.0
- Issues
- 5 open
2,317
stars
- Forks
- 231
- Commits
- 325 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
MarginaliaSearch/MarginaliaSearch
Internet search engine for text-oriented websites. Indexing the small, old and weird web.
GitHub topics
- Updated
- 2026-08-09
- Lists
- 0 list mentions
- First commit
- 2022-05-19
- History
- 43 history points
- License
- NOASSERTION
- Issues
- 37 open
- Forks
- 50
- Commits
- 4,359 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
webrecorder/browsertrix-crawler
Run a high-fidelity browser-based web archiving crawler in a single Docker container
Stack
GitHub topics
- Updated
- 2026-08-27
- Lists
- 1 list mention
- First commit
- 2020-10-31
- History
- 7 history points
- License
- AGPL-3.0
- Issues
- 144 open
1,127
stars
- Forks
- 151
- Commits
- 752 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
postmodern/spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
- Updated
- 2026-01-12
- Lists
- 1 list mention
- First commit
- 2008-05-19
- History
- 5 history points
- License
- MIT
- Issues
- 16 open
835
stars
- Forks
- 106
- Commits
- 898 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
graphlit/graphlit-mcp-server
Model Context Protocol (MCP) Server for Graphlit Platform
Stack
- Updated
- 2026-01-12
- Lists
- 1 list mention
- First commit
- 2025-03-01
- History
- 7 history points
- License
- MIT
- Issues
- 5 open
- Forks
- 52
- Commits
- 261 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
s0rg/crawley
The unix-way web crawler
Stack
- Updated
- 2026-08-21
- Lists
- 2 list mentions
- First commit
- 2021-10-27
- History
- 7 history points
- License
- MIT
- Issues
- 8 open
341
stars
- Forks
- 18
- Commits
- 158 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
