unclecode/crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
67581 stars
Python
2 awesome lists
AIMLPM/markcrawl
Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.
- Stars
- 2
- Forks
- 0
- Commits
- 234
- Language
- Python
- Awesome lists
- 1
Similar repositories
firecrawl/firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
127429 stars
TypeScript
1 awesome list
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
1261 stars
Rust
2 awesome lists
Pyx-Corp/spectrawl
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
24 stars
JavaScript
1 awesome list
study8677/antigravity-workspace-template
Give Claude Code, Cursor, Codex CLI a ChatGPT for your codebase. Multi-agent knowledge engine, grounded Q&A with file paths and line numbers. Works in any AI IDE.
1246 stars
Python
2 awesome lists
LearningCircuit/local-deep-research
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
8254 stars
Python
1 awesome list
Tracked growth
4 captures since 2026-05-22
Latest capture 2026-05-27 03:01
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2025-09-07
- First commit: —
- Last pushed: 2026-05-17
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
AI agent config detected
1 config path
1 file
0 directories
Claude Code
Key config paths
-
file
CLAUDE.md