AIMLPM/markcrawl
Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.
2 stars
Python
1 awesome list
Pyx-Corp/spectrawl
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
- Stars
- 24
- Forks
- 6
- Commits
- 53
- Language
- JavaScript
- Awesome lists
- 1
Similar repositories
jina-ai/reader
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
10925 stars
TypeScript
1 awesome list
epiral/bb-browser
Your browser is the API. CLI + MCP server for AI agents to control Chrome with your login state.
5463 stars
TypeScript
1 awesome list
firecrawl/firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
127429 stars
TypeScript
1 awesome list
unclecode/crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
67581 stars
Python
2 awesome lists
Aas-ee/open-webSearch
Multi-engine MCP server, CLI, and local daemon for agent web search and content retrieval — skill-guided workflows, no API keys.
1304 stars
TypeScript
1 awesome list
Tracked growth
4 captures since 2026-05-22
Latest capture 2026-05-30 03:00
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2026-03-09
- First commit: 2026-03-09
- Last pushed: 2026-03-14
- Website: https://www.npmjs.com/package/spectrawl
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
No AI development config files detected.