AIMLPM/markcrawl
Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
Appears on
Quick read
Latest capture 2026-08-24 03:07
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
9 observed captures since 2026-05-22. Observed captures are shown by default.
Stars from first capture +4
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
The context API to search, scrape, and interact with the web at scale. 🔥
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
MCP server with multi-tier fallback chain for fetching web content as clean markdown
Your browser is the API. CLI + MCP server for AI agents to control Chrome with your login state.