A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Interact with REST services in an ActiveRecord-like manner
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
Log and Analyze Outgoing HTTP Requests
The unix-way web crawler
Self-hosted webscraper.
1 capture since 2026-06-09
Gemfile
· ruby · 12 dependencies
spidr.gemspec
· ruby · 0 dependencies