propublica/upton
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Appears on
Quick read
Latest capture 2026-08-24 03:02
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
5 observed captures since 2026-06-09. Observed captures are shown by default.
Stars from first capture -1
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Turn any webpage into structured data using LLMs
A Rails engine supporting the discovery of web archives.
Wget-compatible web downloader and crawler.
Self-hosted webscraper.
Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head