Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
GitHub projects from awesome lists
Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
Core Python Web Archiving Toolkit for replay and recording of web archives
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
Run a high-fidelity browser-based web archiving crawler in a single Docker container
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
Wayback Machine API interface & a command-line tool
Streaming WARC/ARC library for fast web archive IO
Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!
A Tool To Push Web Resources Into Web Archives
WarcDB: Web crawl data as SQLite databases.
:whale2: Web Archiving Integration Layer: One-Click User Instigated Preservation
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
:whale2: One-Click User Instigated Preservation
Parse And Create Web ARChive (WARC) files with node.js
A Memento Aggregator CLI and Server in Go
Web archive index server based on RocksDB
Converts HTTrack crawls to WARC files
CLI implementation of httpreserve that can test links and retrieve internet archive replacements
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
Partition (W)ARC Files by MIME Type and Year