Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
An Awesome List for getting started with web archiving
GitHub stars and default-branch commits for iipc/awesome-web-archiving.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Extract web archive data using Wayback Machine and Common Crawl
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
A robust web archive analytics toolkit
Parse And Create Web ARChive (WARC) files with node.js
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz
Parse CDXJ(https://github.com/oduwsdl/ORS/wiki/CDXJ) files with node.js
Partition (W)ARC Files by MIME Type and Year