Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
An Awesome List for getting started with web archiving
GitHub stars and default-branch commits for iipc/awesome-web-archiving.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
Web application for distributed compute analysis of Archive-It web archive collections.
Internet Archive's Sparkling Data Processing Library
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.