helgeho/Web2Warc
An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
26 stars
Scala
1 awesome list
ukwa/webarchive-discovery
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
- Stars
- 132
- Forks
- 26
- Commits
- 1615
- Language
- Java
- Awesome lists
- 1
Similar repositories
netarchivesuite/solrwayback
A search interface and wayback machine for the UKWA Solr based warc-indexer framework.
144 stars
Java
1 awesome list
archivesunleashed/warclight
A Rails engine supporting the discovery of web archives.
50 stars
Ruby
1 awesome list
webrecorder/warcio
Streaming WARC/ARC library for fast web archive IO
458 stars
Python
1 awesome list
Florents-Tselai/WarcDB
WarcDB: Web crawl data as SQLite databases.
405 stars
Python
1 awesome list
internetarchive/warctools
Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)
174 stars
Python
1 awesome list
Tracked growth
2 captures since 2026-05-23
Latest capture 2026-05-31 03:02
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2012-12-20
- First commit: 2011-10-26
- Last pushed: 2025-11-21
- Website: https://github.com/ukwa/webarchive-discovery/wiki
- Archived: no
- Stack detected: —
- License: —
AI development signals
No AI development config files detected.