Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Web Archiving
An Awesome List for getting started with web archiving
iipc/awesome-web-archiving
#awesome
#awesome-list
#webarchiving
- List stars
- 2,605
- README repos
- 105
- Indexed repos
- 103
- List commits
- 162
- Forks
- 196
- Open issues
- 11
Tracked list growth
GitHub stars and default-branch commits for iipc/awesome-web-archiving.
Latest scan 2026-07-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-07-15
ArchiveBox/ArchiveBox
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
AI dev
GitHub topics
- Updated
- 2026-07-15
- Lists
- 4 list mentions
- First commit
- 2017-05-05
- License
- MIT
- Issues
- 174 open
27,940
stars
- Forks
- 1,553
- Commits
- 5,730 commits
- Star growth, last 7 days
- +49 +0.2%
- Commit velocity, last 7 days
- +2 0.0%
internetarchive/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
- Updated
- 2026-07-10
- Lists
- 1 list mention
- First commit
- 2009-05-11
- License
- NOASSERTION
- Issues
- 37 open
3,271
stars
- Forks
- 792
- Commits
- 2,985 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
wabarc/wayback
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
Stack
- Updated
- 2026-07-12
- Lists
- 3 list mentions
- First commit
- 2020-06-13
- License
- GPL-3.0
- Issues
- 60 open
2,213
stars
- Forks
- 86
- Commits
- 538 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
jjjake/internetarchive
A Python and Command-Line Interface to Archive.org
AI dev
- Updated
- 2026-07-06
- Lists
- 1 list mention
- First commit
- 2012-08-15
- License
- AGPL-3.0
- Issues
- 101 open
1,882
stars
- Forks
- 249
- Commits
- 2,331 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/pywb
Core Python Web Archiving Toolkit for replay and recording of web archives
Stack
GitHub topics
- Updated
- 2026-04-10
- Lists
- 1 list mention
- First commit
- 2013-12-09
- License
- GPL-3.0
- Issues
- 182 open
1,677
stars
- Forks
- 238
- Commits
- 2,352 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ArchiveTeam/grab-site
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
- Updated
- 2025-05-23
- Lists
- 1 list mention
- First commit
- 2015-02-05
- License
- NOASSERTION
- Issues
- 103 open
1,598
stars
- Forks
- 157
- Commits
- 1,174 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
DocNow/twarc
A command line tool (and Python library) for archiving Twitter JSON
- Updated
- 2025-10-31
- Lists
- 1 list mention
- First commit
- 2013-01-14
- License
- MIT
- Issues
- 48 open
1,393
stars
- Forks
- 254
- Commits
- 1,804 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/browsertrix-crawler
Run a high-fidelity browser-based web archiving crawler in a single Docker container
Stack
GitHub topics
- Updated
- 2026-07-11
- Lists
- 1 list mention
- First commit
- 2020-10-31
- License
- AGPL-3.0
- Issues
- 137 open
1,079
stars
- Forks
- 147
- Commits
- 696 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
WikiTeam/wikiteam
Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2026, WikiTeam has preserved more than 600,000 wikis.
GitHub topics
- Updated
- 2026-01-10
- Lists
- 1 list mention
- First commit
- 2011-04-05
- License
- GPL-3.0
- Issues
- 172 open
853
stars
- Forks
- 175
- Commits
- 1,143 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
internetarchive/brozzler
brozzler - distributed browser-based web crawler
- Updated
- 2026-07-07
- Lists
- 1 list mention
- First commit
- 2014-01-21
- License
- Apache-2.0
- Issues
- 60 open
807
stars
- Forks
- 115
- Commits
- 1,789 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
oduwsdl/ipwb
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
GitHub topics
- Updated
- 2026-06-15
- Lists
- 1 list mention
- First commit
- 2016-03-04
- License
- MIT
- Issues
- 160 open
654
stars
- Forks
- 41
- Commits
- 1,622 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ArchiveTeam/wpull
Wget-compatible web downloader and crawler.
- Updated
- 2024-04-29
- Lists
- 1 list mention
- First commit
- 2013-12-07
- License
- GPL-3.0
- Issues
- 205 open
611
stars
- Forks
- 84
- Commits
- 2,047 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
akamhy/waybackpy
Wayback Machine API interface & a command-line tool
- Updated
- 2024-02-26
- Lists
- 2 list mentions
- First commit
- 2020-05-02
- License
- MIT
- Issues
- 21 open
594
stars
- Forks
- 40
- Commits
- 497 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/warcio
Streaming WARC/ARC library for fast web archive IO
GitHub topics
- Updated
- 2026-06-10
- Lists
- 1 list mention
- First commit
- 2017-03-02
- License
- Apache-2.0
- Issues
- 62 open
459
stars
- Forks
- 70
- Commits
- 161 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
internetarchive/warcprox
WARC writing MITM HTTP/S proxy
- Updated
- 2026-06-17
- Lists
- 1 list mention
- First commit
- 2012-07-18
- License
- Unknown
- Issues
- 28 open
456
stars
- Forks
- 66
- Commits
- 1,116 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
oduwsdl/archivenow
A Tool To Push Web Resources Into Web Archives
GitHub topics
- Updated
- 2024-01-23
- Lists
- 1 list mention
- First commit
- 2017-02-09
- License
- MIT
- Issues
- 17 open
434
stars
- Forks
- 40
- Commits
- 186 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
Florents-Tselai/WarcDB
WarcDB: Web crawl data as SQLite databases.
- Updated
- 2024-07-13
- Lists
- 1 list mention
- First commit
- 2022-05-29
- License
- Apache-2.0
- Issues
- 9 open
406
stars
- Forks
- 10
- Commits
- 73 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
machawk1/wail
:whale2: Web Archiving Integration Layer: One-Click User Instigated Preservation
GitHub topics
- Updated
- 2026-06-19
- Lists
- 1 list mention
- First commit
- 2013-03-20
- License
- MIT
- Issues
- 184 open
398
stars
- Forks
- 38
- Commits
- 871 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
medialab/hyphe
Websites crawler with built-in exploration and control web interface
Stack
- Updated
- 2026-05-18
- Lists
- 1 list mention
- First commit
- 2010-12-22
- License
- AGPL-3.0
- Issues
- 56 open
384
stars
- Forks
- 62
- Commits
- 3,601 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
harvard-lil/scoop
🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.
- Updated
- 2025-09-03
- Lists
- 1 list mention
- First commit
- 2022-09-20
- License
- MIT
- Issues
- 15 open
204
stars
- Forks
- 12
- Commits
- 1,255 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chfoo/warcat
Tool and library for handling Web ARChive (WARC) files.
- Updated
- 2024-10-11
- Lists
- 1 list mention
- First commit
- 2013-04-09
- License
- GPL-3.0
- Issues
- 15 open
165
stars
- Forks
- 20
- Commits
- 78 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chatnoir-eu/chatnoir-resiliparse
A robust web archive analytics toolkit
GitHub topics
- Updated
- 2026-06-16
- Lists
- 1 list mention
- First commit
- 2021-06-04
- License
- Apache-2.0
- Issues
- 0 open
- Forks
- 18
- Commits
- 1,545 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
justinlittman/fbarc
A commandline tool and Python library for archiving data from Facebook using the Graph API.
Archived
GitHub topics
- Updated
- 2018-01-29
- Lists
- 1 list mention
- First commit
- 2017-02-22
- License
- CC0-1.0
- Issues
- 3 open
78
stars
- Forks
- 11
- Commits
- 68 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
turicas/crau
Easy-to-use Web archiver
- Updated
- 2026-04-13
- Lists
- 1 list mention
- First commit
- 2019-10-26
- License
- LGPL-3.0
- Issues
- 11 open
64
stars
- Forks
- 10
- Commits
- 76 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
peterk/warcworker
A dockerized, queued high fidelity web archiver based on Squidwarc
- Updated
- 2024-07-09
- Lists
- 1 list mention
- First commit
- 2018-07-21
- License
- GPL-3.0
- Issues
- 6 open
62
stars
- Forks
- 9
- Commits
- 34 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/har2warc
Convert HTTP Archive (HAR) -> Web Archive (WARC) format
- Updated
- 2018-10-21
- Lists
- 1 list mention
- First commit
- 2017-03-16
- License
- Apache-2.0
- Issues
- 3 open
55
stars
- Forks
- 4
- Commits
- 18 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ikreymer/webarchive-indexing
Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
- Updated
- 2017-12-04
- Lists
- 1 list mention
- First commit
- 2015-02-26
- License
- MIT
- Issues
- 5 open
- Forks
- 12
- Commits
- 47 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
commoncrawl/whirlwind-python
A whirlwind tour of Common Crawl's data using Python
- Updated
- 2026-06-15
- Lists
- 1 list mention
- First commit
- 2024-06-23
- License
- Apache-2.0
- Issues
- 0 open
- Forks
- 9
- Commits
- 41 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
PromyLOPh/crocoite
Web archiving using Google Chrome
Archived
GitHub topics
- Updated
- 2019-12-30
- Lists
- 1 list mention
- First commit
- 2017-11-17
- License
- MIT
- Issues
- 12 open
45
stars
- Forks
- 7
- Commits
- 282 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chfoo/warcat-rs
Command-line tool and Rust library for handling Web ARChive (WARC) files
- Updated
- 2025-06-02
- Lists
- 1 list mention
- First commit
- 2024-09-15
- License
- MPL-2.0
- Issues
- 5 open
32
stars
- Forks
- 3
- Commits
- 81 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
natliblux/warc-safe
A tool for detecting viruses and NSFW material in WARC files
GitHub topics
- Updated
- 2026-06-09
- Lists
- 1 list mention
- First commit
- 2024-05-03
- License
- GPL-3.0
- Issues
- 1 open
18
stars
- Forks
- 1
- Commits
- 33 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
unt-libraries/py-wasapi-client
A client for the Archive-It And Webrecorder WASAPI Data Transfer API
- Updated
- 2019-10-18
- Lists
- 1 list mention
- First commit
- 2017-08-10
- License
- BSD-3-Clause
- Issues
- 0 open
- Forks
- 5
- Commits
- 118 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
emmadickson/unwarcit
No description.
- Updated
- 2022-01-07
- Lists
- 1 list mention
- First commit
- 2021-12-13
- License
- Apache-2.0
- Issues
- 1 open
13
stars
- Forks
- 1
- Commits
- 8 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
oduwsdl/MementoMap
A Tool to Summarize Web Archive Holdings
GitHub topics
- Updated
- 2021-06-15
- Lists
- 1 list mention
- First commit
- 2019-01-20
- License
- MIT
- Issues
- 0 open
12
stars
- Forks
- 1
- Commits
- 63 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ukwa/ukwa-heritrix
The UKWA Heritrix3 custom modules and Docker builder.
Archived
- Updated
- 2024-12-02
- Lists
- 1 list mention
- First commit
- 2013-06-06
- License
- Unknown
- Issues
- 46 open
11
stars
- Forks
- 7
- Commits
- 575 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%