Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Web Archiving
An Awesome List for getting started with web archiving
iipc/awesome-web-archiving
#awesome
#awesome-list
#webarchiving
- List stars
- 2,635
- README repos
- 107
- Indexed repos
- 103
- List commits
- 162
- Forks
- 199
- Open issues
- 8
Tracked list growth
GitHub stars and default-branch commits for iipc/awesome-web-archiving.
Latest scan 2026-09-03 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-09-04
ArchiveBox/ArchiveBox
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
AI dev
GitHub topics
- Updated
- 2026-08-02
- Lists
- 4 list mentions
- First commit
- 2017-05-05
- License
- MIT
- Issues
- 169 open
28,068
stars
- Forks
- 1,555
- Commits
- 6,112 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
internetarchive/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
- Updated
- 2026-09-02
- Lists
- 1 list mention
- First commit
- 2009-05-11
- License
- NOASSERTION
- Issues
- 37 open
3,313
stars
- Forks
- 792
- Commits
- 3,022 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
wabarc/wayback
An archiving tool with an IM-style interface that prioritizes privacy and accessibility, integrated with various archival services including Internet Archive, archive.today, Ghostarchive, IPFS, Telegraph, and file systems.
Stack
- Updated
- 2026-07-28
- Lists
- 3 list mentions
- First commit
- 2020-06-13
- License
- GPL-3.0
- Issues
- 60 open
2,221
stars
- Forks
- 86
- Commits
- 538 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
jjjake/internetarchive
A Python and Command-Line Interface to Archive.org
AI dev
- Updated
- 2026-07-24
- Lists
- 1 list mention
- First commit
- 2012-08-15
- License
- AGPL-3.0
- Issues
- 100 open
1,889
stars
- Forks
- 252
- Commits
- 2,337 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
webrecorder/pywb
Core Python Web Archiving Toolkit for replay and recording of web archives
Stack
GitHub topics
- Updated
- 2026-08-26
- Lists
- 1 list mention
- First commit
- 2013-12-09
- License
- GPL-3.0
- Issues
- 183 open
1,698
stars
- Forks
- 239
- Commits
- 2,355 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ArchiveTeam/grab-site
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
- Updated
- 2025-05-23
- Lists
- 1 list mention
- First commit
- 2015-02-05
- License
- NOASSERTION
- Issues
- 103 open
1,602
stars
- Forks
- 157
- Commits
- 1,174 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
DocNow/twarc
A command line tool (and Python library) for archiving Twitter JSON
- Updated
- 2025-10-31
- Lists
- 1 list mention
- First commit
- 2013-01-14
- License
- MIT
- Issues
- 47 open
1,394
stars
- Forks
- 250
- Commits
- 1,804 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/browsertrix-crawler
Run a high-fidelity browser-based web archiving crawler in a single Docker container
Stack
GitHub topics
- Updated
- 2026-08-27
- Lists
- 1 list mention
- First commit
- 2020-10-31
- License
- AGPL-3.0
- Issues
- 144 open
1,127
stars
- Forks
- 151
- Commits
- 752 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
WikiTeam/wikiteam
Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2026, WikiTeam has preserved more than 600,000 wikis.
GitHub topics
- Updated
- 2026-01-10
- Lists
- 1 list mention
- First commit
- 2011-04-05
- License
- GPL-3.0
- Issues
- 172 open
858
stars
- Forks
- 174
- Commits
- 1,143 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
internetarchive/brozzler
brozzler - distributed browser-based web crawler
- Updated
- 2026-07-27
- Lists
- 1 list mention
- First commit
- 2014-01-21
- License
- Apache-2.0
- Issues
- 63 open
812
stars
- Forks
- 114
- Commits
- 1,792 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
oduwsdl/ipwb
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
GitHub topics
- Updated
- 2026-07-24
- Lists
- 1 list mention
- First commit
- 2016-03-04
- License
- MIT
- Issues
- 160 open
654
stars
- Forks
- 40
- Commits
- 1,622 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ArchiveTeam/wpull
Wget-compatible web downloader and crawler.
- Updated
- 2024-04-29
- Lists
- 1 list mention
- First commit
- 2013-12-07
- License
- GPL-3.0
- Issues
- 205 open
613
stars
- Forks
- 84
- Commits
- 2,047 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
akamhy/waybackpy
Wayback Machine API interface & a command-line tool
- Updated
- 2024-02-26
- Lists
- 2 list mentions
- First commit
- 2020-05-02
- License
- MIT
- Issues
- 23 open
604
stars
- Forks
- 42
- Commits
- 497 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/warcio
Streaming WARC/ARC library for fast web archive IO
GitHub topics
- Updated
- 2026-06-10
- Lists
- 1 list mention
- First commit
- 2017-03-02
- License
- Apache-2.0
- Issues
- 64 open
471
stars
- Forks
- 74
- Commits
- 161 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/browsertrix
Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!
GitHub topics
- Updated
- 2026-09-04
- Lists
- 1 list mention
- First commit
- 2021-06-28
- License
- AGPL-3.0
- Issues
- 322 open
468
stars
- Forks
- 77
- Commits
- 2,172 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
internetarchive/warcprox
WARC writing MITM HTTP/S proxy
- Updated
- 2026-06-17
- Lists
- 1 list mention
- First commit
- 2012-07-18
- License
- Unknown
- Issues
- 31 open
464
stars
- Forks
- 66
- Commits
- 1,116 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
oduwsdl/archivenow
A Tool To Push Web Resources Into Web Archives
GitHub topics
- Updated
- 2024-01-23
- Lists
- 1 list mention
- First commit
- 2017-02-09
- License
- MIT
- Issues
- 17 open
434
stars
- Forks
- 40
- Commits
- 186 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
Florents-Tselai/WarcDB
WarcDB: Web crawl data as SQLite databases.
- Updated
- 2024-07-13
- Lists
- 1 list mention
- First commit
- 2022-05-29
- License
- Apache-2.0
- Issues
- 9 open
407
stars
- Forks
- 10
- Commits
- 73 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
machawk1/wail
:whale2: Web Archiving Integration Layer: One-Click User Instigated Preservation
GitHub topics
- Updated
- 2026-06-19
- Lists
- 1 list mention
- First commit
- 2013-03-20
- License
- MIT
- Issues
- 184 open
401
stars
- Forks
- 38
- Commits
- 871 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
medialab/hyphe
Websites crawler with built-in exploration and control web interface
Stack
- Updated
- 2026-05-18
- Lists
- 1 list mention
- First commit
- 2010-12-22
- License
- AGPL-3.0
- Issues
- 56 open
387
stars
- Forks
- 62
- Commits
- 3,601 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
harvard-lil/scoop
🍨 High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web.
- Updated
- 2025-09-03
- Lists
- 1 list mention
- First commit
- 2022-09-20
- License
- MIT
- Issues
- 16 open
210
stars
- Forks
- 12
- Commits
- 1,255 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chfoo/warcat
Tool and library for handling Web ARChive (WARC) files.
- Updated
- 2024-10-11
- Lists
- 1 list mention
- First commit
- 2013-04-09
- License
- GPL-3.0
- Issues
- 15 open
165
stars
- Forks
- 20
- Commits
- 78 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chatnoir-eu/chatnoir-resiliparse
A robust web archive analytics toolkit
GitHub topics
- Updated
- 2026-08-18
- Lists
- 1 list mention
- First commit
- 2021-06-04
- License
- Apache-2.0
- Issues
- 2 open
- Forks
- 21
- Commits
- 1,550 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
justinlittman/fbarc
A commandline tool and Python library for archiving data from Facebook using the Graph API.
Archived
GitHub topics
- Updated
- 2018-01-29
- Lists
- 1 list mention
- First commit
- 2017-02-22
- License
- CC0-1.0
- Issues
- 3 open
78
stars
- Forks
- 11
- Commits
- 68 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
turicas/crau
Easy-to-use Web archiver
- Updated
- 2026-04-13
- Lists
- 1 list mention
- First commit
- 2019-10-26
- License
- LGPL-3.0
- Issues
- 11 open
64
stars
- Forks
- 10
- Commits
- 76 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
peterk/warcworker
A dockerized, queued high fidelity web archiver based on Squidwarc
- Updated
- 2024-07-09
- Lists
- 1 list mention
- First commit
- 2018-07-21
- License
- GPL-3.0
- Issues
- 6 open
62
stars
- Forks
- 9
- Commits
- 34 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
webrecorder/har2warc
Convert HTTP Archive (HAR) -> Web Archive (WARC) format
- Updated
- 2018-10-21
- Lists
- 1 list mention
- First commit
- 2017-03-16
- License
- Apache-2.0
- Issues
- 3 open
55
stars
- Forks
- 5
- Commits
- 18 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
commoncrawl/whirlwind-python
A whirlwind tour of Common Crawl's data using Python
- Updated
- 2026-06-15
- Lists
- 1 list mention
- First commit
- 2024-06-23
- License
- Apache-2.0
- Issues
- 0 open
- Forks
- 9
- Commits
- 41 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ikreymer/webarchive-indexing
Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
- Updated
- 2017-12-04
- Lists
- 1 list mention
- First commit
- 2015-02-26
- License
- MIT
- Issues
- 5 open
- Forks
- 13
- Commits
- 47 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
PromyLOPh/crocoite
Web archiving using Google Chrome
Archived
GitHub topics
- Updated
- 2019-12-30
- Lists
- 1 list mention
- First commit
- 2017-11-17
- License
- MIT
- Issues
- 12 open
45
stars
- Forks
- 7
- Commits
- 282 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chfoo/warcat-rs
Command-line tool and Rust library for handling Web ARChive (WARC) files
- Updated
- 2025-06-02
- Lists
- 1 list mention
- First commit
- 2024-09-15
- License
- MPL-2.0
- Issues
- 5 open
34
stars
- Forks
- 3
- Commits
- 81 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
natliblux/warc-safe
A tool for detecting viruses and NSFW material in WARC files
GitHub topics
- Updated
- 2026-07-15
- Lists
- 1 list mention
- First commit
- 2024-05-03
- License
- GPL-3.0
- Issues
- 1 open
18
stars
- Forks
- 1
- Commits
- 35 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
unt-libraries/py-wasapi-client
A client for the Archive-It And Webrecorder WASAPI Data Transfer API
- Updated
- 2019-10-18
- Lists
- 1 list mention
- First commit
- 2017-08-10
- License
- BSD-3-Clause
- Issues
- 0 open
- Forks
- 6
- Commits
- 118 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
emmadickson/unwarcit
No description.
- Updated
- 2022-01-07
- Lists
- 1 list mention
- First commit
- 2021-12-13
- License
- Apache-2.0
- Issues
- 1 open
13
stars
- Forks
- 1
- Commits
- 8 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
oduwsdl/MementoMap
A Tool to Summarize Web Archive Holdings
GitHub topics
- Updated
- 2021-06-15
- Lists
- 1 list mention
- First commit
- 2019-01-20
- License
- MIT
- Issues
- 0 open
12
stars
- Forks
- 1
- Commits
- 63 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ukwa/ukwa-heritrix
The UKWA Heritrix3 custom modules and Docker builder.
Archived
- Updated
- 2024-12-02
- Lists
- 1 list mention
- First commit
- 2013-06-06
- License
- Unknown
- Issues
- 46 open
11
stars
- Forks
- 7
- Commits
- 575 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%