Repositories list

• webarchive-commons

  Public
  Common web archive utility code.

  Java

  •

  Apache License 2.0

  •7777 forks•6565 stars•1414 issues•66 pull requests•Updated Jul 3, 2026Jul 3, 2026

• jwarc

  Public
  Java library for reading and writing WARC files with a typed API

  Java

  •

  Apache License 2.0

  •1818 forks•6060 stars•1818 issues•22 pull requests•Updated Jun 27, 2026Jun 27, 2026

• warcaroo

  Public
  Java

  •

  Apache License 2.0

  •33 forks•1818 stars•55 issues•00 pull requests•Updated Apr 29, 2026Apr 29, 2026

• awesome-web-archiving

  Public
  An Awesome List for getting started with web archiving

  awesomeawesome-listwebarchiving

  awesomeawesome-listwebarchiving

  Creative Commons Zero v1.0 Universal

  •196196 forks•2.6k2.6k stars•44 issues•77 pull requests•Updated Apr 27, 2026Apr 27, 2026

• WACAD

  Public
  Web Archive Collections as Data Project

  Jupyter Notebook

  •00 forks•11 star•11 issue•00 pull requests•Updated Apr 20, 2026Apr 20, 2026

• warc-specifications

  Public
  Centralised repository for WARC usage specifications.

  HTML

  •3535 forks•128128 stars•4949 issues•22 pull requests•Updated Apr 4, 2026Apr 4, 2026

• robustlinks

  Public
  Links on the web break all the time, robustify them!

  javascripthtmllinks+ 2

  javascripthtmllinkswebarchivesrobust-links

  JavaScript

  •88 forks•6161 stars•22 issues•11 pull request•Updated Mar 5, 2026Mar 5, 2026

• warc2html

  Public
  Converts WARC files to static HTML

  Java

  •

  Apache License 2.0

  •88 forks•5959 stars•55 issues•00 pull requests•Updated Sep 18, 2025Sep 18, 2025

• javaswf

  Public
  Fork of JavaSWF2 for building Heritrix

  Java

  •

  Other

  •11 fork•44 stars•00 issues•00 pull requests•Updated Oct 17, 2024Oct 17, 2024

• openwayback

  Public
  The OpenWayback Development

  Java

  •

  Apache License 2.0

  •312312 forks•521521 stars•100100 issues•55 pull requests•Updated Jan 3, 2024Jan 3, 2024

• openwayback-access-control

  Public
  web access control (exclusion oracle) tools for optional use with wayback machine

  JavaScript

  •

  Apache License 2.0

  •66 forks•99 stars•00 issues•77 pull requests•Updated Jan 2, 2023Jan 2, 2023

• logtrix

  Public
  Java library/tool for parsing and summarising Heritrix crawl logs

  Java

  •

  Apache License 2.0

  •22 forks•77 stars•33 issues•33 pull requests•Updated Nov 16, 2022Nov 16, 2022

• urlcanon

  Public
  url canonicalization library for python and java

  Java

  •77 forks•4343 stars•44 issues•00 pull requests•Updated May 22, 2022May 22, 2022

• heritrix-dependencies

  Public
  Dependencies needed to build Heritrix that aren't in Maven Central

  11 fork•44 stars•00 issues•00 pull requests•Updated Sep 1, 2021Sep 1, 2021

• training

  Public
  Inventory of Web Archiving Training Resources

  11 fork•1010 stars•00 issues•00 pull requests•Updated Oct 24, 2019Oct 24, 2019

• archive-crawler-yg-archive

  Public
  An 'archive' of the Yahoo-hosted archive-crawler group

  22 forks•77 stars•00 issues•00 pull requests•Updated Oct 17, 2019Oct 17, 2019

• qa2019

  Public
  Resources for the 2019 IIPC QA hackathon

  HTML

  •33 forks•66 stars•1414 issues•00 pull requests•Updated May 3, 2019May 3, 2019

• crawl-recipes

  Public
  A place to share practical bits of crawling experiences

  Apache License 2.0

  •11 fork•44 stars•00 issues•00 pull requests•Updated Dec 12, 2018Dec 12, 2018

• iipc.github.io

  Public
  IIPC Open Development

  Apache License 2.0

  •44 forks•1111 stars•00 issues•00 pull requests•Updated Jun 16, 2017Jun 16, 2017

• travis

  Public
  Shared config for Travis CI for IIPC.

  Shell

  •

  Apache License 2.0

  •22 forks•44 stars•00 issues•00 pull requests•Updated May 3, 2017May 3, 2017

• heritrix3

  Public
  Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

  Java

  •789789 forks•1212 stars•00 issues•11 pull request•Updated Mar 9, 2017Mar 9, 2017

• cdx-cli

  Public
  Command line utility for working with CDX files

  Java

  •

  Apache License 2.0

  •44 forks•77 stars•00 issues•00 pull requests•Updated Sep 29, 2016Sep 29, 2016

• iipc-parent

  Public
  IIPC Parent POM

  Apache License 2.0

  •11 fork•44 stars•00 issues•00 pull requests•Updated May 24, 2016May 24, 2016

• twittervane

  Public archive
  Using social media to steer web archiving and curation.

  JavaScript

  •44 forks•1818 stars•11 issue•00 pull requests•Updated Nov 20, 2015Nov 20, 2015

• openwayback-sample-overlay

  Public
  Sample Wayback Config using OpenWayback

  66 forks•66 stars•00 issues•00 pull requests•Updated Feb 7, 2014Feb 7, 2014