Archive-It

Archive-It
Name	Archive-It
Founded	2006
Founder	Internet Archive
Headquarters	San Francisco, California
Services	Web archiving, collection curation, preservation
Website	[omitted per instructions]

Archive-It is a subscription web archiving service operated by the Internet Archive that enables libraries, archives, museums, universities, corporations, and community groups to harvest, build, and preserve collections of born-digital cultural heritage. It supports capture of websites, social media, and digital publications for research, accountability, legal deposit, and institutional memory. Users can assemble thematic collections spanning subjects from political campaigns to disaster response and scholarly communication, and provide public access through browsing and full-text search interfaces.

History

Archive-It launched in 2006 as a programmatic expansion of the Internet Archive initiative begun by Brewster Kahle and colleagues in 1996. Early adopters included academic institutions such as the Library of Congress, the British Library, and the New York Public Library, which sought to complement traditional collecting with web-scale capture of periodicals, government sites, and cultural records. Over the 2010s, the service responded to developments in platforms like Twitter, Facebook, and YouTube by integrating new crawling strategies used by organizations including the Smithsonian Institution, the British Columbia Electronic Library Network, and the National Library of the Netherlands. Major events such as the 2010 Haiti earthquake, the 2011 Arab Spring, the 2016 United States presidential election, and the COVID-19 pandemic prompted substantial growth in institutional subscriptions and collection-building, paralleling global initiatives by UNESCO, the Council on Library and Information Resources, and national legal-deposit frameworks.

Mission and Services

Archive-It’s mission centers on enabling institutions to capture and preserve web-based cultural heritage for future research and public access. Subscriber services include scheduled web crawling, on-demand capture, seed list management, metadata assignment, and quality assurance tools used by staff at the Library of Congress, Harvard University, Stanford University Libraries, Yale University, and the University of Oxford. The service also provides access tools that mirror features used in projects led by the British Library, the National Library of Scotland, the Bodleian Libraries, and the Bibliothèque nationale de France. Archive-It’s curation workflows support compliance and stewardship practices promoted by organizations such as the Society of American Archivists, the Digital Preservation Coalition, and the International Council on Archives.

Technology and Infrastructure

Technically, Archive-It builds on crawler technology and storage architectures developed within the Internet Archive ecosystem, leveraging tools and formats like Heritrix, WARC (Web ARChive), and the Wayback Machine playback engine—components familiar to practitioners at the National Archives (UK), the Library and Archives Canada, and the Koninklijke Bibliotheek. Scalable storage and indexing systems enable full-text search and faceted browsing comparable to systems used at the California Digital Library, the Digital Public Library of America, and Europeana. Archive-It integrates with harvesting protocols and standards endorsed by the Open Archives Initiative and collaborates with software projects supported by the Mellon Foundation, the Andrew W. Mellon Foundation, and the Digital Preservation Coalition to align with best practices in digital preservation and persistent identifier strategies used by Crossref and ORCID.

Collections and Content

Collections assembled via Archive-It cover a wide spectrum of topics curated by institutions such as the New York Public Library, the British Library, the Library of Congress, and university libraries including Columbia University, Princeton University, and the University of Michigan. Subject areas include political campaigns archived around events like the 2016 United States presidential election and the 2019 United Kingdom general election; disaster response documentation for Hurricane Katrina and the 2011 Tōhoku earthquake and tsunami; cultural heritage projects with material related to the Venice Biennale and the Metropolitan Museum of Art; and scientific communication linked to NASA, CERN, and the World Health Organization during the COVID-19 pandemic. Collections also reflect social movements documented during Occupy Wall Street, Black Lives Matter, and the Arab Spring, and contain material related to major works and media outlets such as The New York Times, BBC, The Guardian, and The Washington Post.

Partnerships and Collaborations

Archive-It collaborates with cultural heritage institutions including the Library of Congress, the British Library, the Smithsonian Institution, the National Library of Australia, and the Bibliothèque nationale de France. It partners with funders and standards bodies such as the Andrew W. Mellon Foundation, the Wikimedia Foundation, and the International Internet Preservation Consortium to support capacity building, training, and research. Collaborative projects have involved university consortia like the Ivy Plus Libraries Confederation, regional alliances such as the North of England Regional Libraries, and national programs including legal-deposit pilot initiatives with national libraries and state archives.

Access and Use

Subscribers manage and publish collections that are discoverable via full-text search, metadata browsing, and Wayback-style playback used by researchers at institutions including Harvard, Yale, and UC Berkeley. Access policies vary by collecting institution; some collections are open to the public while others are restricted for legal, privacy, or donor-related reasons—policies aligned with guidance from the Society of American Archivists and national archival legislation such as the U.K. Data Protection Act. Researchers use Archive-It content for historical inquiry, computational analysis, digital humanities projects, and journalistic verification, often in conjunction with tools and methods developed in collaborations with the Digital Scholarship Lab at the University of Richmond, the Stanford Digital Repository, and the HathiTrust Research Center.

Impact and Reception

Archive-It is widely regarded by librarians, archivists, and scholars as a central infrastructure for institutional web archiving, influencing practices at the National Archives (UK), the Library and Archives Canada, and the National Library of New Zealand. Evaluations in professional venues and conferences—such as meetings of the International Internet Preservation Consortium, the Society of American Archivists, and the Conference on Digital Preservation—highlight its role in preserving ephemeral web content for accountability, scholarship, and cultural memory. Critics and practitioners alike continue to debate scope, selection policy, privacy, and the technical challenges of capturing dynamic web platforms, prompting ongoing research funded by bodies including the Mellon Foundation and national research councils.

Category:Web archiving