The Internet Archive

The Internet Archive
Internet Archive · Public domain · source
Name	The Internet Archive
Founded	1996
Founder	Brewster Kahle
Location	San Francisco, California, United States
Area served	Worldwide
Mission	Provide "universal access to all knowledge"
Employees	150–200

The Internet Archive is a digital library founded in 1996 that preserves and provides access to cultural artifacts in digital form. It operates large-scale web, text, audio, video, and software collections and collaborates with libraries, museums, universities, and archives to support research, preservation, and public access. The organization is led by technologists and librarians and interacts with major institutions and legal frameworks to balance preservation with intellectual property rights.

History

The Archive was established by Brewster Kahle following work at Thinking Machines Corporation, NetDay, and with influences from the Library of Congress and the vision of the World Wide Web Consortium. Early efforts paralleled projects at Stanford University, Internet Memory Foundation, and Digital Public Library of America. Rapid growth accelerated after partnerships with Alexa Internet contributed web crawl data, while collaborations with Harvard University, University of California, Berkeley, Smithsonian Institution, and New York Public Library expanded digitization. High-profile initiatives included archiving coverage of the September 11 attacks and partnerships for preservation with Mozilla Foundation, Wikimedia Foundation, and the Internet Engineering Task Force. Over time the Archive has navigated legal disputes similar to cases involving Google Books and policy debates at the United States Copyright Office, while contributing to standards championed by the Open Archives Initiative and International Internet Preservation Consortium.

Mission and Activities

The stated goal echoes principles articulated at UNESCO meetings and aligns with goals promoted by Creative Commons and proponents such as Lawrence Lessig and Aaron Swartz advocates. Core activities include large-scale web archiving inspired by early web mapping by Tim Berners-Lee and data-sharing initiatives akin to work at CERN and MIT Media Lab. The Archive supports scholarship used by researchers at Princeton University, Yale University, Columbia University, Oxford University, and Cambridge University. It provides resources for journalists from outlets like The New York Times, BBC, The Guardian, and historians studying events such as the Iraq War and Arab Spring. The Archive also engages with policy stakeholders including members of the United States Congress, the European Commission, and the Canadian Radio-television and Telecommunications Commission on digital preservation and access issues.

Collections and Services

Collections range across web pages, texts, audio, moving images, and software. Major services include the Wayback Machine (web archiving used by scholars at University of Michigan and practitioners at Mozilla Corporation), a digitized book collection used in projects alongside HathiTrust, and audiovisual archives accessed by producers at PBS and NPR. The Archive hosts software emulations used by preservationists from Internet Archive partners and classics preserved similarly to collections at Smithsonian Folkways and Library of Congress National Recording Registry. It preserves broadcasts relevant to institutions such as C-SPAN, NPR, Al Jazeera, and CNN. The collection supports digital humanities projects at Stanford University's d.school, Duke University's humanities labs, and the Max Planck Institute for the History of Science. Specialized holdings have been contributed by entities including Princeton University Library, Bodleian Libraries, University of Toronto, and Bibliothèque nationale de France.

Technology and Infrastructure

The Archive employs large-scale crawling and storage infrastructure informed by architectures from Apache Hadoop, Apache Cassandra, and techniques used at Google and Amazon Web Services. Its data centers in the San Francisco Bay Area reflect practices also used by Facebook and Netflix for content distribution and redundancy. The organization makes use of metadata standards developed by Dublin Core, protocols from the Open Archives Initiative, and emulation strategies influenced by work at The Library of Congress and Rhizome. Open-source tools and contributions intersect with projects from GitHub, Debian, and Free Software Foundation. Research collaborations have referenced methods from Internet Engineering Task Force publications and storage models compared with LOCKSS and Preservica systems.

Legal Issues and Copyright

The Archive has engaged in litigation and policy debates similar to those involving Google LLC and Hachette Book Group, addressing access to digitized books, orphan works, and takedown procedures governed by statutes like the U.S. Copyright Act and directives such as the European Union Copyright Directive. High-profile legal contests have involved publishers represented by organizations like the Association of American Publishers and advocacy groups such as the Electronic Frontier Foundation have intervened in policy discussions. The Archive’s practices intersect with licensing models promoted by Creative Commons and court precedents from cases in the United States Court of Appeals for the Second Circuit and filings before the Supreme Court of the United States have shaped public discourse. Internationally, the Archive has navigated frameworks involving the World Intellectual Property Organization and national regulations in countries like Germany, Canada, and Australia.

Funding and Organizational Structure

The Archive is funded through a mix of philanthropic donations, grants, and partnerships with institutions including the Andrew W. Mellon Foundation, the John D. and Catherine T. MacArthur Foundation, the Sloan Foundation, and support from patrons such as John Gilmore in early phases. Revenue sources include partnerships with universities like University of California campuses and grants from agencies such as the National Endowment for the Humanities and the Institute of Museum and Library Services. Governance involves a board with members connected to organizations like Internet Society, Wikimedia Foundation, and academic institutions including Massachusetts Institute of Technology and University of Washington. Organizational practices mirror nonprofit models used by Public Knowledge and Electronic Frontier Foundation and collaborate with regional archives such as California State Library and San Francisco Public Library.

Category:Digital libraries