Data Archiving and Networked Services

Data Archiving and Networked Services
Name	Data Archiving and Networked Services
Focus	Information preservation and distributed access

Contents

Data Archiving and Networked Services Data Archiving and Networked Services describes systems and institutions that preserve, curate, and provide remote access to digital records through interconnected infrastructures. It sits at the intersection of archival science, information technology, and institutional stewardship involving actors such as libraries, museums, national archives, and research consortia. Major archival projects and initiatives often involve collaboration among organizations like the Library of Congress, British Library, National Archives (United Kingdom), National Archives and Records Administration, and international bodies such as the United Nations Educational, Scientific and Cultural Organization and the International Council on Archives.

Overview

Core archival principles derive from standards and best practices promoted by bodies including the International Organization for Standardization, the International Council on Archives, and the Society of American Archivists. Practical workflows often reference provenance models used by the United Nations Archives, appraisal methods developed at institutions like the British Library, and metadata frameworks implemented by projects at the Getty Research Institute and Digital Public Library of America. Preservation strategies draw upon institutional case studies from the National Library of Australia, Library and Archives Canada, State Library of New South Wales, and research programs at Princeton University and Yale University. Collections management integrates conservation methods standardized by the International Institute for Conservation and risk assessment approaches used by the World Bank in heritage projects.

Networked services interlink repositories operated by entities such as the California Digital Library, Duke University Libraries, Columbia University Libraries, University of California, Berkeley, and national systems like Trove and Austrian National Library’s digital platforms. Distributed storage and cloud partnerships involve providers and initiatives linked to Amazon Web Services, Google Cloud Platform, Microsoft Azure, and cooperative infrastructures like CLOCKSS and Portico. Regional networks and research infrastructures—European Research Infrastructure Consortium, EUDAT, SERSCIDA—work with universities including ETH Zurich, KU Leuven, and University of Toronto to enable federated search, replication, and persistent access. Collaborations include museum networks such as the Metropolitan Museum of Art and the Museum of Modern Art.

Interoperability relies on standards promulgated by the World Wide Web Consortium, the Internet Engineering Task Force, and the Open Archives Initiative with formats like MARC 21, Dublin Core, PREMIS, and METS widely implemented across systems used by the British Library, Bibliothèque nationale de France, and the Vatican Library. Persistent identifiers and resolution schemes such as Digital Object Identifier, Handle System, and ORCID enable linkage among datasets produced by researchers at CERN, NASA, European Space Agency, and academic publishers including Elsevier and Springer Nature. Protocols for harvest and exchange—OAI-PMH, SWORD—are used by repositories maintained by institutions like Cornell University and University of Michigan.

Security and integrity frameworks draw on guidance from bodies including the National Institute of Standards and Technology, the European Union Agency for Cybersecurity, and national cybersecurity centers in United Kingdom, Australia, and Canada. Cryptographic sealing, checksums, and fixity services used by archives echo implementations at Los Alamos National Laboratory, Lawrence Berkley National Laboratory, and repositories serving the Human Genome Project and Intergovernmental Panel on Climate Change. Privacy and legal compliance intersect with regulations such as the General Data Protection Regulation and national statutes overseen by courts and legislatures in United States, European Union, and Japan; institutional counsel at universities like University of California and University of Edinburgh manage retention and access constraints.

Access policies integrate licensing and rights management approaches from organizations including Creative Commons, International Federation of Library Associations and Institutions, and legal scholarship from law schools at Harvard, Yale, and Columbia. Discovery layers leverage services provided by WorldCat, Google Scholar, and CrossRef while user interfaces and catalogs are designed by teams at MIT, Stanford, and the Smithsonian Institution. Preservation policies adapt retention schedules and appraisal criteria used by the National Archives (United Kingdom), National Archives and Records Administration, and cultural programs supported by the Andrew W. Mellon Foundation and Wellcome Trust.

Contemporary challenges involve scale and sustainability confronted by projects at Internet Archive and consortiums like LOCKSS and CLOCKSS, while future directions explore machine-assisted curation from research at OpenAI, DeepMind, and labs at Google Research and Microsoft Research. Emerging trends include linked data initiatives influenced by W3C’s work, decentralized storage experiments with technologies originating from IPFS and blockchain research by groups at Ethereum Foundation and Hyperledger, and international policy coordination pursued at forums such as the United Nations, G7, and G20. Cross-disciplinary collaborations span heritage institutions like the Louvre, scientific bodies at European Organization for Nuclear Research, and philanthropic partners such as the Bill & Melinda Gates Foundation.

Category:Information management