InterPlanetary File System

InterPlanetary File System. It is a protocol and peer-to-peer network for storing and sharing data in a distributed file system. By using content-addressing to uniquely identify each file in a global namespace connecting all computing devices, it aims to create a permanent and decentralized method of storing and sharing hypermedia. The system was originally designed by Juan Benet and is now developed by the open-source community and his company, Protocol Labs.

Overview

The fundamental goal is to supplement or replace the location-based Hypertext Transfer Protocol that underpins the traditional World Wide Web. Instead of relying on specific server addresses, it uses a cryptographic hash of the content itself to form an address, a concept known as content-addressable storage. This approach allows for data to be stored across a network of participating nodes, making it resistant to censorship and single points of failure. The vision is to create a more resilient, efficient, and open internet infrastructure, often discussed in the context of Web3 and the decentralized web. Early support and development have been influenced by organizations like the Electronic Frontier Foundation and grants from entities such as the Filecoin Foundation.

Technical design

At its core, it utilizes a distributed hash table to coordinate and locate content across the peer-to-peer network. Files are broken into smaller blocks, each identified by a unique hash, and structured into a Merkle tree format known as a Merkle DAG. This structure ensures data integrity and enables efficient versioning and deduplication. The network uses the libp2p framework for modular peer-to-peer networking and the Multiformats project for self-describing data formats. For naming and human-readable links, it employs the InterPlanetary Name System, a decentralized naming system. Data persistence and incentivization are often handled by separate layers, most notably the Filecoin blockchain network.

Applications and use cases

It is used as a foundational layer for decentralized applications and services across the blockchain ecosystem. Major platforms like the Ethereum blockchain and Polygon use it for storing non-fungible token metadata and assets, ensuring permanence beyond the life of any single website. It serves as the storage backbone for the Decentraland virtual world and the Audius music streaming service. Within the scientific community, projects like the arXiv preprint repository and institutions like CERN have explored its use for distributing large datasets. It is also instrumental in archiving digital information, with initiatives from the Internet Archive and the Wikimedia Foundation.

Governance and development

Primary stewardship and core protocol development are led by Protocol Labs, founded by Juan Benet. Development is open-source, with contributions from a global community of developers coordinated through platforms like GitHub. Significant funding for research and ecosystem growth has come from venture capital firms such as Andreessen Horowitz and Union Square Ventures, as well as through the Filecoin initial coin offering. Broader governance discussions and standards development often occur within the context of the Decentralized Identity Foundation and other Internet Engineering Task Force-like working groups focused on decentralized web protocols.

Comparison with other systems

Unlike traditional web protocols like HTTP which rely on the location of a server, it is based on the identity of the content, similar to earlier peer-to-peer systems like BitTorrent but with a unified global namespace. Compared to blockchain storage solutions like Arweave, which focuses on permanent, on-chain data, it is a more generalized protocol that can be paired with various incentive layers. It differs from centralized cloud storage providers such as Amazon S3 or Google Cloud Storage by being inherently decentralized and not controlled by a single corporate entity. Its approach to content addressing also contrasts with the domain-based system of the Domain Name System, though projects like Cloudflare have built gateways to bridge the two architectures.