EMC Atmos

EMC Atmos
Name	EMC Atmos
Developer	EMC Corporation
Initial release	2008
Latest release	2015 (Atmos 3.0)
Operating system	Proprietary appliance/virtualized
Website	(discontinued)

EMC Atmos is a distributed object storage platform developed by EMC Corporation for large-scale cloud and archive storage. It was designed to provide multi-tenancy, geo-replication, and a RESTful API surface to support service providers, enterprises, and research institutions. Atmos influenced subsequent object storage systems and was positioned alongside technologies from companies such as Amazon Web Services, Google, Microsoft Azure and competitors like OpenStack projects.

Overview

Atmos was introduced to address the growth of unstructured data driven by deployments at Yahoo!, University of California}}, Government of the United Kingdom initiatives, and commercial cloud providers. The product targeted workloads from digital media in Hollywood studios to scientific archives at NASA centers and financial services in New York City data centers. It combined software and appliance form factors and was often compared with offerings from NetApp, HPE, Dell EMC divisions, and object systems in open-source communities such as Ceph and Swift.

Architecture and Components

The Atmos architecture is based on a distributed grid of nodes providing metadata services, data services, and a global namespace. Core components included Atmos Data Services, Atmos Metadata Services, and client protocol gateways supporting the Atmos API, as well as protocols like Amazon S3-compatible endpoints. Nodes were deployed in clusters across data centers in locations such as Silicon Valley, London, and Singapore to enable geographic dispersion and durability. The design employed concepts similar to distributed systems research from Google File System and the Dynamo (Amazon) paper, integrating erasure coding, replication strategies, and consistent hashing techniques.

Deployment and Management

Atmos could be deployed as purpose-built appliances, virtual appliances on platforms like VMware ESXi, or as software running on commodity servers in data center facilities operated by companies such as Verizon or BT Group. Management tools included a web-based GUI, CLI utilities, and integrations with enterprise toolchains from VMware, Microsoft System Center, and backup vendors like Commvault. Administrators performed provisioning, tenant isolation, and replication policies using role-based access aligned with directory services such as Active Directory and identity solutions from Okta in large organizations. For service providers, Atmos was integrated into billing and OSS/BSS systems used by carriers like AT&T and Deutsche Telekom.

Features and Capabilities

Atmos provided multi-tenancy, a RESTful object API, S3 compatibility, and policy-based data placement for regulatory requirements in jurisdictions including European Union member states. It supported object versioning, retention policies aligned with legal frameworks such as Sarbanes–Oxley Act and data residency controls relevant to General Data Protection Regulation (GDPR) discussions. Other capabilities included large-object support for media workflows in Walt Disney Studios and content distribution integrations with CDNs operated by Akamai Technologies. Atmos also offered lifecycle management used by archives at institutions like the Library of Congress and research repositories maintained by CERN.

Use Cases and Applications

Typical use cases encompassed cloud storage services offered by hosting companies, backup and archival for enterprises in Financial Industry Regulatory Authority-regulated sectors, and content repositories for broadcasters such as BBC. Scientific projects, including space missions from European Space Agency and instrument archives at National Oceanic and Atmospheric Administration, leveraged Atmos for long-term retention. Media production workflows in studios and post-production houses interfaced Atmos with asset management systems from vendors like Avid Technology and Adobe Systems.

Performance and Scalability

Atmos was engineered to scale to billions of objects and petabyte-class capacities across federated clusters. Performance characteristics were determined by network topology, disk subsystems from manufacturers like Seagate and Western Digital, and caching strategies influenced by research from MIT and Stanford University labs. Benchmarks published by third parties compared Atmos throughput and latency against offerings from EMC Isilon, NetApp, and cloud services such as Amazon S3, showing strengths in metadata-heavy workloads and predictable multi-site replication patterns. Scalability features included adding nodes without downtime and balancing data using consistent hashing and rebalancing algorithms akin to those described by Amazon DynamoDB research.

Security and Compliance

Security features in Atmos encompassed TLS for in-transit encryption, server-side and client-side encryption options leveraging key management integrations with vendors like Thales Group and Gemalto, and audit logging compatible with compliance regimes such as Payment Card Industry Data Security Standard. Role-based access control integrated with Active Directory and LDAP directories enabled enterprise policy enforcement. Atmos supported immutable retention and write-once-read-many (WORM) modes to satisfy regulatory holds in sectors overseen by agencies like the Securities and Exchange Commission.

Category:Object storage systems