Graviton (processor)

Graviton (processor)
Name	Graviton
Designer	Amazon Web Services
Bits	64-bit
Introduced	26 November 2018
Design	ARM
Version	ARMv8-A
Numcores	Up to 64
Application	Cloud computing
Predecessor	Intel Xeon, AMD EPYC

Graviton (processor). The Graviton is a family of 64-bit ARM-based microprocessors designed by Amazon Web Services (AWS) for its cloud computing infrastructure. First announced in 2018, these processors are custom-built to power Amazon Elastic Compute Cloud (EC2) instances, offering an alternative to traditional x86-64 chips from vendors like Intel and Advanced Micro Devices. The development of Graviton represents a major strategic move by AWS to gain greater control over its hardware supply chain, optimize performance for its specific workloads, and reduce costs for itself and its customers.

Overview

The Graviton processor family is central to AWS's strategy of designing its own silicon for the data center. By leveraging the ARM architecture license, AWS engineers can create custom systems on a chip (SoCs) that are deeply integrated with its cloud platform. These processors are fabricated by partners like TSMC using advanced process nodes and are deployed exclusively within AWS's global network of availability zones. The initiative is part of a broader industry trend seen with other cloud providers, such as Google with its Tensor Processing Unit and Microsoft with its Azure Maia projects, aiming to tailor hardware to specific software and AI workloads.

Design and architecture

Graviton processors are based on the ARMv8-A instruction set architecture and incorporate custom ARM Cortex-A CPU cores designed by AWS's Annapurna Labs team, which Amazon acquired in 2015. The chips feature a multi-core design with a focus on energy efficiency and high throughput for scale-out applications. Key architectural elements include large caches, high-speed interconnects like AMBA protocols, and integrated DDR4 or DDR5 memory controllers. Later generations, such as Graviton3, introduced support for PCI Express and specialized extensions for machine learning tasks, enhancing performance for workloads like web servers, containerized microservices, and in-memory databases like Redis.

Performance and benchmarks

Independent benchmarks and AWS-published data indicate that Graviton processors offer significant price–performance ratio advantages for many cloud workloads compared to equivalent x86-64 instances. In tests running Linux-based applications like NGINX, Apache Hadoop, and Java workloads on platforms such as Ubuntu and Red Hat Enterprise Linux, Graviton2 and Graviton3 instances often show better performance per dollar. Specific performance gains are noted in compute-intensive areas like media encoding and high-performance computing (HPC) simulations, which benefit from the processors' high memory bandwidth and optimized instruction-level parallelism.

Product history and generations

The first-generation Graviton processor, announced at AWS re:Invent 2018, was based on the ARM Cortex-A72 and offered limited core counts. A major leap came with Graviton2 in 2020, built on a 7 nm process from TSMC and featuring up to 64 custom Neoverse N1 cores, which delivered substantial performance improvements. Graviton3 was unveiled in 2021, further enhancing performance and adding capabilities for HPC and ML inference. In 2023, AWS introduced Graviton3E, optimized for floating-point performance, and later the Graviton4, which increased core counts and memory bandwidth. Each generation has been accompanied by new Amazon EC2 instance families, such as the M6g, C7g, and R8g series.

Software and ecosystem support

Wide software ecosystem support has been critical for Graviton's adoption. Major Linux distributions like Amazon Linux, Canonical's Ubuntu, Red Hat's RHEL, and SUSE provide optimized images. Container platforms including Docker and Kubernetes are fully compatible, and programming language runtimes such as Java (JVM), Node.js, Python, and Go have ARM64 ports. Key database and middleware software from Oracle, IBM, and open-source projects like PostgreSQL and MySQL also offer native support, enabling a broad range of enterprise applications to migrate from x86-64 architectures.

Market impact and competition

The Graviton processor has significantly disrupted the data center microprocessor market, historically dominated by Intel and AMD. Its success has pressured these incumbents to offer more competitive products for the cloud and inspired other large technology firms to pursue custom silicon. Competitors include Google Cloud Platform with its Tensor Processing Unit and Ampere Computing, an independent company designing ARM-based server chips. The Graviton project has also strengthened AWS's competitive position against other cloud service providers like Microsoft Azure and Google Cloud, allowing it to offer differentiated, cost-effective infrastructure as a service (IaaS) options that appeal to cost-conscious enterprises and startups.

Category:ARM microarchitectures Category:Amazon Web Services Category:Cloud computing