Meta Signs Multibillion-Dollar Deal for Amazon Graviton5 Chips as AI Compute Demand Outstrips $135B Capex Budget
Summary: Meta has signed a significant, multi-year agreement with Amazon Web Services (AWS) to deploy tens of millions of Amazon's Graviton5 ARM CPU cores in AWS data centers for agentic AI workloads. These general-purpose processors handle CPU-intensive tasks like inference and orchestration, crucial for real-time reasoning and complex AI agents. The deal reflects Meta's recognition that its AI compute requirements exceed the capacity of any single supplier.
Meta has partnered with AWS to rent Graviton5 processor cores, not purchasing them outright. This agreement includes tens of millions of cores, with expansion options, over a minimum three-year period. Most of the deployed capacity will be in US data centers.
The Graviton5, unveiled earlier this year, offers a 25% performance boost and improved latency compared to its predecessor while doubling the core count.
Quotable Insights:
"allows us to run the CPU-intensive workloads behind agentic AI with the performance and efficiency we need at our scale." - Santosh Janardhan, Meta’s head of infrastructure
"for price performance" despite having "access to so many options from the supply side." - Nafea Bshara, AWS vice president and distinguished engineer
Key Takeaways:
- Growing AI Demand: Meta's deal highlights the surging demand for AI compute power.
- Multi-Cloud Strategy: Meta is diversifying its infrastructure by leveraging both Amazon Web Services and other suppliers like Nvidia, AMD, CoreWeave, Nebius, and Broadcom.
- Performance and Efficiency: Graviton5 chips deliver significant advancements in performance and latency crucial for demanding AI workloads.