Meta's multi-billion-dollar Graviton deal (www.tomshardware.com)

Meta has secured a multibillion-dollar, multi-year agreement with Amazon Web Services (AWS) to deploy tens of millions of Graviton5 CPU cores across AWS data centers, marking Meta as one of the largest Graviton customers globally. This partnership focuses on CPU-intensive agentic AI workloads, reflecting a significant shift in AI infrastructure where CPU demand is surging alongside traditional GPU training. AWS's Graviton5, featuring 192 Arm Neoverse V3 cores and offering a 25% performance enhancement over its predecessor, is seen as critical for executing complex agentic AI tasks that require extensive branching and orchestration capabilities. The deal underscores a broader trend of increasing CPU usage in the AI/ML landscape, as the deployment of agentic AI workloads necessitates a leaner CPU-to-GPU ratio—potentially approaching 1:1—as opposed to the current 1:4. This shift is driving a reassessment of supply chains and infrastructure spending, with a heightened emphasis on general-purpose compute capabilities. Meta's aggressive push for diverse CPU resources, in conjunction with its existing multi-billion contracts across various silicon manufacturers, emphasizes the necessity for robust and scalable AI infrastructure to meet the growing demands of advanced AI functionalities.