The Great GPU Shortage: H100 Rental Prices Up 40% (newsletter.semianalysis.com)

The GPU rental market is experiencing a significant surge, with H100 rental prices increasing by 40%, rising from $1.70/hr/GPU to $2.35/hr/GPU in just six months. This sharp uptick is driven by an explosive demand for AI capabilities, particularly due to applications such as Anthropic’s Claude 4.6, which has seen its annual recurring revenue triple in a single quarter from $9 billion to over $30 billion. As organizations scramble for GPU access amid limited availability, the rental capacity for most GPU types is increasingly sold out, creating a competitive landscape reminiscent of high-demand travel markets. This escalation in rental pricing reflects broader trends in the AI and ML community, where the demand for high-performance computing continues to grow in response to advancements in open models and increasing inference workloads. SemiAnalysis is responding to this trend by launching a publicly accessible H100 1-year rental price index, constructed from survey data among over 100 market participants, highlighting the rising costs and rental prices that are impacting future project viability. As AI tools demonstrate substantial returns on investment, the demand for GPUs shows no signs of waning, suggesting that rental prices may continue to rise, further tightening the compute market and driving up associated costs.