Nvidia's latest trick for cooling its data center hardware is... hot water (www.techradar.com)

Nvidia has unveiled its Rubin-generation AI servers, which utilize a novel hot water cooling system operating with coolant temperatures between 45°C and 55°C. This innovative design not only facilitates efficient heat transfer from the server chips but also significantly reduces the water consumption of data centers, with Nvidia claiming to conserve roughly 2.6 million gallons per megawatt annually. This approach could potentially save a 50-megawatt facility over $4 million each year in cooling-related energy and water costs, making it a compelling solution for the rapidly expanding AI industry. The significance of this development lies in its potential to drastically lower the environmental impact of data centers, which traditionally rely heavily on cold water and energy-intensive chiller plants. By adopting a liquid cooling system integrated at the platform level, Nvidia's design aims to eliminate nearly all water usage and drastically cut energy consumption, addressing critical sustainability concerns. While Nvidia's adoption of hot water cooling initially stems from the need to manage the increasing power density of its chips, the broader implications for the AI/ML community are profound, prompting a reevaluation of cooling strategies in a sector that continues to grow amidst global water shortages and energy challenges.