NVIDIA Data Centers Run Very Hot

NVIDIA’s new 100% liquid-cooled AI data centers operate at a temperature of 45 degrees Celsius, or 113 degrees Fahrenheit, which is significantly higher than the traditionally recommended range of 18 to 27 degrees Celsius. NVIDIA claims this cooling method is one of the biggest efficiency leaps in data center history.

Josh Parker, head of corporate sustainability at NVIDIA, says the company’s DSX AI factories host Rubin AI infrastructure with no fans or cold aisles. The idea that a data center must be kept at a very low temperature is being challenged by NVIDIA’s new design.

NVIDIA’s design works by having liquid coolant enter the chip at 45 degrees Celsius, absorb heat from across the chip’s surface, and exit at 55 degrees. They observed that processors can continue to operate at full performance at this temperature without degrading. This can lead to significant energy savings, as every one-degree-Fahrenheit increase in operating temperature translates to up to 5% savings in energy costs.

This new cooling method could have significant implications for data centers, particularly in the US energy sector, as the country pushes for data centers to pay for grid access. NVIDIA’s timing couldn’t be better, as data centers are under increasing pressure to reduce their energy consumption, and this development relates to compliance in the tech industry.

The mention of an all-liquid-cooling data center may raise concerns about environmental impact, particularly with regards to water consumption. However, NVIDIA claims its DSX AI factories have “zero water consumption” due to a dry-cooler-based design featuring a closed-loop system with no evaporative water cooling.

Energy-efficient high-temperature cooling might also find its way into consumer products, such as home computers. For the CPU and GPU in your home computer, manufacturers recommend targeting a temperature as low as 30 degrees Celsius when the system is idle or under light use. However, with NVIDIA’s new design, this temperature could potentially increase to 45 degrees Celsius.

One of the key benefits of this new cooling method is the potential for significant energy savings. Parker stated, “AI workloads are not getting lighter,” and the compute demand driving data center construction is growing faster than almost any other category of infrastructure investment.

NVIDIA’s DSX design is a significant departure from traditional data center cooling methods. By using a liquid-cooling system, they are able to reduce energy consumption and increase efficiency. As the company continues to innovate and improve its designs, it’s likely that we’ll see even more efficient and effective cooling methods in the future, possibly even incorporating concepts like theoretical high-speed travel.

Efficiency.