- Nvidia's Rubin-generation AI servers run coolant that is often hotter than a hot tub as it enters a closed loop at up to 45°C and leaves at around 55°C, with no performance penalty in tow
- The principle leveraged here is that of a temperature gradient with server chips still running hotter than the coolant, allowing heat transfer to occur seamlessly
- The approach allows Nvidia to roughly conserve 2.6 million gallons per megawatt annually to near zero and could save a 50MW site over $4 million a year in cost
Nvidia's Rubin generation is the first of its kind in multiple ways, but the one that sticks out possibly is the fact that it is 100% liquid cooled, implementing it as a core design feature at a platform level with every single chip and networking component covered by a closed loop.
