
Last year it turned out that Elon Musk’s xAI had to install additional ‘portable’ generators near its facility adjacent to Memphis, Tennessee, to power the Colossus supercomputer with over 100,000 Nvidia H100 GPUs as local power grid could not support the load. The Southern Environmental Law Center contends the generators are "illegal," yet they can keep running, reports The Guardian.
xAI’s Colossus supercomputer consumes about 150 MW of power when equipped with 100,000 H100 GPUs. More when it is upgraded to 200,000 processors. However, last July the site near Memphis, Tennessee, could only provide 8 MW of power to the facility, so Musk’s company had to install gas fueled turbines to power the colossal supercomputer.