AWS CEO estimates large city scale power consumption of future AI model training tasks — 'an individual model may require somewhere between one to 5GW of power'

Nuclear power plant.

Amazon Web Services CEO Matt Garman estimates that large language model (LLM) training two to three generations from now will require as much power as a large city. According to The Transcript’s quote posted on X (formerly Twitter), from a WSJ interview, Garman believes one model might need anywhere between one to five gigawatts to complete training, and that AWS is investing in power projects that could help these growing demands.

$AMZN AWS CEO on AI & Energy:"If you think about these generative AI models... estimates suggest that in two to three models' time, an individual model may require somewhere between one to 5GW of power, which is equivalent to powering a small to medium, or even a large city" pic.twitter.com/RXF4arZNZnOctober 25, 2024