It's no secret that generative AI requires exorbitant amounts of electricity and cooling water to function. Over the past few years, multiple reports have emerged, giving a glimpse of what it takes to keep these multi-billion-dollar data centers operational.
According to OpenAI CEO Sam Altman, ChatGPT uses 0.34 watt-hours for every query response, "about what an oven would use in a little over one second, or a high-efficiency lightbulb would use in a couple of minutes."
