Get all your news in one place.
100’s of premium titles.
One app.
Start reading
Fortune
Fortune
Allie Garfinkle

AWS CEO Matt Garman on startups, nuclear power, and soaring AI compute costs

AWS CEO Matt Garman smiling onstage while gesticulating with arms spread wide (Credit: Courtesy of Amazon Web Services/Noah Berge)

Amazon Web Services CEO Matt Garman thinks about startups more than you might expect. Garman, who stepped into the role in June, sees startups as customers, partners, and, in some sense, as Amazon’s future.

"Startups are the enterprises of the future," he told Fortune. "Pinterest was a startup, Netflix was a startup, Rivian was a startup. X-energy is a startup…So, we want to be a part of helping them grow, helping them build on AWS, and helping them grow their company."

Every 10 minutes a startup around the world joins AWS Activate, a program that offers startups cloud credits and mentorship, among other things. The program was founded in 2013, and has since helped 280,000 startups, providing more than $6 billion in credits. Amazon says that, today, 80% of PitchBook-listed unicorns run on AWS. 

Garman notes that AWS learns a lot from startups, who are often "at the bleeding edge of technology" and "looking around corners." This helps AWS improve its own services to better support startups and its broader customer base.

Garman has taken the reins at AWS at an interesting moment in the cloud business, as the AI boom drives up the need for computing power.

In December, AWS held its annual summit in Las Vegas, AWS re:Invent, which featured new partnerships with a wide range of startups. One of those startups, Redpoint-backed unicorn Poolside, announced plans to include its models on AWS Bedrock and leverage AWS Trainium chips. Jason Warner, cofounder and CEO of Poolside says AI training and inference have made securing reliable cloud computing horsepower more important than ever.  

"These models are so large, and the resource requirements to train them and run them are so large," Warner told Fortune. "You can't just work with any old partner. This is actually one of those weird things where a startup really requires so much out of their other partner."

Luma AI’s founder and CEO Amit Jain echoes the sentiment: 

"Think about it this way: My business has only two inputs, talent and compute," Jain told Fortune. “Honestly, talent, I got it right. But the second thing is that you need to be able to find reliable compute, where it doesn’t stand in your way…Video images are insanely compute-intensive, right? We think this next generation of AI is going to drive the majority of demand on compute."

Garman acknowledged the growing costs for startups, but predicted that costs would come down—and in turn, create even more demand. 

"Today, inference is just too expensive,” said Garman. With smaller models, creative techniques like "distilling," and new inventions, Garman predicts that inference costs will drop by "an order of magnitude"—and the amount of AI inference being done by companies will increase by three orders of magnitude.

This year, AWS doubled down on startups in an effort to solve another problem—powering an AI future. "I think that type of collaboration allows us to prosper together," said David Roldan, AWS head of startup business development in EMEA. In October, Amazon announced it would invest more than $500 million in two nuclear energy-focused companies: X-energy is a Maryland-based small modular reactor (SMR) startup and Washington-based Energy Northwest. The company also has a third project with Virginia-based Dominion Energy.

And it all connects together. There’s potential for small modular reactors (SMRs) to rise as a safe and scalable nuclear technology that can be placed closer to data centers—in many ways, the bread and butter of AWS. Garman says he believes nuclear power can provide the 24/7 power needed to support Amazon's data centers and other always-on applications.

Nuclear energy has been gaining momentum across Big Tech. It’s a high-potential energy source with a longstanding perception problem. High-profile incidents like Chernobyl and Fukushima have left lasting impressions on public consciousness, but nuclear power is evolving. 

"Technology and the costs are really coming to a place where it's being competitive," Garman told Fortune. "Most of these SMRs, we estimate that they'll be ready for production use, sometime around 2030, give or take…It’s not a new technology, but it’s getting to the point where they’ve solved some really hard problems. It’s becoming realistic. It’s now something you can actually go and plan to implement."

X-energy CEO J. Clay Sell told Fortune via email: "Amazon needs clean, safe, secure electricity as it scales its data center growth and experiences higher power demand. We see this collaboration as an exciting opportunity to advance not only Amazon’s data center and net-zero goals."

Garman knows you can’t build the future if you can’t afford to power it. And startups can provide answers to Amazon’s future, while also being a key part of its past. 

"When we started AWS 18 years ago…[startups] were our first customers," said Garman. "They continue to be a super important set of customers that we invest in."

More AWS…If you want to read more about AWS and Garman, my colleague Jason Del Rey dropped a great profile of him this week. Read the whole story here.

See you Monday,

Allie Garfinkle
Twitter:
@agarfinks
Email: alexandra.garfinkle@fortune.com
Submit a deal for the Term Sheet newsletter here.

Nina Ajemian curated the deals section of today’s newsletter. Subscribe here.

Correction, December 20, 2024: The email version of this newsletter included an incorrect figure about the number of nuclear projects Amazon invested $500 million in. It has been corrected.

Sign up to read this article
Read news from 100’s of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.