This message is from NPR sponsor, Total Wine & More.
This summer season, with so many bottles to choose from, it's easy to find your favorite and more.
Find what you love and love what you find, only at Total Wine & More.
Drink responsibly, B21.
A quick note before we start today's show.
You may have heard that President Trump has issued an executive order seeking to block all federal funding to NPR.
This is the latest in a series of threat to media organizations across the country.
The Executive Order is an affront to the First Amendment rights of public media organizations.
It's also an affront to the First Amendment rights of the American people.
NPR remains committed to serving the public—that's you.
We lay out the facts and bring you stories that spark your curiosity, that you won't find anywhere else.
This is a pivotal moment.
It's more important than ever that every supporter who can contribute comes together to pitch in as much as they are able.
visit donate .npr .org now to give.
And if you already support us, via NPR Plus or another means, thank you.
Your support means so much to us now, more than ever.
You help make NPR shows freely available to everyone.
We are proud to do this work for you and with you.
You're listening to Short Wave from NPR.
Hey, Short Waivers.
Regina Barbour here with my co -host Emily Kuang with the second half of a miniseries she reported on the environmental footprint of AI.
Hey, Em! Hi, Gina! So today I am bringing you a story of a personal crisis.
That's very relatable.
Go on. Okay. So in 2018, computer scientist Sasha Lucione took a new job, AI researcher for Morgan Stanley.
She was excited to learn something new in the field of AI, but she couldn't shake this worry.
I essentially was getting more and more climate anxiety I was really feeling this profound disconnect between my job and my values and the things that I cared about and so essentially I was like oh I should quit my job and go plant trees I should you know I should do something that's really making a difference in the world and then my partner was like well you have a PhD in AI you can use that.
So Sasha quit her job and she joined this growing movement to make AI more sustainable Yeah You were saying that like AI innovation was causing this like surge in energy and water use like to cool data centers And the construction of those data centers was only going to increase.
Yes something exponentially Gina by 2028 Lawrence Berkeley National Laboratory forecasts that data centers could consume as much as 12 percent of the nation's electricity that's 480 terawatt -hours.
Okay, can you give me like a different way to think about how much that actually is?
It's like the amount of energy that Canada consumed two years ago.
Okay, so US data centers alone could someday use a Canada -size amount of energy?
They could. Wow. So Sasha is on a quest to find AI models that are smaller and use less energy.
She is now the climate lead at Hugging Face, which is an online community for AI developers to share models and datasets.
And a model is just like an AI program that's trained to take in data and output data.
Yes. So virtual assistants such as ChatGPT, Microsoft Copilot, Google Gemini, they are all powered by what's known as Large Language Models.
And Sasha, as she made quite plain in her 2023 TED talk, is not a fan.
In recent years, we've seen AI models balloon in size because the current trend in AI is bigger is better.
but please don't get me started on why that's the case.
Wait, so I actually do want her to get started.
Like why are these like big players all using these huge models?
I'm glad you asked, because today on the show, we're going to talk about why bigger isn't always better when it comes to generative AI.
In part two of our series, we'll talk about how this big sprawling industry is looking to shrink its environmental footprint with everything from small models, clean energy and a back to the future way of keeping data centers cool.
I'm Emily Kuang. And I'm Regina Barber.
You're listening to Short Wave, the science podcast from NPR.
Don't worry, you won't be lost if you haven't heard Part 1.
This message comes from Schwab.
At Schwab, how you invest is your choice, not theirs.
That's why when it comes to managing your wealth, Schwab gives you more choices.
You can invest and trade on your own.
Plus, get advice and more comprehensive wealth solutions to help meet your unique needs.
With award -winning service, low costs and transparent advice, you can manage your wealth your way at Schwab.
Visit Schwab .com to learn more.
This message comes from Mint Mobile.
Mint Mobile took what's wrong with wireless and made it right.
They offer premium wireless plans for less and all plans include high -speed data, unlimited talk and text, and nationwide coverage.
See for yourself at mintmobile .com slash switch. This message comes from Charles Schwab.
When it comes to managing your wealth, Schwab gives you more choices like full service wealth management and advice when you need it.
You can also invest on your own and trade on Thinkorswim.
Visit Schwab .com to learn more.
Okay, you've been talking with like four of the biggest tech companies, Google, Meta, Microsoft, and Amazon, which I should say are like all financial supporters of NPR.
It's true. Amazon also pays to distribute some of NPR's content.
Right. And these four companies, like all, have ambitious goals for hitting net -zero carbon emissions, most by 2030, Amazon by 2040.
How are they going to get there?
There are three paths, as far as I can tell.
But before we talk about small AI models, you know, what Sasha is describing, let's talk about two solutions to make large -language model computing more green.
And that is more efficient data centers and nuclear power.
What do you want to start with, Gina?
I'm a physicist, a nuclear, obviously.
Of course, of course, of course.
Nuclear because Amazon, Meta and Alphabet, which runs Google, made a big announcement in March as reported by Straight Arrow News.
Three of the world's largest tech companies are promising to help triple global nuclear power supply by 2050.
They're gonna build new nuclear power plants and along with Microsoft, purchase nuclear energy.
Okay. And Microsoft plans to get its nuclear energy by reviving a plant in Pennsylvania.
Yeah, our colleague, Jeff Brumfield, he came on the show in December to talk about how Microsoft purchased Three Mile Island, like the site of a partial nuclear meltdown in 1979.
Yes, only one of the reactors melted down.
By the way, the whole site was shut down in 2019 and now Microsoft wants to bring it back.
OK, so are A .I. companies turning into energy companies?
They are turning into energy movers and shakers, for sure, but Jeff sees a discrepancy in this, you know, between the A .I.
people and the nuclear energy people.
Yeah, Silicon Valley loves to go fast and break things.
The nuclear industry has to move very, very, very slowly because nothing can ever break.
Nuclear is also extremely expensive.
Yes. And while solar and wind energy combined with batteries is quicker to build and more inexpensive than nuclear or gas power plants, it still takes time.
I mean, like, do we need to move that quickly to grow AI?
Well, it depends on who you ask.
Kevin Miller, who runs global infrastructure at Amazon Web Services, says yes.
I think you have to look at the world around us and say, we're moving towards a more digital economy overall and and that is ultimately kind of the biggest driver for the need for data centers and cloud computing.
But Sasha Lucioni the computer scientist we met earlier feels this rush for AI is coming from industry not from consumers.
It's unfair to say that users want more because users aren't given the choice.
Yeah I mean like I hear Sasha here because like I'm a big fan of like AI's benefits, it's totally changed science and medicine and business and banking, all these things that affect our lives, but it does feel like opting out of AI is like becoming more and more difficult.
Absolutely, yes. And until nuclear power catches up with AI's energy demand, data centers will, for the foreseeable future, continue to use fossil fuel sources.
So the question becomes, you know, is there a way to make data centers themselves more efficient?
And the tech giants are trying through better hardware, better chips, and this really captured my attention, more efficient cooling systems. So that's solution number two.
I love a tech solution to a tech problem.
What are some of these strategies?
Well, one method that's become quite popular is to design a data center to bring in cool air from outside the facility, no chilling required.
So they just like pull in this cold air.
Yeah, this is what's known as a free air cooling system.
And then there's a design paradigm that's getting a bit of buzz.
Folks in the industry call it liquid cooling.
Okay, and this is a different kind of liquid cooling evaporation we talked about in the first episode.
Yes, this does not use water.
Liquid cooling uses a special synthetic fluid that runs through the hottest parts of the server to take the heat away, or whole servers are immersed in this cool liquid bath.
Okay, so the idea of like running coolant through like a car engine.
The very same. You can think of this like coolant, but for computers.
Benjamin Lee who studies computer architecture at the University of Pennsylvania, said this is just a much more efficient way to cool off a hot computer.
Because now you're just cooling the surface of whatever the cold plate is covering rather than just blowing air through the entire machine.
So I wanted to talk to someone who's trying to bring liquid cooling to the market and I found this company called Isotope.
David Craig is their recently retired CEO. I definitely come from the point of view that, you know, we literally have just one planet it.
And I cannot understand why anybody would want to do anything other than care for it.
David says the older way of cooling data centers, that daisy chain of moving heat with air and water, is just completely consumptive.
Yeah. And while he couldn't tell me which tech companies have struck agreements with Isotope— So there are a number of confidentiality clauses that sit around customers.
Isotope has announced public partnerships with Hewlett -Packard and Intel.
And Ashlee Settle, a spokesperson at Meta, told me that Meta anticipates some of its liquid -cooling enabled data centers will be up and running by 2026.
Wow. Okay. But because I'm a numbers person, how much energy is being saved by liquid cooling versus air or water cooling?
Depends on the data center.
However, you can say that the very best liquid cooling system uses about 40 % less energy than a traditional air cooling system, and it uses no water.
And then what we're doing is we're capturing that heat in a closed water loop, so it's a bit like a domestic central heating system at that point.
And in huge parts of the planet, particularly the North, we can return that heat and do useful things with it in much more intelligent ways.
David is talking about something called district heating and that's where the heat from a data center, any data center, it doesn't have to be liquid cooled, is then diverted to a local neighborhood.
And that is starting to happen at some data centers in Europe.
Google has a data center in Finland that is providing heat to two thousand people.
That's so cool. I think I've actually read about this.
Like, I think it's called Homina Data Center.
That's the one, yeah.
Now, Homina does not use liquid cooling, but it is kind of a poster child for a green data center.
Hamana runs on 97 percent renewable energy and pumps in seawater from the bay of Finland to keep cool.
Wow. That's really cool.
Literally. Okay. So, Hamana is just like one of these data centers, like, out of thousands, right?
Yes. And this is the challenge.
Most data centers are not situated by bodies of water in Northern Europe.
Right. So I want to talk about a third and final innovation, and it's the one that the tech companies I spoke to were kind of quiet about.
Oh, okay. But the one that scientists and engineers outside the industry could not stop mentioning, and that is smaller AI models.
I mean of course. Right?
One's good enough to complete a lot of the tasks we care about but in a much less energy intensive way.
So a third and final solution to AI's climate problem is just to use less AI.
One kind of disruptor in this space is DeepSeek.
Right. That's the chat bot out of a company in China, and it is claiming to use less energy.
Yes, I did reach out to DeepSeek for comment.
I didn't hear back.
But here's the thing, Gina, large language models like ChatGPT, are often trained with really large data sets.
DeepSeek, on the other hand, appears to have been trained with fewer chips and consists of smaller models that run fewer parameters.
Benjamin Lee at U -Pen says this is called a mixture of experts.
The idea behind a mixture of experts is, you don't need a single huge model with a trillion parameters to answer every possible question under the sun. Rather, you would like to have a collection of experts, smaller models, and then you just sort of route the request to the right expert.
And because each expert is so much smaller, it's going to cost less energy to invoke.
But DeepSeek, here's the thing about it, it's still a big general purpose model.
And Sasha Lucione at Huggin' Face wants to walk away from large models entirely.
And nowadays, more and more, I think companies are like, for our intents and purposes, we want to do UX, like, whatever.
Summarize PDFs. But you don't need a general purpose model for that.
You can use a model that's task -specific and a lot smaller and a lot cheaper.
Basically, Sasha wants to see companies develop small language models.
Models that have far fewer parameters and are trained for a specific task.
So, are tech companies experimenting with this?
A few. Here's what I found.
Last year, Meta announced a smaller, quantized version of some of their models and Microsoft announced a family of small models called Phi3.
But honestly, in all of my conversations and emails with big tech, it's clear to me that large language models are here to stay.
So, if that's the case, Sasha has one last idea, an industry -wide score for AI models.
Okay, so like Energy Star was created to, like, rank the energy efficiencies of appliances.
You see that little star on a lot of those appliances.
Yes, something like that for AI models, but at least according to Sasha, tech companies are not embracing a rating system.
There's like such a blanket ban on any kind of transparency because it could either like make you look bad, open you up for, whatever, legal action, or just kind of give people a sneak peek behind the curtain.
And as a science reporter for NPR, my question was just, do we really need all of this computing power when we don't know how much it's costing us environmentally and when it could imperil our climate goals?
And David Craig, the recently retired CEO of Isotope, he chuckled when I said this and he's like, Emily, you know, human nature is against us.
We are always that kid who does touch the very hot ring on the cooker when a mom said don't We are always the people who touch the wet paint We're not good at learning until bad things happen to us The truth is with data, you know, this stuff is just grown up in the back and people just haven't known about it I mean, yeah I mean, I certainly had no idea about all of this while I was growing up All this was happening in the background, but m you can't like to, um, disinvent the internet, right?
Nor should we, where would we get our cat videos.
In the mail. There's something I think that we as consumers can think about.
The AI revolution is fairly new.
Google CEO Sundar Pichai compared it to the discovery of electricity, except unlike the people during the industrial revolution, we know that this has a climate cost. Wow.
Yep. And there's still time to adjust how and how much we use AI.
Em, thank you so much for bringing us this reporting.
Thanks Gina. If you liked this episode, you can check out part one of our series on AI in the Environment It's Already Out.
This episode was produced by Hannah Chin, edited by our showrunner Rebecca Ramirez, and fact -checked by Tyler Jones.
Robert Rodriguez was the audio engineer.
Special thanks to Brent Bachman, Johannes Derge, and our incredible standards team, and special thanks to TED Conferences, LLC.
week. Special thanks also to Julia Simon on NPR's Climate Desk.
Beth Donovan is our Senior Director and Colin Campbell is our Senior Vice President of Podcasting Strategy.
I'm Emily Kuang. And I'm Regina Barber.
Thanks for listening to Shortwave, the science podcast from NPR.
With 100 years of experience navigating ups and downs, Edward Jones can help guide you.
Let's find your rich together.
Edward Jones, member SIPC.
This message comes from Mint Mobile.
If you're tired of spending hundreds on big wireless bills, bogus fees and free perks, Mint Mobile might be right for you with plans starting from 15 bucks a month.
Shop plans today at mintmobile .com slash switch. Up front payment of $45 for three month, five gigabyte plan required.
New customer offer for first three months only then full price plan options available taxes and fees extra.
See Mint Mobile for details.
Support for this NPR podcast comes from Zscaler.
Reduce infrastructure costs by 90 % and improve networking and security agility by eliminating Firewalls and VPNs with Zscaler Zero Trust plus AI.
Learn more at zscaler .com slash security.
