In March, Nvidia announced a new microchip designed for AI that is 25 times more energy efficient than its predecessor. Two months later, Google announced one with a 67% efficiency improvement. Today, the rest of the semiconductor industry is hyper focused on efficiency gains.

Will they save us from ballooning data center energy demands?

In this episode, Shayle talks to Christian Belady, former Microsoft vice president now focusing on data center advanced development. They unpack concerns about this new surge of demand and whether it’s different from the energy scare two decades ago. Back in 1999, researchers predicted that data centers could end up consuming half of U.S. electricity. But instead, demand remained largely flat at about 4% as cutting-edge hyperscale cloud computing displaced inefficient, on-premises servers.

And yet, driven by the AI boom, energy concerns are back. The Electric Power Research Institute predicts that data center loads could consume 9% of U.S. power generation by 2030. Demand is already rising fast, with emissions at both Google and Microsoft up significantly.

Shayle and Christian examine the factors driving those trends and what we can do about it, covering topics like:

Whether chip efficiency improvements will lead to energy savings or just more powerful computing
The upper limits of Moore’s Law
Energy, labor, and other big constraints on AI growth
Changing computing architecture to find energy savings
Enlisting data centers in integrated, or compulsory, demand response
Using AI to improve chip design

Recommended resources

Fierce Electronics: Power-hungry AI chips face a reckoning, as chipmakers promise ‘efficiency’

Latitude Media: The data center of the future looks like a massive virtual power plant

Latitude Media: Enchanted Rock is selling utilities on flexible data center connection

Latitude Media: Energy is now the ‘primary bottleneck’ for AI

Catalyst: Under the hood of data center power demand

Catalyst is brought to you by Kraken, the advanced operating system for energy. Kraken is helping utilities offer excellent customer service and develop innovative products and tariffs through the connection and optimization of smart home energy assets. Already licensed by major players across the globe, including Origin Energy, E.ON, and EDF, Kraken can help you create a smarter, greener grid. Visit kraken.tech.

Catalyst is brought to you by Anza Renewables, a data, technology, and services platform for solar and storage buyers. Anza’s real-time market intel equips buyers with the essential data they need to get the best deals. Download Anza’s free Q2 Module Pricing Insights Report at go.anzarenewables.com/latitude.

Catalyst is brought to you by Antenna Group, the global leader in integrated marketing, public relations, creative, and public affairs for energy and climate brands. If you're a startup, investor, or enterprise that's trying to make a name for yourself, Antenna Group's team of industry insiders is ready to help tell your story and accelerate your growth engine. Learn more at antennagroup.com.

Ep. 275 - How Notebooks Changed the Entire World Forever w/Roland Allen

Parker's Pensées

Why This Book and Roland's Notebook Practice

The AI-powered Podcast Player