Reimagining Data Center design by breaking down the challenges of AI
Dec 5, 2023
auto_awesome
Steven Carlini, VP of Innovation at Schneider Electric, joins the show to discuss challenges of AI in data centers. Topics include power demands of AI workloads, innovative cooling solutions, managing extreme rack power densities, liquid cooling for AI, and updates to environmental sustainability metrics.
AI's rapid growth will increase data center power demands significantly by 2028.
Liquid cooling is emerging as a solution to manage higher thermal design power efficiently.
Deep dives
Challenges of AI Workloads in Data Centers
AI's rapid growth represents a significant power demand increase in data centers, projected to reach 13.5 to 20 gigawatts by 2028. The shift to next-gen infrastructure will require quick adaptation to support AI workloads. Steven discusses challenges across power, cooling, racks, and software management, focusing on liquid cooling and the impact on sustainability strategies.
Extreme Rack Power Densities and Liquid Cooling
The challenge of extreme power densities in AI training servers highlights the importance of dense rack configurations to support parallel processing. Liquid cooling emerges as a solution to efficiently manage higher thermal design power, enhancing cooling efficiency with direct chip cooling methods and intricate heat exchange processes.
Evolution of Liquid Cooling Technology for AI Clusters
The gradual transition from air to liquid cooling in data centers responds to the rising heat output from AI workloads. Liquid cooling designs involve complex cooling distribution units and regulated flow rates. The future evolution of liquid cooling is driven by digital design tools and AI optimization for enhanced system performance.
In this episode of the Data Center Frontier Show podcast, Matt Vincent, Editor-in-Chief of Data Center Frontier, and Steven Carlini, Vice President of Innovation and Data Centers for Schneider Electric, break down the challenges of AI for each physical infrastructure category including power, cooling, racks, and software management.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode