The MAD Podcast with Matt Turck cover image

Can AI Infrastructure Work Like Magic? | Erik Bernhardsson, CEO, Modal

The MAD Podcast with Matt Turck

00:00

Managing GPU Resources in the Cloud

This chapter focuses on the strategic sourcing and management of GPU resources across various cloud providers, emphasizing the importance of capacity management and cost optimization. It also highlights Modal's architecture for scaling GPU resources to meet fluctuating demands, particularly in AI applications like music generation. The discussion extends to the evolving landscape of AI infrastructure, weighing the economic dynamics of training versus inference, and exploring innovative uses of batch processing in fields such as biotech.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app