Building AI-Native Infrastructure for Developers | Erik Berhnardsson, CEO of Modal
The Peel with Turner Novak
How Modal Aggregates GPU Capacity
Erik describes Modal's approach of integrating many cloud regions and hyperscalers to aggregate spot GPU capacity for customers.
Erik Bernhardsson is the Co-founder and CEO of Modal, building high-performance AI infrastructure.
We talk about building what is essentially a new cloud provider, created from the ground up, optimized for AI. We also talk about what actually happened with the great GPU shortage, how Modal fixes the inference problem in AI, and why he thinks AI will lead to 10x more developers.
He also shares lessons on culture from joining Spotify as the 40th employee, treating hiring like a prediction problem, what most people get wrong working with early customers, why more people should start companies in their 30’s and 40’s, and reflections on fundraising in a hot market.
Thank you to Tim Chen at Essence Venture Capital and Erik’s Co-founder Akshat for their help brainstorming topics for this conversation.
Thank you to Meow and Hanover Park for supporting this episode.
Meow: Get free bookkeeping for your startup at https://www.meow.com
Hanover Park: Modern, AI-native fund admin at https://www.hanoverpark.com/Turner
Timestamps:
(4:26) Modal: AI-native infrastructure
(9:02) Why its so hard to get GPU’s
(15:00) Hitting PMF with AI generated media
(20:37) Competing in IOI competitions
(23:09) 40th employee at Spotify
(27:17) Lessons from Spotify
(31:17) Starting Better[dot]com
(34:05) Treating hiring like a prediction problem
(36:12) Erik’s favorite interview question
(39:07) Sales + common design partner mistakes
(42:02) Startups should solve hard problems
(44:05) Evolution of Modal’s product over time
(50:15) Rise in importance of inference in AI
(52:07) AI development post-GPU scarcity
(58:51) Building a brand in dev tools
(1:04:31) Fundraising from Seed to Series B
(1:07:42) More 30+ year old’s should start companies
(1:10:00) Reducing developer tax, increasing productivity
(1:20:37) Why Erik’s bullish and bearish on AI
(1:26:17) Bubbles, downsides to inappropriate valuations
(1:34:58) High CO2 levels make you dumb
(1:37:38) Difference between US and European startups
Referenced
Modal: https://modal.com
Careers at Modal: https://jobs.ashbyhq.com/modal
Suno: https://suno.com
Planet Scale: https://planetscale.com
How to hire smarter than the market: https://erikbern.com/2020/01/13/how-to-hire-smarter-than-the-market-a-toy-model
Interviewing is a noisy prediction problem: https://erikbern.com/2018/05/02/interviewing-is-a-noisy-prediction-problem
Cloud in 2030: https://erikbern.com/2021/11/30/storm-in-the-stratosphere-how-the-cloud-will-be-reshuffled
Follow Erik
Twitter: https://x.com/bernhardsson
LinkedIn: https://www.linkedin.com/in/erikbern
Follow Turner
Twitter: https://twitter.com/TurnerNovak
LinkedIn: https://www.linkedin.com/in/turnernovak
Subscribe to my newsletter to get every episode + the transcript in your inbox every week: https://www.thespl.it/
The AI-powered Podcast Player
