Odd Lots

How to Build the Ultimate GPU Cloud to Power AI

Jul 20, 2023

Brannin McBee, co-founder of CoreWeave, shares insights on building a GPU cloud for AI. He discusses the intense demand for AI chips like NVIDIA's H100 and the challenges of acquiring them in a competitive landscape. The conversation dives into the evolution of data centers, infrastructure needs for AI advancements, and strategic pivots from crypto mining to AI technologies. Brannin also addresses how smaller companies can succeed in the crowded AI cloud services market despite the dominance of larger players.

52:52

Creator website

Episode guests

Brannin McBee

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

GPU cloud powers AI with Nvidia chips, scalability challenges for companies like CoreWeave.

Intel's deepfake detection uses AI and Xeon processors to combat misinformation in videos.

AI compute demand surges with chip shortages, creating supply chain hurdles for infrastructure providers.

Deep dives

Bank of America's Expansion in Paris Post-Brexit

Bank of America expanded operations in Paris in 2019 to ensure seamless service to European clients post the Brexit vote. Vanessa Holtz, CEO of Bank of America Securities, aimed to offer a comprehensive service in Paris, becoming a one-stop shop for clients.

The Relationship Between NVIDIA and CoreWeave

02:39

Changes and Challenges in the Supply Chain for GPU Clusters

01:41

Intro

2min

The Evolution of AI Chip Utilization

13min

Building Next-Generation AI Infrastructure: From CPUs to GPUs

5min

Harnessing AI Through NVIDIA's Cloud Partnerships

13min

Navigating the Competitive Landscape of AI Cloud Services

6min

From Mining to AI: A Strategic Pivot

17min

Navigating AI and Deepfakes: The Future of Content Verification

3min

Artificial Intelligence is all the rage right now and most of the investor excitement has so far been focused on the companies providing the hardware and computing power to actually run this new technology. So how does it all work and what does it actually take to run these complex models? On this episode, we speak with Brannin McBee, co-founder of CoreWeave, which provides cloud computing services based on GPUs, the type of chips pioneered by Nvidia and which have now become immensely popular for generative AI. He walks us through the infrastructure involved in powering AI, how difficult it is to get chips right now, who has them, and how the landscape might change in the future.

See omnystudio.com/listener for privacy information.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.

Odd Lots

How to Build the Ultimate GPU Cloud to Power AI

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Bank of America's Expansion in Paris Post-Brexit

The Rising Impact of Deepfake Videos

Challenges in Scaling AI Infrastructure

The Importance of Developing AI Ecosystems

Adapting from Cryptocurrency Mining to AI Workloads

Navigating Supply Chain Disruptions in AI Infrastructure

The Relationship Between NVIDIA and CoreWeave

Changes and Challenges in the Supply Chain for GPU Clusters

Remember Everything You Learn from Podcasts