Odd Lots

Inside the Battle for Chips That Will Power Artificial Intelligence

May 8, 2023

Stacy Rasgon, a semiconductor expert from Bernstein Research, dives deep into the booming AI chip market. He discusses Nvidia's dominance and the fierce competition from startups and tech giants. The conversation highlights the critical role of GPUs in AI's rise and the economic implications of training versus inference. Rasgon also examines how proprietary chip development is reshaping the semiconductor landscape, alongside the challenges and opportunities presented by the evolving hardware ecosystem for artificial intelligence.

58:48

Creator website

Episode guests

Stacy Rasgon

Highlights

AI Chapters

Episode notes

The Future of AI Supercomputers

02:40

The Future of Chatbots

04:51

The Role of Semiconductors in Training AI Models

01:08

Intro

2min

AI's Rise: The Semiconductor Connection

14min

Understanding the Mechanics of Neural Networks

4min

Training AI: The Process and Costs

4min

Exploring the Economics of AI Training and Inference

5min

The Role of Semiconductors in AI Processing

3min

Divergence in Chip Development: Hyperscalers vs. NVIDIA's Software Ecosystem

3min

The AI Hardware Landscape

12min

Navigating the Complexity of AI Capabilities and Accuracy

5min

10.

The Semiconductor Market and AI Dynamics

9min

11.

Reflecting on AI Developments and Engaging the Community

2min

Nobody knows for sure who is going to make all the money when it comes to artificial intelligence. Will it be the incumbent tech giants? Will it be startups? What will the business models look like? It's all up in the air. One thing is clear though — AI requires a lot of computing power and that means demand for semiconductors. Right now, Nvidia has been a huge winner in the space, with their chips powering both the training of AI models (like ChatGPT) and the inference (the results of a query.) But others want in on the action as well. So how big will this market be? Can other companies gain a foothold and "chip away" at Nvidia's dominance? On this episode we speak with Bernstein semiconductor analyst Stacy Rasgon about this rapidly growing space and who has a shot to win it.

See omnystudio.com/listener for privacy information.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.