The Future of Hardware in the AI Chip Market

5min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

This chapter explores the current challenges of stock outs of Nvidia chips and the increasing consumption of AI. It also delves into the future of hardware in AI, including the end of Moore's Law and the rise of specialized chips, and discusses the open source risk five and AMD licensing models.

This Week in Startups is brought to you by…

Roots. Invest in the only real estate investment trust that creates wealth for you and its residents at https://investwithroots.com/TWIST

Supergut is the easiest and tastiest way clinically-proven to regulate digestion, curb cravings, and boost energy. Get 30% off their delicious shakes, bars, and fiber mix at https://Supergut.com with code TWIST.

LinkedIn Marketing. To redeem a $100 LinkedIn ad credit and launch your first campaign, go to https://linkedin.com/thisweekinstartups

Today’s show:

Modular CEO Chris Lattner joins Jason to discuss the process of building LLMs (8:14), what caused Nvidia to be entrenched in machine learning today (35:37), the AI wrapper debate (41:44), and much more!

Time stamps:

(0:00) Modular CEO Chris Lattner joins Jason

(2:24) Where hardware and optimization stand today

(8:14) What goes into deploying and distributing an AI model into a product

(10:32) Roots - Head to https://investwithroots.com/TWIST to sign up and start investing today!

(12:02) Why companies make their own machine-learning software

(14:32) Nvidia’s outlook on what Modular is building

(18:46) Chris’s time at Apple

(20:05) Strategies for reducing complexity

(22:53) Awareness of underlying complexities in the technology stack

(25:14) Supergut - Get 30% off with code TWIST at https://supergut.com

(26:46) What it will look like in five to ten years; Increase consumption by creating new categories