This Week in Startups

Expanding AI chip capabilities beyond Nvidia with Modular CEO Chris Lattner | E1808

Sep 14, 2023

01:03:30

Snipd AI

CEO of Modular, Chris Lattner, joins Jason to discuss building LLMs, Nvidia's role in machine learning, the AI wrapper debate, and more!

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Modular aims to fill the gap in machine learning by offering a platform that simplifies the deployment and integration of AI modules across various hardware platforms.

Deploying AI models for production is complex, but Modular aims to simplify the process and address scalability challenges.

Modular reduces accidental complexity in AI development by providing a unified AI stack and abstracting away hardware integration complexities.

Deep dives

Modular is building a full AI stack for developers

Modular is developing a comprehensive AI stack that provides developers with a complete AI solution. This is particularly crucial because unlike hardware integration with LLVM, machine learning lacks a unifying technology. Modular aims to fill this gap by offering a platform that simplifies the deployment and integration of AI modules across various hardware platforms. By plugging into Modular's technology, developers gain access to a full AI stack, empowering them to build powerful AI-enabled applications and products.

Introduction

2min

Introduction to Modular and Non-Nvidia Hardware for AI

9min

Exploring a Unique Real Estate Investment Platform

2min

Building the AI Stack

10min

Evolution of technology and the challenges of using Python in AI

6min

The Future of Hardware in the AI Chip Market

5min

Comparison of RISC-V and ARM Architectures, Importance of Innovation, and LinkedIn Ad

3min

NVIDIA's Journey and Success in Deep Learning

8min

Open AI's Transition to for-profit Closed System

19min

This Week in Startups is brought to you by…

Roots. Invest in the only real estate investment trust that creates wealth for you and its residents at https://investwithroots.com/TWIST

Supergut is the easiest and tastiest way clinically-proven to regulate digestion, curb cravings, and boost energy. Get 30% off their delicious shakes, bars, and fiber mix at https://Supergut.com with code TWIST.

LinkedIn Marketing. To redeem a $100 LinkedIn ad credit and launch your first campaign, go to https://linkedin.com/thisweekinstartups

Today’s show:

Modular CEO Chris Lattner joins Jason to discuss the process of building LLMs (8:14), what caused Nvidia to be entrenched in machine learning today (35:37), the AI wrapper debate (41:44), and much more!

Time stamps:

(0:00) Modular CEO Chris Lattner joins Jason

(2:24) Where hardware and optimization stand today

(8:14) What goes into deploying and distributing an AI model into a product

(10:32) Roots - Head to https://investwithroots.com/TWIST to sign up and start investing today!

(12:02) Why companies make their own machine-learning software

(14:32) Nvidia’s outlook on what Modular is building

(18:46) Chris’s time at Apple

(20:05) Strategies for reducing complexity

(22:53) Awareness of underlying complexities in the technology stack

(25:14) Supergut - Get 30% off with code TWIST at https://supergut.com

(26:46) What it will look like in five to ten years; Increase consumption by creating new categories