Building With AI

Harnessing data to create intelligent machines | Naveen Rao (VP of GenAI, Databricks)

May 7, 2024

50:51

In this episode of Building With AI, host Haroon Choudery is joined by Naveen Rao, VP of GenAI at Databricks. Naveen is a serial entrepreneur who established the first AI chip company, which he sold to Intel in 2016. He then founded MosaicML in 2020, which was acquired by Databricks for $1.3 billion last year.

During the episode, he shares:

MosaicML’s jobs to be done,
Why MosaicML teamed up with Databricks,
The economics of training AI models,
Advice for teams building with AI,
And much more!

—

[00:00] Up next:

[00:51] Episode introduction

[01:40] Autoblocks: AI Optimization Platform

[02:06] Naveen's Introduction

[05:17] Naveen's experience scaling AI products

[06:52] Why we need to scale AI

[11:40] MosaicML's jobs to be done

[14:09] Why did MosaicML team up with Databricks?

[18:24] LLMs 101

[24:47] The economics of training AI models

[28:11] Training a new model vs. adapting a general model

[30:51] The shelf life of AI models

[34:33] A look into DSPy

[41:11] The challenges of DSPy

[43:59] Techniques and architectures that excite Naveen

[47:58] Advice for teams building with AI

—

Brought to you by Autoblocks (https://www.autoblocks.ai/) — how product teams deliver better AI experiences.

—

Building with AI is a weekly podcast featuring conversations with top AI product builders and leaders. Through thoughtful dialogue, host Hamza Choudery Choudery (Co-founder of Autoblocks) uncovers tactical insights that help listeners build & scale world-class AI products.

—

Subscribe to Building With AI: