Building With AI cover image

Building With AI

Harnessing data to create intelligent machines | Naveen Rao (VP of GenAI, Databricks)

May 7, 2024
50:51

In this episode of Building With AI, host Haroon Choudery is joined by Naveen Rao, VP of GenAI at Databricks. Naveen is a serial entrepreneur who established the first AI chip company, which he sold to Intel in 2016. He then founded MosaicML in 2020, which was acquired by Databricks for $1.3 billion last year.

 

During the episode, he shares:

  • MosaicML’s jobs to be done,
  • Why MosaicML teamed up with Databricks,
  • The economics of training AI models,
  • Advice for teams building with AI,
  • And much more!

[00:00] Up next: 

[00:51] Episode introduction 

[01:40] Autoblocks: AI Optimization Platform 

[02:06] Naveen's Introduction 

[05:17] Naveen's experience scaling AI products 

[06:52] Why we need to scale AI 

[11:40] MosaicML's jobs to be done 

[14:09] Why did MosaicML team up with Databricks? 

[18:24] LLMs 101 

[24:47] The economics of training AI models 

[28:11] Training a new model vs. adapting a general model 

[30:51] The shelf life of AI models 

[34:33] A look into DSPy 

[41:11] The challenges of DSPy 

[43:59] Techniques and architectures that excite Naveen 

[47:58] Advice for teams building with AI

Brought to you by Autoblocks (https://www.autoblocks.ai/) — how product teams deliver better AI experiences.

Building with AI is a weekly podcast featuring conversations with top AI product builders and leaders. Through thoughtful dialogue, host Hamza Choudery Choudery (Co-founder of Autoblocks) uncovers tactical insights that help listeners build & scale world-class AI products.

Subscribe to Building With AI:

Where to find Naveen Rao:

Learn more about Databricks:

Where to find Hamza Choudery:

Learn more about Autoblocks:

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode