The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Perplexity's Aravind Srinivas on Will Foundation Models Commoditise, Diminishing Returns in Model Performance, OpenAI vs Anthropic: Who Wins & Why the Next Breakthrough in Model Performance will be in Reasoning

Jun 5, 2024

Aravind Srinivas, former research scientist at OpenAI, Google, and DeepMind, discusses the next AI breakthrough in reasoning, the commoditization of foundation models, and misconceptions about AI. He shares insights on talent assembly, diminishing returns in model performance, and the timeline for reasoning improvement. Aravind also delves into the challenges of integrating AI into enterprise tools and explores personal motivations in the AI space.

55:03

Creator website

Episode guests

Aravind Srinivas

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Model performance improvement requires real reasoning integration for progression.

Scaling models may lead to diminishing returns, emphasizing data curation and efficient training.

Challenges in implementing memory in models need to be addressed for optimal performance.

Deep dives

Models Evolving towards Real Reasoning Era

The progression of models from providing outputs to incorporating reasoning processes by receiving feedback, refining reasoning, and enhancing output is noted. Companies benefit from the advancement towards real reasoning, contributing to the evolution of models.

Continuous Improvement of Reasoning through Self-Taught Automated Reasoner

01:13

Exploring the Benefits and Challenges of Model Commoditization for Application Layer Companies

02:53

Value in AI Companies Lies in People, not Models

01:32

Discovering Expertise through Unexpected Success

01:45

Introduction

3min

Exploration of Journey into AI and Machine Learning

4min

Exploring Diminishing Returns in Model Performance

12min

Navigating the Commoditization of AI Foundation Models

15min

Navigating Enterprise Tools and Challenges in AI Space

9min

Exploring Personal Motivations, AI Misconceptions, and Future Browser & OS Innovations

6min

Navigating Contradictions and Decision-Making in Startup CEO Roles

2min

Vision for the Future and the Importance of Truth and Knowledge

3min

Aravind Srinivas is the Co-Founder & CEO of Perplexity, the conversational "answer engine" that provides precise, user-focused answers to queries. Aravind co-founded the company in 2022 after working as a research scientist at OpenAI, Google, and DeepMind. To date, Perplexity has raised over $100 million from investors including Jeff Bezos, Nat Friedman, Elad Gil, and Susan Wojciki.

In Today’s Episode with Aravind Srinivas We Discuss:

Biggest Lessons from DeepMind & OpenAI

What was the best career advice Sam Altman @ OpenAI gave Aravind?
What were Aravind’s biggest takeaways at DeepMind?
How did DeepMind shape how Aravind built Perplexity?
What did Aravind mean by “competition is for losers?” What did he learn about talent assembly at DeepMind?

The Next AI Breakthrough: Reasoning

Does Aravind think we are experiencing diminishing returns on compute & model performance?
Does Aravind agree reasoning will be the next big breakthrough for models?
What are the reasons Aravind thinks models suck at reasoning today?
What is the timeline for reasoning improvement according to Aravind?
What does Aravind think are the biggest misconceptions about AI today?

Will Foundation Models Commoditise?

Does Aravind think foundation models will commoditise? What will the end state of foundation models look like?
Why does Aravind think the second tier models will get commoditised?
Why does Aravind think the subscription model will not work for AI models with true reasoning?
Why does Aravind think the application layer companies will benefit from foundation models commoditising?
Why does Aravind think foundation models will not verticalize?
When does Aravind think is the right time to go enterprise? What is his strategy to differentiate Perplexity from its competitors?

AI Arms Race: Who Will Win?

Who does Aravind think will be the winners of foundation models?
What do AI companies need to do to win the model arms race?
How does Aravind think startups can compete against incumbents' infinite cash flow?
What are the reasons Aravind thinks Perplexity’s browsing is better than ChatGPT?
What is Aravind’s biggest challenge at Perplexity today?

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Perplexity's Aravind Srinivas on Will Foundation Models Commoditise, Diminishing Returns in Model Performance, OpenAI vs Anthropic: Who Wins & Why the Next Breakthrough in Model Performance will be in Reasoning

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Models Evolving towards Real Reasoning Era

Diminishing Returns in Model Performance

Challenges in Developing Models with Memory

Importance of Diversification in Revenue Streams

Innovative Approach to Enterprise Search Solutions

Continuous Improvement of Reasoning through Self-Taught Automated Reasoner

Exploring the Benefits and Challenges of Model Commoditization for Application Layer Companies

Value in AI Companies Lies in People, not Models

Discovering Expertise through Unexpected Success

Get the Snipd
podcast app

AI-powered
podcast player

Discover
highlights

Save any
moment

Share
& Export

AI-powered
podcast player

Discover
highlights

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Perplexity's Aravind Srinivas on Will Foundation Models Commoditise, Diminishing Returns in Model Performance, OpenAI vs Anthropic: Who Wins & Why the Next Breakthrough in Model Performance will be in Reasoning

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Models Evolving towards Real Reasoning Era

Diminishing Returns in Model Performance

Challenges in Developing Models with Memory

Importance of Diversification in Revenue Streams

Innovative Approach to Enterprise Search Solutions

Continuous Improvement of Reasoning through Self-Taught Automated Reasoner

Exploring the Benefits and Challenges of Model Commoditization for Application Layer Companies

Value in AI Companies Lies in People, not Models

Discovering Expertise through Unexpected Success

Get the Snipdpodcast app

AI-poweredpodcast player

Discoverhighlights

Save anymoment

Share& Export

AI-poweredpodcast player

Discoverhighlights

Get the Snipd
podcast app

AI-powered
podcast player

Discover
highlights

Save any
moment

Share
& Export

AI-powered
podcast player

Discover
highlights