The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch cover image

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai

Aug 31, 2023
Noam Shazeer, co-founder and CEO of Character.AI, discusses the importance of data size vs model size in AI, the lifespan of models, and the value of data. He also shares his experience working at Google and his biggest takeaways from 20 years there. The episode explores the mission of Character.AI and the role of AI in the future, as well as personal growth and the rapid advancement of AI technology.
35:09

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • The size of the model and the amount of computation required are the main challenges in AI.
  • Character.ai prioritizes building versatile and usable models.

Deep dives

The Challenge of Model Size and Computation

The size of the model and the amount of computation required to train it are the main challenges in AI. Training a larger model for a longer time is desired, but the number of computational operations needed is a limiting factor. For example, a model was trained last summer, and it took $2 million worth of compute cycles. The advancement of hardware plays a crucial role in addressing these challenges and pushing AI technology forward.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode