AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai
Aug 31, 2023
Noam Shazeer, co-founder and CEO of Character.AI, is a celebrated computer scientist known for his work in AI and NLP, including his role at Google Brain. He dives into the critical balance between model size and data size, questioning their true value in the evolving AI landscape. Shazeer shares insights on barriers to AI, his journey at Google, and the unique role startups can play amidst larger corporations. He also contemplates the future of AI, emphasizing the importance of fostering real human connections through technology.
35:09
Episode guests
AI Summary
Highlights
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- The size of the model and the amount of computation required are the main challenges in AI.
- Character.ai prioritizes building versatile and usable models.
Deep dives
The Challenge of Model Size and Computation
The size of the model and the amount of computation required to train it are the main challenges in AI. Training a larger model for a longer time is desired, but the number of computational operations needed is a limiting factor. For example, a model was trained last summer, and it took $2 million worth of compute cycles. The advancement of hardware plays a crucial role in addressing these challenges and pushing AI technology forward.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode