20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai
Noam Shazeer, co-founder and CEO of Character.AI, is a celebrated computer scientist known for his work in AI and NLP, including his role at Google Brain. He dives into the critical balance between model size and data size, questioning their true value in the evolving AI landscape. Shazeer shares insights on barriers to AI, his journey at Google, and the unique role startups can play amidst larger corporations. He also contemplates the future of AI, emphasizing the importance of fostering real human connections through technology.
35:09
forum Ask episode
web_stories AI Snips
view_agenda Chapters
auto_awesome Transcript
info_circle Episode notes
question_answer ANECDOTE
Spelling Corrector
Noam Shazeer's first Google project was improving Google's spelling corrector.
The old system, using a 50,000-word dictionary, was unsuitable for the diversity of web searches.
volunteer_activism ADVICE
Broad Applicability
Launch general technologies with broad applicability to a wide audience.
Prioritize direct-to-consumer approaches for maximum reach and impact.
insights INSIGHT
AI's Leverage
Noam Shazeer is motivated by pushing technology forward to solve global problems.
He believes AI can have greater leverage in solving problems like disease than direct research.
Get the Snipd Podcast app to discover more snips from this episode
Noam Shazeer is the co-founder and CEO of Character.AI, a full-stack AI computing platform that gives people access to their own flexible superintelligence. A renowned computer scientist and researcher, Shazeer is one of the foremost experts in artificial intelligence (AI) and natural language processing (NLP). He is a key author for the Transformer, a revolutionary deep learning model enabling language understanding, machine translation, and text generation that has become the foundation of many NLP models. A former member of the Google Brain team, Shazeer led the development of spelling corrector capabilities within Gmail, the algorithm at the heart of AdSense.
In Today's Episode with Noam Shazeer We Discuss:
1. Entry into the World of AI and NLP:
How did Noam first make his way into the world of AI and come to work on spell corrector with Google?
What are 1-2 of his biggest takeaways from spending 20 years at Google?
What does Noam know now that he wishes he had known when he started Character?
2. Model Size or Data Size:
What is more important, the size of the data or the size of the model?