Last Week in AI Reflecting on AI news in 2021 (so far) with the host of the Towards Data Science Podcast
Jul 21, 2021
Jeremie Harris, co-founder of ShapestMinds and host of the Towards Data Science Podcast, dives into the notable advancements in AI during 2021. The conversation explores the fascinating avocado armchair AI, the ethical dilemmas surrounding facial recognition after a false arrest in New Jersey, and even a new Nirvana song generated by AI. They discuss the transformative potential of multimodal models and the broader implications for creativity, copyright, and ethical practices in the fast-evolving landscape of artificial intelligence.
AI Snips
Chapters
Transcript
Episode notes
Multimodal AI
- OpenAI's multimodal approach combines language and image models.
- This approach allows more complex semantic understanding, exemplified by CLIP and DALL-E.
Scaling over Cleverness
- OpenAI's strategy follows Rich Sutton's "bitter lesson."
- Focus on scaling general models with vast data and compute, rather than complex algorithms.
Open-Source GPT-3
- EleutherAI, a collective, attempts to recreate and surpass GPT-3.
- They aim to build a trillion-parameter model and have released smaller open-source models.