Practical AI 2019's AI top 5
Jan 6, 2020
2019 was a landmark year for AI, featuring major breakthroughs like BERT and GPT-2, which revolutionized natural language processing. The hosts dive into amazing feats, such as a robotic hand solving a Rubik's Cube with finesse. They also tackle the ethical dilemmas posed by advancements like deepfakes and emphasize the need for responsible AI practices. As they look towards 2020, discussions about the integration of diverse perspectives and the societal impacts of AI innovations take center stage, promising an exciting future.
AI Snips
Chapters
Books
Transcript
Episode notes
Transformers in 2019
- 2019 was the year of large language models, notably transformers like BERT and GPT-2.
- These models learn language by training on massive datasets and transfer that knowledge to various NLP tasks.
GPT-2's Impact
- OpenAI's GPT-2, a transformer model, generated human-quality text, raising security concerns.
- Trained on 40 gigabytes of text, its staged release highlighted the model's power and potential misuse.
BERT in Google Search
- Google integrated BERT into its search engine, demonstrating its transformative impact.
- This move signifies BERT's effectiveness and importance in natural language processing.
