Practical AI It's been a BIG week in AI news đź—ž
Mar 29, 2022
This week, the focus is on the ambitious training of a massive language model by BigScience. NVIDIA unveils their cutting-edge H100 GPUs, pushing the boundaries of AI capabilities. There's an engaging discussion about the balance of personal anecdotes with professional AI advancements. The dangers of mountain waves in aviation link fluid dynamics with AI safety research. Finally, ethical considerations and biases in AI are tackled, along with nostalgic ties between childhood cartoons and today's tech landscape.
AI Snips
Chapters
Transcript
Episode notes
BigScience Language Model Training
- BigScience is training a massive, multilingual language model with 176 billion parameters.
- This model is being trained on 416 A100 GPUs for over four months.
Multilingual Model Limitations
- The BigScience language model only covers 46 of the 7,000+ languages spoken globally.
- While impressive, it highlights the need for continued development in language-specific models.
Contributing to BigScience
- Daniel Whitenack's team contributed multilingual data to the BigScience language model training dataset.
- This personal involvement showcases the collaborative nature of the project.