Practical AI: Machine Learning, Data Science, LLM

It's been a BIG week in AI news 🗞

Mar 29, 2022

41:17

Creator website

Highlights

AI Chapters

Episode notes

Is There a Way to Distribute Your Data?

01:45

The New Transformer Engine

03:21

The Scale of Multilingual Models

01:49

Introduction

2min

The Big Science Research Workshop Training Logs

3min

Model Training on Over 400 a 100 Gpus for Greater Than Four Months

2min

The Scale of Multilingual Models

2min

Iversat: Is There a Need for Multilingual Models?

4min

You Still Need to Have Dinner With Your Wife

2min

Is the H One Hundred a Good Idea?

3min

Is There a Way to Distribute Your Data?

2min

The New Architecture for Transformers Is a Good Idea

2min

10.

The New Transformer Engine

3min

11.

Ai Driven Simulation Is a Big Thing, Isn't It?

3min

12.

The Future of Computational Fluid Dynamics

2min

13.

You May Save My Life Later

3min

14.

The Rise of a I Ethics

3min

15.

Robotic Vacuum Cleaners Are Coming Down in Price

2min

16.

How to Keep Up With the Latest Trends in the Market

2min

17.

Practical Ai for This Week.

2min

This last week has been a big week for AI news. BigScience is training a huge language model (while the world watches), and NVIDIA announced their latest “Hopper” GPUs. Chris and Daniel discuss these and other topics on this fully connected episode!

Join the discussion

Changelog++ members get a bonus 2 minutes at the end of this episode and zero ads. Join today!

Sponsors:

Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
Changelog++ – You love our content and you want to take it to the next level by showing your support. We’ll take you closer to the metal with no ads, extended episodes, outtakes, bonus content, a deep discount in our merch store (soon), and more to come. Let’s do this!

Featuring:

Chris Benson – Twitter, GitHub, LinkedIn, Website
Daniel Whitenack – Twitter, GitHub, Website

Show Notes:

BigScience Language Model Training

H100 from NVIDIA

[White paper](https://www.nvidia.com/en-us/data-center/h100/
https://cf-store.widencdn.net/nvdam/8/4/a/84ae26c1-6774-4083-a41d-4f3d82a6a449.pdf)
Omniverse platform
Earth-2 Supercomputer

Stanford’s AI Index 2022

Something missing or broken? PRs welcome!