Eye On A.I. cover image

#123 Aidan Gomez: How AI Language Models Will Shape The Future

Eye On A.I.

00:00

Tensor2Tensor: A Framework for Large Distributed Model Training

Tensor2Tensor was built on top of TensorFlow at the time, but it was basically just a library to support large distributed model training. It had all the latest kind of tricks and hacks with learning rate schedules and initialization techniques. And so it led us experiment really rapidly. I think for me, I wasn't sleeping. 14-hour days, coding, building up this infrastructure,. making it more robust, running experiments.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app