The Robot Brains Podcast cover image

Meet Ross Wightman, a prolific contributor to the AI/ML open source movement

The Robot Brains Podcast

00:00

How to Train a Vision Transformer?

The Vision Transformer was in some sense the first big breakthrough of that new architecture in computer vision. When you come out with a piece of code, I can actually do it just from the paper. That's pretty unique in the early days of such a new neural net architecture to be able to train it properly. The Google group really wanted to do some more work on training with smaller data sets or open accessible data sets like ImageNet 21K.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app