The Robot Brains Podcast cover image

Meet Ross Wightman, a prolific contributor to the AI/ML open source movement

The Robot Brains Podcast

CHAPTER

How to Train a Vision Transformer?

The Vision Transformer was in some sense the first big breakthrough of that new architecture in computer vision. When you come out with a piece of code, I can actually do it just from the paper. That's pretty unique in the early days of such a new neural net architecture to be able to train it properly. The Google group really wanted to do some more work on training with smaller data sets or open accessible data sets like ImageNet 21K.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner