Eye On A.I. cover image

#299 Jacob Buckman: Why the Future of AI Won't Be Built on Transformers

Eye On A.I.

00:00

State size limits in modern retention models

Jacob explains why modern RNNs and retention models have too-small state sizes compared to transformers, hurting performance at scale.

Play episode from 11:12
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app