Eye On A.I. cover image

#299 Jacob Buckman: Why the Future of AI Won't Be Built on Transformers

Eye On A.I.

00:00

Why transformer context scaling is a problem

Craig asks about quadratic context scaling; Jacob explains why transformers become intractable on very large inputs.

Play episode from 03:48
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app