Data Science at Home cover image

From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)

Data Science at Home

00:00

Predicting vectors instead of tokens

Francesco outlines replacing next-token prediction with next-vector prediction and the implications for generation speed (T/4 steps with k=4).

Play episode from 07:45
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app