Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas cover image

336 | Anil Ananthaswamy on the Mathematics of Neural Nets and AI

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

00:00

Transformer attention explained

Anil unpacks attention, embeddings, contextualization of tokens, and how transformers predict next words.

Play episode from 01:03:52
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app