Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas cover image

230 | Raphaël Millière on How Artificial Intelligence Thinks

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

NOTE

Rethink Your Intuition on Model Interpolation

Intuition regarding interpolation in specific, narrow domains often falls short when applied to large language and image generation models. These models' processes involve a fundamentally distinct form of interpolation that contrasts sharply with traditional nearest neighbor pixel interpolation in lossy image decompression. The key takeaway is that generative models operate through a novel generative process in inference rather than simple brute force memorization, highlighting the limitations of human intuition in understanding complex, high-dimensional vector spaces.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner