
230 | Raphaël Millière on How Artificial Intelligence Thinks
Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas
Rethink Your Intuition on Model Interpolation
Intuition regarding interpolation in specific, narrow domains often falls short when applied to large language and image generation models. These models' processes involve a fundamentally distinct form of interpolation that contrasts sharply with traditional nearest neighbor pixel interpolation in lossy image decompression. The key takeaway is that generative models operate through a novel generative process in inference rather than simple brute force memorization, highlighting the limitations of human intuition in understanding complex, high-dimensional vector spaces.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.