Astral Codex Ten Podcast cover image

The Canal Papers

Astral Codex Ten Podcast

00:00

The Landscape Metaphor of AI Inference and Training

A modern AI, like GPT-4, is trained by feeding an empty neural net some very large amount of data. This gives it some set of neural weights, that is, transition probabilities from one neuron being activated to another neurons being activated. The second paper tries to map these two forms of change into AI inference and training. Humans don't have a clear training slash inference distinction. There's no age at which we stop learning new things and changing our personality,. We learn and interact at the same time.

Play episode from 15:48
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app