
Episode 24: Jack Parker-Holder, DeepMind, on open-endedness, evolving agents and environments, online adaptation, and offline learning
Generally Intelligent
Is There a Difference Between the Second Generation and the First Generation?
The ability to improve is like much more available because you didn't have to take as many steps as it gets to the same point in your previously app. The obvious questions are like, why can't we just do like entry-gradualization or like wait decay or something? And maybe those approaches would work equally well, I don't know. But then you have to do like a goal as well and compare against just training the same agent for a little bit longer. Asymptotically, the second generation agent is better than the first generation agent. Probably most of the effect is not coming from training for longer.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.