3min chapter

Clerestory (Bryan Kam) cover image

The Stability-Plasticity Dilemma/Sonnet 122

Clerestory (Bryan Kam)

CHAPTER

Is There a Stability Effect in Machine Learning?

If the system is too chaotic, or if you let the chaotic parts of the system touch the long term memory, that can be a problem for a neural network. So what you might say is that there's a spectrum between explorer mode and exploit mode. And on one side lies catastrophic forgetting. That may not just be a fetrineral networks, it might also be a feature of human culture. On the other end of the spectrum, on the exploit side, where you've found a successful strategy, and maybe it's not working as well as it used to, but for some reason just keep doubling down - that leads to intrenchment effect.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode