6min chapter

Lex Fridman Podcast cover image

Juergen Schmidhuber: Godel Machines, Meta-Learning, and LSTMs

Lex Fridman Podcast

CHAPTER

Is It Necessary to Look Back in Time?

Eliteum is one of the great examples of architectures that a do something beyond just deeper and deeper networks. It's not clear what are the practical limits of the elustien when it comes to looking back. The credit assignment problem across way back, not just 50 time steps, or a hundred or a thousand, but millions and billions. So essentially, although it's predicting only the next time step, it is motivated to learn,. to put into memory something that happened maybe a million steps ago - because it's important to memorize that if you want to predict that at the next timestep, the next evento.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode