4min snip

Machine Learning Street Talk (MLST) cover image

061: Interpolation, Extrapolation and Linearisation (Prof. Yann LeCun, Dr. Randall Balestriero)

Machine Learning Street Talk (MLST)

NOTE

Hybrid learning systems with continuous and discrete elements

The apparent dycodomy between continuous and discreet systems is like the human brain. It has evolved both analogue and discreet computations. It's difficult to train fixed depth neural networks for discreet computations. The hybrid system is efficient since it clusters different settings and applies discreet and continuous reasoning accordingly. Both systems need to interact for optimal results. Humans lack a discreet system for playing chess, but symbolic and statically coded discreet systems have limitations. Deep learning models can guide discreet programm search, but it's not feasible within the continuous domain.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode