4min chapter

Machine Learning Street Talk (MLST) cover image

#107 - Dr. RAPHAËL MILLIÈRE - Linguistics, Theory of Mind, Grounding

Machine Learning Street Talk (MLST)

CHAPTER

The Hidden Meta Relationships in Deep Learning Models

Dali is trained with this constructive, constructive learning objective. It's fed by pairs and image and captions that go together and pairs that don't go together. And there are good reasons to think it will not get a model to induce a lot of information about syntactic structure of language. If you look at other models like Parsey and other models that use frozen pre-trained language models as the text encoder instead of clip, they do much better at this kind of thing. So Dali too, I've taken an issue with a number of claims that are made about compositionality in deep learning generally or even in text to image models based on examples from Dali too.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode