It feels pretty intuitive that at least as a single passive transformer you can't really think through it thoroughly as a compositional task. It's more of a like jumping to a conclusion with some instinct and they have theoretical results as well as empirical ones so again we are accumulating more understanding of these kinds of models transformers or language models. This kind of result on compositional tasks very relevant to something like Swift Sage right where we create an agent that is iterative instead of just having one output.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode