AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
4min chapter
Lost in the Middle: How Language Models Use Long Contexts
Deep Papers
The Open Source Encoder-Decoder Models
Sally Ann: I think scientists are going to kind of dive into, like, the why behind all of this. Amber: We're really glad this paper came out because it's making us reevaluate where we're spending our time and priorities. Sally Ann: It's such a straightforward thing. The way that you can just play around with like the positions and actually see how things are doing is very interesting. But obviously model performance is highest when the relative information occurs at the beginning or end of the input context. A lot of people are focusing on, but you'll see Sally Ann and I are going to be focusing on a few other concepts that this paper really showed.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode