Evolution of Information Retrieval in Language Models

In today's episode, I chat about retrieval-augmented generation (RAG) with Ola Piktus, Member of Technical Staff at Cohere. With her roots in software engineering and significant contributions to RAG through her research, Ola has an interesting perspective on the evolution of RAG and the language technology landscape.

We cover a range of topics, including the potential of RAG to address model hallucination, the transition from theory to real-world application, and the balance between creativity and accuracy in AI models. Ola’s journey from software engineering to state-of-the-art research in AI is a rare glimpse into the development of language tech.

• Ola's research paper "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks": https://arxiv.org/abs/2005.11401
• Ola's research paper "Improving Wikipedia Verifiability with AI": https://arxiv.org/abs/2207.06220
• Learn more about Command R+, Cohere model optimized for RAG use cases: https://txt.cohere.com/command-r-plus-microsoft-azure/
• Try it out: https://cohere.com/coral

Watch the episodes on YouTube: https://www.youtube.com/playlist?list=PLhBwB1lBTwJWR19WkJw87EMh1JU9O7Uff   I'm a co-author of a manual on GPT-3 and OpenAI API (Packt, 2023): https://www.packtpub.com/product/gpt-3/9781805125228   You can keep in touch with me via socials: IG, TikTok, X, LinkedIn @itsSandraKublik   Sign up for my Substack newsletter for the personal scoop on the topics covered today: https://substack.com/@itssandrakublik   Website: www.sandrakublik.com   For brand collabs, reach out to me at team@sandrakublik.com

Music by: Acid Jazz by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 license. https://creativecommons.org/licenses/by/4.0/