The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

AI Trends 2024: Machine Learning & Deep Learning with Thomas Dietterich - #666

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

NOTE

Challenges and Solutions in Retrieval for Factual Knowledge

Retrieval for factual knowledge requires addressing issues such as pre-training knowledge leakage, prompt injection, and the need to separate control and data channels in the architecture. Solutions include forcing models to only answer based on retrieved documents and designing architecture to bring retrieved models into the language model along a different channel to ensure the language model retrieves information from the retrieved documents. These challenges and solutions are critical for making retrieval-augmented generation safe to use.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner