AI Snips
Chapters
Transcript
Episode notes
Tools Fix World-Access Limits
- Language models lack access to the external world, causing limits like outdated knowledge and poor calculations.
- Equipping models with text-to-text APIs lets them retrieve facts, compute, and connect to personal or temporal context.
Code Example That Failed At Runtime
- Thomas describes a coding example where a model produced code that looked right but failed when run.
- Executing code and getting runtime feedback would let models debug and iterate like humans.
Design Simple Text-To-Text API Calls
- Make APIs text-to-text and let the model signal a call with a special token during generation.
- Interrupt decoding to run the API, insert the textual result, then let the model continue generating.