
Constitutional AI, Emergent Abilities and Foundation Models
The AI Buzz from Lightning AI
 00:00 
Limits of current language models: memory and context windows
Luca discusses core limitations: finite context windows and where knowledge is stored, and recent work to extend context length.
 Transcript 
 Play full episode 


