Get the app
Jacob Buckman
Co-founder and CEO of Manifest AI, focused on architectures for long-context transformers and creator of the Power Retention approach and related open-source tools like Vidrial and PowerCoder.
Best podcasts with Jacob Buckman
Ranked by the Snipd community
190 snips
Oct 7, 2025
• 57min
Recurrence and Attention for Long-Context Transformers with Jacob Buckman - #750
chevron_right
Jacob Buckman, co-founder and CEO of Manifest AI, dives deep into the world of long-context transformers. He discusses innovative techniques like windowed attention and the revolutionary Power Retention approach, which melds attention and recurrence for astonishing training speeds. Buckman also shares insights on Manifest AI's open-source tools, Vidrial and PowerCoder, and explores the significance of metrics in measuring context utility. Learn about the balance between state and weight for optimal compute architectures and the future potential of context length in AI.
The AI-powered Podcast Player
Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
Get the app