Reinventing AI Agents with Imbue CEO Kanjun Qiu
Gradient Dissent: Conversations on AI
00:00
Open-Sourcing AI: Training and Evaluation Insights
This chapter explores the open-sourcing of a 70 billion parameter model, focusing on the technical setup with 4096 GPUs and the implications of a new custom optimizer. It highlights how clear evaluation questions significantly improve model performance and discusses internal evaluation processes.
Transcript
Play full episode
