Matt Shumer and Sahil, co-founders of Glaive.ai, share insights on their new Reflection-LLama 70B model, which surpasses Claude 3.5 in performance. Niklas, a leading author of OLMoE, discusses the significance of open-source AI in advancing model training techniques. Eugene, known as pico_creator, reveals RWKV's deployment to 1.5 billion devices. The conversation highlights major developments such as Anthropic's expansive context window and Elon Musk's massive AI training cluster, showcasing the rapid evolution of AI technologies and their potential impact.