This week is a very exciting one in the world of AI news, as we get 3 SOTA models, one in overall LLM rankings, on in OSS coding and one in OSS voice + a bunch of new breaking news during the show (which we reacted to live on the pod, and as we're now doing video, you can see us freak out in real time at 59:32)
00:00 Welcome to ThursdAI
00:25 Meet the Hosts
02:38 Show Format and Community
03:18 TLDR Overview
04:01 Open Source Highlights
13:31 Qwen Coder 2.5 Release
14:00 Speculative Decoding and Model Performance
22:18 Interactive Demos and Artifacts
28:20 Training Insights and Future Prospects
33:54 Breaking News: Nexus Flow
36:23 Exploring Athene v2 Agent Capabilities
36:48 Understanding ArenaHard and Benchmarking
40:55 Scaling and Limitations in AI Models
43:04 Nexus Flow and Scaling Debate
49:00 Open Source LLMs and New Releases
52:29 FrontierMath Benchmark and Quantization Challenges
58:50 Gemini Experimental 1114 Release and Performance
01:11:28 LLM Observability with Weave
01:14:55 Introduction to Tracing and Evaluations
01:15:50 Weave API Toolkit Overview
01:16:08 Buzz Corner: Weights & Biases
01:16:18 Nous Forge Reasoning API
01:26:39 Breaking News: OpenAI's New MacOS Features
01:27:41 Live Demo: ChatGPT Integration with VS Code
01:34:28 Ultravox: Real-Time AI Conversations
01:42:03 Tilde Research and Stargazer Tool
01:46:12 Conclusion and Final Thoughts
This week also, there was a debate online, whether deep learning (and scale is all you need) has hit a wall, with folks like Ilya Sutskever being cited by publications claiming it has, folks like Yann LeCoon calling "I told you so". TL;DR? multiple huge breakthroughs later, and both Oriol from DeepMind and Sam Altman are saying "what wall?" and Heiner from X.ai saying "skill issue", there is no walls in sight, despite some tech journalism love to pretend there is. Also, what happened to Yann? π΅βπ«
Ok, back to our scheduled programming, here's the TL;DR, afterwhich, a breakdown of the most important things about today's update, and as always, I encourage you to watch / listen to the show, as we cover way more than I summarize here π
TL;DR and Show Notes:
* Open Source LLMs
* Qwen Coder 2.5 32B (+5 others) - Sonnet @ home (HF, Blog, Tech Report)
* The End of Quantization? (X, Original Thread)
* Epoch : FrontierMath new benchmark for advanced MATH reasoning in AI (Blog)
* Common Corpus: Largest multilingual 2T token dataset (blog)
* NexusFlow - Athena v2 - open model suite (X, Blog, HF)
* Big CO LLMs + APIs
* Gemini 1114 is new king LLM #1 LMArena (X)
* Nous Forge Reasoning API - beta (Blog, X)
* Reuters reports "AI is hitting a wall" and it's becoming a meme (Article)
* Cursor acq. SuperMaven (X)
* This Weeks Buzz
* Weave JS/TS support is here π
* Voice & Audio
* Fixie releases UltraVox SOTA (Demo, HF, API)
* Suno v4 is coming and it's bonkers amazing (Alex Song, SOTA Jingle)
* Tools demoed
* Qwen artifacts - HF Demo
* Tilde Galaxy - Interp Tool
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit
sub.thursdai.news/subscribe
