#227 - Jeremie is back! DeepSeek 3.2, TPUs, Nested Learning
Last Week in AI
00:00
Sparse Attention and Indexer Trick
Jeremie explains DeepSeek's sparse-attention indexer, token pruning and why retaining ~2,000 tokens works.
Play episode from 06:10
Transcript
Transcript
Episode notes
Our 227th episode with a summary and discussion of last week's big AI news!
Recorded on 12/05/2025
Hosted by Andrey Kurenkov and Jeremie Harris
Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
In this episode:
- Deep Seek 3.2 and Flux 2 release, showcasing advancements in open-source AI models for natural language processing and image generation respectively.
- Amazon's new AI chips and Google's TPUs signal potential shifts in AI hardware dominance, with growing competition against Nvidia.
- Anthropic's potential IPO and OpenAI's declared ‘Code Red’ indicate significant moves in the AI business landscape, including high venture funding rounds for startups.
- Key research papers from DeepMind and Google explore advanced memory architectures and multi-agent systems, indicating ongoing efforts to enhance AI reasoning and efficiency.
Timestamps:
- (00:00:10) Intro / Banter
- (00:02:42) News Preview
- Tools & Apps
- (00:03:30) Deepseek 3.2 : New AI Model is Faster, Cheaper and Smarter
- (00:23:22) Black Forest Labs launches Flux.2 AI image models to challenge Nano Banana Pro and Midjourney
- (00:28:00) Sora and Nano Banana Pro throttled amid soaring demand | The Verge
- (00:29:34) Mistral closes in on Big AI rivals with new open-weight frontier and small models | TechCrunch
- (00:31:41) Kling's Video O1 launches as the first all-in-one video model for generation and editing
- (00:34:07) Runway rolls out Gen 4.5 AI video model that beats Google, OpenAI
- Applications & Business
- (00:35:18) NVIDIA’s Partners Are Beginning to Tilt Toward Google’s TPU Ecosystem, with Foxconn Reportedly Securing TPU Rack Orders
- (00:40:37) Amazon releases an impressive new AI chip and teases an Nvidia-friendly roadmap | TechCrunch
- (00:43:03) OpenAI declares ‘code red’ as Google catches up in AI race | The Verge
- (00:46:20) Anthropic reportedly preparing for massive IPO in race with OpenAI: FT
- (00:48:41) Black Forest Labs raises $300M at $3.25B valuation | TechCrunch
- (00:49:20) Paris-based AI voice startup Gradium nabs $70M seed | TechCrunch
- (00:50:10) OpenAI announced a 1 GW Stargate cluster in Abu Dhabi
- (00:53:22) OpenAI’s investment into Thrive Holdings is its latest circular deal
- (00:55:11) OpenAI to acquire Neptune, an AI model training assistance startup
- (00:56:11) Anthropic acquires developer tool startup Bun to scale AI coding
- (00:56:55) Microsoft drops AI sales targets in half after salespeople miss their quotas - Ars Technica
- Projects & Open Source
- (00:57:51) [2511.22570] DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoning
- (01:01:52) Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory
- Research & Advancements
- (01:05:44) Nested Learning: The Illusion of Deep Learning Architecture
- (01:13:30) Multi-Agent Deep Research: Training Multi-Agent Systems with M-GRPO
- (01:15:50) State of AI: An Empirical 100 Trillion Token Study with OpenRouter
- Policy & Safety
- (01:21:52) Trump signs executive order launching Genesis Mission AI project
- (01:24:42) OpenAI has trained its LLM to confess to bad behavior | MIT Technology Review
- (01:29:34) US senators seek to block Nvidia sales of advanced chips to China
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
The AI-powered Podcast Player
Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
