#189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI
Last Week in AI
Reflecting on Feedback and Introducing New Sponsors
This chapter addresses listener feedback on the podcast, particularly regarding content alignment and intro music. The hosts introduce sponsors, including an AI lab and a book focused on the significance of tackling advanced AI risks.
Our 189th episode with a summary and discussion of last week's big AI news!
Hosted by Andrey Kurenkov and Jeremie Harris.
Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.
In this episode:
* OpenAI's acquisition of chat.com and internal shifts, including hardware lead hire and hardware model leaks, signal significant strategy pivots and challenges with model scaling and security.
* Saudi Arabia plans a $100 billion AI initiative aiming to rival UAE's tech hub, highlighting the region's escalating AI investments.
* U.S. penalties on GlobalFoundries for violating sanctions against SMIC underline ongoing challenges in enforcing AI-chip export controls.
* Anthropic collaborates with Palantir and AWS to integrate CLAWD into defense environments, marking a significant policy shift for the company.
Sponsors:
- The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.
- The AI safety book “Uncontrollable" which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today!
If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.
Timestamps + Links:
- (00:00:00) Intro / Banter
- (00:01:28) News Preview
- (00:02:10) Response to listener comments
- (00:05:02) Sponsor Break
- Tools & Apps
- (00:07:31) OpenAI Introduces ‘Predicted Outputs’ Feature: Speeding Up GPT-4o by ~5x for Tasks like Editing Docs or Refactoring Code
- (00:11:55) Anthropic’s Haiku 3.5 surprises experts with an “intelligence” price increase
- (00:17:10) Introducing FLUX1.1 [pro] Ultra and Raw Modes
- (00:19:11) X is testing a free version of Grok AI chatbot in select regions
- Applications & Business
- (00:21:39) OpenAI acquired Chat.com
- (00:23:40) Saudis Plan $100 Billion AI Powerhouse to Rival UAE Tech Hub
- (00:28:28) Meta’s former hardware lead for Orion is joining OpenAI
- (00:31:38) OpenAI Accidentally Leaked Its Upcoming o1 Model to Anyone With a Certain Web Address
- (00:35:50) Nvidia Rides AI Wave to Pass Apple as World’s Largest Company
- Projects & Open Source
- Research & Advancements
- (00:49:55) Applying “Golden Gate Claude” mechanistic interpretability techniques to protein language models.
- (00:58:3) Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
- (01:05:55) From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code
- (01:10:22) OpenAI reportedly developing new strategies to deal with AI improvement slowdown
- Policy & Safety
- (01:39:23) Outro
Remember Everything You Learn from Podcasts
