“AI in 2025: gestalt” by technicalities

Dec 7, 2025

46:33

forum

Ask episode

view_agenda

Chapters

auto_awesome

Transcript

info_circle

Episode notes

This is the editorial for this year's "Shallow Review of AI Safety". (It got long enough to stand alone.)

Epistemic status: subjective impressions plus one new graph plus 300 links.

Huge thanks to Jaeho Lee, Jaime Sevilla, and Lexin Zhou for running lots of tests pro bono and so greatly improving the main analysis.

tl;dr

Informed people disagree about the prospects for LLM AGI – or even just what exactly was achieved this year. But the famous ones with a book to talk at least agree that we’re 2-20 years off (allowing for other paradigms arising). In this piece I stick to arguments rather than reporting who thinks what.
My view: compared to last year, AI is much more impressive but not proportionally more useful. They improved on some things they were explicitly optimised for (coding, vision, OCR, benchmarks), and did not hugely improve on everything else. Progress is thus (still!) consistent with current frontier training bringing more things in-distribution rather than generalising very far.
Pretraining (GPT-4.5, Grok 3/4, but also the counterfactual large runs which weren’t done) disappointed people this year. It's probably not because it didn't or wouldn’t work; it was just too hard to serve [...]

---

Outline:

(00:43) tl;dr

(04:02) Capabilities in 2025

(04:21) Arguments against 2025 capabilities growth being above-trend

(10:24) Arguments for 2025 capabilities growth being above-trend

(19:46) Evals crawling towards ecological validity

(22:55) Safety in 2025

(23:00) Are reasoning models safer than the old kind?

(26:05) The looming end of evals

(28:07) Prosaic misalignment

(30:34) What is the plan?