Beth Barnes
CEO of METR (Model Evaluation & Threat Research), an organization focused on measuring AI capabilities and evaluating potential threats.
Best podcasts with Beth Barnes
Ranked by the Snipd community
236 snips
Jun 2, 2025 • 3h 47min
#217 – Beth Barnes on the most important graph in AI right now — and the 7-month rule that governs its progress
Beth Barnes, CEO of METR, dives into the remarkable advancements in AI capabilities, noting that models now have a 50% success rate in tackling complex tasks originally designed for expert humans. She reveals the staggering trend of AI's planning horizon doubling every seven months. Beth emphasizes that AI could soon self-improve, potentially within two years. The conversation also critiques the urgency of addressing AI safety and regulatory challenges as technology evolves, urging a proactive approach while acknowledging the societal implications of AI advancements.
Jun 26, 2025 • 41min
Highlights: #217 – Beth Barnes on the most important graph in AI right now — and the 7-month rule that governs its progress
Beth Barnes, CEO of METR, leads the charge in assessing AI models' capabilities and risks. In this intriguing discussion, she reveals that AI can now tackle expert-level tasks in under 30 minutes, a drastic shift from earlier benchmarks. Barnes emphasizes the necessity of rigorous external audits for AI safety, arguing that internal checks alone may not suffice. Excitingly, she forecasts the arrival of recursively self-improving AI in just two years, prompting urgent conversations about accountability and testing before deployment.
