AI Breakthroughs and the Challenge of Measuring Intelligence

In episode 44 of The AI Fix, ChatGPT won’t build a crystal meth lab, GPT-4o improves the show’s podcast art, some students manage to screw in a lightbulb, Google releases Gemini 2.5 Pro Experimental and nobody notices, and Mark invents a clock for measuring AI time.

Graham explains how ChatGPT’s love for Young Adult fiction can be used to turn it into an evil malware developer, and Mark looks at the ARC-AGI-2 benchmark and a staggering leap forward in AI intelligence.

Episode links:

• Engineers develop hybrid robot that balances strength and flexibility - and can screw in a lightbulb.
• Gemini 2.5.
• Introducing 4o Image Generation.
• New LLM Jailbreak Technique Enables Easy Creation of Password-Stealing Malware.
• New AI Attack Compromises Google Chrome’s Password Manager.
• The ARC Prize.
• The ARC test with which Mark challenged Graham.

The AI Fix

The AI Fix podcast is presented by Graham Cluley and Mark Stockley.

Learn more about the podcast at theaifix.show, and follow us on Bluesky at @theaifix.show.

Never miss another episode by following us in your favourite podcast app. It's free!

Like to give us some feedback or sponsor the podcast? Get in touch.

Support the show and gain access to ad-free episodes by becoming a supporter: Join The AI Fix Plus!