Generative AI enabling black-box testing

Generative AI has made major leaps since we last explored its use in game QA, and this episode dives into how that progress is reshaping the field. Host Devin Becker is joined again by Christoffer Holmgård and Julian Togelius, co-founders of modl.ai, to unpack how recent advances in computer vision and agent behavior are enabling fully no-code QA testing workflows. We discuss the shift from traditional code-integrated systems to screen-seeing, input-driving AI agents, and the technical breakthroughs that finally made this approach viable. The conversation also explores the types of bugs and edge cases this new method catches, and the surprising ways it differs from prior tools.

The conversion also goes deeper into what this shift means for studios. Julian and Christoffer highlight how QA roles are evolving when testers can direct powerful AI agents without needing engineering resources. They also examine the line between automation and augmentation, arguing for the enduring value of human testers while outlining where AI can dramatically improve speed, coverage, and reporting. From auto-generating reproduction steps to fitting into broader ecosystems of AI coworkers, this episode offers a grounded, forward-looking take on how AI is transforming QA from the inside out.

Previous episode with Modl.ai: https://naavik.co/podcast/ai-powered-quality-assurance/

We’d like to thank Heroic Labs for making this episode possible! Thousands of studios have trusted Heroic Labs to help them focus on their games and not worry about gametech or scaling for success. To learn more and reach out, visit https://heroiclabs.com/?utm_source=Naavik&utm_medium=CPC&utm_campaign=Podcast 

We’d also like to thank Neon – a merchant of record with customizable webshops optimized for conversion – for making this episode possible! Neon is trusted by some of the biggest names in gaming and can help you sell direct without the typical overhead. To learn more, visit https://www.neonpay.com/?utm_source=naavik 

If you like the episode, please help others find us by leaving a 5-star rating or review! And if you have any comments, requests, or feedback shoot us a note at podcast@naavik.co.

Watch the episode: YouTube Channel

For more episodes and details: Podcast Website

Free newsletter: Naavik Digest

Follow us: Twitter | LinkedIn | Website

Sound design by Gavin Mc Cabe