
On METR's AI Coding RCT
Don't Worry About the Vase Podcast
00:00
The Paradox of AI Coding Assistants
This chapter reveals surprising findings from a randomized controlled trial on AI coding tools, indicating that experienced developers were 19% slower with AI assistance than without. It emphasizes the importance of thorough experimentation in evaluating the true impact of AI on coding productivity and highlights the complexities involved in its integration.
Transcript
Play full episode