Fed Gov Today The Pentagon’s AI Gamble: Can Automation Save U.S. Weapons Testing?
Jun 26, 2025
Doug Schmidt, former Director of the Office of Operational Test and Evaluation at the Department of Defense, now Dean at William and Mary, reveals pressing challenges in military weapons testing. He discusses a new directive emphasizing automation and AI, which could reshape the landscape of defense. Schmidt highlights the struggle to integrate innovative, low-cost systems from nontraditional contractors. He raises concerns about the balance between rapid advancement and ensuring safety and effectiveness, as well as the critical R&D needed to align human expertise with automation.
AI Snips
Chapters
Transcript
Episode notes
Testing Challenges in Rapid Systems
- Rapid capability systems by non-traditional providers pose testing and integration challenges.
- Downsizing staff threatens the ability to validate operational realism and system integration effectively.
Limits of Automation in Testing
- Automation and AI are promising but need responsible application with deep knowledge of tested systems.
- Advanced digital twins cost more to develop than traditional live tests and need substantial R&D investment.
Collaborate to Improve AI Testing
- Leverage expertise from service test orgs, national labs, and research centers to improve testing with AI.
- Break down silos and foster collaboration to share best practices for automation and AI testing.