National Security Seminar: Artificial Intelligence in Nuclear Operations
CNA Talks: A National Security Podcast
00:00
The Importance of a Feedback Loop in AI Testing
The problem with AI systems is that we're going to see strange things in a real-world deployment. We can't test against all of the possible permutations of how it's going to interact with the environment. So DODs talked publicly about Project Maven when they first deployed it, that the performance dropped off dramatically from testing. And so just on a daily basis, taking information happening out in the operating environment, feeding them in making changes, updating the system has really important for AI systems to succeed.
Transcript
Play full episode
