AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of a Feedback Loop in AI Testing
The problem with AI systems is that we're going to see strange things in a real-world deployment. We can't test against all of the possible permutations of how it's going to interact with the environment. So DODs talked publicly about Project Maven when they first deployed it, that the performance dropped off dramatically from testing. And so just on a daily basis, taking information happening out in the operating environment, feeding them in making changes, updating the system has really important for AI systems to succeed.