AI Frontiers: The future of causal reasoning with Emre Kiciman and Amit Sharma
Microsoft Research Podcast
00:00
The Importance of Construct Validity in Black Box Testing
Amitai Etzioni: I find this concept of construct validity pretty fascinating here. And you stress the importance of it for doing this kind of black box testing where you don't actually have an explicit model for how the model is doing what it's doing. You talked about memorization as one important test where you want to have a valid construct. But I think even deeper than that, there's an aspect of your mental model, your beliefs about what the algorithm is doing and how relevant the testing would be to future performance or performance on future tasks. That's my mental model of what I think it's doing," he says.
Transcript
Play full episode
