Microsoft Research Podcast cover image

AI Frontiers: The future of causal reasoning with Emre Kiciman and Amit Sharma

Microsoft Research Podcast

CHAPTER

The Importance of Construct Validity in Black Box Testing

Amitai Etzioni: I find this concept of construct validity pretty fascinating here. And you stress the importance of it for doing this kind of black box testing where you don't actually have an explicit model for how the model is doing what it's doing. You talked about memorization as one important test where you want to have a valid construct. But I think even deeper than that, there's an aspect of your mental model, your beliefs about what the algorithm is doing and how relevant the testing would be to future performance or performance on future tasks. That's my mental model of what I think it's doing," he says.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner