Episode 7: There Are Now 15 Competing Evaluation Metrics (ft. Dr. Jeremy Kahn). December 12, 2022
Mystery AI Hype Theater 3000
00:00
The Importance of Empowering Disinformation
I don't see how it is then integrated into the evaluation of the artifact in a way that reflects the fact that generating disinformation is not actually a goal. And I think this is a weak spot here that we're like, and yes, we can generate disinformation. We're going to evaluate how well that works. So for instance, there's not even a line that really goes through Twitter or Reddit, because there is kind of an impossible heterogeneity in that.
Transcript
Play full episode
