
Evaluating Language Models
The Data Exchange with Ben Lorica
00:00
The Importance of Data
There are copyright issues, but there's also security issues. For example, data poisoning is an attack that an adversary can inject data into a training set of a model and cause it to do whatever the adversary wants. So we're dealing with these models that might appear to be working fine, but may have catastrophic failure modes in certain regimes.
Transcript
Play full episode