The Black Box Concept of AI Systems

In earlier models that switch was turned on and it could remember from one conversation to the next. People started feeling creeped out that the model knew them better than their best friends did. Now, what they're learning is a mathematical function that is more complicated than anyone can really understand. And if the system were built a different way, we would be able to know,. okay, this piece of the system does this job. This piece of thesystem does this other job.