The Challenge of Bias and Humanity

Predictive algorithms can be biased because of the people who write them. Algorithms are designed to make predictions based on data collected by humans. The company asks questions like, how will this b maintained? Who's actuall going to use this tool at the end of the day? But then we also ask, what's the worst that happens if we succeed? How would you know that it's wrong right?