AI and Discrimination

AI decision-making can lead to discrimination in various ways. For instance, facial recognition software has been found to have difficulty accurately identifying people with black skin, which can result in unfair treatment, such as denying boarding passes or wrongful arrests. Similarly, in the EU settlement scheme, the use of AI to determine eligibility may discriminate against individuals with irregular employment patterns or from low-income backgrounds. Another example is in money lending or mortgages, where AI-based decisions could discriminate against those who are not married but in civil partnerships. It is crucial to examine how AI decision-making intersects with discrimination law and the challenges it poses.