Random Selection and the Risk Score

We go in-depth on an article that has not received the attention it is due: an investigation into an automated welfare fraud system in the Netherlands, which is based on unprecedented access to the machine learning model, its training data, and operational handbooks. Through a deep analysis of the systems mechanics, this investigation goes beyond validating what we already know to be true about how such algorithms discriminate. It shows how these systems are complex and targeted in their discrimination, while also being simplistic and arbitrary in their decisions. Articles we discuss ••• Inside the Suspicion Machine https://www.wired.com/story/welfare-state-algorithms/ ••• Welfare surveillance system violates human rights, Dutch court rules https://www.theguardian.com/technology/2020/feb/05/welfare-surveillance-system-violates-human-rights-dutch-court-rules Subscribe to hear more analysis and commentary in our premium episodes every week! https://www.patreon.com/thismachinekills Hosted by Jathan Sadowski (www.twitter.com/jathansadowski) and Edward Ongweso Jr. (www.twitter.com/bigblackjacobin). Production / Music by Jereme Brown (www.twitter.com/braunestahl)