HRDAG and the Allegheny Family Screening Tool
The Associated Press published an article about an investigation that HRDAG and the ACLU have been working on for more than a year. The article explains how the ACLU became involved in an examination of a tool that relies on artificial intelligence to predict which children could be at risk of harm. The tool is used by the Department of Human Services and the child welfare system in Allegheny County, Pennsylvania. Both the ACLU and the Department of Justice became concerned that the Family Screening Tool, as it is called, was “forever flagging” parents with disabilities and disproportionately removing their children to foster care.
The team’s analysis is quoted in the AP article: ”These predictors have the effect of casting permanent suspicion and offer no means of recourse for families marked by these indicators. They are forever seen as riskier to their children.” HRDAG is pleased to have had the opportunity to contribute to this work and to partner with the ACLU.
Related links:
The Allegheny Family Screening Tool’s Overestimation of Utility and Risk
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Allegheny Family Screening Tool’s Overestimation of Utility and Risk. Logic(s). 13 December, 2023. Issue 20.
The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
Here’s how an AI tool may flag families with disabilities
HRDAG contributed to work by the ACLU showing that a predictive tool used to guide responses to alleged child neglect may forever flag parents with disabilities. “These predictors have the effect of casting permanent suspicion and offer no means of recourse for families marked by these indicators,” according to the analysis from researchers at the ACLU and the nonprofit Human Rights Data Analysis Group. “They are forever seen as riskier to their children.”
AP story: https://apnews.com/article/child-protective-services-algorithms-artificial-intelligence-disability-02469a9ad3ed3e9a31ddae68838bc76e