How do police officer booking decisions affect pre-trial risk assessment tools relied upon by judges?
Illuminating Data's Dark Side: Big data create conveniences, but we must consider who designs these tools, who benefits from them, and who is left out of the equation.
On September 7, 2018, Kristian Lum and Patrick Ball participated in a panel at Disrupt San Francisco by TechCrunch. The talk was titled "Dismantling Algorithmic Bias." Brian Brackeen of Kairos was part of the panel as well, and the talk was moderated by TechCrunch reporter Megan Rose Dickey.
From the TechCrunch website, "Disrupt is a 3-day conference focused on breaking technology news and developments with big-name thought leaders who are making waves in the industry."
Video of the talk is available here, and Megan Rose Dickey's coverage is here.
Over the last few years, we've tried to make the data organized in our projects publicly accessible. We have encouraged our partners to publish the data at the completion of the project. We continue to believe it is important to offer access to the data used in our projects for the sake of transparency as well as to encourage further research and analysis. However, we are increasingly concerned about how raw data are used. Data collected by what we can observe is what statisticians call a convenience sample, which is subject to selection bias.
We're keeping these datasets available for researchers who want to use them for simulation or estimation ...
HRDAG contributes to the project by helping to classify, filter, extract, and standardize the records so that they can be useful in the database.
Laurel Eckhouse (2017). Big data may be reinforcing racial bias in the criminal justice system. Washington Post. 10 February 2017. © 2017 Washington Post.
Laurel Eckhouse (2017). Big data may be reinforcing racial bias in the criminal justice system. Washington Post. 10 February 2017. © 2017 Washington Post.
Three months after the announcement of the momentous verdict finding former Chadian president Hissène Habré guilty of crimes against humanity, the presiding judges have released the full, written 681-page judgment of the court. Testimony given by HRDAG’s director of research, Patrick Ball, is mentioned at three points in the verdict.
The judges included in their written judgment the HRDAG analysis that the mortality rate in Habré prisons was staggeringly high—much higher than the mortality rate among the population as a whole. Here’s an excerpt from the judgment, page 358 (translated by Google):
The statistical expert, Patrick Ball, ...
We're thinking about how rigorous analysis can fortify debates about components of our criminal justice system such as cash bail, pretrial risk assessment and fairness in general.
Donating to HRDAG
Thank you for your interest in making a donation to the Human Rights Data Analysis Group to help us use science to support our partners in the human rights world.
You can make a donation by credit card on the Community Partners® Network for Good page. HRDAG is a "project of Community Partners," and right below the section on payment information, you'll be able to select "Human Rights Data Analysis Group" from a drop-down menu. (On most browsers, if you use this link, HRDAG will be pre-selected on the drop-down menu.)
This transaction will appear on your credit card statement as "Network for Good."
If you donate by check, ...
Megan Price, Jeff Klingner, and Patrick Ball (2013). The Benetech Human Rights Program, commissioned by the United Nations Office of the High Commissioner for Human Rights (OHCHR). January 2, 2013. © 2013 HRDAG. Creative Commons BY-NC-SA.
Large-scale human rights violations in Timor-Leste began in 1975 when the Indonesian government invaded the small island and continued until Timorese independence in 1999. Disappearances, torture, forced displacement and extra-judicial killings took place during the Indonesian occupation compounded by a severe famine. Estimates of deaths ranged from 50,000 to 200,000, but individual sources reflected only a fraction of total fatalities. The Commission for Reception, Truth and Reconciliation in East Timor (CAVR) asked HRDAG to investigate abuses during the conflict. This chapter describes how Ball and HRDAG scientists Romesh Silva and Scott Weikart ...
Solving for X documents Patrick's team as they travel to Guatemala, Kosovo, and Liberia, helping human rights supporters apply sophisticated computer analysis to human rights events.
The World According to Artificial Intelligence: Targeted by Algorithm (Part 1)
The Big Picture: The World According to AI explores how artificial intelligence is being used today, and what it means to those on its receiving end.
Patrick Ball is interviewed: “Machine learning is pretty good at finding elements out of a huge pool of non-elements… But we’ll get a lot of false positives along the way.”
The modular nature of the workflow and use of Git allowed us to work on different parts of the project from across the country.
<< Previous post: MSE: The Basics
Q3. What are the steps in an MSE analysis?
Q4. What does data collection look like in the human rights context? What kind of data do you collect?
Q5. [In depth] Do you include unnamed or anonymous victims in the matching process?
Q6. What do you mean by "cleaning" and "canonicalization?"
Q7. [In depth] What are some of the challenges of canonicalization? (more…)
In this story, Carl Bialik of FiveThirtyEight interviews HRDAG executive director Patrick Ball about the process of de-duplication, integration of databases, and machine-learning in the recent enumeration of reported casualties in Syria.
New reports of old deaths come in all the time, Ball said, making it tough to maintain a database. The duplicate-removal process means “it’s a lot like redoing the whole project each time,” he said.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG's Kristian Lum and Tarak Shah served as Project Members and made contributions to the primer.>>
Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG’s Kristian Lum and Tarak Shah served as Project Members and made significant contributions to the primer.>>
