Big Data, Selection Bias, and the Statistical Patterns of Mortality in Conflict

Megan Price and Patrick Ball (2014). SAIS Review of International Affairs © 2014 The Johns Hopkins University Press. This article first appeared in SAIS Review, Volume 34, Issue 1, Winter-Spring 2014, pages 9-20. All rights reserved.

Connect with HRDAG

If you’d like to stay informed about HRDAG events, blogposts, and news, connect with us on Twitter, Facebook or through our RSS feed. We also have a LinkedIn page. You may contact us directly via email at info @ hrdag.org. A note for persons in search of assistance with specific human rights cases: We are very sorry for your troubles and your suffering; however, HRDAG does not take on casework. If you need help with a human rights case, you might consider requesting it from the International Committee of the Red Cross (www.icrc.org). Photo: U.S. National Archives

Rise of the racist robots – how AI is learning all our worst impulses

“If you’re not careful, you risk automating the exact same biases these programs are supposed to eliminate,” says Kristian Lum, the lead statistician at the San Francisco-based, non-profit Human Rights Data Analysis Group (HRDAG). Last year, Lum and a co-author showed that PredPol, a program for police departments that predicts hotspots where future crime might occur, could potentially get stuck in a feedback loop of over-policing majority black and brown neighbourhoods. The program was “learning” from previous crime reports. For Samuel Sinyangwe, a justice activist and policy researcher, this kind of approach is “especially nefarious” because police can say: “We’re not being biased, we’re just doing what the math tells us.” And the public perception might be that the algorithms are impartial.

.Rproj Considered Harmful

We aim to produce code that is clear, replicatable across machines and operating systems, and that leaves an easy-to-follow audit trail.

Identifiers of Detained Children Have Implications for Data Security and Estimation

Identifiers being sequential could make possible estimations of the population of detained children.

How Data Analysis Confirmed the Bias in a Family Screening Tool

In Pittsburgh …

FAQs on Predictive Policing and Bias

Last month Significance magazine published an article on the topic of predictive policing and police bias, which I co-authored with William Isaac. Since then, we've published a blogpost about it and fielded a few recurring questions. Here they are, along with our responses. Do your findings still apply given that PredPol uses crime reports rather than arrests as training data? Because this article was meant for an audience that is not necessarily well-versed in criminal justice data and we were under a strict word limit, we simplified language in describing the data. The data we used is a version of the Oakland Police Department’s crime report...

Report on Measures of Fairness in NYC Risk Assessment Tool

The report tries to answer the question of whether a particular risk assessment model reinforces racial inequalities in the criminal justice system.

Learning to Learn: Reflections on My Time at HRDAG

So much of what I learned at HRDAG was intangible, and I'm grateful to have been able to go deep.

The Truth of Truth Commissions: Comparative Lessons from Haiti, South Africa, and Guatemala.

Audrey Chapman and Patrick Ball. “The Truth of Truth Commissions: Comparative Lessons from Haiti, South Africa, and Guatemala.” Human Rights Quarterly. 23(4):1-42. 2001

Quantifying Police Misconduct in Louisiana

HRDAG contributes to the project by helping to classify, filter, extract, and standardize the records so that they can be useful in the database.

Truth and Myth in Sierra Leone: An Empirical Analysis of the Conflict, 1991–2000

Tamy Guberek, Daniel Guzmán, Romesh Silva, Kristen Cibelli, Jana Asher, Scott Weikart, Patrick Ball, and Wendy Grossman. “Truth and Myth in Sierra Leone: An Empirical Analysis of the Conflict, 1991–2000″ (pdf). A report by the Benetech Human Rights Data Analysis Group and the American Bar Association. March 28, 2006.

Full Updated Statistical Analysis of Documentation of Killings in the Syrian Arab Republic

Price, Megan, Jeff Klingner, Anas Qtiesh, and Patrick Ball. 2013. Commissioned by the United Nations Office of the High Commissioner for Human Rights (OHCHR). Human Rights Data Analysis Group (June 13). © 2013 HRDAG. Creative Commons BY-NC-SA. [pdf via UN]

Matching the Libro Amarillo to Historical Human Rights Datasets in El Salvador

Speaking Truth to Power in Chad

Our hearty congratulations to our partners at Human Rights Watch (HRW), Association des Victimes des Crimes du Régime de Hissène Habré (AVCRP), Association Tchadienne pour la Promotion et la Défense des Droits de l’Homme (PDDH), and the Fédération Internationale des ligues des Droits de l’Homme (FIDH) on today's launch of "La Plaine des mortes: Le Tchad des Hissène Habré, 1982-1990." This book chronicles the alleged human rights abuses of Hissène Habré, the president of Chad between 1982 and 1990. It is the culmination of more than 13 years of investigations, documentation and research focused on uncovering the nature of political ...

Guatemala’s Bol de la Cruz Found Guilty

Today Guatemala’s former national police chief Colonel Héctor Rafael Bol de la Cruz was convicted and sentenced to 40 years in prison for his role in the 1984 kidnapping and disappearance of 27-year-old student union leader Fernando Garcia, who was last seen when officers detained him outside his home. Along with Bol de la Cruz, former senior police officer Jorge Gomez was also tried; he received a sentence of 40 years in prison. That verdict comes in part because of testimony this month by HRDAG’s Patrick Ball, who served as an expert witness and presented data analysis done with colleague Daniel Guzmán to assess the flow of thousands of ...

Frequently Asked Questions

Multiple Systems Estimation What is MSE? What do you mean by statistical inference? What is an overlap, and how do we know when lists overlap? How does MSE find the total number of violations? How was MSE originally developed? How does the Benetech Human Rights Program use MSE? 1. What is MSE? A: Multiple Systems Estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations. Return to Top 2. What do you mean by statistical inference? A: ...

Using Cemetery Information in the Search for the Disappeared: Lessons from a Pilot Study in Rionegro, Antioquia

Tamy Guberek, Daniel Guzmán, and Beatriz Vejarano. “Using Cemetery Information in the Search for the Disappeared: Lessons from a Pilot Study in Rionegro, Antioquia.” In Methodological Proposals for Documenting and Searching for Missing Persons in Colombia. (Available in Spanish) © 2010 EQUITAS. All rights reserved.

MEDIA MISREPRESENTATIONS OF THE CAVR REPORT

Press release from the Technical Secretariat of the Commission for Reception, Truth, and Reconciliation (CAVR) MEDIA MISREPRESENTATIONS OF THE CAVR REPORT Although not yet officially released, the 2500 page CAVR Report 'Chega!' has been the subject of several prominent reports in the media based on leaked versions of the Executive Summary and particularly its section on Recommendations. Stories on the Report have been carried by AFP, AP, the Japan Times, the Singapore Straits Times, Sydney Morning Herald, Lusa,Timor-Leste press and Bali Times - to name some. Regrettably some of these stories contained serious misrepresentations of the Report which ...

Cuentas y mediciones de la criminalidad y de la violencia

Exploración y análisis de los datas para comprender la realidad. Patrick Ball y Michael Reed Hurtado. 2015. Forensis 16, no. 1 (July): 529-545. © 2015 Instituto Nacional de Medicina Legal y Ciencias Forenses (República de Colombia).

<
1
…
8
9
10
…
21
>

Big Data, Selection Bias, and the Statistical Patterns of Mortality in Conflict

Connect with HRDAG

Rise of the racist robots – how AI is learning all our worst impulses

.Rproj Considered Harmful

Identifiers of Detained Children Have Implications for Data Security and Estimation

How Data Analysis Confirmed the Bias in a Family Screening Tool

FAQs on Predictive Policing and Bias

Report on Measures of Fairness in NYC Risk Assessment Tool

Learning to Learn: Reflections on My Time at HRDAG

The Truth of Truth Commissions: Comparative Lessons from Haiti, South Africa, and Guatemala.

Quantifying Police Misconduct in Louisiana

Truth and Myth in Sierra Leone: An Empirical Analysis of the Conflict, 1991–2000

Full Updated Statistical Analysis of Documentation of Killings in the Syrian Arab Republic

Matching the Libro Amarillo to Historical Human Rights Datasets in El Salvador

Speaking Truth to Power in Chad

Guatemala’s Bol de la Cruz Found Guilty

Frequently Asked Questions

Using Cemetery Information in the Search for the Disappeared: Lessons from a Pilot Study in Rionegro, Antioquia

MEDIA MISREPRESENTATIONS OF THE CAVR REPORT

Cuentas y mediciones de la criminalidad y de la violencia

Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents.

Donate

HRDAG

Selected projects

Stay informed about our work

Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents. Donate

HRDAG

Selected projects

Stay informed about our work

Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents.

Donate