Patrick Ball (2016). The case against a golden key. Foreign Affairs. September 14, 2016. ©2016 Council on Foreign Relations, Inc. All Rights Reserved.
Patrick Ball (2016). The case against a golden key. Foreign Affairs. September 14, 2016. ©2016 Council on Foreign Relations, Inc. All Rights Reserved.
Ball analyzed the data reporters had collected from a variety of sources – including on-the-ground interviews, police records, and human rights groups – and used a statistical technique called multiple systems estimation to roughly calculate the number of unreported deaths in three areas of the capital city Manila.
The team discovered that the number of drug-related killings was much higher than police had reported. The journalists, who published their findings last month in The Atlantic, documented 2,320 drug-linked killings over an 18-month period, approximately 1,400 more than the official number. Ball’s statistical analysis, which estimated the number of killings the reporters hadn’t heard about, found that close to 3,000 people could have been killed – more than three times the police figure.
Ball said there are both moral and technical reasons for making sure everyone who has been killed in mass violence is counted.
“The moral reason is because everyone who has been murdered should be remembered,” he said. “A terrible thing happened to them and we have an obligation as a society to justice and to dignity to remember them.”
Kristian Lum’s work on the HRDAG Policing Project is referred to here: “In fact, Lum argues, it’s not clear how well this model worked at depicting the situation in Oakland. Those data on drug crimes were biased, she now reports. The problem was not deliberate, she says. Rather, data collectors just missed some criminals and crime sites. So data on them never made it into her model.”
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
In this free, downloadable report, Mike Barlow of O’Reilly Media cites several examples of how data and the work of data scientists have made a measurable impact on organizations such as DataKind, a group that connects socially minded data scientists with organizations working to address critical humanitarian issues. HRDAG—and executive director Megan Price—is one of the first organizations whose work is mentioned.
Wilkerson was speaking at the inaugural Conference on Fairness, Accountability, and Transparency, a gathering of academics and policymakers working to make the algorithms that govern growing swaths of our lives more just. The woman who’d invited him there was Kristian Lum, the 34-year-old lead statistician at the Human Rights Data Analysis Group, a San Francisco-based non-profit that has spent more than two decades applying advanced statistical models to expose human rights violations around the world. For the past three years, Lum has deployed those methods to tackle an issue closer to home: the growing use of machine learning tools in America’s criminal justice system.
“Every kind of classification system – human or machine – has several kinds of errors it might make,” [Patrick Ball] says. “To frame that in a machine learning context, what kind of error do we want the machine to make?” HRDAG’s work on predictive policing shows that “predictive policing” finds patterns in police records, not patterns in occurrence of crime.
If we could glean key missing information from those fields, we would be able to use more records.
Gen. José Guillermo García, El Salvador’s defense minister from 1979 to 1983, may be deported from Florida to El Salvador because of his involvement in war crimes that occurred under his command. The recommendation comes from a Miami immigration judge, whose decision was supported with expert testimony from Stanford political science professor Terry Karl, who presented extensive statistical analysis of killings, disappearances, kidnappings, torture and other crimes under Gen. García’s watch. The statistical analysis was a joint effort between Professor Karl and Amelia Hoover Green and Patrick Ball of Human Rights Data Analysis Group (HRDAG). ...
HRDAG has been working with the Historic Archive of the National Police in Guatemala (hereafter, the Archive) for the past seven years. The Archive contains a treasure trove of data recorded and kept by the Guatemalan National Police over the past century. When the Archive was first discovered in 2005, researchers there immediately recognized both the value and fragility of the tens of millions of documents. As a result, they reached out to HRDAG, and we reached out to volunteers at Westat to devise a plan to estimate the contents of the entire Archive as quickly as possible in case the documents were destroyed or access to them was limited. ...
How do police officer booking decisions affect pre-trial risk assessment tools relied upon by judges?
Patrick Ball won the Karl E. Peace Award for Outstanding Statistical Contributions for the Betterment of Society at the 2018 Joint Statistical Meeting.
In 1984, as a fresh PhD, I heard Richard Savage give his presidential address at the Joint Statistical Meetings in Philadelphia. He called it "Hard/Soft Problems" and made a big pitch for statisticians to get involved in human rights data analysis. It was inspirational, and I was immediately sold. I started working with the American Statistical Association's Committee on Scientific Freedom and Human Rights (now chaired by HRDAG's own Megan Price). Over time, a growing set of statisticians became involved, initially in letter-writing campaigns to help dissident statisticians (and other quantitative academics—economists seemed to have a particular ...
In December 2006, Human Rights Watch (HRW) issued a report documenting torture and unlawful killings committed by Bangladesh's Rapid Action Battalion (RAB), an elite anti-crime and anti-terrorism force. According to HRW, many of the deaths for which RAB is responsible resulted from summary executions or extreme physical abuse. The statistical analysis presented in the report, "Judge, Jury, and Death: Torture and Executions by Bangladesh's Elite Security Force," was conducted by Romesh Silva, a statistician who worked within the Benetech Human Rights Program at the time, and who now works with HRDAG.
While researching these incidents, HRW compiled ...
We’re pleased to announce that Camille Fassett has joined our team as our new data science fellow.
For years I have been engaged in a quantitative study at Guatemala’s Historic Archive of the National Police, or AHPN. (See the blogposts below.) In this study coders collect data on sheets of paper according to criteria established and explained in manuals. But when collecting data, there’s always room for human error—this is why the validity of the study hinges on verifying that coders use the correct criteria.
It is important to mention that the mainstay of coding is the use of a controlled vocabulary. A controlled vocabulary gives analysts a framework, or frame of reference, when converting qualitative information into categories ...
I have made it my personal objective to amplify HRDAG's message of being extra careful and scientifically rigorous with human rights data.
(This post is co-authored by Patrick Ball and Kristian Lum.)
In early March, the Bureau of Justice Statistics published a report that estimated that in the period 2003-2009 and 2011, there were approximately 7427 homicides committed by police in the US. We responded that the method the analysts used, capture-recapture with two databases, is vulnerable to underestimation if the databases exhibit positive dependence. We conduct a thorough sensitivity analysis on the original independence model as applied to the police homicides databases. We used information from several other countries where our partners created multiple databases of homicides. We ...
