Ball analyzed the data reporters had collected from a variety of sources – including on-the-ground interviews, police records, and human rights groups – and used a statistical technique called multiple systems estimation to roughly calculate the number of unreported deaths in three areas of the capital city Manila.
The team discovered that the number of drug-related killings was much higher than police had reported. The journalists, who published their findings last month in The Atlantic, documented 2,320 drug-linked killings over an 18-month period, approximately 1,400 more than the official number. Ball’s statistical analysis, which estimated the number of killings the reporters hadn’t heard about, found that close to 3,000 people could have been killed – more than three times the police figure.
Ball said there are both moral and technical reasons for making sure everyone who has been killed in mass violence is counted.
“The moral reason is because everyone who has been murdered should be remembered,” he said. “A terrible thing happened to them and we have an obligation as a society to justice and to dignity to remember them.”
Dec 10, 1991
HRDAG is born when Patrick Ball begins database design at the Human Rights Office of the Salvadoran Lutheran Church. The work soon moves to the non-governmental Human Rights Commission (CDHES). The database analysis identified the 100 worst officers in the Salvadoran military — who were forced to resign as part of the peace process.
1994
Patrick publishes A Definit...
Help us hold human rights violators accountable!
Last month Significance magazine published an article on the topic of predictive policing and police bias, which I co-authored with William Isaac. Since then, we've published a blogpost about it and fielded a few recurring questions. Here they are, along with our responses.
Do your findings still apply given that PredPol uses crime reports rather than arrests as training data?
Because this article was meant for an audience that is not necessarily well-versed in criminal justice data and we were under a strict word limit, we simplified language in describing the data. The data we used is a version of the Oakland Police Department’s crime report...
In 2018, HRDAG collaborated on work in Guatemala, US criminal justice, and more.
James Johndrow, Patrick Ball, Maria Gargiulo, and Kristian Lum. (2020). Estimating the Number of SARS-CoV-2 Infections and the Impact of Mitigation Policies in the United States. Harvard Data Science Review. 24 November, 2020. © The Authors, 2020, CC BY 4.0. https://doi.org/10.1162/99608f92.7679a1ed
James Johndrow, Patrick Ball, Maria Gargiulo, and Kristian Lum. (2020). Estimating the Number of SARS-CoV-2 Infections and the Impact of Mitigation Policies in the United States. Harvard Data Science Review. 24 November, 2020. © The Authors, 2020, CC BY 4.0. https://doi.org/10.1162/99608f92.7679a1ed
Issues surrounding policing in the United States are at the forefront of our national attention. Among these is the use of “predictive policing,” which is the application of statistical or machine learning models to police data, with the goal of predicting where or by whom crime will be committed in the future. Today Significance magazine published an article on this topic that I co-authored with William Isaac. Significance has kindly made this article open access (free!) for all of October. In the article we demonstrate the mechanism by which the use of predictive policing software may amplify the biases that already pervade our criminal ...
Patrick Ball, Ethan Hee-Seok Shin and Hyerin Yang (2018). There may have been 14 undocumented Korean “comfort women” in Palembang, Indonesia. Human Rights Data Analysis Group. 26 December 2018.© 2018 HRDAG. Creative Commons.
Patrick Ball, Ethan Hee-Seok Shin and Hyerin Yang (2018). There may have been 14 undocumented Korean “comfort women” in Palembang, Indonesia. Human Rights Data Analysis Group. 26 December 2018.© 2018 HRDAG. Creative Commons.
Access to the records contained in archives is a concern shared by many. Archives support memory and free access to them strengthens democratic processes. Everyone should be allowed to see first-hand the records contained in an archive and be free to interpret them as needed.
Access to archives can increase knowledge on various topics and opens opportunities for different fields of knowledge. (more…)
Principled Data Processing is a way to prove to someone, usually yourself, that what you did was right.
HRDAG collaborated with Data for Justice Project on a tool tool allowing members of the public to visualize and analyze nearly a decade of Boston Police Department SWAT team after-action reports. Tarak Shah of HRDAG is named in the acknowledgments.
Bing Wang has joined HRDAG as a Visiting Data Science Student until the summer of 2020.
Mailing List Subscription
We use Mailchimp to help us keep track of community members who want to stay informed about what HRDAG is doing and thinking. If you self-subscribe to our list, we will never share your contact information. We will never subscribe anyone who does not explicitly agree to a subscription.
Over the course of a year, we mail quarterly letters and fundraising letters, as well as one or two updates as events demand. If, during the course of a fundraising campaign, you make a donation, we will do our best to remove you from the remainder of fundraising mailings that year. We may use your contact information to invite you to ...
It could make sense to use Rust as a data journalist for in-browser computations, and other thoughts from RustConf.
Some of the earliest large-scale human rights information projects happened in El Salvador. One was developed by Patrick Ball at the Salvadoran non-governmental Human Rights Commission, also known as Comision de Derechos Humanos de El Salvador (CDHES-ng). Between 1977 and 1990, more than 9,000 testimonies were taken in an effort to document the nature and scope of the bloody conflict between the army and the Farabundo Marti National Liberation Front (FMLN). Starting in 1991, Patrick worked with CDHES staff to organize the information in an early computer database. They linked reported human rights violations with the career structures of individual ...
(This post is co-authored by Patrick Ball and Kristian Lum.)
Today the Bureau of Justice Statistics (BJS) released a report on their effort to document “all deaths that occur during the process of arrest in the United States.” The analysis estimates that the Arrest-Related Deaths (ARD) program covers only 34-49% of these deaths. A parallel program by the FBI (the Supplementary Homicide Reports, SHR) is estimated to cover approximately the same proportion of deaths. Even taking into consideration both programs, 28% of all police homicides remain unreported.
In order to estimate the total number of homicides that appear on neither the ARD or ...
Last Thursday, HRDAG co-founder and director of research Megan Price presented at Strata, the conference for data scientists and people who work with "big data." In her talk, she addressed the question of how we can know the actual number of conflict casualties in Syrian. Her short answer was, "We don't know." The longer answer was that we have a very good idea of how many conflict casualties have been reported, by several documentation groups, and that we're working on analyzing (more…)
