(This post is co-authored by Patrick Ball and Kristian Lum.)
Today the Bureau of Justice Statistics (BJS) released a report on their effort to document “all deaths that occur during the process of arrest in the United States.” The analysis estimates that the Arrest-Related Deaths (ARD) program covers only 34-49% of these deaths. A parallel program by the FBI (the Supplementary Homicide Reports, SHR) is estimated to cover approximately the same proportion of deaths. Even taking into consideration both programs, 28% of all police homicides remain unreported.
In order to estimate the total number of homicides that appear on neither the ARD or ...
Last Thursday, HRDAG co-founder and director of research Megan Price presented at Strata, the conference for data scientists and people who work with "big data." In her talk, she addressed the question of how we can know the actual number of conflict casualties in Syrian. Her short answer was, "We don't know." The longer answer was that we have a very good idea of how many conflict casualties have been reported, by several documentation groups, and that we're working on analyzing (more…)
Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
Structural Zero Issue 01
Jun 03, 2025
Part One of Our Three Part “Gathering the Data” Series
As a statistician, I spend most days trying to wrangle and analyze massive data sets. The specific data I deal with is documentation of human rights violations. My job is to make sense of data that I know is incomplete and answer questions about the past using statistical analysis and scientific reasoning.
But where does this data come from? How was it generated, and how do human rights advocates and researchers access it and secure it?
To kick off our new newsletter Structural Zero, I’ll be writing a ...
Almost a quarter century ago, on November 16, 1989, six Jesuit scholars, their housekeeper and her 15-year-old daughter were massacred inside the University of Central America (UCA) in San Salvador, El Salvador. Their chief target was the rector of the country’s leading university. The murders were carried out by members of the elite Atlacatl Battalion, acting on the direct orders of the highest-ranking members of the Salvadoran military. The United Nations–sponsored Truth Commission for El Salvador found that members of the Salvadoran military's high command “gave...the order to kill Father Ignacio Ellacuría and to leave no witnesses.” ...
Patrick Ball, director of research at the Human Rights Data Analysis Group, and a statistician who has conducted similar estimates of violent deaths in conflicts in other regions, said the study was strong and well reasoned. But he cautioned that the authors may have underestimated the amount of uncertainty caused by the ongoing conflict.
The authors used different variations of mathematical models in their calculations, but Dr. Ball said that rather than presenting a single figure — 64,260 deaths — as the estimate, it may have been more appropriate to present the number of deaths as a range from 47,457 to 88,332 deaths, a span that encompasses all of the estimates produced by modeling the overlap among the three lists.
“It’s really hard to do this kind of thing in the middle of a conflict,” Dr. Ball said. “It takes time, and it takes access. I think you could say the range is larger, and that would be plausible.”
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Will you help HRDAG advance human rights?
We’re very happy to announce that our executive director, Patrick Ball, has been elected as a Fellow of the American Statistical Association (ASA), as announced by ASA President Nathaniel Schenker. Patrick is one of 63 new ASA Fellows to be honored this year in a ceremony at the Joint Statistical Meetings, which will take place this August 5 in Boston, Massachusetts. (more…)
HRDAG’s core values all have a connection to Scott Weikart, 1951–2023.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Bailey Passmore + Larry Barrett. 2025. Shots fired: Can technology really keep us safe from gunfire? Significance, Volume 22, Issue 4, July 2025, Pages 34–37. 27 May 2025. © Royal Statistical Society 2025. https://doi.org/10.1093/jrssig/qmaf042
Bailey Passmore + Larry Barrett. 2025. Shots fired: Can technology really keep us safe from gunfire? Significance, Volume 22, Issue 4, July 2025, Pages 34–37. 27 May 2025. © Royal Statistical Society 2025. https://doi.org/10.1093/jrssig/qmaf042
HRDAG researchers and analysts at Peru's Truth and Reconciliation Commission (TRC) estimated conflict mortality due to violence using Capture-Recapture methods.
In July 2009, HRDAG concluded a three-year project with the Liberian Truth and Reconciliation Commission (TRC) to help clarify Liberia’s violent history and hold perpetrators accountable. A military coup in 1979 sparked 24 years of civil war in Liberia where warring factions subjected civilians to severe human rights abuses. The TRC sought to determine whether these violations represented a systematic pattern or policy. This chapter describes how HRDAG developed a statistical analysis of the more than 17,000 victim and witness statements collected by the TRC and applied Ball’s “Who Did What To Whom?” methodology. HRDAG scientist Kristen ...
I will use the skills and culture I learned from HRDAG’s team to understand how the conflict has affected the people in my country.
There may have been more undocumented World War II-era Korean "comfort women" than known.
Ten data nerds gathered in a large hilltop beach house to analyze counts of killings from several war-torn countries. The time was January 16-20, 2014, the place was near San Francisco, the agenda was packed, and I was excited to be there.
Having defended my dissertation at Carnegie Mellon University just days before, I had often supposed that my thesis on a generalization of
log-linear models for capture-recapture might serve little other purpose than to fill a line on my curriculum vitae. This perception faded after a mid-2013 discussion with Patrick convinced me that HRDAG's data challenges could easily be the best match to my research ...
Patrick Ball (2016). Why Just Counting the Dead in Syria Won’t Bring Them Justice. Foreign Policy. October 19, 2016. © 2016 Foreign Policy.
Patrick Ball (2016). Why Just Counting the Dead in Syria Won’t Bring Them Justice. Foreign Policy. October 19, 2016. © 2016 Foreign Policy.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and "Official" Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and “Official” Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
