I look at the beach and then at the table surrounded by nerds, deep in thought and conversation about Dirichlet priors, matching algorithms, and armed conflicts. This peculiar (in the best way) environment catalyzes a moment of reflection: how did I get here?
Four years ago, as a second-year statistics PhD student, I watched "Guatemala: The Secret Files" on PBS Frontline World. I listened to stories of family members who disappeared without answers or justice. Then the story shifted to the work being done by archivists and data experts at Guatemala's Historic Archive of the National Police. The scientists' pursuit of the truth energized me. I ...
We are saddened by the passing of Steve Fienberg yesterday in Pittsburgh, at the age of 74. He is perhaps best known around the world for bringing statistics to science and public policy and was a beloved professor at Carnegie Mellon University. At HRDAG we are in awe of and grateful for the work Steve did formalizing multiple systems estimation. His work on that front blazed a trail and essentially enabled all of our most important analytical work at the intersection of human rights and statistical science.
If we are to reduce the amount of human violence in the world, the first task is to determine the scope of the violence, to know how much of ...
This blog is a part of International Justice Monitor’s technology for truth series, which focuses on the use of technology for evidence and features views from key proponents in the field.
As highlighted by other posts in this series, emerging technology is increasing the amount and type of information available, in some contexts, to criminal and other investigations. Much of what is produced by these emerging technologies (Facebook posts, tweets, YouTube videos, text messages) falls in the category we refer to as “found” data. By “found” data we mean data not generated for a specific investigation, but instead, that is generated for ...
As we get ready to begin our fourth year as an independent nonprofit, we are, as always, indebted to our Advisory Board and to our funders for their support and vision. We’re finishing up a busy year that took us to Dakar (for the trial of former Chadian dictator Hissène Habré), Pristina (for the release of the Kosovo Memory Book), Colombia (for work on a book about the Guatemalan Police Archives), and kept us busy here at home working on police violence statistics. But one of our biggest victories has been to score a new, talented, wise Advisory Board member—Michael Bear Kleinman, whom we first met when he was working with Humanity United.
...
In our work, we merge many databases to figure out how many people have been killed in violent conflict. Merging is a lot harder than you might think.
Many of the database records refer to the same people--the records are duplicated. We want to identify and link all the records that refer to the same victims so that each victim is counted only once, and so that we can use the structure of overlapping records to do multiple systems estimation.
Merging records that refer to the same person is called entity resolution, database deduplication, or record linkage. For definitive overviews of the field, see Scheuren, Herzog, and Winkler, Data Quality ...
Exploración y análisis de los datas para comprender la realidad. Patrick Ball y Michael Reed Hurtado. 2015. Forensis 16, no. 1 (July): 529-545. © 2015 Instituto Nacional de Medicina Legal y Ciencias Forenses (República de Colombia).
In this interview with Colombian newspaper El Espectador, Patrick Ball is quoted as saying “la gente que no conoce de álgebra nunca debería hacer estadísticas” (people who don’t know algebra should never do statistics).
Carl Bialik of 538 Politics reports on a new HRDAG study authored by Kristian Lum and Patrick Ball regarding the Bureau of Justice Statistics report about the number of annual police killings, which was issued a few weeks ago. As Bialik writes, the HRDAG scientists extrapolated from their work in five other countries (Colombia, Guatemala, Kosovo, Sierra Leone and Syria) to estimate that the BJS study missed approximately one quarter of the total number of killings by police.
Dear friends,
Our spirits were really on the ground on Wednesday, but they lifted at the board meeting we had at the Human Rights Data Analysis Group on Thursday. Executive Director Megan Price, Director of Research Patrick Ball, and the Board drafted these thoughts which we'd like to share with you.
For more than twenty-five years, we have held heads of state accountable for human rights violations. We support our partners and advocates in the human rights field. They collect data which we analyze using technical and scientific expertise. Those scientific results bring clarity to human rights violence and support the fight for justice.
...
Structural Zero Issue 01
Jun 03, 2025
Part One of Our Three Part “Gathering the Data” Series
As a statistician, I spend most days trying to wrangle and analyze massive data sets. The specific data I deal with is documentation of human rights violations. My job is to make sense of data that I know is incomplete and answer questions about the past using statistical analysis and scientific reasoning.
But where does this data come from? How was it generated, and how do human rights advocates and researchers access it and secure it?
To kick off our new newsletter Structural Zero, I’ll be writing a ...