I look at the beach and then at the table surrounded by nerds, deep in thought and conversation about Dirichlet priors, matching algorithms, and armed conflicts. This peculiar (in the best way) environment catalyzes a moment of reflection: how did I get here?
Four years ago, as a second-year statistics PhD student, I watched "Guatemala: The Secret Files" on PBS Frontline World. I listened to stories of family members who disappeared without answers or justice. Then the story shifted to the work being done by archivists and data experts at Guatemala's Historic Archive of the National Police. The scientists' pursuit of the truth energized me. I ...
Dear friends,
Our spirits were really on the ground on Wednesday, but they lifted at the board meeting we had at the Human Rights Data Analysis Group on Thursday. Executive Director Megan Price, Director of Research Patrick Ball, and the Board drafted these thoughts which we'd like to share with you.
For more than twenty-five years, we have held heads of state accountable for human rights violations. We support our partners and advocates in the human rights field. They collect data which we analyze using technical and scientific expertise. Those scientific results bring clarity to human rights violence and support the fight for justice.
...
This blog is a part of International Justice Monitor’s technology for truth series, which focuses on the use of technology for evidence and features views from key proponents in the field.
As highlighted by other posts in this series, emerging technology is increasing the amount and type of information available, in some contexts, to criminal and other investigations. Much of what is produced by these emerging technologies (Facebook posts, tweets, YouTube videos, text messages) falls in the category we refer to as “found” data. By “found” data we mean data not generated for a specific investigation, but instead, that is generated for ...
As we get ready to begin our fourth year as an independent nonprofit, we are, as always, indebted to our Advisory Board and to our funders for their support and vision. We’re finishing up a busy year that took us to Dakar (for the trial of former Chadian dictator Hissène Habré), Pristina (for the release of the Kosovo Memory Book), Colombia (for work on a book about the Guatemalan Police Archives), and kept us busy here at home working on police violence statistics. But one of our biggest victories has been to score a new, talented, wise Advisory Board member—Michael Bear Kleinman, whom we first met when he was working with Humanity United.
...
In our work, we merge many databases to figure out how many people have been killed in violent conflict. Merging is a lot harder than you might think.
Many of the database records refer to the same people--the records are duplicated. We want to identify and link all the records that refer to the same victims so that each victim is counted only once, and so that we can use the structure of overlapping records to do multiple systems estimation.
Merging records that refer to the same person is called entity resolution, database deduplication, or record linkage. For definitive overviews of the field, see Scheuren, Herzog, and Winkler, Data Quality ...
Exploración y análisis de los datas para comprender la realidad. Patrick Ball y Michael Reed Hurtado. 2015. Forensis 16, no. 1 (July): 529-545. © 2015 Instituto Nacional de Medicina Legal y Ciencias Forenses (República de Colombia).
In this interview with Colombian newspaper El Espectador, Patrick Ball is quoted as saying “la gente que no conoce de álgebra nunca debería hacer estadísticas” (people who don’t know algebra should never do statistics).
Carl Bialik of 538 Politics reports on a new HRDAG study authored by Kristian Lum and Patrick Ball regarding the Bureau of Justice Statistics report about the number of annual police killings, which was issued a few weeks ago. As Bialik writes, the HRDAG scientists extrapolated from their work in five other countries (Colombia, Guatemala, Kosovo, Sierra Leone and Syria) to estimate that the BJS study missed approximately one quarter of the total number of killings by police.
“Patrick Ball, a statistician at the US-based Human Rights Data Analysis Group not involved in the research, has used capture-recapture methods to estimate death tolls for conflicts in Guatemala, Kosovo, Peru and Colombia.
Ball told AFP the well-tested technique had been used for centuries and that the researchers had reached “a good estimate” for Gaza.”