Pulling Back the Curtain on LLMs & Policing Data

Structural Zero Issue 04 September 30, 2025 Artificial intelligence is transforming how we work with information. At HRDAG, that changes how I do my job every day. My most recent project was using LLMs to explore and parse vast quantities of data about police abuses in California. In this newsletter, I’ll pull back the curtain on that work. I’ll describe how a diverse coalition gathered more than a million pages of documents about police misconduct in California and how LLMs helped us make sense of them in ways that wouldn’t have been possible before the advent of this technology. In addition to understanding my work, I hope that this ...

Learning Day by Day: Quantitative Research at the AHPN

Working at the Historic Archive of the National Police (AHPN) of Guatemala, there are many skills I learned on the job. My many years of work on the team that studies the recovered documents have been like a custom-made course in how to do quantitative research. The Archive documents I study are the result of 36 years of creation during civil war (1960 to 1996). Many of these documents are simply administrative—but we are able to use them to understand patterns that occurred during the conflict, to get a sense of what mattered to the National Police and what didn’t. Our quantitative research shows us the Police behavior in broad strokes. ...

El problema del asesinato a líderes es más grave de lo que se piensa

Una investigación de Dejusticia y Human Rights Data Analysis Group asegura que en Colombia hay un subregistro de los asesinatos de líderes sociales que se han perpetrado en Colombia. Al analizar las diferentes cifras de homicidios que han publicado diversas organizaciones desde 2016, se llegó a la conclusión que la problemática es mayor de lo que se cree.

Focus on Good Science, not Scientists

We recently learned about an article by Dr Nafeez Ahmed that criticizes the methods and conclusions of the Iraq Body Count (IBC) and the work of Professor Michael Spagat. Dr Ahmed cites our work extensively in support of his arguments, so we think it’s useful for us to reply. We welcome Dr Ahmed’s summary of various points of scientific debate about mortality due to violence, specifically in Iraq and Colombia. We think these are very important questions for the analysis of data about violent conflict, and indeed, about data analysis more generally. We appreciate his exploration of the technical nuances of this difficult field. Unfortunately, ...

Corrigendum: Killings and Refugee Flow in Kosovo, March–June, 1999 (A report to ICTY)

State Violence in Guatemala, 1960-1996: A Quantitative Reflection

Patrick Ball, Paul Kobrak, Herbert F. Spirer. State Violence in Guatemala, 1960-1996: A Quantitative Reflection. © 1999 American Association for the Advancement of Science. [pdf – english] [pdf – español]

Justice Unknown, Justice Unsatisfied? Bosnian NGOs Speak about the International Criminal Tribunal for the Former Yugoslavia.

Kristen Cibelli and Tamy Guberek. “Justice Unknown, Justice Unsatisfied? Bosnian NGOs Speak about the International Criminal Tribunal for the Former Yugoslavia.” A project of Education and Public Inquiry and International Citizenship at Tufts University. December, 2000.

Sierra Leone Statistical Appendix

Richard Conibere, Jana Asher, Kristen Cibella, Jana Dudukovic, Rafe Kaplan, and Patrick Ball. Sierra Leone Statistical Appendix, A Report by the Benetech Human Rights Data Analysis Group and the American Bar Association Central European and Eurasian Law Initiative to the Truth and Reconciliation Commission. October 5, 2004.

The Bosnian Book of the Dead: Assessment of the Database (Full Report).

Patrick Ball, Ewa Tabeau, and Philip Verwimp (2007). “The Bosnian Book of the Dead: Assessment of the Database (Full Report).” Households in Conflict Network Research Design Note 5.

Quantitative Data Analysis and Large-Scale Human Rights Violations: An Example of Applied Statistics at the Grassroots.

Romesh Silva. “Quantitative Data Analysis and Large-Scale Human Rights Violations: An Example of Applied Statistics at the Grassroots.” Gazette of the Australian Mathematical Society. Canberra (Australia). Volume 32, Number 2, May 2005.

Missing People in Casanare

Daniel Guzmán, Tamy Guberek, Amelia Hoover, and Patrick Ball (2007). “Missing People in Casanare.” Benetech. Also available in Spanish – “Los Desaparecidos de Casanare.”

The Demography of Large-Scale Human Rights Atrocities: Integrating demographic and statistical analysis into post-conflicthistorical clarification in Timor-Leste.

Romesh Silva and Patrick Ball. “The Demography of Large-Scale Human Rights Atrocities: Integrating demographic and statistical analysis into post-conflicthistorical clarification in Timor-Leste.” Paper presented at the 2006 meetings of the Population Association of America.

Rapid response: Civilian deaths from weapons used in the Syrian conflict

Megan Price, Anita Gohdes, Jay D. Aronson, and Christopher McNaboe. 2015. BMJ (29 September): 351. doi: http://dx.doi.org/10.1136/bmj.h4736. © The BMJ Publishing Group Ltd. All rights reserved. Open access.

Preliminary Statistical Analysis of AVCRP & DDS Documents – A report to Human Rights Watch about Chad under the government of Hissène Habré

Miguel Cruz, Kristen Cibelli, and Jana Dudukovic. “Preliminary Statistical Analysis of AVCRP & DDS Documents – A report to Human Rights Watch about Chad under the government of Hissène Habré”. Benetech. November 4, 2003.

¿Quién le hizo qué a quién? Planear e implementar un proyecto a gran escala de información en derechos humanos.

Patrick Ball (2008). “¿Quién le hizo qué a quién? Planear e implementar un proyecto a gran escala de información en derechos humanos.” (originally in English at AAAS) Translated by Beatriz Verjerano. Palo Alto, California: Benetech.

How Many Peruvians Have Died?

Studying Millions of Rescued Documents: Sampling Plan at the Guatemalan National Police Archive (GNPA).

Daniel R. Guzmán, Tamy Guberek, Gary M. Shapiro, Paul Zador (2009). “Studying Millions of Rescued Documents: Sampling Plan at the Guatemalan National Police Archive (GNPA).” In JSM Proceedings, Survey Research Methods Section. Alexandria, VA: American Statistical Association.

The Profile of Human Rights Violations in Timor-Leste, 1974-1999

Romesh Silva and Patrick Ball. “The Profile of Human Rights Violations in Timor-Leste, 1974-1999″, a Report by the Benetech Human Rights Data Analysis Group to the Commission on Reception, Truth and Reconciliation. 9 February 2006.

A Statistical Analysis of the Guatemalan National Police Archive: Searching for Documentation of Human Rights Abuses.

Megan E. Price, Tamy Guberek, Daniel R. Guzmán, Paul Zador, Gary M. Shapiro (2009). “A Statistical Analysis of the Guatemalan National Police Archive: Searchingfor Documentation of Human Rights Abuses.”In JSM Proceedings, Survey Research Methods Section. Alexandria, VA: American Statistical Association.

Reflections: Pivotal Moments in Freetown

The summer of 2002 in Washington, DC, was steamy and hot, which is how I remember my introduction to HRDAG. I had begun working with them, while they were still at AAAS, in the late spring, learning all about their core concepts: duplicate reporting and MSE, controlled vocabularies, inter-rater reliability, data models and more. The days were long, with a second shift more often than not running late into the evening. In addition to all the learning, I also helped with matching for the Chad project – that is, identifying multiple records of the same violation – back when matching was done by hand. But it was not long after I arrived in Washington ...

S
1
…
19
20
21
…
28
s

Pulling Back the Curtain on LLMs & Policing Data

Learning Day by Day: Quantitative Research at the AHPN

El problema del asesinato a líderes es más grave de lo que se piensa

Focus on Good Science, not Scientists

Corrigendum: Killings and Refugee Flow in Kosovo, March–June, 1999 (A report to ICTY)

State Violence in Guatemala, 1960-1996: A Quantitative Reflection

Justice Unknown, Justice Unsatisfied? Bosnian NGOs Speak about the International Criminal Tribunal for the Former Yugoslavia.

Sierra Leone Statistical Appendix

The Bosnian Book of the Dead: Assessment of the Database (Full Report).

Quantitative Data Analysis and Large-Scale Human Rights Violations: An Example of Applied Statistics at the Grassroots.

Missing People in Casanare

The Demography of Large-Scale Human Rights Atrocities: Integrating demographic and statistical analysis into post-conflicthistorical clarification in Timor-Leste.

Rapid response: Civilian deaths from weapons used in the Syrian conflict

Preliminary Statistical Analysis of AVCRP & DDS Documents – A report to Human Rights Watch about Chad under the government of Hissène Habré

¿Quién le hizo qué a quién? Planear e implementar un proyecto a gran escala de información en derechos humanos.

How Many Peruvians Have Died?

Studying Millions of Rescued Documents: Sampling Plan at the Guatemalan National Police Archive (GNPA).

The Profile of Human Rights Violations in Timor-Leste, 1974-1999

A Statistical Analysis of the Guatemalan National Police Archive: Searching for Documentation of Human Rights Abuses.

Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents.

Donate

HRDAG

Selected projects

Stay informed about our work

Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents. Donate

HRDAG

Selected projects

Stay informed about our work

Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents.

Donate