602 results for search: %EC%9D%B8%ED%84%B0%EB%84%B7%ED%99%8D%EB%B3%B4%E2%96%B2%E0%B4%A0%E2%9D%B6%E0%B4%A0%2B%E2%9D%BD%E2%9D%BD%E2%9D%BC%E2%9D%BB%2B%E2%9D%BD%E2%9D%BC%E2%9D%BC%E2%9D%BD%E2%96%B2%EC%83%81%ED%95%98%EB%8F%99%EC%95%88%EB%A7%88%E3%81%AB%EC%9D%B8%ED%84%B0%EB%84%B7%E2%94%9A%ED%99%8D%EB%B3%B4%E2%86%92%EC%83%81%ED%95%98%EB%8F%99%E5%AA%99%EC%95%88%EB%A7%88%E4%A2%8Ddesklight/feed/rss2/copyright
Pulling Back the Curtain on LLMs & Policing Data
Structural Zero Issue 04
September 30, 2025
Artificial intelligence is transforming how we work with information. At HRDAG, that changes how I do my job every day. My most recent project was using LLMs to explore and parse vast quantities of data about police abuses in California.
In this newsletter, I’ll pull back the curtain on that work. I’ll describe how a diverse coalition gathered more than a million pages of documents about police misconduct in California and how LLMs helped us make sense of them in ways that wouldn’t have been possible before the advent of this technology.
In addition to understanding my work, I hope that this ...
Report on Measures of Fairness in NYC Risk Assessment Tool
The report tries to answer the question of whether a particular risk assessment model reinforces racial inequalities in the criminal justice system.
Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Timor-Leste
During the violence in Timor-Leste in June 2006, armed gangs broke into the offices of the Commission for Reception, Truth and Reconciliation (CAVR) in Dili and stole their motorbikes.
The Human Rights Data Analysis Group, then at Benetech®, and other human rights observers wondered whether the mobs would soon return to loot the irreplaceable paper records used by the CAVR to compile their definitive report entitled "Chega!"
The Benetech Initiative contributed to the CAVR findings and released a separate statistical report (PDF) establishing that at least 102,800 (+/- 11,000) Timorese died as a result of human rights violations in Timor-Leste ...
Bangladesh
In December 2006, Human Rights Watch (HRW) issued a report documenting torture and unlawful killings committed by Bangladesh's Rapid Action Battalion (RAB), an elite anti-crime and anti-terrorism force. According to HRW, many of the deaths for which RAB is responsible resulted from summary executions or extreme physical abuse. The statistical analysis presented in the report, "Judge, Jury, and Death: Torture and Executions by Bangladesh's Elite Security Force," was conducted by Romesh Silva, a statistician who worked within the Benetech Human Rights Program at the time, and who now works with HRDAG.
While researching these incidents, HRW compiled ...
When Data Doesn’t Tell the Whole Story
This blog is a part of International Justice Monitor’s technology for truth series, which focuses on the use of technology for evidence and features views from key proponents in the field.
As highlighted by other posts in this series, emerging technology is increasing the amount and type of information available, in some contexts, to criminal and other investigations. Much of what is produced by these emerging technologies (Facebook posts, tweets, YouTube videos, text messages) falls in the category we refer to as “found” data. By “found” data we mean data not generated for a specific investigation, but instead, that is generated for ...
Speaking Truth to Power in Chad
Our hearty congratulations to our partners at Human Rights Watch (HRW), Association des Victimes des Crimes du Régime de Hissène Habré (AVCRP), Association Tchadienne pour la Promotion et la Défense des Droits de l’Homme (PDDH), and the Fédération Internationale des ligues des Droits de l’Homme (FIDH) on today's launch of "La Plaine des mortes: Le Tchad des Hissène Habré, 1982-1990." This book chronicles the alleged human rights abuses of Hissène Habré, the president of Chad between 1982 and 1990. It is the culmination of more than 13 years of investigations, documentation and research focused on uncovering the nature of political ...
FAQs on Predictive Policing and Bias
Last month Significance magazine published an article on the topic of predictive policing and police bias, which I co-authored with William Isaac. Since then, we've published a blogpost about it and fielded a few recurring questions. Here they are, along with our responses.
Do your findings still apply given that PredPol uses crime reports rather than arrests as training data?
Because this article was meant for an audience that is not necessarily well-versed in criminal justice data and we were under a strict word limit, we simplified language in describing the data. The data we used is a version of the Oakland Police Department’s crime report...
BJS Report on Arrest-Related Deaths: True Number Likely Much Greater
(This post is co-authored by Patrick Ball and Kristian Lum.)
Today the Bureau of Justice Statistics (BJS) released a report on their effort to document “all deaths that occur during the process of arrest in the United States.” The analysis estimates that the Arrest-Related Deaths (ARD) program covers only 34-49% of these deaths. A parallel program by the FBI (the Supplementary Homicide Reports, SHR) is estimated to cover approximately the same proportion of deaths. Even taking into consideration both programs, 28% of all police homicides remain unreported.
In order to estimate the total number of homicides that appear on neither the ARD or ...
Lessons at HRDAG: Making More Syrian Records Usable
If we could glean key missing information from those fields, we would be able to use more records.
How many police homicides in the US? A reconsideration
(This post is co-authored by Patrick Ball and Kristian Lum.)
In early March, the Bureau of Justice Statistics published a report that estimated that in the period 2003-2009 and 2011, there were approximately 7427 homicides committed by police in the US. We responded that the method the analysts used, capture-recapture with two databases, is vulnerable to underestimation if the databases exhibit positive dependence. We conduct a thorough sensitivity analysis on the original independence model as applied to the police homicides databases. We used information from several other countries where our partners created multiple databases of homicides. We ...
Preguntas frecuentes sobre el proyecto JEP-CEV-HRDAG de integración de datos y estimación estadística
¿Hay una fuente de información única sobre las víctimas del conflicto armado en Colombia?
No. Colombia cuenta con un amplio proceso de documentación de víctimas del conflicto armado. Cientos de entidades, organizaciones de víctimas y organizaciones de la sociedad civil han focalizado sus esfuerzos en registrar la información. Sin embargo, cada entidad u organización desarrolla este proceso con las limitaciones propias de capacidades técnicas, logísticas, sociales y de misionalidad, lo que conduce a que ninguna entidad ni organización logre documentar el universo completo de víctimas. Esto se debe a que les es imposible llegar a ...
HRDAG Takes a Stand Against Tyranny in the United States
by Patrick Ball and Megan Price
Today the Human Rights Data Analysis Group (HRDAG) publicly denounces the growing attacks on science and human rights in the United States. We reaffirm our commitment to using rigorous scientific research and data analysis to uphold accountability for perpetrators of violence—particularly when those perpetrators are in power.
For decades, HRDAG has sought accountability for those who have committed war crimes and genocide around the world. We have researched patterns of genocide, torture, disappearances, and other forms of state-sponsored violence in countries such as Guatemala, South Africa, and Haiti. We ...
Focus on Good Science, not Scientists
We recently learned about an article by Dr Nafeez Ahmed that criticizes the methods and conclusions of the Iraq Body Count (IBC) and the work of Professor Michael Spagat. Dr Ahmed cites our work extensively in support of his arguments, so we think it’s useful for us to reply.
We welcome Dr Ahmed’s summary of various points of scientific debate about mortality due to violence, specifically in Iraq and Colombia. We think these are very important questions for the analysis of data about violent conflict, and indeed, about data analysis more generally. We appreciate his exploration of the technical nuances of this difficult field.
Unfortunately, ...
14 Questions about Counting Casualties in Syria
In early 2012, HRDAG was commissioned by the UN Office of the High Commissioner for Human Rights (OHCHR) to do an enumeration project, essentially a count of all of the reported casualties in the Syrian conflict. HRDAG has published two analyses so far, the first in January 2013, and the second in June 2013. In this post, HRDAG scientists Anita Gohdes, Megan Price, and Patrick Ball answer questions about that project.
So, how many people have been killed in the Syrian conflict?
This is a complicated question. As of our last report, in June 2013, we know that there have been at least 93,000 reported, identifiable conflict-related casualties. The ...
Identifiers of Detained Children Have Implications for Data Security and Estimation
Identifiers being sequential could make possible estimations of the population of detained children.
.outter-wrapper.feature {
background: #15795b;
}
.outter-wrapper.feature hr {
border-width: 0;
height: 30px;
}
.outter-wrapper.feature h4 {
/* height: 30px; */
border-width: 0;
}
.wrapper {
padding: 20px 0;
}
.branding-headline {
width: 100%;
font-size: 40px;
font-weight: 600;
padding-bottom: 20px;
color: #15795b;
line-height: 43.2px;
}
.border-line {
border-bottom: 1px solid #000;
margin: 20px 0;
}
.hed-dek-illo {
margin: 20px 0;
}
.illo {
width: 100%;
min-height: 200px;
}
.illo img {
margin: 0;
}
.blog-pages {
display: flex;
}
.blog-post {
flex: 0 0 ...
Chad
Hissène Habré's rule over the former French colony of Chad, from 1982 to 1990, was marked by numerous and credible allegations of systematic torture and crimes against humanity. Habré claims that he was not aware of violations committed by the Documentation and Security Directorate (DDS), the state security force that pursued political opponents and operated notorious prisons during his regime.
In January 2010, the Human Rights Data Analysis Group (HRDAG) released a new study showing that Habré was well informed of the hundreds of deaths that occurred in prisons operated by the DDS. The HRDAG report, State Coordinated Violence in Chad under ...
Reflections: Richard Savage’s Vision Fulfilled
In 1984, as a fresh PhD, I heard Richard Savage give his presidential address at the Joint Statistical Meetings in Philadelphia. He called it "Hard/Soft Problems" and made a big pitch for statisticians to get involved in human rights data analysis. It was inspirational, and I was immediately sold. I started working with the American Statistical Association's Committee on Scientific Freedom and Human Rights (now chaired by HRDAG's own Megan Price). Over time, a growing set of statisticians became involved, initially in letter-writing campaigns to help dissident statisticians (and other quantitative academics—economists seemed to have a particular ...