It could make sense to use Rust as a data journalist for in-browser computations, and other thoughts from RustConf.
Defending Human Rights Data And The Possibility of Justice In East Timor
By Patrick Ball and Romesh Silva
On June 5th, armed gangs broke into the offices of the Commission for Reception, Truth and Reconciliation (CAVR) in Dili, East Timor and stole their motorbikes.
Many human rights workers wondered whether the mobs would soon return to loot the irreplaceable paper records used by the CAVR to compile a definitive report on human rights abuses during the Indonesian occupation of East Timor from 1975-1999.
The release of this report was preempted by the recent violence in Dili. But in the midst of the chaos, Australian military forces stepped in to ...
Alejandro Valencia Villa is a Former Commissioner of the Colombian Truth Commission. (Letter in English, and letter in Spanish.)
Introduction
One of the most obvious and most difficult questions to answer when analyzing an armed conflict is determining the number of victims. In a conflict like Colombia’s, prolonged and with complex characteristics due to the different nature of the armed actors and because they committed a great variety and quantity of human rights violations and breaches of humanitarian law, the challenge is even greater. As if this were not enough, Colombia also had a large number of records of these violations and infract...
HRDAG is currently evaluating the quality and completeness of the Kosovo Memory Book of the Humanitarian Law Center (HLC) in Belgrade, Serbia. The objective of the Kosovo Memory Book (KMB) is to commemorate every single person who fell victim to armed conflict in Kosovo from 1998 to 2000, either through death or disappearance.
While building and reviewing their database, one of the things that HLC has to do is “record linkage,” a process also known as “matching.” Matching determines whether two records are the same people (“a match”) or different people (“a non-match”). Matching helps to identify whether two existing records refer ...
(This post is co-authored by Patrick Ball and Kristian Lum.)
Today the Bureau of Justice Statistics (BJS) released a report on their effort to document “all deaths that occur during the process of arrest in the United States.” The analysis estimates that the Arrest-Related Deaths (ARD) program covers only 34-49% of these deaths. A parallel program by the FBI (the Supplementary Homicide Reports, SHR) is estimated to cover approximately the same proportion of deaths. Even taking into consideration both programs, 28% of all police homicides remain unreported.
In order to estimate the total number of homicides that appear on neither the ARD or ...
Help us hold human rights violators accountable!
Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Some of the earliest large-scale human rights information projects happened in El Salvador. One was developed by Patrick Ball at the Salvadoran non-governmental Human Rights Commission, also known as Comision de Derechos Humanos de El Salvador (CDHES-ng). Between 1977 and 1990, more than 9,000 testimonies were taken in an effort to document the nature and scope of the bloody conflict between the army and the Farabundo Marti National Liberation Front (FMLN). Starting in 1991, Patrick worked with CDHES staff to organize the information in an early computer database. They linked reported human rights violations with the career structures of individual ...
In July 2009, HRDAG concluded a three-year project with the Liberian Truth and Reconciliation Commission (TRC) to help clarify Liberia’s violent history and hold perpetrators accountable. A military coup in 1979 sparked 24 years of civil war in Liberia where warring factions subjected civilians to severe human rights abuses. The TRC sought to determine whether these violations represented a systematic pattern or policy. This chapter describes how HRDAG developed a statistical analysis of the more than 17,000 victim and witness statements collected by the TRC and applied Ball’s “Who Did What To Whom?” methodology. HRDAG scientist Kristen ...
Une Nouvelle Etude Démontre qu’ Hissène Habré supervisait les Prisons de la Police Politique où des Milliers de Personnes Sont Décédées.
10ème Anniversaire de l’Inculpation de l’Ancien Dictateur Tchadien
Janvier 29, 2010, N’Djaména, Tchad, Palo Alto, CA, Etats-Unis – A l’occasion du 10ème anniversaire de la première mise en accusation d’Hissène Habré au Sénégal, le Groupe d'Analyse des Données de Droits Humains de Benetech (GADDH) a réalisé une nouvelle étude qui démontre que l’ancien dictateur tchadien était bien informé des politiques et des pratiques de sa police politique. Cette étude pourrait s’avérer ...
Structural Zero Issue 01
Jun 03, 2025
Part One of Our Three Part “Gathering the Data” Series
As a statistician, I spend most days trying to wrangle and analyze massive data sets. The specific data I deal with is documentation of human rights violations. My job is to make sense of data that I know is incomplete and answer questions about the past using statistical analysis and scientific reasoning.
But where does this data come from? How was it generated, and how do human rights advocates and researchers access it and secure it?
To kick off our new newsletter Structural Zero, I’ll be writing a ...
Patrick Ball and Michael Reed Hurtado. 2016. El registro y la medición de la criminalidad. El problema de los datos faltantes y el uso de la ciencia para producir estimaciones en relación con el homicidio en Colombia, demostrado a partir de un ejemplo: el departamento de Antioquia (2003-2011). Revista Criminalidad, 58 (1): 9-23.
Patrick Ball and Michael Reed Hurtado. 2016. El registro y la medición de la criminalidad. El problema de los datos faltantes y el uso de la ciencia para producir estimaciones en relación con el homicidio en Colombia, demostrado a partir de un ejemplo: el departamento de Antioquia (2003-2011). Revista Criminalidad, 58 (1): 9-23. Criminality registration and measurement. The problem of missing data, and the use of science to produce estimations relating to homicide in Colombia, as demonstrated with an example from one of its administrative and political divisions: the Department of Antioquia (2003-2011).
There may have been more undocumented World War II-era Korean "comfort women" than known.
Las estimaciones se estratificaron por ubicación y perpetrador.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and "Official" Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and “Official” Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
Patrick Ball, director of research at the Human Rights Data Analysis Group, and a statistician who has conducted similar estimates of violent deaths in conflicts in other regions, said the study was strong and well reasoned. But he cautioned that the authors may have underestimated the amount of uncertainty caused by the ongoing conflict.
The authors used different variations of mathematical models in their calculations, but Dr. Ball said that rather than presenting a single figure — 64,260 deaths — as the estimate, it may have been more appropriate to present the number of deaths as a range from 47,457 to 88,332 deaths, a span that encompasses all of the estimates produced by modeling the overlap among the three lists.
“It’s really hard to do this kind of thing in the middle of a conflict,” Dr. Ball said. “It takes time, and it takes access. I think you could say the range is larger, and that would be plausible.”
