Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG's Kristian Lum and Tarak Shah served as Project Members and made contributions to the primer.>>
Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG’s Kristian Lum and Tarak Shah served as Project Members and made significant contributions to the primer.>>
Doing an investigation on the contents of the Archive brought with it three major lessons. The first big lesson was the constant movement (nothing was static), The second great lesson was that everything evolved (the changes were a constant). The third major lesson was to discover how two institutions can work together while geographically far apart.
The constant movement
As there were other processes being carried out at the Archive, everything was in constant movement. In other words, one day the documents were in X location and tomorrow they may be in location Y or dispersed in multiple locations. This made it impossible to know with certai...
This morning I got a query from a journalist asking for our data from the report we published yesterday. The journalist was hoping to create an interactive infographic to track the number of deaths in the Syrian conflict over time. Our data would not support an analysis like the one proposed, so I wrote this reply.
We can't send you these data because they would be misleading—seriously misleading—for the purpose you describe. Here's why:
What we have is a list of documented deaths, in essence, a highly non-random sample, though a very big one. We like bigger samples because we think that they must be closer to true. The mathematical justificat...
Cynthia Conti-Cook came on board in March, 2025.
“Usually, the thing you’re trying to predict in a lot of these cases is something like rearrest,” Lum said. “So even if we are perfectly able to predict that, we’re still left with the problem that the human or systemic or institutional biases are generating biased arrests. And so, you still have to contextualize even your 100 percent accuracy with is the data really measuring what you think it’s measuring? Is the data itself generated by a fair process?”
HRDAG Director of Research Patrick Ball, in agreement with Lum, argued that it’s perhaps more practical to move it away from bias at the individual level and instead call it bias at the institutional or structural level. If a police department, for example, is convinced it needs to police one neighborhood more than another, it’s not as relevant if that officer is a racist individual, he said.
Reports of torture and disappearances in Syria are not new. But the Amnesty International report says the magnitude and severity of abuse has “increased drastically” since 2011. Citing the Human Rights Data Analysis Group, the report says “at least 17,723 people were killed in government custody between March 2011 and December 2015, an average of 300 deaths each month.”
In this NPR story, HRDAG’s Patrick Ball comments on first-of-its-kind projections.
Henrik Urdal has released his final Nobel Shortlist for 2022, and HRDAG is included on it, alongside Sviatlana Tsikhanouskaya and Alexei Navalny, and others. The list highlights pro-democracy efforts, multilateral cooperation, combating religious extremism and intolerance, and the value that research and knowledge can have for promoting peace.
Dear Friends,
This has been quite a year, and I don’t just mean the recent political events in the United States, Europe and the Middle East.
Thanks to your ongoing support, HRDAG has a number of accomplishments to be proud of this year:
Patrick’s testimony in the trial of Hissene Habré for crimes against humanity was cited by the judges three times in their determination of guilt.
We launched a book describing ten years of collaborative work with the Historic Archive of the National Police in Guatemala.
We contributed quantitative analyses to Amnesty International’s report on deaths in Syrian custody, and published an ...
We’re pleased to announce that Camille Fassett has joined our team as our new data science fellow.
Illuminating Data's Dark Side: Big data create conveniences, but we must consider who designs these tools, who benefits from them, and who is left out of the equation.
On September 7, 2018, Kristian Lum and Patrick Ball participated in a panel at Disrupt San Francisco by TechCrunch. The talk was titled "Dismantling Algorithmic Bias." Brian Brackeen of Kairos was part of the panel as well, and the talk was moderated by TechCrunch reporter Megan Rose Dickey.
From the TechCrunch website, "Disrupt is a 3-day conference focused on breaking technology news and developments with big-name thought leaders who are making waves in the industry."
Video of the talk is available here, and Megan Rose Dickey's coverage is here.
It was July of 2006, I’d spent five years working at a local human rights NGO in Bogotá, and I had reached retirement age. But then a whole new world opened up for me to discover. Tamy Guberek, then HRDAG Latin America coordinator, whom I had met at the NGO, approached me about becoming part of the HRDAG Colombia team as a research/administrative assistant. Over a cup of suitably Colombian coffee, the deal was quickly "signed.” My responsibilities ranged from fundraising to translations, from support in data gathering for estimates on homicides and disappearances in various regions of Colombia to editorial support to different Benetech-HRDAG ...
