“In 2016, two researchers, the statistician Kristian Lum and the political scientist William Isaac, set out to measure the bias in predictive policing algorithms. They chose as their example a program called PredPol.  … Lum and Isaac faced a conundrum: if official data on crimes is biased, how can you test a crime prediction model? To solve this technique, they turned to a technique used in statistics and machine learning called the synthetic population.”

“In a recent article, social scientist Patrick Ball revisited his and Kristian Lum’s 2015 study, which made a compelling argument for the underreporting of lethal police shootings by the Bureau of Justice Statistics (BJS). Lum and Ball’s study may be old, but it bears revisiting amid debates over the American police system — debates that have featured plenty of data on the excessive use of police force. It is a useful reminder that many of the facts and figures we rely on require further verification.”

William Isaac is quoted.

HRDAG director of research Patrick Ball is quoted in this New York Times article about a paper that models death tolls in Gaza.

Tarak Shah is quoted with regard to the National Police Index: “Police often avoid accountability by moving to another agency rather than face discipline. This tool, allowing anyone to look up and track the histories of such officers, provides an invaluable service for the human rights community in our fight against impunity.”

HRDAG director of research Patrick Ball is quoted in this Nature article about how body counts are a crude measure of the war’s impact and more reliable estimates will take time to compile.

NPR Illinois has covered the new National Police Index, created by HRDAG’s Tarak Shah, Ayyub Ibrahim of Innocence Project, and Sam Stecklow of Invisible Institute.

Biotechniques published an interview with Patrick Ball, inspired by his John Maddox Prize award.

The Human Rights Data Analysis Group, an independent scientific human rights organization based in San Francisco, has counted at least 17,723 people killed in Syrian custody from 2011 to 2015 — around 300 every week — almost certainly a vast undercount, it says.

According to the Human Rights Data Analysis Group, at least 17,723 people were killed in government custody from the start of the uprising in March 2011 to December 2015 – an average of 300 deaths each month. There are no figures for subsequent years but there is no reason to believe the killings stopped.

The Human Rights Data Analysis Group employs AI to analyze data from conflict zones, identifying patterns of human rights abuses that might be overlooked. This assists international organizations in holding perpetrators accountable.

Contrario a lo que se puede pensar, los datos oficiales sobre líderes sociales asesinados no necesariamente corresponden a la realidad y podría haber mucha mayor victimización en las regiones golpeadas por este flagelo, según el más reciente informe del Centro de Estudios de Justicia, Derecho y Sociedad (Dejusticia) en colaboración con el Human Rights Data Analysis Group.

“Kristian Lum… organized a workshop together with Elizabeth Bender, a staff attorney for the NY Legal Aid Society and former public defender, and Terrence Wilkerson, an innocent man who had been arrested and could not afford bail. Together, they shared first hand experience about the obstacles and inefficiencies that occur in the legal system, providing valuable context to the debate around COMPAS.”

Kristian Lum is focusing on artificial intelligence and the controversial use of predictive policing and sentencing programs.

What’s the relationship between statistics and AI and machine learning?

AI seems to be a sort of catchall for predictive modeling and computer modeling. There was this great tweet that said something like, “It’s AI when you’re trying to raise money, ML when you’re trying to hire developers, and statistics when you’re actually doing it.” I thought that was pretty accurate.

One of the researchers, a Michigan State PhD candidate named William Isaac, had not previously heard of New Orleans’ partnership with Palantir, but he recognized the data-mapping model at the heart of the program. “I think the data they’re using, there are serious questions about its predictive power. We’ve seen very little about its ability to forecast violent crime,” Isaac said.