In this NPR story, HRDAG’s Patrick Ball comments on first-of-its-kind projections.

HRDAG director of research Patrick Ball is quoted in this New York Times article about a paper that models death tolls in Gaza.

In this video, Trina Reynolds-Tyler of Invisible Institute talks about her work with HRDAG on the missing persons project in Chicago and Beneath the Surface.

William Isaac is quoted.

From the article: Esta entidad, que existe desde 1991, es liderada por su fundador, Patrick Ball, un científico que acumula una experiencia de más de 25 años realizando análisis cuantitativos en los lugares y en las situaciones más convulsos del planeta. Sobre su colaboración con el proyecto del predictor de fosas clandestinas en México, único en el mundo, Ball afirmó en entrevista:

“Cuando hablamos de crímenes de lesa humanidad estamos hablando de instituciones, de organizaciones grandes, cometiendo miles o centenares de miles  de violaciones a víctimas distribuidas sobre una geografía enorme. Para entender los patrones en esas violaciones, la estadística puede brindar una mirada sobre quiénes son los responsables materiales e intelectuales, quiénes son las víctimas y dónde o cuándo pasaron esas violaciones. Pero la estadística no es contabilidad, pues no estamos hablando solamente de las violaciones que podemos ver, sino que también debemos calcular las violaciones no observadas, las escondidas, invisibles, para incluir en nuestro análisis la totalidad de las violaciones”.

“In 2016, two researchers, the statistician Kristian Lum and the political scientist William Isaac, set out to measure the bias in predictive policing algorithms. They chose as their example a program called PredPol.  … Lum and Isaac faced a conundrum: if official data on crimes is biased, how can you test a crime prediction model? To solve this technique, they turned to a technique used in statistics and machine learning called the synthetic population.”

Kristian Lum, the lead statistician at the Human Rights Data Analysis Group, and an expert on algorithmic bias, said she hoped Stanford’s stumble made the institution think more deeply about representation.

“This type of oversight makes me worried that their stated commitment to the other important values and goals – like taking seriously creating AI to serve the ‘collective needs of humanity’ – is also empty PR spin and this will be nothing more than a vanity project for those attached to it,” she wrote in an email.

Ball analyzed the data reporters had collected from a variety of sources – including on-the-ground interviews, police records, and human rights groups – and used a statistical technique called multiple systems estimation to roughly calculate the number of unreported deaths in three areas of the capital city Manila.

The team discovered that the number of drug-related killings was much higher than police had reported. The journalists, who published their findings last month in The Atlantic, documented 2,320 drug-linked killings over an 18-month period, approximately 1,400 more than the official number. Ball’s statistical analysis, which estimated the number of killings the reporters hadn’t heard about, found that close to 3,000 people could have been killed – more than three times the police figure.

Ball said there are both moral and technical reasons for making sure everyone who has been killed in mass violence is counted.

“The moral reason is because everyone who has been murdered should be remembered,” he said. “A terrible thing happened to them and we have an obligation as a society to justice and to dignity to remember them.”

Patrick Ball, director of research at the Human Rights Data Analysis Group, and a statistician who has conducted similar estimates of violent deaths in conflicts in other regions, said the study was strong and well reasoned. But he cautioned that the authors may have underestimated the amount of uncertainty caused by the ongoing conflict.

The authors used different variations of mathematical models in their calculations, but Dr. Ball said that rather than presenting a single figure — 64,260 deaths — as the estimate, it may have been more appropriate to present the number of deaths as a range from 47,457 to 88,332 deaths, a span that encompasses all of the estimates produced by modeling the overlap among the three lists.

“It’s really hard to do this kind of thing in the middle of a conflict,” Dr. Ball said. “It takes time, and it takes access. I think you could say the range is larger, and that would be plausible.”