Ball analyzed the data reporters had collected from a variety of sources – including on-the-ground interviews, police records, and human rights groups – and used a statistical technique called multiple systems estimation to roughly calculate the number of unreported deaths in three areas of the capital city Manila.

The team discovered that the number of drug-related killings was much higher than police had reported. The journalists, who published their findings last month in The Atlantic, documented 2,320 drug-linked killings over an 18-month period, approximately 1,400 more than the official number. Ball’s statistical analysis, which estimated the number of killings the reporters hadn’t heard about, found that close to 3,000 people could have been killed – more than three times the police figure.

Ball said there are both moral and technical reasons for making sure everyone who has been killed in mass violence is counted.

“The moral reason is because everyone who has been murdered should be remembered,” he said. “A terrible thing happened to them and we have an obligation as a society to justice and to dignity to remember them.”

Earlier this year, the Canadian Tamil Congress connected with HRDAG to bring its campaign to Toronto’s annual Tamil Fest, one of the largest gatherings of Canada’s Sri Lankan diaspora.

Ravichandradeva, along with a few other volunteers, spent the weekend speaking with festival-goers in Scarborough about the project and encouraging them to come forward with information about deceased or missing loved ones and friends.

“The idea is to collect thorough, scientifically rigorous numbers on the total casualties in the war and present them as a non-partisan, independent organization,” said Michelle Dukich, a data consultant with HRDAG.

Kristian Lum, the lead statistician at the Human Rights Data Analysis Group, and an expert on algorithmic bias, said she hoped Stanford’s stumble made the institution think more deeply about representation.

“This type of oversight makes me worried that their stated commitment to the other important values and goals – like taking seriously creating AI to serve the ‘collective needs of humanity’ – is also empty PR spin and this will be nothing more than a vanity project for those attached to it,” she wrote in an email.

From the article: “Intentionally inconsistent tracking can also influence the final tally, notes Megan Price, a statistician at the Human Rights Data Analysis Group. During the Iraq War, for example, officials worked to conceal mortality or to cherry pick existing data to steer the political narrative. While wars are handled differently from pandemics, Price thinks the COVID-19 data could still be at risk of this kind of manipulation.”

In this NPR story, HRDAG’s Patrick Ball comments on first-of-its-kind projections.

Patrick Ball, director of research at the Human Rights Data Analysis Group, and a statistician who has conducted similar estimates of violent deaths in conflicts in other regions, said the study was strong and well reasoned. But he cautioned that the authors may have underestimated the amount of uncertainty caused by the ongoing conflict.

The authors used different variations of mathematical models in their calculations, but Dr. Ball said that rather than presenting a single figure — 64,260 deaths — as the estimate, it may have been more appropriate to present the number of deaths as a range from 47,457 to 88,332 deaths, a span that encompasses all of the estimates produced by modeling the overlap among the three lists.

“It’s really hard to do this kind of thing in the middle of a conflict,” Dr. Ball said. “It takes time, and it takes access. I think you could say the range is larger, and that would be plausible.”

According to the Human Rights Data Analysis Group, at least 17,723 people were killed in government custody from the start of the uprising in March 2011 to December 2015 – an average of 300 deaths each month. There are no figures for subsequent years but there is no reason to believe the killings stopped.

NPR Illinois has covered the new National Police Index, created by HRDAG’s Tarak Shah, Ayyub Ibrahim of Innocence Project, and Sam Stecklow of Invisible Institute.