A new study has estimated that over 500 Tamils were forcibly disappeared in just three days, after surrendering to the Sri Lankan army in May 2009.
The study, carried out by the Human Rights Data Analysis Group and the International Truth and Justice Project, based on compiled lists which identify those who were known to have surrendered, estimated that 503 people had been forcibly disappeared between the 17th– 19th of May 2009.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Kristian Lum, Chesa Boudin and Megan Price (2020). The impact of overbooking on a pre-trial risk assessment tool. FAT* '20: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. January 2020. Pages 482–491. https://doi.org/10.1145/3351095.3372846 ©ACM, Inc., 2020.
Kristian Lum, Chesa Boudin and Megan Price (2020). The impact of overbooking on a pre-trial risk assessment tool. FAT* ’20: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. January 2020. https://doi.org/10.1145/3351095.3372846 ©ACM, Inc., 2020.
There may have been more undocumented World War II-era Korean "comfort women" than known.
The Washington Post’s Paul Schemm recognized HRDAG’s work in Syria, in the category of research and activism. “HRDAG gained renown at the start of the war, when it was one of the few organizations that tried to put a number on the war’s enormous toll in Syrian lives.”
“The 36th Rafto Prize was awarded to the Human Rights Data Analysis Group (HRDAG) for their work on uncovering large-scale human rights violations. By using statistics and data science, HRDAG documents human rights violations that might otherwise go undetected. Their approach has enabled courts to bring perpetrators to justice and given closure to affected victims and their families.”
Laurel Eckhouse (2017). Big data may be reinforcing racial bias in the criminal justice system. Washington Post. 10 February 2017. © 2017 Washington Post.
Laurel Eckhouse (2017). Big data may be reinforcing racial bias in the criminal justice system. Washington Post. 10 February 2017. © 2017 Washington Post.
/wp-content/uploads/2013/01/Definition_of_Database_Design_Standards_1994.pdf
Patrick Ball. “A Definition of Database Design Standards for Human Rights Agencies.” © 1994 American Association for the Advancement of Science. [pdf]
At the end of 2014 we completed the evaluation of the Kosovo Memory Book database and are pleased to conclude that the database has succeeded in documenting all or nearly all the human losses during conflicts in Kosovo during the period from 1998 to 2000.
With a motto of "Let people remember people," the goal of the Kosovo Memory Book (KMB) is to document all people who were killed or disappeared in connection with the war in Kosovo. The project aimed to document all human losses during armed conflict in the territory of the Former Yugoslav Republic (FYR) between 1998 and 2000.
The KMB database evaluation is the fruition of several years of ...
When working with documents in an archive, every document offers the opportunity for statistical study and quantitative research. But a document can also offer the discovery of a story. That is the case with the disappearance of Ana Lucrecia Orellana Stormont, who was reported missing on June 6, 1983, at the age of 35.
Ana Lucrecia, a professor of psychology at the University of San Carlos, was scheduled to attend a meeting with Edgar Raúl Rivas Rodríguez at the Plaza Hotel in Guatemala’s capital city. Edgar, who also went missing, was a teacher at the School of Political Science at the University. (Ana Lucrecia’s case is explained more fully ...
Help us hold human rights violators accountable!
James Johndrow, Patrick Ball, Maria Gargiulo, and Kristian Lum. (2020). Estimating the Number of SARS-CoV-2 Infections and the Impact of Mitigation Policies in the United States. Harvard Data Science Review. 24 November, 2020. © The Authors, 2020, CC BY 4.0. https://doi.org/10.1162/99608f92.7679a1ed
James Johndrow, Patrick Ball, Maria Gargiulo, and Kristian Lum. (2020). Estimating the Number of SARS-CoV-2 Infections and the Impact of Mitigation Policies in the United States. Harvard Data Science Review. 24 November, 2020. © The Authors, 2020, CC BY 4.0. https://doi.org/10.1162/99608f92.7679a1ed
The Historic Archive of the Guatemalan National Police (hereafter the Archive) was discovered, quite by accident, in July 2005. Researchers immediately recognized both the importance and the fragility of the Archive's contents. As a result, in early 2006 the Archive team invited Patrick to evaluate the documents and help them answer a seemingly simple question: How can we learn about the contents of the Archive in a shorter period of time than is needed to systematically examine each individual document?
After inspecting the Archive, Patrick designed a multi-stage random sample of documents. In May 2006, Tamy Guberek, Daniel Guzmán, and ...
What do you get when you bring seven statisticians, one quantitative political scientist, a writer, a computer scientist, and an administrator together for four days in a vacation rental on California’s Russian River? A lot of code, a technical paper and book chapter revised, another paper started, a great hike in the Redwoods, descriptions of food poisoning and crash landings in war zones, and a lot of talk about feelings.
Did I mention feelings? On the first evening of the annual retreat of the Human Rights Data Analysis Group, executive director Megan Price asked us to go around the room and share how we were feeling on arrival. The request ...
If this could be you, let us know. Also, please feel free to pass on this link to great people.
Job Title. Technical lead with a hacker's heart
Location. A cool office in SOMA, San Francisco. You need to be on-site with us.
What we do. The Human Rights Data Analysis Group (HRDAG) develops statistical techniques to measure human rights atrocities. Our work helps bring dictators to justice through data analysis of human rights atrocities around the world. Over more than 20 years, our small team has developed technology and statistical techniques to take disjoint, incomplete, and inaccurate information from conflict zones and process it to identify ...
Valentina Rozo Ángel has joined our team as our new visiting analyst this fall.
Multiple Systems Estimation
What is MSE?
What do you mean by statistical inference?
What is an overlap, and how do we know when lists overlap?
How does MSE find the total number of violations?
How was MSE originally developed?
How does the Benetech Human Rights Program use MSE?
1. What is MSE?
A: Multiple Systems Estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations.
Return to Top
2. What do you mean by statistical inference?
A: ...
In 2023, HRDAG continued to learn from our partners about resilience and patience.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
