James Johndrow, Patrick Ball, Maria Gargiulo, and Kristian Lum. (2020). Estimating the Number of SARS-CoV-2 Infections and the Impact of Mitigation Policies in the United States. Harvard Data Science Review. 24 November, 2020. © The Authors, 2020, CC BY 4.0. https://doi.org/10.1162/99608f92.7679a1ed
James Johndrow, Patrick Ball, Maria Gargiulo, and Kristian Lum. (2020). Estimating the Number of SARS-CoV-2 Infections and the Impact of Mitigation Policies in the United States. Harvard Data Science Review. 24 November, 2020. © The Authors, 2020, CC BY 4.0. https://doi.org/10.1162/99608f92.7679a1ed
Help us hold human rights violators accountable!
The Historic Archive of the Guatemalan National Police (hereafter the Archive) was discovered, quite by accident, in July 2005. Researchers immediately recognized both the importance and the fragility of the Archive's contents. As a result, in early 2006 the Archive team invited Patrick to evaluate the documents and help them answer a seemingly simple question: How can we learn about the contents of the Archive in a shorter period of time than is needed to systematically examine each individual document?
After inspecting the Archive, Patrick designed a multi-stage random sample of documents. In May 2006, Tamy Guberek, Daniel Guzmán, and ...
Dr. Patrick Ball recently visited the Plutopia News Network podcast for a wide-ranging, inspiring conversation about his work for the Human Rights Data Analysis Group.
Patrick spoke about how he first discovered human rights work during his time in El Salvador with the Peace Brigades International. That led to his ongoing work as a statistician and computer programmer working to assess and analyze human rights violations. He also unpacked some common statistical techniques used by researchers at Human Rights Data Analysis Group, such as multiple systems estimation, which uses multiple different datasets to gain insights into the data we don't ...
What do you get when you bring seven statisticians, one quantitative political scientist, a writer, a computer scientist, and an administrator together for four days in a vacation rental on California’s Russian River? A lot of code, a technical paper and book chapter revised, another paper started, a great hike in the Redwoods, descriptions of food poisoning and crash landings in war zones, and a lot of talk about feelings.
Did I mention feelings? On the first evening of the annual retreat of the Human Rights Data Analysis Group, executive director Megan Price asked us to go around the room and share how we were feeling on arrival. The request ...
If this could be you, let us know. Also, please feel free to pass on this link to great people.
Job Title. Technical lead with a hacker's heart
Location. A cool office in SOMA, San Francisco. You need to be on-site with us.
What we do. The Human Rights Data Analysis Group (HRDAG) develops statistical techniques to measure human rights atrocities. Our work helps bring dictators to justice through data analysis of human rights atrocities around the world. Over more than 20 years, our small team has developed technology and statistical techniques to take disjoint, incomplete, and inaccurate information from conflict zones and process it to identify ...
Valentina Rozo Ángel has joined our team as our new visiting analyst this fall.
The US Bureau of Justice collects information on deaths during arrest, and HRDAG determined the efforts were incomplete. The conclusion: Approximately one third of all Americans killed by strangers are killed by police.
Multiple Systems Estimation
What is MSE?
What do you mean by statistical inference?
What is an overlap, and how do we know when lists overlap?
How does MSE find the total number of violations?
How was MSE originally developed?
How does the Benetech Human Rights Program use MSE?
1. What is MSE?
A: Multiple Systems Estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations.
Return to Top
2. What do you mean by statistical inference?
A: ...
In 2023, HRDAG continued to learn from our partners about resilience and patience.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
[popup citation="For migrations: Ball, Patrick. (2000). AAAS/ Human Rights Data Analysis Group database of migrations in Albania and Kosovo. For killings: Patrick Ball, Wendy Betts, Fritz Scheuren, Jana Dudukovich, and Jana Asher. (2002). AAAS/ABA-CEELI/Human Rights Data Analysis Group database of killings in Kosovo. For other data: Human Rights Data Analysis Group. (2002). Database of NATO airstrikes, geographic coding, and KLA activity in Kosovo."]
The data on migration from Kosovo are in seven files. All of the files are comma-delimited ASCII. The fields in each file are described below. For more information, see Policy or Panic, section A1, pp. ...
Analysis of Uncovered Government Data from Guatemala and Chad Clarifies History and Supports Criminal Prosecutions
By Ann Harrison
The past year of research by the Benetech Human Rights Data Analysis Group (HRDAG) has supported criminal prosecutions and uncovered the truth about political violence in Guatemala, Iran, Colombia, Chad and Liberia. On today’s celebration of the 62nd anniversary of the Universal Declaration of Human Rights, HRDAG invites the international community to engage scientifically defensible methodologies that illuminate all human rights violations – including those that cannot be directly observed. 2011 will mark the 20th year that HRDAG researchers have analyzed the patterns and magnitude of human rights violations in political conflicts to determine how many of the killed and disappeared have never been accounted for – and who is most responsible.
Tarak Shah, Cristian Allen, Ayyub Ibrahim, Harlan Kefalas, and Bavo Stevens (2024). The Use of Unstructured Data to Study Police Use of Force. 5 December, 2024. CHANCE, 37(4), 18–23. https://doi.org/10.1080/09332480.2024.2434437
Tarak Shah, Cristian Allen, Ayyub Ibrahim, Harlan Kefalas, and Bavo Stevens (2024). The Use of Unstructured Data to Study Police Use of Force. 5 December, 2024. CHANCE, 37(4), 18–23. https://doi.org/10.1080/09332480.2024.2434437
Kristian Lum, Erwin Ma and Mike Baiocchi (2017). The causal impact of bail on case outcomes for indigent defendants in New York City. Observational Studies 3 (2017) 39-64. 31 October 2017. © 2017 Institute of Mathematical Statistics.
Kristian Lum, Erwin Ma and Mike Baiocchi (2017). The causal impact of bail on case outcomes for indigent defendants in New York City. Observational Studies 3 (2017) 39-64. 31 October 2017. © 2017 Institute of Mathematical Statistics.
Patrick Ball (2016). The case against a golden key. Foreign Affairs. September 14, 2016. ©2016 Council on Foreign Relations, Inc. All Rights Reserved.
Patrick Ball (2016). The case against a golden key. Foreign Affairs. September 14, 2016. ©2016 Council on Foreign Relations, Inc. All Rights Reserved.
In July 2009, The Human Rights Data Analysis Group concluded a three-year project with the Liberian Truth and Reconciliation Commission to help clarify Liberia’s violent history and hold perpetrators of human rights abuses accountable for their actions. In the course of this work, HRDAG analyzed more than 17,000 victim and witness statements collected by the Liberian Truth and Reconciliation Commission and compiled the data into a report entitled “Descriptive Statistics From Statements to the Liberian Truth and Reconciliation Commission.”
Liberian TRC data and the accompanying data dictionary
anonymized-statgivers.csv contains information ...
Henrik Urdal has released his final Nobel Shortlist for 2022, and HRDAG is included on it, alongside Sviatlana Tsikhanouskaya and Alexei Navalny, and others. The list highlights pro-democracy efforts, multilateral cooperation, combating religious extremism and intolerance, and the value that research and knowledge can have for promoting peace.
Kristian Lum (2017). Limitations of mitigating judicial bias with machine learning. Nature. 26 June 2017. © 2017 Macmillan Publishers Limited, part of Springer Nature. All rights reserved. Nature Human Behavior. DOI 10.1038/s41562-017-0141.
.
Kristian Lum (2017). Limitations of mitigating judicial bias with machine learning. Nature. 26 June 2017. © 2017 Macmillan Publishers Limited, part of Springer Nature. All rights reserved. Nature Human Behavior. DOI 10.1038/s41562-017-0141.
Megan Price, Anita Gohdes, Jay D. Aronson, and Christopher McNaboe. 2015. BMJ (29 September): 351. doi: http://dx.doi.org/10.1136/bmj.h4736. © The BMJ Publishing Group Ltd. All rights reserved. Open access.
