Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
Trina Reynolds-Tyler's internship at HRDAG helped her use data science to find patterns in state-sanctioned violence.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Propelled by the impact of data analysis in El Salvador, Patrick Ball applied his WDWTW model to human rights information in other countries. Throughout the 1990’s, Ball worked at the American Association for the Advancement of Science (AAAS) analyzing large-scale human rights violations in Ethiopia, South Africa, Haiti and Guatemala. Together with senior scientific colleagues, including statistician Dr. Herb Spirer, Ball developed new methods for analyzing state-sanctioned violence. This chapter documents how the research expanded when a group of nongovernmental organizations in Guatemala asked the scientific community to gather and analyze ...
Text in English
Assessing Claims of Declining Lethal Violence
In March 2007, HRDAG published a study entitled "Assessing Claims of Declining Lethal Violence in Colombia." The authors of this report evaluated assertions that violence in Colombia declined after the demobilization of paramilitaries. They showed that these claims rest both on the overinterpretation of unadjusted data and on unsound causal inferences. The authors concluded that multiple data sources are needed to estimate the true rates of violence in Colombia after demobilization and they suggest avenues for further research.
This research paper is also available in Spanish at ...
In 1984, as a fresh PhD, I heard Richard Savage give his presidential address at the Joint Statistical Meetings in Philadelphia. He called it "Hard/Soft Problems" and made a big pitch for statisticians to get involved in human rights data analysis. It was inspirational, and I was immediately sold. I started working with the American Statistical Association's Committee on Scientific Freedom and Human Rights (now chaired by HRDAG's own Megan Price). Over time, a growing set of statisticians became involved, initially in letter-writing campaigns to help dissident statisticians (and other quantitative academics—economists seemed to have a particular ...
How do police officer booking decisions affect pre-trial risk assessment tools relied upon by judges?
Identifiers being sequential could make possible estimations of the population of detained children.
We’re very happy to announce that our executive director, Patrick Ball, has been elected as a Fellow of the American Statistical Association (ASA), as announced by ASA President Nathaniel Schenker. Patrick is one of 63 new ASA Fellows to be honored this year in a ceremony at the Joint Statistical Meetings, which will take place this August 5 in Boston, Massachusetts. (more…)
Multiple Systems Estimation
What is MSE?
What do you mean by statistical inference?
What is an overlap, and how do we know when lists overlap?
How does MSE find the total number of violations?
How was MSE originally developed?
How does the Benetech Human Rights Program use MSE?
1. What is MSE?
A: Multiple Systems Estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations.
Return to Top
2. What do you mean by statistical inference?
A: ...
HRDAG analysis shows that the government figures are a gross underestimation of the drug-related killings in the Philippines.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and "Official" Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and “Official” Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
Kevin Uhrmacher of the Washington Post prepared a graph that illustrates reported deaths over time, by number of organizations reporting the deaths.
Kristian Lum, Megan Price, Tamy Guberek, and Patrick Ball. “Measuring Elusive Populations with Bayesian Model Averaging for Multiple Systems Estimation: A Case Study on Lethal Violations in Casanare, 1998-2007,” Statistics, Politics, and Policy. 1(1) 2010. All rights reserved.
This week The Statistical Journal of the IAOS published a new(ish) paper by Megan Price and Patrick Ball. The open-access paper, Selection bias and the statistical patterns of mortality in conflict, is a revisiting and updating of both the Iraq and Syria examples used in an earlier paper, Big Data, Selection Bias, and the Statistical Patterns of Mortality in Conflict, which was published last year inThe SAIS Review of International Affairs (JHU Press, 2014).
HRDAG believes that the concerns highlighted by these examples are important for a wide variety of audiences, including both the foreign policy readers reached by The SAIS Review and the ...
We aim to produce code that is clear, replicatable across machines and operating systems, and that leaves an easy-to-follow audit trail.