But while HRDAG’s estimate relied on the painstaking efforts of human workers to carefully weed out potential duplicate records, hashing with statistical estimation proved to be faster, easier and less expensive. The researchers said hashing also had the important advantage of a sharp confidence interval: The range of error is plus or minus 1,772, or less than 1 percent of the total number of victims.
“The big win from this method is that we can quickly calculate the probable number of unique elements in a dataset with many duplicates,” said Patrick Ball, HRDAG’s director of research. “We can do a lot with this estimate.”
At some point in the next week, HRDAG's executive director, Patrick Ball, will be providing expert testimony in the trial of General José Efraín Ríos Montt, the de-facto president of Guatemala in 1982-1983. Gen. Ríos is being tried on charges of genocide and crimes against humanity. (His military intelligence director, Gen. Mauricio Rodríguez Sánchez is also on trial.) Patrick will testify on approximately April 15-18, 2013, and he may begin as early as this Friday, April 12.
The trial opened on March 20, 2013, in the Supreme Court building in Guatemala City. According to an Open Society Justice Initiative blogpost covering the event, the ...
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
On the anniversary of the Universal Declaration of Human Rights, HRDAG executive director Megan Price tells us why she loves her work, and why she feels hopeful about the future.
This past year at HRDAG has been about continuing efforts to uncover the truth.
At HRDAG, we worry about what we don't know. Specifically, we worry about how we can use statistical techniques to estimate homicides that are not observed by human rights groups. Based on what we've seen studying many conflicts over the last 25 years, what we don't know is often quite different from what we do know.
The technique we use most often to estimate what we don't know is called "multiple systems estimation." In this medium-technical post, I explain how to organize data and use three R packages to estimate unobserved events.
Click here for Computing Multiple Systems Estimation in R.
In this NPR story, HRDAG’s Patrick Ball comments on first-of-its-kind projections.
Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG's Kristian Lum and Tarak Shah served as Project Members and made contributions to the primer.>>
Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG’s Kristian Lum and Tarak Shah served as Project Members and made significant contributions to the primer.>>
Megan Price, Anita Gohdes, and Patrick Ball (2014). Human Rights Data Analysis Group, commissioned by the United Nations Office of the High Commissioner for Human Rights (OHCHR). August 22, 2014. © 2014 HRDAG. Creative Commons BY-NC-SA.
In this video, Trina Reynolds-Tyler of Invisible Institute talks about her work with HRDAG on the missing persons project in Chicago and Beneath the Surface.
Inaccurate statistics can damage the credibility of human rights claims—and that's why we strive to ensure that statistics about human rights violations are generated with as much rigor and are as scientifically accurate as possible.
But, what are the pitfalls leading to inaccuracy—when, where, and how do data become compromised? How are patterns biased by having only partial data? And what are the best scientific methods for collecting, managing, processing and analyzing data?
Here are the data pitfalls that HRDAG has identified, as well as some of our approaches for meeting these challenges. We believe that human rights researchers must take ...
Today The Tor Project announced that it has elected a new Board of Directors, and among them is HRDAG executive director Megan Price. The Tor Project is a nonprofit advocacy group that promotes online privacy and provides software that helps users opt out of online tracking.
Megan and Patrick have long maintained that encryption and privacy are essential for enabling human rights work. Patrick's ideas are described in Monday's FedScoop story about encryption, human rights, and the U.S. State Department.
“Human rights groups depend on strong cryptography in order to hold governments accountable," says Patrick. "HRDAG depends on local human ...
<< Previous post: MSE: The Basics
Q3. What are the steps in an MSE analysis?
Q4. What does data collection look like in the human rights context? What kind of data do you collect?
Q5. [In depth] Do you include unnamed or anonymous victims in the matching process?
Q6. What do you mean by "cleaning" and "canonicalization?"
Q7. [In depth] What are some of the challenges of canonicalization? (more…)
Doing an investigation on the contents of the Archive brought with it three major lessons. The first big lesson was the constant movement (nothing was static), The second great lesson was that everything evolved (the changes were a constant). The third major lesson was to discover how two institutions can work together while geographically far apart.
The constant movement
As there were other processes being carried out at the Archive, everything was in constant movement. In other words, one day the documents were in X location and tomorrow they may be in location Y or dispersed in multiple locations. This made it impossible to know with certai...
We’ve known for years that Beka Steorts is on the cutting-edge of statistical science, and now The MIT Technology Review has realized the same. Last week she was named one of 35 Innovators Under 35, in the category of humanitarian.
We first became familiar with Beka's work in 2013 when she was a visiting professor at Carnegie Mellon and was introduced to us by Prof. Steve Fienberg. Since then, we’ve felt very fortunate to collaborate with her on projects such as the UN enumeration of casualties in the Syrian conflict, and we look forward to many more years of work with her. She is one of several young stars we include in our superheroine hall ...
