Reflections: A Simple Plan
I got an email from my superheroic PhD adviser in June 2006: Would I be interested in relocating to Palo Alto for six months in order to work with Patrick Ball at the Human Rights Data Analysis Group? (She'd gotten a grant and would cover my stipend.) Since I'd spent the last several months in New Haven wrestling ineffectually with giant, brain-melting methodological problems, I said yes immediately.
The plan with my adviser was simple: I'd digitize the ancient, multiply-photocopied pages of data from the United Nations Truth Commission for El Salvador, combine them ...
Reflections: HRDAG Was Born in Washington
I began working with HRDAG in the summer of 2001 before it was ever even called HRDAG. In fact, not intended as a boast, I think I’m responsible for coming up with the name. After contracting with Dr. Patrick Ball for a time writing the Analyzer data management platform, I left New York City and joined him in Washington, DC, at AAAS in 2002. Soon after starting, Patrick decided to establish an identity for this new team, consisting mainly of myself, Miguel Cruz and a handful of field relationships. We discussed what to name it briefly in the AAAS Science & Policy ...
Locating Hidden Graves in Mexico
For more than 10 years, and with regularity, Mexican authorities have been discovering mass graves, known as fosas clandestinas, in which hundreds of bodies and piles of bones have been found. The casualties are attributed broadly to the country’s “drug war,” although the motivations and perpetrators behind the mass murders are often unknown.
Recently, HRDAG collaborated with two partners in Mexico—Data Cívica and Programa de Derechos Humanos of the Universidad Iberoamericana—to model the probability of identifying a hidden grave in each county (municipio). ...
Reflections: It Began In Bogotá
It was July of 2006, I’d spent five years working at a local human rights NGO in Bogotá, and I had reached retirement age. But then a whole new world opened up for me to discover. Tamy Guberek, then HRDAG Latin America coordinator, whom I had met at the NGO, approached me about becoming part of the HRDAG Colombia team as a research/administrative assistant. Over a cup of suitably Colombian coffee, the deal was quickly "signed.” My responsibilities ranged from fundraising to translations, from support in data gathering for estimates on homicides and disappearances ...
Reflections: Growing and Learning in Guatemala
As a woman, mother and sociologist who is curious about the patterns of our political past in Guatemala, I feel privileged to know and work with the HRDAG team. Collaborating and learning from people like Patrick, Megan, Suzanne, Beatriz and Tamy has been an invaluable gift. I have discovered many things, both human and academic. For example, I’ve learned new ways of seeing what seemed everyday and simple, to discover that not only do the social sciences and statistics work hand in hand, but that they are critical for understanding Guatemala’s reality.
Twenty years ...
Letter from the Executive Director
Dear Friends,
This has been quite a year, and I don’t just mean the recent political events in the United States, Europe and the Middle East.
Thanks to your ongoing support, HRDAG has a number of accomplishments to be proud of this year:
Patrick’s testimony in the trial of Hissene Habré for crimes against humanity was cited by the judges three times in their determination of guilt.
We launched a book describing ten years of collaborative work with the Historic Archive of the National Police in Guatemala.
We contributed quantitative analyses to ...
Stephen Fienberg 1942-2016
We are saddened by the passing of Steve Fienberg yesterday in Pittsburgh, at the age of 74. He is perhaps best known around the world for bringing statistics to science and public policy and was a beloved professor at Carnegie Mellon University. At HRDAG we are in awe of and grateful for the work Steve did formalizing multiple systems estimation. His work on that front blazed a trail and essentially enabled all of our most important analytical work at the intersection of human rights and statistical science.
If we are to reduce the amount of human violence in the world, ...
HRDAG – 25 Years and Counting
Today is a very special day for all of us at HRDAG. This is, of course, the 68th anniversary of the Universal Declaration of Human Rights—but this day also marks our 25th year of using statistical science to support the advancement of human rights.
It started 25 years ago, in December 1991, in San Salvador, when Patrick Ball was invited to work with the Salvadoran Lutheran Church to design a database to keep track of human rights abuses committed by the military in El Salvador. That work soon migrated to the NGO Human Rights Commission (CDHES). Fueled by thin beer and ...
FAQs on Predictive Policing and Bias
Last month Significance magazine published an article on the topic of predictive policing and police bias, which I co-authored with William Isaac. Since then, we've published a blogpost about it and fielded a few recurring questions. Here they are, along with our responses.
Do your findings still apply given that PredPol uses crime reports rather than arrests as training data?
Because this article was meant for an audience that is not necessarily well-versed in criminal justice data and we were under a strict word limit, we simplified language in describing the data. ...
Training with HRDAG: Rules for Organizing Data and More
I had the pleasure of working with Patrick Ball at the HRDAG office in San Francisco for a week during summer 2016. I knew Patrick from two workshops he previously hosted at the University of Washington’s Centre for Human Rights (UWCHR). The workshops were indispensable to us at UWCHR as we worked to publish a number of datasets on human rights violations during the El Salvador Civil War. The training was all the more helpful because the HRDAG team was so familiar with the data. As part of an impressive career which took him from Ethiopia and Kosovo to Haiti and El ...
Using MSE to Estimate Unobserved Events
At HRDAG, we worry about what we don't know. Specifically, we worry about how we can use statistical techniques to estimate homicides that are not observed by human rights groups. Based on what we've seen studying many conflicts over the last 25 years, what we don't know is often quite different from what we do know.
The technique we use most often to estimate what we don't know is called "multiple systems estimation." In this medium-technical post, I explain how to organize data and use three R packages to estimate unobserved events.
Click here for Computing ...
HRDAG Names New Board Members Julie Broome and Frank Schulenburg
We are pleased to announce that HRDAG will be supported by two additions to our Advisory Board, Julie Broome and Frank Schulenburg.
We’ve worked with Julie for many years, getting to know her when she was Director of Programmes at The Sigrid Rausing Trust. She is now the Director of London-based Ariadne, a network of European funders and philanthropists. She worked at the Trust for seven years, most notably Head of Human Rights, before becoming Director of Programmes in 2014. Before joining the Trust she was Programme Director at the CEELI Institute in Prague, where ...
Predictive Policing Reinforces Police Bias
Issues surrounding policing in the United States are at the forefront of our national attention. Among these is the use of “predictive policing,” which is the application of statistical or machine learning models to police data, with the goal of predicting where or by whom crime will be committed in the future. Today Significance magazine published an article on this topic that I co-authored with William Isaac. Significance has kindly made this article open access (free!) for all of October. In the article we demonstrate the mechanism by which the use of predictive ...
Judges in Habré Trial Cite HRDAG Analysis
Three months after the announcement of the momentous verdict finding former Chadian president Hissène Habré guilty of crimes against humanity, the presiding judges have released the full, written 681-page judgment of the court. Testimony given by HRDAG’s director of research, Patrick Ball, is mentioned at three points in the verdict.
The judges included in their written judgment the HRDAG analysis that the mortality rate in Habré prisons was staggeringly high—much higher than the mortality rate among the population as a whole. Here’s an excerpt from the ...
HRDAG and Amnesty International: Prison Mortality in Syria
Today Amnesty International released “‘It breaks the human’: Torture, disease and death in Syria’s prisons ,” a report detailing the conditions and mortality in Syrian prisons from 2011 to 2015, including data analysis conducted by HRDAG.
The report provides harrowing accounts of ill treatment of detainees in Syrian prisons since the conflict erupted in March 2011, and publishes HRDAG’s estimate of the number of killings that occurred inside the prisons.
To accompany the report, HRDAG has released a technical memo that explains the methodology, ...
Clustering and Solving the Right Problem
In our database deduplication work, we’re trying to figure out which records refer to the same person, and which other records refer to different people.
We write software that looks at tens of millions of pairs of records. We calculate a model that assigns each pair of records a probability that the pair of records refers to the same person. This step is called pairwise classification.
However, there may be more than just one pair of records that refer to the same person. Sometimes three, four, or more reports of the same death are recorded.
So once we have all ...
HRDAG and AHPN Launch Book Detailing Collaboration
Earlier this month, HRDAG and the Historic Archive of the National Police (AHPN) of Guatemala launched a book that represents a long-time collaboration between the two organizations. The book, “Una mirada al AHPN a partir de un studio de cuantitativo,” is, as the title states, a look at the Archive’s datasets via a quantitative study. Book authors are HRDAG executive director Megan Price and AHPN colleague Carolina López, with translations by Beatriz Vejarano. The book is available in Spanish and forthcoming in English.
The book explains how HRDAG and the Archive ...
Megan Price Elected Board Member of Tor Project
Today The Tor Project announced that it has elected a new Board of Directors, and among them is HRDAG executive director Megan Price. The Tor Project is a nonprofit advocacy group that promotes online privacy and provides software that helps users opt out of online tracking.
Megan and Patrick have long maintained that encryption and privacy are essential for enabling human rights work. Patrick's ideas are described in Monday's FedScoop story about encryption, human rights, and the U.S. State Department.
“Human rights groups depend on strong cryptography in order ...
The task is a quantum of workflow
This post describes how we organize our work over ten years, twenty analysts, dozens of countries, and hundreds of projects: we start with a task. A task is a single chunk of work, a quantum of workflow. Each task is self-contained and self-documenting; I'll talk about these ideas at length below. We try to keep each task as small as possible, which makes it easy to understand what the task is doing, and how to test whether the results are correct.
In the example I'll describe here, I'm going to describe work from our Syria database matching project, which ...
Momentous Verdict against Hissène Habré
Today we’re very pleased to hear of the verdict finding Hissène Habré guilty of crimes against humanity. Habré, president of Chad from 1982 to 1990, has been sentenced to life in prison in Dakar, Senegal, where he was tried. He is the first former head of state to be tried and found guilty of crimes against humanity in one country (Chad) by the courts of another country (Senegal). Here’s more on the verdict from The Guardian.
The verdict resonates especially with HRDAG because of our role in the trial. In September 2015, director of research Patrick Ball ...
