The story of one document inside the AHPN
The beginnings are crucial in every step—as critical as the beginning of sound, life, hope, and justice. Here are some first steps from the AHPN (Archivo Histórico de la Policía Nacional).
This is the story of Oficio Number COC/207-laov, a document that at first appears uninteresting. But this is not just any oficio*. This is one of the many documents that helped bring to trial the people responsible for the disappearance of Edgar Fernando García. A father, husband, son, and student, García was, like many people today, interested in changing his community for ...
Happy Ada Lovelace Day!
As an organization that uses science to advocate for human rights, the goals and issues represented by Ada Lovelace Day are very near and dear to our hearts. Additionally, we are lucky to work with and be advised by some pretty kick-ass ladies in STEM (see our People page to learn more about these amazing women (and men)).
I brainstormed a list of women I could write about, as Finding Ada suggests we celebrate today by blogging about a STEM heroine. I considered Anita Borg (she has her own institute!), who advocated tirelessly for women in computer science. I ...
Quantitative Research at the AHPN Guatemala
In early 2006 I joined the Historical Archive of the National Police (Archivo Histórico de la Policía Nacional, or AHPN) without knowing the impact it would have on my future. I started with cleaning, organizing and classifying documents—and learning, with other colleagues, what a historical archive is and how it works.
By April of that year, parallel to these learning processes, I was selected along with 20 other people to begin work on the challenging Quantitative Research project. I started as a "coder," transferring key content from documents into a datab...
Guatemala’s Bol de la Cruz Found Guilty
Today Guatemala’s former national police chief Colonel Héctor Rafael Bol de la Cruz was convicted and sentenced to 40 years in prison for his role in the 1984 kidnapping and disappearance of 27-year-old student union leader Fernando Garcia, who was last seen when officers detained him outside his home. Along with Bol de la Cruz, former senior police officer Jorge Gomez was also tried; he received a sentence of 40 years in prison. That verdict comes in part because of testimony this month by HRDAG’s Patrick Ball, who served as an expert witness and presented data ...
HRDAG is hiring – technical lead
If this could be you, let us know. Also, please feel free to pass on this link to great people.
Job Title. Technical lead with a hacker's heart
Location. A cool office in SOMA, San Francisco. You need to be on-site with us.
What we do. The Human Rights Data Analysis Group (HRDAG) develops statistical techniques to measure human rights atrocities. Our work helps bring dictators to justice through data analysis of human rights atrocities around the world. Over more than 20 years, our small team has developed technology and statistical techniques to take disjoint, incomp...
HRDAG Analysis Supports Efforts to Hold Salvadoran Commanders Accountable for 1989 Jesuit Massacre
Almost a quarter century ago, on November 16, 1989, six Jesuit scholars, their housekeeper and her 15-year-old daughter were massacred inside the University of Central America (UCA) in San Salvador, El Salvador. Their chief target was the rector of the country’s leading university. The murders were carried out by members of the elite Atlacatl Battalion, acting on the direct orders of the highest-ranking members of the Salvadoran military. The United Nations–sponsored Truth Commission for El Salvador found that members of the Salvadoran military's high command ...
HRDAG and the Digital Commons
One of the three main goals of HRDAG is education and outreach, and to that end we use Creative Commons licenses for all of our blogposts and, whenever possible, for our publications. Using a Creative Commons license makes it clear that educators are free to use HRDAG's publications, in their entirety, and with the peace of mind that they are doing so with our blessing.
Also, the use of the Creative Commons license allows us to participate in and encourage the creation of a digital commons, which we feel helps to advance another one of our goals, the creation of ...
Film: Solving for X
Solving for X documents Patrick's team as they travel to Guatemala, Kosovo, and Liberia, helping human rights supporters apply sophisticated computer analysis to human rights events.
Why raw data doesn't support analysis of violence
This morning I got a query from a journalist asking for our data from the report we published yesterday. The journalist was hoping to create an interactive infographic to track the number of deaths in the Syrian conflict over time. Our data would not support an analysis like the one proposed, so I wrote this reply.
We can't send you these data because they would be misleading—seriously misleading—for the purpose you describe. Here's why:
What we have is a list of documented deaths, in essence, a highly non-random sample, though a very big one. We like bigger samples ...
Counting Casualties in Syria
Today the United Nations Office of the High Commissioner for Human Rights (OHCHR) released a report prepared by me and my colleagues describing the current state of reported killings in the Syrian Arab Republic from the beginning of the conflict in March 2011 through April 2013. (UN news release here.) This report is an update of work we published in January 2013. This updated analysis includes records from eight data sources documenting a total of 92,901 reported killings.
Our analysis begins with 263,055 total records reported by the eight data sources that ...
HRDAG contributes to textbook Counting Civilian Casualties
Next week, on June 11, Oxford University Press officially puts Counting Civilian Casualties: An Introduction to Recording and Estimating Nonmilitary Deaths in Conflict on the market. This textbook, edited by Taylor B. Seybolt, Jay D. Aronson, and Baruch Fischhoff, responds to the increasing concern for civilians in conflict and aims to promote scientific dialogue by highlighting the strengths and weaknesses of the most commonly used casualty recording and estimation techniques.
HRDAG is very well represented here, as our colleagues have co-authored four chapters, and ...
Hat-Tip from Guatemala Judges on HRDAG Evidence
We welcome the verdict of a week ago by Judges Barrios, Bustamante, and Xitumul in the conviction of General Efraín Ríos Montt for genocide and crimes against humanity. Their 718-page written opinion contains many compelling arguments, findings, and conclusions. But the section we at HRDAG are most interested in is the one on page 245 (see original, below), where Patrick's testimony is referred to. (more…)
Historic verdict in Guatemala—Gen.Efraín Ríos Montt found guilty
I've been working with various projects in Guatemala to document mass violence since 1993, so in 2011, when Claudia Paz y Paz asked me to revisit the analysis I did for the Commission for Historical Clarification examining the differential mortality rates due to homicide for indigenous and non-indigenous people in the Ixil region, I was delighted. We have far better data processing and statistical methods than we had in 1998, plus much more data. I think the resulting analysis is a conservative lower bound on total homicides of indigenous people. (more…)
How we go about estimating casualties in Syria—Part 1
I spent the two weeks over Easter working with Patrick and Megan in San Francisco, trying to figure out a strategy of how best to estimate the number of casualties the Syrian civil war has claimed in the past two years. In January, HRDAG published a report on the number of fully identified casualties reported in the Syrian Arab Republic between March 2011 and November 2012. The number of de-duplicated records of killings for this period was 59,648, a number that is likely to be an undercount since we know that many incidences of lethal violence in conflict go unreported, ...
Trips to and from Guatemala
HRDAG has been working with the Historic Archive of the National Police in Guatemala (hereafter, the Archive) for the past seven years. The Archive contains a treasure trove of data recorded and kept by the Guatemalan National Police over the past century. When the Archive was first discovered in 2005, researchers there immediately recognized both the value and fragility of the tens of millions of documents. As a result, they reached out to HRDAG, and we reached out to volunteers at Westat to devise a plan to estimate the contents of the entire Archive as quickly ...
HRDAG and the Trial of José Efraín Ríos Montt
At some point in the next week, HRDAG's executive director, Patrick Ball, will be providing expert testimony in the trial of General José Efraín Ríos Montt, the de-facto president of Guatemala in 1982-1983. Gen. Ríos is being tried on charges of genocide and crimes against humanity. (His military intelligence director, Gen. Mauricio Rodríguez Sánchez is also on trial.) Patrick will testify on approximately April 15-18, 2013, and he may begin as early as this Friday, April 12.
The trial opened on March 20, 2013, in the Supreme Court building in Guatemala City. ...
Convenience Samples: What they are, and what they should (and should not) be used for
As noted on our Core Concepts page, we spend a lot of time worrying about the ways data are used to make claims about human rights violations. This is because inaccurate statistics can damage the credibility of human rights claims. Analyses of records of human rights violations are used to guide policy decisions, determine resource allocation for interventions, and inform transitional justice mechanisms. It is vital that such analyses are accurate.
Unfortunately, all too often these decisions are based, inappropriately, on analyses of a single convenience sample. ...
Multiple Systems Estimation: Does it Really Work?
<< Previous post, MSE: Stratification and Estimation
Q15. Are there other MSE models one might use with human rights data?
Q16. Is it possible to use MSE to model non-lethal human rights violations?
Q17. I am concerned about using MSE with my data, because the datasets were gathered by opposing organizations. Victims who were reported to an NGO were very unlikely to be reported to state sources, but also very likely to be reported to religious organizations. Won't that cause the overlaps between the NGO list and the state list to be artificially low, and the ...
Multiple Systems Estimation: Stratification and Estimation
<< Previous post, MSE: The Matching Process
Q10. What is stratification?
Q11. [In depth] How do HRDAG analysts approach stratification, and why is it important?
Q12. How does MSE find the total number of violations?
Q13. [In depth] What are the assumptions of two-system MSE (capture-recapture)? Why are they not necessary with three or more systems?
Q14. What statistical model(s) does HRDAG typically use to calculate MSE estimates? (more…)
Multiple Systems Estimation: The Matching Process
<<Previous post: Collection, Cleaning, and Canonicalization of Data
Q8. What do you mean by "overlap," and why are overlaps important?
Q9. [In depth] Why is automated matching so important, and what process do you use to match records?
Q8. What do you mean by "overlap," and why are overlaps important?
MSE estimates the total number of violations by comparing the size of the overlap(s) between lists of human rights violations to the sizes of the lists themselves. By "overlap," we mean the set of incidents, such as deaths, that appear on more than one list of ...