When Data Doesn’t Tell the Whole Story

This blog is a part of International Justice Monitor’s technology for truth series, which focuses on the use of technology for evidence and features views from key proponents in the field. As highlighted by other posts in this series, emerging technology is increasing the amount and type of information available, in some contexts, to criminal and other investigations. Much of what is produced by these emerging technologies (Facebook posts, tweets, YouTube videos, text messages) falls in the category we refer to as “found” data. By “found” data we mean data ...

Read More


Focus on Good Science, not Scientists

We recently learned about an article by Dr Nafeez Ahmed that criticizes the methods and conclusions of the Iraq Body Count (IBC) and the work of Professor Michael Spagat. Dr Ahmed cites our work extensively in support of his arguments, so we think it’s useful for us to reply. We welcome Dr Ahmed’s summary of various points of scientific debate about mortality due to violence, specifically in Iraq and Colombia. We think these are very important questions for the analysis of data about violent conflict, and indeed, about data analysis more generally. We appreciate his ...

Read More


HRDAG Offers New R Package – dga

Much of the work we do at HRDAG involves estimating the number of undocumented deaths using a statistical technique called multiple systems estimation (MSE, described in more detail here). One of our goals is to make this class of methods more broadly available to human rights researchers. In particular, we are finding that Bayesian approaches are extremely valuable for MSE. Accordingly, we are pleased to offer a new R package called dga (“decomposable graphs approach”) that performs Bayesian model averaging for MSE. The main function in this package implements a ...

Read More


How many police homicides in the US? A reconsideration

(This post is co-authored by Patrick Ball and Kristian Lum.) In early March, the Bureau of Justice Statistics published a report that estimated that in the period 2003-2009 and 2011, there were approximately 7427 homicides committed by police in the US. We responded that the method the analysts used, capture-recapture with two databases, is vulnerable to underestimation if the databases exhibit positive dependence. We conduct a thorough sensitivity analysis on the original independence model as applied to the police homicides databases. We used information from several ...

Read More


HRDAG Retreat 2015

I look at the beach and then at the table surrounded by nerds, deep in thought and conversation about Dirichlet priors, matching algorithms, and armed conflicts. This peculiar (in the best way) environment catalyzes a moment of reflection: how did I get here? Four years ago, as a second-year statistics PhD student, I watched "Guatemala: The Secret Files" on PBS Frontline World. I listened to stories of family members who disappeared without answers or justice. Then the story shifted to the work being done by archivists and data experts at Guatemala's Historic Archive ...

Read More


BJS Report on Arrest-Related Deaths: True Number Likely Much Greater

(This post is co-authored by Patrick Ball and Kristian Lum.) Today the Bureau of Justice Statistics (BJS) released a report on their effort to document “all deaths that occur during the process of arrest in the United States.” The analysis estimates that the Arrest-Related Deaths (ARD) program covers only 34-49% of these deaths. A parallel program by the FBI (the Supplementary Homicide Reports, SHR) is estimated to cover approximately the same proportion of deaths. Even taking into consideration both programs, 28% of all police homicides remain unreported. In ...

Read More


The Great Lessons in Research at the Archive

Doing an investigation on the contents of the Archive brought with it three major lessons. The first big lesson was the constant movement (nothing was static), The second great lesson was that everything evolved (the changes were a constant). The third major lesson was to discover how two institutions can work together while geographically far apart. The constant movement As there were other processes being carried out at the Archive, everything was in constant movement. In other words, one day the documents were in X location and tomorrow they may be in location Y ...

Read More


Evaluation of the Kosovo Memory Book

At the end of 2014 we completed the evaluation of the Kosovo Memory Book database and are pleased to conclude that the database has succeeded in documenting all or nearly all the human losses during conflicts in Kosovo during the period from 1998 to 2000. With a motto of "Let people remember people," the goal of the Kosovo Memory Book (KMB) is to document all people who were killed or disappeared in connection with the war in Kosovo. The project aimed to document all human losses during armed conflict in the territory of the Former Yugoslav Republic (FYR) between 1998 ...

Read More


Yezidi Activists Teach HRDAG about Human Rights – updated

UPDATE (21 Dec 2014): Juan Cole is reporting that the Kurdish militia (the peshmerga) have retaken Shingal (also known as Sinjar) mountain where many Yezidi people have been trapped since 3 August 2014. They are now moving to liberate other Yezidi towns south of the mountain. The Yezidi people trapped on the mountain are now free. There is no word yet on the thousands of Yezidi people enslaved by ISIS. ORIGINAL (19 Nov 2014): Farhad (not his real name) got the call from ISIS on his personal cell phone just after lunch: we have your sister, and we will give her back if ...

Read More


Syria: No word on four abducted activists

Razan Zatouneh is an esteemed colleague of ours, and we are one of 57 organizations demanding immediate release for her and the three other human rights defenders still missing. A year on, no information on Douma Four The prominent Syrian human rights defenders Razan Zaitouneh, Samira Khalil, Wa’el Hamada and Nazem Hamadi – the Douma Four—remain missing a year after their abduction, 57 organizations said today. The four were abducted in Duma, a city near Damascus under the control of armed opposition groups. They should be released immediately, the groups ...

Read More


Revisiting the analysis of event size bias in the Iraq Body Count

(This post is co-authored by Patrick Ball and Megan Price) In a recent article in the SAIS Review of International Affairs, we wrote about "event size bias," the problem that events of different sizes have different probabilities of being reported. In this case, the size of an event is defined by the number of reported victims. Our concern is that not all violent (in this case homicide) events are recorded, that is, some events will have zero sources. Our theory is that events with fewer victims will receive less coverage than events with more victims, and that a higher ...

Read More


The AHPN: Home of Stories Old and New

Access to the records contained in archives is a concern shared by many. Archives support memory and free access to them strengthens democratic processes. Everyone should be allowed to see first-hand the records contained in an archive and be free to interpret them as needed. Access to archives can increase knowledge on various topics and opens opportunities for different fields of knowledge. (more…)

Read More


Release of Yellow Book Calls on Salvadoran Military to Open Archives

With the release today of a civil war-era catalog of “enemies,” Salvadorans are calling for a new look at the 12-year civil war during which hundreds of citizens were victims of human rights violations such as torture, forced disappearance, and illegal imprisonment. The recently leaked document, known as The Yellow Book, is a list created and (more…)

Read More


Updated Casualty Count for Syria

Today the United Nations Office of the High Commissioner for Human Rights (OHCHR) released an HRDAG-prepared report that describes and tallies documented killings in the Syrian Arab Republic from the beginning of the conflict in March 2011 through April 2014. (The report is here.) This is our third report for the UN on the Syrian conflict, and it is an update of work we published in January 2013 and June 2013. The report, Updated Statistical Analysis of Documentation of Killings in the Syrian Arab Republic, concludes that approximately 191,000 identifiable victims have ...

Read More


Patrick Ball Honored as New ASA Fellow

We’re very happy to announce that our executive director, Patrick Ball, has been elected as a Fellow of the American Statistical Association (ASA), as announced by ASA President Nathaniel Schenker. Patrick is one of 63 new ASA Fellows to be honored this year in a ceremony at the Joint Statistical Meetings, which will take place this August 5 in Boston, Massachusetts. (more…)

Read More


IRR: Agreement Among Coders is Key

For years I have been engaged in a quantitative study at Guatemala’s Historic Archive of the National Police, or AHPN. (See the blogposts below.) In this study coders collect data on sheets of paper according to criteria established and explained in manuals. But when collecting data, there’s always room for human error—this is why the validity of the study hinges on verifying that coders use the correct criteria. It is important to mention that the mainstay of coding is the use of a controlled vocabulary. A controlled vocabulary gives analysts a framework, or ...

Read More


12 Questions about Using Data Analysis to Bring Guatemalan War Criminals to Justice

When people talk about war criminals in Guatemala, which war are they talking about? They’re talking about the Guatemalan civil war, which began in 1960 and ended in 1996. That’s thirty-six years of civil war. Even though it ended almost two decades ago, Guatemala is still recovering from it. At its simplest, this civil war story was right-wing government forces fighting leftist rebels. But it went deeper than that, of course. The majority of the rebel forces was composed of indigenous peoples, primarily the Maya, (more…)

Read More


Deportation Possible for El Salvador’s Gen. García – Supported by HRDAG Analysis

Gen. José Guillermo García, El Salvador’s defense minister from 1979 to 1983, may be deported from Florida to El Salvador because of his involvement in war crimes that occurred under his command. The recommendation comes from a Miami immigration judge, whose decision was supported with expert testimony from Stanford political science professor Terry Karl, who presented extensive statistical analysis of killings, disappearances, kidnappings, torture and other crimes under Gen. García’s watch. The statistical analysis was a joint effort between Professor Karl and ...

Read More


HRDAG Drops Dropbox

On Wednesday, April 9, the file hosting service Dropbox announced the addition of Condoleezza Rice, former U.S. National Security Advisor and Secretary of State, to their Board of Directors, citing the need for “a leader who could help us expand our global footprint.” In response to this announcement, HRDAG requested (and rapidly received) a refund for our recent purchase of Dropbox for Business, and will drop the use of their service entirely. Patrick Ball, HRDAG’s Executive Director stated: “As a human rights organization, we find Condoleezza Rice's complic...

Read More


Learning Day by Day: Quantitative Research at the AHPN

Working at the Historic Archive of the National Police (AHPN) of Guatemala, there are many skills I learned on the job. My many years of work on the team that studies the recovered documents have been like a custom-made course in how to do quantitative research. The Archive documents I study are the result of 36 years of creation during civil war (1960 to 1996). Many of these documents are simply administrative—but we are able to use them to understand patterns that occurred during the conflict, to get a sense of what mattered to the National Police and what ...

Read More


Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents.

Donate