One year ago, HRDAG cast out on its own as an independent nonprofit—and this first year has been busy, productive, and exciting. We’re indebted to our Advisory Board for their valuable contributions and to our funders for their generosity and participation in our mission. Highlights of the past year include contributing testimony to three court cases, publishing two reports on conflict-casualties in Syria, presenting over a dozen talks (many of which are available on our talks page), traveling to over half a dozen countries to testify, collaborate with partners, and participate in conferences/workshops, hiring a new technical lead, and bringing in ...
In our work, we merge many databases to figure out how many people have been killed in violent conflict. Merging is a lot harder than you might think.
Many of the database records refer to the same people--the records are duplicated. We want to identify and link all the records that refer to the same victims so that each victim is counted only once, and so that we can use the structure of overlapping records to do multiple systems estimation.
Merging records that refer to the same person is called entity resolution, database deduplication, or record linkage. For definitive overviews of the field, see Scheuren, Herzog, and Winkler, Data Quality ...
I had the pleasure of working with Patrick Ball at the HRDAG office in San Francisco for a week during summer 2016. I knew Patrick from two workshops he previously hosted at the University of Washington’s Centre for Human Rights (UWCHR). The workshops were indispensable to us at UWCHR as we worked to publish a number of datasets on human rights violations during the El Salvador Civil War. The training was all the more helpful because the HRDAG team was so familiar with the data. As part of an impressive career which took him from Ethiopia and Kosovo to Haiti and El Salvador among others, Patrick himself had worked on gathering and analysing ...
Doing an investigation on the contents of the Archive brought with it three major lessons. The first big lesson was the constant movement (nothing was static), The second great lesson was that everything evolved (the changes were a constant). The third major lesson was to discover how two institutions can work together while geographically far apart.
The constant movement
As there were other processes being carried out at the Archive, everything was in constant movement. In other words, one day the documents were in X location and tomorrow they may be in location Y or dispersed in multiple locations. This made it impossible to know with certai...
Guatemala is still plagued by urban crime, but it is peaceful now compared to the decades of bloody civil war that convulsed the small Central American country. As he arrives in the capital, Guatemala City, FRONTLINE/World reporter Clark Boyd recalls, “When the fighting ended in the 1990s, many here wanted to move on, burying the secrets of the war along with hundreds of thousands of the dead and disappeared. But then, in July 2005, the past thundered back.”
Trina Reynolds-Tyler's internship at HRDAG helped her use data science to find patterns in state-sanctioned violence.
Patrick Ball (2018). La importancia de la estadística. Ibero. La revista de la universidad Iberoamericana. August-September 2018. © 2018 Universidad Iberoamericana Ciudad de México. Pp. 50-51.
Patrick Ball (2018). La importancia de la estadística. Ibero. La revista de la universidad Iberoamericana. August-September 2018. © 2018 Universidad Iberoamericana Ciudad de México. Pp. 50-51.
Romesh Silva and Patrick Ball. “The Demography of Large-Scale Human Rights Atrocities: Integrating demographic and statistical analysis into post-conflicthistorical clarification in Timor-Leste.” Paper presented at the 2006 meetings of the Population Association of America.
A week in the California redwoods amongst a hodgepodge of people united by their passion for using quantitative analysis to combat injustice.