The data science field is always changing, which means that I'll always be learning.
Shemika Lamare has joined the HRDAG team as our new data science fellow.
Trina Reynolds-Tyler is HRDAG's 2019 Human Rights Intern.
It was July of 2006, I’d spent five years working at a local human rights NGO in Bogotá, and I had reached retirement age. But then a whole new world opened up for me to discover. Tamy Guberek, then HRDAG Latin America coordinator, whom I had met at the NGO, approached me about becoming part of the HRDAG Colombia team as a research/administrative assistant. Over a cup of suitably Colombian coffee, the deal was quickly "signed.” My responsibilities ranged from fundraising to translations, from support in data gathering for estimates on homicides and disappearances in various regions of Colombia to editorial support to different Benetech-HRDAG ...
Patrick Ball expanded his use of multiple systems estimation (MSE) to clarify the history of a deadly conflict in Kosovo. The violence began in 1989 when Serbian President Slobodan Milošević revoked Kosovo's autonomous status within the Republic of Serbia triggering fighting between Kosovar Albanians and the Yugoslav government. Allegations of widespread and systematic human rights violations were made against Serbian forces and NATO intervened to repel Serb forces from Kosovo. Ball and Scheuren gathered data from Albanian border crossings and other sources in the region. They used this information to examine the claim by the Yugoslav government ...
Propelled by the impact of data analysis in El Salvador, Patrick Ball applied his WDWTW model to human rights information in other countries. Throughout the 1990’s, Ball worked at the American Association for the Advancement of Science (AAAS) analyzing large-scale human rights violations in Ethiopia, South Africa, Haiti and Guatemala. Together with senior scientific colleagues, including statistician Dr. Herb Spirer, Ball developed new methods for analyzing state-sanctioned violence. This chapter documents how the research expanded when a group of nongovernmental organizations in Guatemala asked the scientific community to gather and analyze ...
Text in English
Para evaluar afirmaciones sobre la reducción de la violencia letal en Colombia
En marzo de 2007, el Grupo de Análisis de Datos de Derechos Humanos (HRDAG por sus siglas en inglés) publicó un estudio con el título de "Para Evaluar Afirmaciones Sobre la Reducción de la Violencia Letal en Colombia." Los autores de dicho estudio evaluaron aseveraciones que la violencia en Colombia disminuyó tras la desmovilización de los paramilitares. Demostraron que tales afirmaciones se basan tanto en una sobreinterpretación de datos no ajustados como en inferencias causales infundadas. Los autores concluyeron que se requieren múltip...
This past year at HRDAG has been about continuing efforts to uncover the truth.
Laurel Eckhouse (2017). Big data may be reinforcing racial bias in the criminal justice system. Washington Post. 10 February 2017. © 2017 Washington Post.
Laurel Eckhouse (2017). Big data may be reinforcing racial bias in the criminal justice system. Washington Post. 10 February 2017. © 2017 Washington Post.
HRDAG’s funding comes from private, international donors: the John D. and Catherine T. MacArthur Foundation, Open Society Foundations, an anonymous U.S.-based private foundation, Ford Foundation, The National Endowment for Democracy and individual donors. This funding supports both specific projects, as well as our scientific work generally in human rights data analysis.
For the entirety of its existence, HRDAG has been a project of non-profit organizations, first at the American Association for the Advancement of Science (AAAS), and then at Benetech, a non-profit Silicon Valley technology company. In February 2013, HRDAG became ...
Tamy Guberek, Daniel Guzmán, Romesh Silva, Kristen Cibelli, Jana Asher, Scott Weikart, Patrick Ball, and Wendy Grossman. “Truth and Myth in Sierra Leone: An Empirical Analysis of the Conflict, 1991–2000″ (pdf). A report by the Benetech Human Rights Data Analysis Group and the American Bar Association. March 28, 2006.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
Kristian Lum and William Isaac (2016). To predict and serve? Significance. October 10, 2016. © 2016 The Royal Statistical Society.
The Historic Archive of the Guatemalan National Police (hereafter the Archive) was discovered, quite by accident, in July 2005. Researchers immediately recognized both the importance and the fragility of the Archive's contents. As a result, in early 2006 the Archive team invited Patrick to evaluate the documents and help them answer a seemingly simple question: How can we learn about the contents of the Archive in a shorter period of time than is needed to systematically examine each individual document?
After inspecting the Archive, Patrick designed a multi-stage random sample of documents. In May 2006, Tamy Guberek, Daniel Guzmán, and ...
Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG's Kristian Lum and Tarak Shah served as Project Members and made contributions to the primer.>>
Sarah L. Desmarais and Evan M. Lowder (2019). Pretrial Risk Assessment Tools: A Primer for Judges, Prosecutors, and Defense Attorneys. Safety and Justice Challenge, February 2019. © 2019 Safety and Justice Challenge. <<HRDAG’s Kristian Lum and Tarak Shah served as Project Members and made significant contributions to the primer.>>
In our work, we merge many databases to figure out how many people have been killed in violent conflict. Merging is a lot harder than you might think.
Many of the database records refer to the same people--the records are duplicated. We want to identify and link all the records that refer to the same victims so that each victim is counted only once, and so that we can use the structure of overlapping records to do multiple systems estimation.
Merging records that refer to the same person is called entity resolution, database deduplication, or record linkage. For definitive overviews of the field, see Scheuren, Herzog, and Winkler, Data Quality ...
Today we celebrate the 65th anniversary of the Universal Declaration of Human Rights, which was adopted by the UN General Assembly on 10 December 1948. At HRDAG, we are non-partisan: we do not favor any party or government in conflicts. But we are not neutral: we are always in favor of human rights. We believe in the power and value of data; as we see it, data distills human actions and existence, all of which have power and value. With this in mind, we propose these seven articles that comprise our declaration of a few data rights (click through the links for some examples).
Preamble
Whereas data represents the suffering of human beings,
Whereas ...
Price, Megan, Jeff Klingner, Anas Qtiesh, and Patrick Ball. 2013. Commissioned by the United Nations Office of the High Commissioner for Human Rights (OHCHR). Human Rights Data Analysis Group (June 13). © 2013 HRDAG. Creative Commons BY-NC-SA. [pdf via UN]