In our work, we merge many databases to figure out how many people have been killed in violent conflict. Merging is a lot harder than you might think.
Many of the database records refer to the same people--the records are duplicated. We want to identify and link all the records that refer to the same victims so that each victim is counted only once, and so that we can use the structure of overlapping records to do multiple systems estimation.
Merging records that refer to the same person is called entity resolution, database deduplication, or record linkage. For definitive overviews of the field, see Scheuren, Herzog, and Winkler, Data Quality ...
In a CNN interview predicting a Nobel Peace Prize winner, Henrik Urdal from PRIO talks about his shortlist and HRDAG.
If this could be you, let us know. Also, please feel free to pass on this link to great people.
Job Title. Technical lead with a hacker's heart
Location. A cool office in SOMA, San Francisco. You need to be on-site with us.
What we do. The Human Rights Data Analysis Group (HRDAG) develops statistical techniques to measure human rights atrocities. Our work helps bring dictators to justice through data analysis of human rights atrocities around the world. Over more than 20 years, our small team has developed technology and statistical techniques to take disjoint, incomplete, and inaccurate information from conflict zones and process it to identify ...
Following a brutal 11-year civil war, the Parliament of Sierra Leone called for a Truth and Reconciliation Commission (TRC) to create "an impartial, historical record of the conflict", and "address impunity; respond to the needs of victims; promote healing and reconciliation; and prevent a repetition of the violations and abuses suffered." The full text of the TRC report is available on the Sierra Leone Web.
HRDAG assisted the TRC to build a systematic data coding system, electronic database, and secure data analysis process to manage the thousands of statements given to them in the course of their work. Dr. Ball visited Freetown twice, and HRDAG ...
The institution’s objectives were to learn the truth about what happened during the armed conflict.
HRDAG’s funding comes from private, international donors: the John D. and Catherine T. MacArthur Foundation, Open Society Foundations, an anonymous U.S.-based private foundation, Ford Foundation, The National Endowment for Democracy and individual donors. This funding supports both specific projects, as well as our scientific work generally in human rights data analysis.
For the entirety of its existence, HRDAG has been a project of non-profit organizations, first at the American Association for the Advancement of Science (AAAS), and then at Benetech, a non-profit Silicon Valley technology company. In February 2013, HRDAG became ...
Earlier this month, HRDAG and the Historic Archive of the National Police (AHPN) of Guatemala launched a book that represents a long-time collaboration between the two organizations. The book, “Una mirada al AHPN a partir de un studio de cuantitativo,” is, as the title states, a look at the Archive’s datasets via a quantitative study. Book authors are HRDAG executive director Megan Price and AHPN colleague Carolina López, with translations by Beatriz Vejarano. The book is available in Spanish and forthcoming in English.
The book explains how HRDAG and the Archive worked together over a decade to gain insight into the police activities that ...
Profile touching on HRDAG’s work on the trial and conviction of Hissène Habré, its US Policing Project, data integrity, data archaeology and more.
Lum, Kristian, Megan Emily Price, and David Banks. 2013. The American Statistician 67, no. 4: 191-200. doi: 10.1080/00031305.2013.821093. © 2013 The American Statistician. All rights reserved. [free eprint may be available].
Bailey joined HRDAG as a data scientist in 2022.
The World According to Artificial Intelligence – The Bias in the Machine (Part 2)
Artificial intelligence might be a technological revolution unlike any other, transforming our homes, our work, our lives; but for many – the poor, minority groups, the people deemed to be expendable – their picture remains the same.
Patrick Ball is interviewed: “The question should be, Who bears the cost when a system is wrong?”
“Revolution Analytics will allow HRDAG to handle bigger data sets and leverage the power of R to accomplish this goal and uncover the truth.” Director of Research Megan Price is quoted
This past year at HRDAG has been about continuing efforts to uncover the truth.
Shira Mitchell, Al Ozonoff, Alan Zaslavsky, Bethany Hedt-Gauthier, Kristian Lum and Brent Coull (2013). A Comparison of Marginal and Conditional Models for Capture-Recapture Data with Application to Human Rights Violations Data. Biometrics, Volume 69, Issue 4, pages 1022–1032, December 2013. © 2013, The International Biometric Society. DOI: 10.1111/biom.12089.
Shira Mitchell, Al Ozonoff, Alan Zaslavsky, Bethany Hedt-Gauthier, Kristian Lum and Brent Coull (2013). A Comparison of Marginal and Conditional Models for Capture-Recapture Data with Application to Human Rights Violations Data. Biometrics, , Issue 4, pages 1022–1032, December 2013. © 2013, The International Biometric Society. DOI: 10.1111/biom.12089.
Given a positive test result, what is the probability that an individual has antibodies? This HRDAG-authored
Granta article explains the science.
