In this story, Carl Bialik of FiveThirtyEight interviews HRDAG executive director Patrick Ball about the process of de-duplication, integration of databases, and machine-learning in the recent enumeration of reported casualties in Syria.
New reports of old deaths come in all the time, Ball said, making it tough to maintain a database. The duplicate-removal process means “it’s a lot like redoing the whole project each time,” he said.
FiveThirtyEight
Carl Bialik
August 23, 2014
Link to story on FiveThirtyEight
Related blogpost (Updated Casualty Count for Syria)
Back to Press Room
You may contact us via info @ hrdag.org or use this form.
Would you like to receive our newsletter?
Great! Please sign up here.
Find us on Mastodon
Follow HRDAG on Mastodon.
Employment with HRDAG
Please keep in touch by signing up for our newsletters and following us on Twitter @hrdag or Mastodon.
If you do not see a job listed here, please do not send your CV or résumé, as we do not file or save them, and we will only have to send you a sad “no thank you” letter.
Volunteering with HRDAG
Are you interested in volunteering your time to the Human Rights Data Analysis Group? We’re very flattered—but at this time we’re ...
Megan Price and Patrick Ball. 2015. Canadian Journal of Law and Society / Revue Canadienne Droit et Société volume 30 issue 2 (June): 1-21. doi:10.1017/cls.2015.24. © Cambridge University Press. All rights reserved. Restricted access.
Next week, on June 11, Oxford University Press officially puts Counting Civilian Casualties: An Introduction to Recording and Estimating Nonmilitary Deaths in Conflict on the market. This textbook, edited by Taylor B. Seybolt, Jay D. Aronson, and Baruch Fischhoff, responds to the increasing concern for civilians in conflict and aims to promote scientific dialogue by highlighting the strengths and weaknesses of the most commonly used casualty recording and estimation techniques.
HRDAG is very well represented here, as our colleagues have co-authored four chapters, and Nicholas Jewell, who sits on our Science Committee, has co-authored a fifth. ...
The Rafto Foundation, an international human rights organization, has bestowed the 2021 Rafto Prize to HRDAG for its distinguished work defending human rights and democracy.
Welcome to the web data resource for the International Center for Human Rights Research (Centro Internacional para Investigaciones en Derechos Humanos, or CIIDH). Here you will find raw data on human rights violations in Guatemala during the period 1960-1996. You're welcome to use it for your own statistical analyses.
ASCII delimited (csv)
Resource Information
Data Dictionary
Value Labels
File Structure (Variables)
These files are between 300-700 kilobytes. The data are stored in a zipped compression format.
For an explanation of how the data are structured and what the variables represent, see the data dictionary.
If you use ...
In 1995, the Haitian National Commission for Truth and Justice (CNVJ) requested the advice of the American Association for the Advancement of Science (AAAS) and Dr. Patrick Ball on how to develop a large-scale project to take the testimonies of several thousand witnesses of human rights abuses in Haiti.
The team conducted work incorporating over 5,000 interviews covering over 8,500 victims to produce detailed regional analyses, using quantitative material from the interviews, historical, economic and demographic analysis.
“If you’re not careful, you risk automating the exact same biases these programs are supposed to eliminate,” says Kristian Lum, the lead statistician at the San Francisco-based, non-profit Human Rights Data Analysis Group (HRDAG). Last year, Lum and a co-author showed that PredPol, a program for police departments that predicts hotspots where future crime might occur, could potentially get stuck in a feedback loop of over-policing majority black and brown neighbourhoods. The program was “learning” from previous crime reports. For Samuel Sinyangwe, a justice activist and policy researcher, this kind of approach is “especially nefarious” because police can say: “We’re not being biased, we’re just doing what the math tells us.” And the public perception might be that the algorithms are impartial.
Under apartheid, South Africans from all sides suffered violence and human rights abuses. One of the mandates of the the South African Truth and Reconciliation Commission (TRC) was to report truth by reporting on violations and victims.
Dr. Patrick Ball, as Deputy Director of the Science and Human Rights Program (SHRP) of the American Association for the Advancement of Science (AAAS), used the who-did-what-to-whom data model to provide statistical analysis of the violations reported to the Commission, for use in the final report of the TRC.
Links:
http://shr.aaas.org/southafrica/trcsa/
http://www.doj.gov.za/trc/index....
Following a brutal 11-year civil war, the Parliament of Sierra Leone called for a Truth and Reconciliation Commission (TRC) to create "an impartial, historical record of the conflict", and "address impunity; respond to the needs of victims; promote healing and reconciliation; and prevent a repetition of the violations and abuses suffered." The full text of the TRC report is available on the Sierra Leone Web.
HRDAG assisted the TRC to build a systematic data coding system, electronic database, and secure data analysis process to manage the thousands of statements given to them in the course of their work. Dr. Ball visited Freetown twice, and HRDAG ...
“The model uses obvious predictor variables, Ball says, such as whether or not a drug lab has been busted in that county, or if the county borders the United States, or the ocean, but also includes less-obvious predictor variables such as the percentage of the county that is mountainous, the presence of highways, and the academic results of primary and secondary school students in the county.”
Patrick Ball. 2016. Granta 134: 4 March 2016. © Granta Publications. All rights reserved.
Una investigación de Dejusticia y Human Rights Data Analysis Group concluyó que hay un subconteo en los asesinatos de líderes sociales en Colombia. Es decir, que el aumento de estos crímenes en 2016 y 2017 podría ser incluso mayor al reportado por las organizaciones y por las cifras oficiales.
In this post, Cory Doctorow writes about the Significance article co-authored by Kristian Lum and William Isaac.
HRDAG has been working with the Historic Archive of the National Police in Guatemala (hereafter, the Archive) for the past seven years. The Archive contains a treasure trove of data recorded and kept by the Guatemalan National Police over the past century. When the Archive was first discovered in 2005, researchers there immediately recognized both the value and fragility of the tens of millions of documents. As a result, they reached out to HRDAG, and we reached out to volunteers at Westat to devise a plan to estimate the contents of the entire Archive as quickly as possible in case the documents were destroyed or access to them was limited. ...
