722 results for search: %EC%95%84%EA%B8%B0%EB%A7%98%EB%AF%B8%ED%8C%85%E2%99%AA%EB%B3%B4%EA%B8%B0%ED%8F%B0%ED%8C%85%E2%80%A2O%E2%91%B9O-%E2%91%BCO%E2%91%B6-O%E2%91%BAO%E2%91%BA%E2%99%AA%20%EC%9D%B4%EB%B0%B1%EB%A7%98%EB%AF%B8%ED%8C%85%20%ED%8C%8C%EC%B6%9C%EB%B6%80%EB%AF%B8%ED%8C%85%E2%88%AE%EA%B3%A0%EC%84%B1%EB%85%80%EB%AF%B8%ED%8C%85%F0%9F%94%8B%EB%8F%99%EC%95%88%EB%AF%B8%EB%85%80%EB%AF%B8%ED%8C%85%20%E8%85%9E%E6%AD%B4completeness%EC%95%84%EA%B8%B0%EB%A7%98%EB%AF%B8%ED%8C%85/feed/content/colombia/privacy
Without Encryption, My Work Wouldn’t Be Possible
Structural Zero Issue 03
August 24, 2025
Part Three of Our Three-Part “Gathering the Data” Series. Read part one and part two.
In computer security, “security” is always relative to something. What are we actually defending against, and how are we doing it? This is our “threat model.”
My colleagues and I have been using scientific tools to analyze evidence of human rights abuses, including using statistics to uncover mass graves in Mexico and analyzing under-reported police homicides in the United States.
Our work isn’t always popular. It can infuriate those in power who want to cover up incriminating truths about the ...
Celebrating Ten Years of Data from the AHPN
Ten years ago, in July 2005, human rights officers stumbled upon a nondescript warehouse in a commercial zone of Guatemala City and changed history. They had discovered an archive–its existence kept secret–belonging to the Guatemalan National Police, whose officers committed human rights atrocities on behalf of the government during the civil war.
Inside the building was the bureaucratic detritus typical of a large government agency: 80 million pages detailing shifts worked, tasks assigned, assignments fulfilled, workers’ whereabouts, and who was supervising whom. The documents, which were found stacked on dirty floors, shoved into bags, ...
HRDAG at Strata Conference 2014
Last Thursday, HRDAG co-founder and director of research Megan Price presented at Strata, the conference for data scientists and people who work with "big data." In her talk, she addressed the question of how we can know the actual number of conflict casualties in Syrian. Her short answer was, "We don't know." The longer answer was that we have a very good idea of how many conflict casualties have been reported, by several documentation groups, and that we're working on analyzing (more…)
Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment
Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
Laurel Eckhouse, Kristian Lum, Cynthia Conti-Cook and Julie Ciccolini (2018). Layers of Bias: A Unified Approach for Understanding Problems With Risk Assessment. Criminal Justice and Behavior. November 23, 2018. © 2018 Sage Journals. All rights reserved. https://doi.org/10.1177/0093854818811379
New analysis of World War II Korean “comfort women” held by Japanese
There may have been more undocumented World War II-era Korean "comfort women" than known.
La importancia de la estadística
Patrick Ball (2018). La importancia de la estadística. Ibero. La revista de la universidad Iberoamericana. August-September 2018. © 2018 Universidad Iberoamericana Ciudad de México. Pp. 50-51.
Patrick Ball (2018). La importancia de la estadística. Ibero. La revista de la universidad Iberoamericana. August-September 2018. © 2018 Universidad Iberoamericana Ciudad de México. Pp. 50-51.
Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Focus on Good Science, not Scientists
We recently learned about an article by Dr Nafeez Ahmed that criticizes the methods and conclusions of the Iraq Body Count (IBC) and the work of Professor Michael Spagat. Dr Ahmed cites our work extensively in support of his arguments, so we think it’s useful for us to reply.
We welcome Dr Ahmed’s summary of various points of scientific debate about mortality due to violence, specifically in Iraq and Colombia. We think these are very important questions for the analysis of data about violent conflict, and indeed, about data analysis more generally. We appreciate his exploration of the technical nuances of this difficult field.
Unfortunately, ...
The Art and Science of Coding AHPN Documents
The coding, from my perspective, is the heart of the project. I say this, because the coding team has the responsibility of selecting documents according to the random sample, recording the documents’ contents, and applying the criteria to convert that content into an entry in a quantitative database. Not to mention the fact that this team has the privilege of being in direct contact with the documents.
At present, because of advanced organizational processes, not everyone has a chance to hold an original document in their hands. The quantitative study had many advantages in this regard; since we started work in parallel with the archival ...
Why raw data doesn’t support analysis of violence
This morning I got a query from a journalist asking for our data from the report we published yesterday. The journalist was hoping to create an interactive infographic to track the number of deaths in the Syrian conflict over time. Our data would not support an analysis like the one proposed, so I wrote this reply.
We can't send you these data because they would be misleading—seriously misleading—for the purpose you describe. Here's why:
What we have is a list of documented deaths, in essence, a highly non-random sample, though a very big one. We like bigger samples because we think that they must be closer to true. The mathematical justif...
HRDAG Retreat 2015
I look at the beach and then at the table surrounded by nerds, deep in thought and conversation about Dirichlet priors, matching algorithms, and armed conflicts. This peculiar (in the best way) environment catalyzes a moment of reflection: how did I get here?
Four years ago, as a second-year statistics PhD student, I watched "Guatemala: The Secret Files" on PBS Frontline World. I listened to stories of family members who disappeared without answers or justice. Then the story shifted to the work being done by archivists and data experts at Guatemala's Historic Archive of the National Police. The scientists' pursuit of the truth energized me. I ...
Happy Hacking
From my first introduction to the HRDAG community at the annual retreat it was clear to me that mentorship is an organizational priority and that the contributions of interns are valued. Much of my first couple weeks as a summer intern at HRDAG were spent familiarizing myself with Patrick’s paradigm for principled data processing. At the same time, I was learning the skills and tricks (bash, make, vim, git) that promote an effortless programming workflow, a pursuit that Patrick calls “sharpening the saw” (just like in programming, you can cut down a tree with a dull blade, but your life will be much easier if you take the time to sharpen ...
How We Choose Projects
For more than 20 years, HRDAG has been carving out a niche in the international human rights movement. We know what we’re good at and what we’re not qualified to do. We know what quantitative questions we think are important for the community, and we know what we like to do. These preferences guide us as we consider whether to take on a project. We’re scientists, so our priorities will come as no surprise. We like to stick to science (not ideology), avoid advocacy, answer quantifiable questions, and increase our scientific understanding.
While we have no hard-and-fast rules about what projects to take on, we organize our deliberation ...
How many people are infected with Covid-19?
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Tarak Shah (2020). How many people are infected with Covid-19? Significance. 09 April 2020. © 2020 The Royal Statistical Society.
Colombia
Text in English
Para evaluar afirmaciones sobre la reducción de la violencia letal en Colombia
En marzo de 2007, el Grupo de Análisis de Datos de Derechos Humanos (HRDAG por sus siglas en inglés) publicó un estudio con el título de "Para Evaluar Afirmaciones Sobre la Reducción de la Violencia Letal en Colombia." Los autores de dicho estudio evaluaron aseveraciones que la violencia en Colombia disminuyó tras la desmovilización de los paramilitares. Demostraron que tales afirmaciones se basan tanto en una sobreinterpretación de datos no ajustados como en inferencias causales infundadas. Los autores concluyeron que se requieren múltip...
Funding
HRDAG’s funding comes from private, international donors: the John D. and Catherine T. MacArthur Foundation, Open Society Foundations, an anonymous U.S.-based private foundation, Ford Foundation, The National Endowment for Democracy and individual donors. This funding supports both specific projects, as well as our scientific work generally in human rights data analysis.
For the entirety of its existence, HRDAG has been a project of non-profit organizations, first at the American Association for the Advancement of Science (AAAS), and then at Benetech, a non-profit Silicon Valley technology company. In February 2013, HRDAG became ...
Identifiers of Detained Children Have Implications for Data Security and Estimation
Identifiers being sequential could make possible estimations of the population of detained children.
The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
HRDAG and #GivingTuesday 2017
Help us hold human rights violators accountable!