176 results for search: Что сделать чтобы обратить внимание старшеклассника детальнее bit.ly/psy3000/feed/copyright
A geeky deep-dive: database deduplication to identify victims of human rights violations
In our work, we merge many databases to figure out how many people have been killed in violent conflict. Merging is a lot harder than you might think.
Many of the database records refer to the same people--the records are duplicated. We want to identify and link all the records that refer to the same victims so that each victim is counted only once, and so that we can use the structure of overlapping records to do multiple systems estimation.
Merging records that refer to the same person is called entity resolution, database deduplication, or record linkage. For definitive overviews of the field, see Scheuren, Herzog, and Winkler, Data Quality ...
Happy Ada Lovelace Day!
As an organization that uses science to advocate for human rights, the goals and issues represented by Ada Lovelace Day are very near and dear to our hearts. Additionally, we are lucky to work with and be advised by some pretty kick-ass ladies in STEM (see our People page to learn more about these amazing women (and men)).
I brainstormed a list of women I could write about, as Finding Ada suggests we celebrate today by blogging about a STEM heroine. I considered Anita Borg (she has her own institute!), who advocated tirelessly for women in computer science. I thought about Sally Wyatt, keynote speaker and organizer of the fascinating workshop...
India
In 2009, as Indians debated institutional reform of their security forces in the wake of the previous year's Mumbai attacks, HRDAG issued a groundbreaking report about the human cost of suspending the rule of law during a violent counterinsurgency campaign in the Indian state of Punjab. Together with our partner Ensaaf, HRDAG released findings that cast substantial doubt on the Indian government's past explanations and justifications for disappearances and extrajudicial killings during the height of the Punjab counterinsurgency in the early 1990s. These findings contribute to an increasing body of knowledge that informs policy questions about the ...
HRDAG Testimony in Guatemala Retrials
HRDAG analysis presented by Patrick found that 5 percent of the indigenous Maya Ixil population was killed in a 15-month period.
Lessons at HRDAG: Holding Public Institutions Accountable
Principled Data Processing is a way to prove to someone, usually yourself, that what you did was right.
Multiple Systems Estimation: The Basics
Multiple systems estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations. In this blogpost, and four more to follow, I’ll answer both conceptual and practical questions about this important method. (In posts to follow, questions that refer to specific statistical procedures or debates will be marked, "In depth.") (more…)
Sierra Leone
Following a brutal 11-year civil war, the Parliament of Sierra Leone called for a Truth and Reconciliation Commission (TRC) to create "an impartial, historical record of the conflict", and "address impunity; respond to the needs of victims; promote healing and reconciliation; and prevent a repetition of the violations and abuses suffered." The full text of the TRC report is available on the Sierra Leone Web.
HRDAG assisted the TRC to build a systematic data coding system, electronic database, and secure data analysis process to manage the thousands of statements given to them in the course of their work. Dr. Ball visited Freetown twice, and HRDAG ...
Podcast: Dr. Patrick Ball on Using Statistics to Uncover Truth
Dr. Patrick Ball recently visited the Plutopia News Network podcast for a wide-ranging, inspiring conversation about his work for the Human Rights Data Analysis Group.
Patrick spoke about how he first discovered human rights work during his time in El Salvador with the Peace Brigades International. That led to his ongoing work as a statistician and computer programmer working to assess and analyze human rights violations. He also unpacked some common statistical techniques used by researchers at Human Rights Data Analysis Group, such as multiple systems estimation, which uses multiple different datasets to gain insights into the data we don't ...
Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Reflections: Minding the Gap
How might we learn what we don’t know? HRDAG associate Christine Grillo hits the wayback machine and recalls her first exposure to People Against Bad Things, ideas about bias and correlation versus causation, and truth.
Without Encryption, My Work Wouldn’t Be Possible
Structural Zero Issue 03
August 24, 2025
Part Three of Our Three-Part “Gathering the Data” Series. Read part one and part two.
In computer security, “security” is always relative to something. What are we actually defending against, and how are we doing it? This is our “threat model.”
My colleagues and I have been using scientific tools to analyze evidence of human rights abuses, including using statistics to uncover mass graves in Mexico and analyzing under-reported police homicides in the United States.
Our work isn’t always popular. It can infuriate those in power who want to cover up incriminating truths about the ...
Scatter and keep working
Structural Zero Issue 02
July 17, 2025
Part Two of Our Three Part “Gathering the Data” Series. Read part one.
As a statistician, I spend most of my days working at a computer.
Because I work with data about human rights violations, I go to places where I can document evidence of crimes—like disappearances, killings, and torture. So while I may just be working at a computer, those computers can be in places where there is still the potential for violence to emerge.
Over the years, I’ve learned a lot about how to work in countries emerging from conflict. Those lessons seem especially applicable today, ...
Welcoming Our 2019 Human Rights Intern
Trina Reynolds-Tyler is HRDAG's 2019 Human Rights Intern.
How Data Analysis Reconsiders Deaths During Arrest
The US Bureau of Justice collects information on deaths during arrest, and HRDAG determined the efforts were incomplete. The conclusion: Approximately one third of all Americans killed by strangers are killed by police.
HRDAG Welcomes New Data Science Fellow
Our newest Data Science Fellow, Will Taylor, is currently a doctoral student in political science and public policy at the University of Michigan.
Drug-Related Killings in the Philippines
Patrick Ball, Sheila Coronel, Mariel Padilla and David Mora (2019). Drug-related killings in the Philippines. Human Rights Data Analysis Group. 26 July 2019. © HRDAG 2019.
Patrick Ball, Sheila Coronel, Mariel Padilla and David Mora (2019). Drug-related killings in the Philippines. Human Rights Data Analysis Group. 26 July 2019. © HRDAG 2019.
Tallying Syria’s War Dead
“Led by the nonprofit Human Rights Data Analysis Group (HRDAG), the process began with creating a merged dataset of “fully identified victims” to avoid double counting. Only casualties whose complete details were listed — such as their full name, date of death and the governorate they had been killed in — were included on this initial list, explained Megan Price, executive director at HRDAG. If details were missing, the victim could not be confidently cross-checked across the eight organizations’ lists, and so was excluded. This provided HRDAG and the U.N. with a minimum count of individuals whose deaths were fully documented by at least one of the different organizations. … “
How Causal Analysis Confirmed Impact of Cash Bail on Verdicts
Causal inference methods show that for indigent clients, money bail increases their likelihood of a guilty conviction.
Funding
HRDAG’s funding comes from private, international donors: the John D. and Catherine T. MacArthur Foundation, Open Society Foundations, an anonymous U.S.-based private foundation, Ford Foundation, The National Endowment for Democracy and individual donors. This funding supports both specific projects, as well as our scientific work generally in human rights data analysis.
For the entirety of its existence, HRDAG has been a project of non-profit organizations, first at the American Association for the Advancement of Science (AAAS), and then at Benetech, a non-profit Silicon Valley technology company. In February 2013, HRDAG became ...