220 results for search: cawidajo.blogspot.com/feed/rss2/fritzscheuren


Scraping for Pattern: Protecting Immigrant Rights in Washington State

With HRDAG's help, the University of Washington Center for Human Rights team has been able to analyze the scraped text and search for key words such as “jail” in order to gain insight into where immigration arrests are being made.

Predictive Policing Reinforces Police Bias

Issues surrounding policing in the United States are at the forefront of our national attention. Among these is the use of “predictive policing,” which is the application of statistical or machine learning models to police data, with the goal of predicting where or by whom crime will be committed in the future. Today Significance magazine published an article on this topic that I co-authored with William Isaac. Significance has kindly made this article open access (free!) for all of October. In the article we demonstrate the mechanism by which the use of predictive policing software may amplify the biases that already pervade our criminal ...

Multiple Systems Estimation: Collection, Cleaning and Canonicalization of Data

<< Previous post: MSE: The Basics Q3. What are the steps in an MSE analysis? Q4. What does data collection look like in the human rights context? What kind of data do you collect? Q5. [In depth] Do you include unnamed or anonymous victims in the matching process? Q6. What do you mean by "cleaning" and "canonicalization?" Q7. [In depth] What are some of the challenges of canonicalization? (more…)

Data on Kosovo Migration

[popup citation="For migrations: Ball, Patrick. (2000). AAAS/ Human Rights Data Analysis Group database of migrations in Albania and Kosovo. For killings: Patrick Ball, Wendy Betts, Fritz Scheuren, Jana Dudukovich, and Jana Asher. (2002). AAAS/ABA-CEELI/Human Rights Data Analysis Group database of killings in Kosovo. For other data: Human Rights Data Analysis Group. (2002). Database of NATO airstrikes, geographic coding, and KLA activity in Kosovo."] The data on migration from Kosovo are in seven files. All of the files are comma-delimited ASCII. The fields in each file are described below. For more information, see Policy or Panic, section A1, pp. ...

Multiple Systems Estimation: The Basics

Multiple systems estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations. In this blogpost, and four more to follow, I’ll answer both conceptual and practical questions about this important method. (In posts to follow, questions that refer to specific statistical procedures or debates will be marked, "In depth.") (more…)

How Machine Learning Protects Whistle-Blowers in Staten Island

People filed complaints against NYPD officers, and HRDAG went above and beyond to protect the privacy of the people who reported the offenses.

How Review of Police Data Verified Neglect of Missing Black Women

Sloppy recordkeeping by Chicago police has compromised missing persons cases. HRDAG is working with Pulitzer Prize-winning Invisible Institute to shed light on these stories.

Film: Solving for X

Solving for X documents Patrick's team as they travel to Guatemala, Kosovo, and Liberia, helping human rights supporters apply sophisticated computer analysis to human rights events.

Projects

We work around the world Here’s more information about How We Choose Projects.    

HRDAG Takes a Stand Against Tyranny in the United States

by Patrick Ball and Megan Price Today the Human Rights Data Analysis Group (HRDAG) publicly denounces the growing attacks on science and human rights in the United States. We reaffirm our commitment to using rigorous scientific research and data analysis to uphold accountability for perpetrators of violence—particularly when those perpetrators are in power.  For decades, HRDAG has sought accountability for those who have committed war crimes and genocide around the world. We have researched patterns of genocide, torture, disappearances, and other forms of state-sponsored violence in countries such as Guatemala, South Africa, and Haiti. We ...

Update on Work in Guatemala and the AHPN

HRDAG has sampled and analyzed documents at Guatemala's AHPN and has testified against war criminals based on that analysis.

Courts and police departments are turning to AI to reduce bias, but some argue it’ll make the problem worse

Kristian Lum: “The historical over-policing of minority communities has led to a disproportionate number of crimes being recorded by the police in those locations. Historical over-policing is then passed through the algorithm to justify the over-policing of those communities.”


Assassinations of social leaders in Colombia in 2016–2017

Patrick Ball, César Rodríguez and Valentina Rozo (2018). Asesinatos de líderes sociales en Colombia en 2016–2017: una estimación del universo. Dejusticia and Human Rights Data Analysis Group. August 2018. © 2018 HRDAG. Creative Commons.

Patrick Ball, César Rodríguez and Valentina Rozo (2018). Asesinatos de líderes sociales en Colombia en 2016–2017: una estimación del universo. Dejusticia and Human Rights Data Analysis Group. August 2018. © 2018 HRDAG. Creative Commons.


Without Encryption, My Work Wouldn’t Be Possible

Structural Zero Issue 03 August 24, 2025 Part Three of Our Three-Part “Gathering the Data” Series. Read part one and part two. In computer security, “security” is always relative to something. What are we actually defending against, and how are we doing it? This is our “threat model.” My colleagues and I have been using scientific tools to analyze evidence of human rights abuses, including using statistics to uncover mass graves in Mexico and analyzing under-reported police homicides in the United States. Our work isn’t always popular. It can infuriate those in power who want to cover up incriminating truths about the ...

Guatemala’s Bol de la Cruz Found Guilty

Today Guatemala’s former national police chief Colonel Héctor Rafael Bol de la Cruz was convicted and sentenced to 40 years in prison for his role in the 1984 kidnapping and disappearance of 27-year-old student union leader Fernando Garcia, who was last seen when officers detained him outside his home. Along with Bol de la Cruz, former senior police officer Jorge Gomez was also tried; he received a sentence of 40 years in prison. That verdict comes in part because of testimony this month by HRDAG’s Patrick Ball, who served as an expert witness and presented data analysis done with colleague Daniel Guzmán to assess the flow of thousands of ...

Reflections: A Simple Plan

I got an email from my superheroic PhD adviser in June 2006: Would I be interested in relocating to Palo Alto for six months in order to work with Patrick Ball at the Human Rights Data Analysis Group? (She'd gotten a grant and would cover my stipend.) Since I'd spent the last several months in New Haven wrestling ineffectually with giant, brain-melting methodological problems, I said yes immediately. The plan with my adviser was simple: I'd digitize the ancient, multiply-photocopied pages of data from the United Nations Truth Commission for El Salvador, combine them with two other datasets, match across all the records, and produce reliable ...

Killings of Social Movement Leaders in Colombia

Using multiple system estimation, we estimate the total population of social movement leaders killed in Colombia during 2018.

Covid-19 Research and Resources

HRDAG is identifying and interpreting the best science we can find to shed light on the global crisis brought on by the novel coronavirus, about which we still know so little. Right now, most of the data on the virus SARS-CoV-2 and Covid-19, the condition caused by the virus, are incomplete and unrepresentative, which means that there is a great deal of uncertainty. But making sense of imperfect datasets is what we do. HRDAG is contributing to a better understanding with explainers, essays, and original research, and we are highlighting trustworthy resources for those who want to dig deeper. Papers and articles by HRDAG .ugb-bbeb275 .ugb-blo...

Lessons at HRDAG: Making More Syrian Records Usable

If we could glean key missing information from those fields, we would be able to use more records.

Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents

Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.

Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.


Our work has been used by truth commissions, international criminal tribunals, and non-governmental human rights organizations. We have worked with partners on projects on five continents.

Donate