698 results for search: %E3%80%88%ED%95%98%EC%95%882%EB%8F%99%EB%8F%99%EC%95%84%EB%A6%AC%E3%80%89%20WWW-MEDA-PW%20%20%EA%B9%80%EC%A0%9C%EB%8C%81%EC%86%8C%EA%B0%9C%ED%8C%85%EC%96%B4%ED%94%8C%20%EA%B9%80%EC%A0%9C%EB%8C%81%EC%86%8C%EC%85%9C%D1%86%EA%B9%80%EC%A0%9C%EB%8C%81%EC%86%94%EB%A1%9C%D1%8B%EA%B9%80%EC%A0%9C%EB%8C%81%EC%88%9C%EC%9C%84%E3%8B%B2%E3%82%87%E8%92%80secretory/feed/rss2/chad-photo-essay/privacy
Predictive Policing Reinforces Police Bias
Issues surrounding policing in the United States are at the forefront of our national attention. Among these is the use of “predictive policing,” which is the application of statistical or machine learning models to police data, with the goal of predicting where or by whom crime will be committed in the future. Today Significance magazine published an article on this topic that I co-authored with William Isaac. Significance has kindly made this article open access (free!) for all of October. In the article we demonstrate the mechanism by which the use of predictive policing software may amplify the biases that already pervade our criminal ...
Multiple Systems Estimation: The Matching Process
<<Previous post: Collection, Cleaning, and Canonicalization of Data
Q8. What do you mean by "overlap," and why are overlaps important?
Q9. [In depth] Why is automated matching so important, and what process do you use to match records?
Q8. What do you mean by "overlap," and why are overlaps important?
MSE estimates the total number of violations by comparing the size of the overlap(s) between lists of human rights violations to the sizes of the lists themselves. By "overlap," we mean the set of incidents, such as deaths, that appear on more than one list of human rights violations. Accurately and efficiently identifying overlaps between ...
Happy Hacking
From my first introduction to the HRDAG community at the annual retreat it was clear to me that mentorship is an organizational priority and that the contributions of interns are valued. Much of my first couple weeks as a summer intern at HRDAG were spent familiarizing myself with Patrick’s paradigm for principled data processing. At the same time, I was learning the skills and tricks (bash, make, vim, git) that promote an effortless programming workflow, a pursuit that Patrick calls “sharpening the saw” (just like in programming, you can cut down a tree with a dull blade, but your life will be much easier if you take the time to sharpen ...
Guatemala 1993-1999 – Using MSE to Estimate the Number of Deaths
Propelled by the impact of data analysis in El Salvador, Patrick Ball applied his WDWTW model to human rights information in other countries. Throughout the 1990’s, Ball worked at the American Association for the Advancement of Science (AAAS) analyzing large-scale human rights violations in Ethiopia, South Africa, Haiti and Guatemala. Together with senior scientific colleagues, including statistician Dr. Herb Spirer, Ball developed new methods for analyzing state-sanctioned violence. This chapter documents how the research expanded when a group of nongovernmental organizations in Guatemala asked the scientific community to gather and analyze ...
Megan Price Elected Board Member of Tor Project
Today The Tor Project announced that it has elected a new Board of Directors, and among them is HRDAG executive director Megan Price. The Tor Project is a nonprofit advocacy group that promotes online privacy and provides software that helps users opt out of online tracking.
Megan and Patrick have long maintained that encryption and privacy are essential for enabling human rights work. Patrick's ideas are described in Monday's FedScoop story about encryption, human rights, and the U.S. State Department.
“Human rights groups depend on strong cryptography in order to hold governments accountable," says Patrick. "HRDAG depends on local human ...
‘Bias deep inside the code’: the problem with AI ‘ethics’ in Silicon Valley
Kristian Lum, the lead statistician at the Human Rights Data Analysis Group, and an expert on algorithmic bias, said she hoped Stanford’s stumble made the institution think more deeply about representation.
“This type of oversight makes me worried that their stated commitment to the other important values and goals – like taking seriously creating AI to serve the ‘collective needs of humanity’ – is also empty PR spin and this will be nothing more than a vanity project for those attached to it,” she wrote in an email.
Timor-Leste 2006 – Combining Found Data and Innovative Surveys To Uncover the Truth
Large-scale human rights violations in Timor-Leste began in 1975 when the Indonesian government invaded the small island and continued until Timorese independence in 1999. Disappearances, torture, forced displacement and extra-judicial killings took place during the Indonesian occupation compounded by a severe famine. Estimates of deaths ranged from 50,000 to 200,000, but individual sources reflected only a fraction of total fatalities. The Commission for Reception, Truth and Reconciliation in East Timor (CAVR) asked HRDAG to investigate abuses during the conflict. This chapter describes how Ball and HRDAG scientists Romesh Silva and Scott Weikart ...
Bangladesh
In December 2006, Human Rights Watch (HRW) issued a report documenting torture and unlawful killings committed by Bangladesh's Rapid Action Battalion (RAB), an elite anti-crime and anti-terrorism force. According to HRW, many of the deaths for which RAB is responsible resulted from summary executions or extreme physical abuse. The statistical analysis presented in the report, "Judge, Jury, and Death: Torture and Executions by Bangladesh's Elite Security Force," was conducted by Romesh Silva, a statistician who worked within the Benetech Human Rights Program at the time, and who now works with HRDAG.
While researching these incidents, HRW compiled ...
Celebrating Ten Years of Data from the AHPN
Ten years ago, in July 2005, human rights officers stumbled upon a nondescript warehouse in a commercial zone of Guatemala City and changed history. They had discovered an archive–its existence kept secret–belonging to the Guatemalan National Police, whose officers committed human rights atrocities on behalf of the government during the civil war.
Inside the building was the bureaucratic detritus typical of a large government agency: 80 million pages detailing shifts worked, tasks assigned, assignments fulfilled, workers’ whereabouts, and who was supervising whom. The documents, which were found stacked on dirty floors, shoved into bags, ...
HRDAG and #GivingTuesday 2018
Will you help HRDAG advance human rights?
Training with HRDAG: Rules for Organizing Data and More
I had the pleasure of working with Patrick Ball at the HRDAG office in San Francisco for a week during summer 2016. I knew Patrick from two workshops he previously hosted at the University of Washington’s Centre for Human Rights (UWCHR). The workshops were indispensable to us at UWCHR as we worked to publish a number of datasets on human rights violations during the El Salvador Civil War. The training was all the more helpful because the HRDAG team was so familiar with the data. As part of an impressive career which took him from Ethiopia and Kosovo to Haiti and El Salvador among others, Patrick himself had worked on gathering and analysing ...
The Art and Science of Coding AHPN Documents
The coding, from my perspective, is the heart of the project. I say this, because the coding team has the responsibility of selecting documents according to the random sample, recording the documents’ contents, and applying the criteria to convert that content into an entry in a quantitative database. Not to mention the fact that this team has the privilege of being in direct contact with the documents.
At present, because of advanced organizational processes, not everyone has a chance to hold an original document in their hands. The quantitative study had many advantages in this regard; since we started work in parallel with the archival ...
Frequently Asked Questions
Multiple Systems Estimation
What is MSE?
What do you mean by statistical inference?
What is an overlap, and how do we know when lists overlap?
How does MSE find the total number of violations?
How was MSE originally developed?
How does the Benetech Human Rights Program use MSE?
1. What is MSE?
A: Multiple Systems Estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations.
Return to Top
2. What do you mean by statistical inference?
A: ...
Welcoming Our 2021-2022 Human Rights and Data Science Intern
Larry Barrett has joined HRDAG as a Human Rights and Data Science Intern until February, 2022.
Reflections: Minding the Gap
How might we learn what we don’t know? HRDAG associate Christine Grillo hits the wayback machine and recalls her first exposure to People Against Bad Things, ideas about bias and correlation versus causation, and truth.
HRDAG Retreat 2018
What follows is an elaborate criss-crossing of collaborations—retreat is a time to embrace the productivity that comes with being in the same room.
500 Tamils disappeared in Army custody — New Study
The Sri Lankan army must explain to the families of the disappeared and missing what happened to an estimated 500 Tamils who disappeared in their custody at the war end on/around 18 May 2009, said two international NGOs who have been collating and analysing lists of names.
Sri Lanka has one of the largest numbers in the world of enforced disappearances but these 500 represent the largest number of disappearances all in one place and time in the country. For a detailed account of the process of estimating the 500 please see: “How many people disappeared on 17-19 May 2009 in Sri Lanka?” .
Reflections: The People Who Make the Data
HRDAG associate Miguel Cruz has an epiphany. All those data he’s drowning in? Each datapoint is a personal tragedy, a story both dark and urgent, and he’s privileged to have access.
Epidemiology has theories. We should study them.
With so many dashboards and shiny visualizations, how can an interested non-technical reader find good science among the noise?