226 results for search: www.xn--299aqd11rg1lb34as7a.net/feed/patrickball
How Data Analysis Reconsiders Deaths During Arrest
The US Bureau of Justice collects information on deaths during arrest, and HRDAG determined the efforts were incomplete. The conclusion: Approximately one third of all Americans killed by strangers are killed by police.
Dictatorships create a lot of data
Structural Zero Issue 01
Jun 03, 2025
Part One of Our Three Part “Gathering the Data” Series
As a statistician, I spend most days trying to wrangle and analyze massive data sets. The specific data I deal with is documentation of human rights violations. My job is to make sense of data that I know is incomplete and answer questions about the past using statistical analysis and scientific reasoning.
But where does this data come from? How was it generated, and how do human rights advocates and researchers access it and secure it?
To kick off our new newsletter Structural Zero, I’ll be writing a ...
Improving the estimate of U.S. police killings
Cory Doctorow of Boing Boing writes about HRDAG executive director Patrick Ball and his contribution to Carl Bialik’s article about the recently released Bureau of Justice Statistics report on the number of annual police killings, both reported and unreported, in 538 Politics.
In Colombia: HRDAG and Dejusticia on the Importance of Missing Data
It’s inevitable that databases will have information gaps, and special care must be taken to account for these gaps.
The story of one document inside the AHPN
The beginnings are crucial in every step—as critical as the beginning of sound, life, hope, and justice. Here are some first steps from the AHPN (Archivo Histórico de la Policía Nacional).
This is the story of Oficio Number COC/207-laov, a document that at first appears uninteresting. But this is not just any oficio*. This is one of the many documents that helped bring to trial the people responsible for the disappearance of Edgar Fernando García. A father, husband, son, and student, García was, like many people today, interested in changing his community for the better. (more…)
The task is a quantum of workflow
This post describes how we organize our work over ten years, twenty analysts, dozens of countries, and hundreds of projects: we start with a task. A task is a single chunk of work, a quantum of workflow. Each task is self-contained and self-documenting; I'll talk about these ideas at length below. We try to keep each task as small as possible, which makes it easy to understand what the task is doing, and how to test whether the results are correct.
In the example I'll describe here, I'm going to describe work from our Syria database matching project, which includes about 100 tasks. I'll start with the first thing we do with files we receive ...
Privacy Policy
Mailing List Subscription
We use Mailchimp to help us keep track of community members who want to stay informed about what HRDAG is doing and thinking. If you self-subscribe to our list, we will never share your contact information. We will never subscribe anyone who does not explicitly agree to a subscription.
Over the course of a year, we mail quarterly letters and fundraising letters, as well as one or two updates as events demand. If, during the course of a fundraising campaign, you make a donation, we will do our best to remove you from the remainder of fundraising mailings that year. We may use your contact information to invite you to ...
Timor-Leste
During the violence in Timor-Leste in June 2006, armed gangs broke into the offices of the Commission for Reception, Truth and Reconciliation (CAVR) in Dili and stole their motorbikes.
The Human Rights Data Analysis Group, then at Benetech®, and other human rights observers wondered whether the mobs would soon return to loot the irreplaceable paper records used by the CAVR to compile their definitive report entitled "Chega!"
The Benetech Initiative contributed to the CAVR findings and released a separate statistical report (PDF) establishing that at least 102,800 (+/- 11,000) Timorese died as a result of human rights violations in Timor-Leste ...
Timor-Leste FAQs
How do you know that there are more conflict-related deaths than have been reported to the Commission for Reception, Truth and Reconciliation (CAVR, by its Portuguese acronym)?
Where did the method of multiple systems estimation come from?
If you didn't have access to the whole population, how do you know how representative these data are of the entire population? i.e. How do you control for bias?
What are the total conflict-related mortality numbers? How many people were killed and disappeared between 1974 and 1999? And how many people died due to hunger and illness?
What is the margin of error associated with these results?
What is ...
Transitional Justice in Syria: Accountability and Reconciliation Conference
I spent last weekend in Istanbul at an excellent conference organized by the Syrian Center for Political and Strategic Studies (SCPSS). The conference included numerous non-governmental organizations (NGOs) from Syria as well as international human rights researchers and advocates. Families of victims told their stories, data collection groups discussed the challenges, and need, to document violations, transitional justice experts worried about infrastructure such as the police force and judicial system, and local leaders pledged to work together for peace.
I was invited to speak about HRDAG's recent report examining killings in Syria documented by ...
Talks
Upcoming Talks
TBA
Past Talks
2015
Presentation on the research behind the Evaluation of the Kosovo Memory Book Database. National Archive, Pristina, Kosovo. Patrick Ball. February 4, 2015.
How do we know what we know? Patrick Ball. Arizona State University. January, 2015.
AAAS Science & Human Rights Coalition Meeting: Big Data & Human Rights. Megan Price, panelist. Washington, D.C. January 15-16, 2015.
Examining the Crisis in Syria: Conference Hosted by New America and Arizona State University’s Center on the Future of War and the Walter Cronkite School of Journalism and Mass Communication. Megan Price, panelist. Washingt...
HRDAG is hiring – technical lead
If this could be you, let us know. Also, please feel free to pass on this link to great people.
Job Title. Technical lead with a hacker's heart
Location. A cool office in SOMA, San Francisco. You need to be on-site with us.
What we do. The Human Rights Data Analysis Group (HRDAG) develops statistical techniques to measure human rights atrocities. Our work helps bring dictators to justice through data analysis of human rights atrocities around the world. Over more than 20 years, our small team has developed technology and statistical techniques to take disjoint, incomplete, and inaccurate information from conflict zones and process it to identify ...
Datasets available for research
Over the last few years, we've tried to make the data organized in our projects publicly accessible. We have encouraged our partners to publish the data at the completion of the project. We continue to believe it is important to offer access to the data used in our projects for the sake of transparency as well as to encourage further research and analysis. However, we are increasingly concerned about how raw data are used. Data collected by what we can observe is what statisticians call a convenience sample, which is subject to selection bias.
We're keeping these datasets available for researchers who want to use them for simulation or estimation ...
Liberian TRC Data and Data Dictionary
The files linked on this page contain the data used in the calculations presented in Benetech's report to the Liberian Truth and Reconciliation Commission entitled "Descriptive Statistics From Statements to the Liberian Truth and Reconciliation Commission." In accordance with Benetech's Memorandum of Understanding with the TRC, these data are published on the Internet so that others can use the material to replicate our findings and continue research on past human rights violations in Liberia. In order to protect the privacy of the people who suffered, the information in the files below contains no personal identifying information about the victims or ...
Tech Corner
The HRDAG Tech Corner is where we collect the deeper and geekier content that we create for the website. Click the accordion blocks below to reveal each of the Tech Corner entries.
Sifting Massive Datasets with Machine Learning
Principled Data Processing
HRDAG Drops Dropbox
On Wednesday, April 9, the file hosting service Dropbox announced the addition of Condoleezza Rice, former U.S. National Security Advisor and Secretary of State, to their Board of Directors, citing the need for “a leader who could help us expand our global footprint.”
In response to this announcement, HRDAG requested (and rapidly received) a refund for our recent purchase of Dropbox for Business, and will drop the use of their service entirely.
Patrick Ball, HRDAG’s Executive Director stated: “As a human rights organization, we find Condoleezza Rice's complicity in the serious human rights abuses of the Bush administration very worrying. ...