If we could glean key missing information from those fields, we would be able to use more records.
The HRDAG Tech Corner is where we collect the deeper and geekier content that we create for the website. Click the accordion blocks below to reveal each of the Tech Corner entries.
Sifting Massive Datasets with Machine Learning
Principled Data Processing
Press release from the Technical Secretariat of the Commission for Reception, Truth, and Reconciliation (CAVR)
MEDIA MISREPRESENTATIONS OF THE CAVR REPORT
Although not yet officially released, the 2500 page CAVR Report 'Chega!' has been the subject of several prominent reports in the media based on leaked versions of the Executive Summary and particularly its section on Recommendations. Stories on the Report have been carried by AFP, AP, the Japan Times, the Singapore Straits Times, Sydney Morning Herald, Lusa,Timor-Leste press and Bali Times - to name some.
Regrettably some of these stories contained serious misrepresentations of the Report which ...
Cecilia Olliveira, Patrick Ball, Dayana Blanco, Eduardo Ribeiro, Juliana Borges, Maria Isabel Couto, Nathália Oliveira (2024)."Unveiling Statistical Invisibility: The Structural Racism of the War on Drugs, its Impact on Social Inequalities, and the Need for Citizen Data Empowerment in Latin America." T20 Brasil. September 2024.
Cecilia Olliveira, Patrick Ball, Dayana Blanco, Eduardo Ribeiro, Juliana Borges, Maria Isabel Couto, Nathália Oliveira (2024).”Unveiling Statistical Invisibility: The Structural Racism of the War on Drugs, its Impact on Social Inequalities, and the Need for Citizen Data Empowerment in Latin America.” T20 Brasil. September 2024.
Benetech's Human Rights Data Analysis Group Publishes 2010 Analysis of Human Rights Violations in Five Countries
Analysis of Uncovered Government Data from Guatemala and Chad Clarifies History and Supports Criminal Prosecutions
By Ann Harrison
The past year of research by the Benetech Human Rights Data Analysis Group (HRDAG) has supported criminal prosecutions and uncovered the truth about political violence in Guatemala, Iran, Colombia, Chad and Liberia. On today's celebration of the 62nd anniversary of the Universal Declaration of Human Rights, HRDAG invites the international community to engage scientifically defensible methodologies that ...
The other data is in three files. All of the files are comma-delimited UTF-8 (like ASCII but including the characters to render Serbian names). The fields in each file are described below.
If you use these data, please cite them with the following citation, as well as this note:
“These are convenience sample data, and as such they are not a statistically representative sample of events in this conflict. These data do not support conclusions about patterns, trends, or other substantive comparisons (such as over time, space, ethnicity, age, etc.).”
Human Rights Data Analysis Group. (2002). Database of NATO airstrikes, geographic coding, and KLA ...
When working with documents in an archive, every document offers the opportunity for statistical study and quantitative research. But a document can also offer the discovery of a story. That is the case with the disappearance of Ana Lucrecia Orellana Stormont, who was reported missing on June 6, 1983, at the age of 35.
Ana Lucrecia, a professor of psychology at the University of San Carlos, was scheduled to attend a meeting with Edgar Raúl Rivas Rodríguez at the Plaza Hotel in Guatemala’s capital city. Edgar, who also went missing, was a teacher at the School of Political Science at the University. (Ana Lucrecia’s case is explained more fully ...
In this interview with Colombian newspaper El Espectador, Patrick Ball is quoted as saying “la gente que no conoce de álgebra nunca debería hacer estadísticas” (people who don’t know algebra should never do statistics).
Patrick Ball is kicking himself for a decision he made almost 25 years ago. “I was clever, but I wasn’t smart,” he says ruefully, as he considers the labyrinth of tables and ASCII-encoded keystrings he used to design a database of human rights violations for the pioneering Salvadoran non-governmental Human Rights Commission (CDHES). Now I’m sitting in his office in San Francisco’s Mission District watching over his shoulder, and trying to keep up, as he bangs out code to decipher the priceless data contained in these old files. Created in 1991 and 1992, during the last days of El Salvador’s internal armed conflict, the files detail ...
Daniel Manrique-Vallier, Patrick Ball, Mauricio Sadinle. (2022). Capture-Recapture for Casualty Estimation and Beyond: Recent Advances and Research Directions. In: Carriquiry, A.L., Tanur, J.M., Eddy, W.F. (eds) Statistics in the Public Interest. Springer Series in the Data Sciences. Springer, Cham. https://doi.org/10.1007/978-3-030-75460-0_2
Manrique-Vallier, D., Ball, P., Sadinle, M. (2022). Capture-Recapture for Casualty Estimation and Beyond: Recent Advances and Research Directions. In: Carriquiry, A.L., Tanur, J.M., Eddy, W.F. (eds) Statistics in the Public Interest. Springer Series in the Data Sciences. Springer, Cham. https://doi.org/10.1007/978-3-030-75460-0_2
Tools like Compas allegedly help judges predict future criminal activities and eliminate bias. HRDAG and partners showed how the tools recycle bias.
2021 Rafto Prize Videos
.ugb-1c7c838 .ugb-video-popup__wrapper{height:460px !important;background-color:#000000;background-image:url(https://hrdag.org/wp-content/uploads/2022/12/Screen-Shot-2022-12-09-at-3.41.30-PM.png)}.ugb-1c7c838 .ugb-video-popup__wrapper:before{background-color:#000000;opacity:0.3}.ugb-1c7c838 .ugb-video-popup__wrapper:hover:before{opacity:0.6}.ugb-1c7c838 .ugb-block-title{color:#ffffff}.ugb-1c7c838 .ugb-block-description{color:#ffffff}@media screen and (max-width:768px){.ugb-1c7c838 .ugb-video-popup__wrapper{height:208px !important}}The Rafto Prize 2021 | Rafto Foundation Rafto Foundation | HRDAG team | 2021 | 4 ...
Statisticien, Patrick Ball est à la barre ce vendredi matin. L’expert est entendu sur le taux de mortalité dans les centres de détention au Tchad sous Habré. Désigné par la chambre d’accusation, il dira avoir axé ses travaux sur des témoignages, des données venant des victimes et des documents de la DDS (Direction de la Documentation et de la Sécurité).
Kristian Lum, Erwin Ma and Mike Baiocchi (2017). The causal impact of bail on case outcomes for indigent defendants in New York City. Observational Studies 3 (2017) 39-64. 31 October 2017. © 2017 Institute of Mathematical Statistics.
Kristian Lum, Erwin Ma and Mike Baiocchi (2017). The causal impact of bail on case outcomes for indigent defendants in New York City. Observational Studies 3 (2017) 39-64. 31 October 2017. © 2017 Institute of Mathematical Statistics.
code{white-space: pre;}
pre:not([class]) {
background-color: white;
}
h1 {
font-size: 34px;
}
h1.title {
font-size: 38px;
}
h2 {
font-size: 30px;
}
h3 {
font-size: 24px;
}
h4 {
font-size: 18px;
}
h5 {
font-size: 16px;
}
h6 {
font-size: 12px;
}
.table th:not([align]) {
text-align: left;
}
.main-container {
max-width: 940px;
margin-left: auto;
margin-right: auto;
}
code {
color: inherit;
background-color: rgba(0, 0, 0, 0.04);
}
img {
max-width:100%;
height: auto;
}
.tabbed-pane {
padding-top: 12px;
}
.html-widget {
margin-bottom: 20px;
}
button.code-foldin...
Las estimaciones se estratificaron por ubicación y perpetrador.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and "Official" Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
Megan Price and Maria Gargiulo (2021). Lies, Damned Lies, and “Official” Statistics. Health and Human Rights Journal. 24 June, 2021. © Health and Human Rights Journal.
En ocasiones, las discusiones sobre ese fenómeno se centran más sobre cuál es la cifra real, mientras que el diagnóstico es el mismo: en las regiones la violencia no cede y no se avizoran políticas efectivas para ponerle fin. En medio de este complejo panorama, el Centro de Estudios de Derecho, Justicia y Sociedad (Dejusticia) y el Human Rights Data Analysis Group, publicaron este miércoles la investigación Asesinatos de líderes sociales en Colombia en 2016–2017: una estimación del universo.
Multiple Systems Estimation
What is MSE?
What do you mean by statistical inference?
What is an overlap, and how do we know when lists overlap?
How does MSE find the total number of violations?
How was MSE originally developed?
How does the Benetech Human Rights Program use MSE?
1. What is MSE?
A: Multiple Systems Estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations.
Return to Top
2. What do you mean by statistical inference?
A: ...
