Working at the Historic Archive of the National Police (AHPN) of Guatemala, there are many skills I learned on the job. My many years of work on the team that studies the recovered documents have been like a custom-made course in how to do quantitative research.
The Archive documents I study are the result of 36 years of creation during civil war (1960 to 1996). Many of these documents are simply administrative—but we are able to use them to understand patterns that occurred during the conflict, to get a sense of what mattered to the National Police and what didn’t. Our quantitative research shows us the Police behavior in broad strokes. ...
<< Previous post: MSE: The Basics
Q3. What are the steps in an MSE analysis?
Q4. What does data collection look like in the human rights context? What kind of data do you collect?
Q5. [In depth] Do you include unnamed or anonymous victims in the matching process?
Q6. What do you mean by "cleaning" and "canonicalization?"
Q7. [In depth] What are some of the challenges of canonicalization? (more…)
Elizabeth Eagen of the Citizens and Technology Lab at Cornell University will expand the HRDAG advisory board.
A week in the California redwoods amongst a hodgepodge of people united by their passion for using quantitative analysis to combat injustice.
<< Previous post, MSE: The Matching Process
Q10. What is stratification?
Q11. [In depth] How do HRDAG analysts approach stratification, and why is it important?
Q12. How does MSE find the total number of violations?
Q13. [In depth] What are the assumptions of two-system MSE (capture-recapture)? Why are they not necessary with three or more systems?
Q14. What statistical model(s) does HRDAG typically use to calculate MSE estimates? (more…)
It could make sense to use Rust as a data journalist for in-browser computations, and other thoughts from RustConf.
Patrick Ball is kicking himself for a decision he made almost 25 years ago. “I was clever, but I wasn’t smart,” he says ruefully, as he considers the labyrinth of tables and ASCII-encoded keystrings he used to design a database of human rights violations for the pioneering Salvadoran non-governmental Human Rights Commission (CDHES). Now I’m sitting in his office in San Francisco’s Mission District watching over his shoulder, and trying to keep up, as he bangs out code to decipher the priceless data contained in these old files. Created in 1991 and 1992, during the last days of El Salvador’s internal armed conflict, the files detail ...
HRDAG built a machine-learning tool to strip the raw data of any potentially identifying information such as names and court case numbers. There was no "acceptable error rate."
In 1984, as a fresh PhD, I heard Richard Savage give his presidential address at the Joint Statistical Meetings in Philadelphia. He called it "Hard/Soft Problems" and made a big pitch for statisticians to get involved in human rights data analysis. It was inspirational, and I was immediately sold. I started working with the American Statistical Association's Committee on Scientific Freedom and Human Rights (now chaired by HRDAG's own Megan Price). Over time, a growing set of statisticians became involved, initially in letter-writing campaigns to help dissident statisticians (and other quantitative academics—economists seemed to have a particular ...
Patrick Ball (2018). La importancia de la estadística. Ibero. La revista de la universidad Iberoamericana. August-September 2018. © 2018 Universidad Iberoamericana Ciudad de México. Pp. 50-51.
Patrick Ball (2018). La importancia de la estadística. Ibero. La revista de la universidad Iberoamericana. August-September 2018. © 2018 Universidad Iberoamericana Ciudad de México. Pp. 50-51.
Today, February 11, is the day of national protests against the National Security Administration.
The critical threat is mass surveillance. In the words of The Day We Fight Back, “Together we will push back against powers that seek to observe, collect, and analyze our every digital action. Together, we will make it clear that such behavior is not compatible with democratic governance. Together, if we persist, we will win this fight.” (more…)
HRDAG has sampled and analyzed documents at Guatemala's AHPN and has testified against war criminals based on that analysis.
Dear friends,
Our spirits were really on the ground on Wednesday, but they lifted at the board meeting we had at the Human Rights Data Analysis Group on Thursday. Executive Director Megan Price, Director of Research Patrick Ball, and the Board drafted these thoughts which we'd like to share with you.
For more than twenty-five years, we have held heads of state accountable for human rights violations. We support our partners and advocates in the human rights field. They collect data which we analyze using technical and scientific expertise. Those scientific results bring clarity to human rights violence and support the fight for justice.
...
Some of the earliest large-scale human rights information projects happened in El Salvador. One was developed by Patrick Ball at the Salvadoran non-governmental Human Rights Commission, also known as Comision de Derechos Humanos de El Salvador (CDHES-ng). Between 1977 and 1990, more than 9,000 testimonies were taken in an effort to document the nature and scope of the bloody conflict between the army and the Farabundo Marti National Liberation Front (FMLN). Starting in 1991, Patrick worked with CDHES staff to organize the information in an early computer database. They linked reported human rights violations with the career structures of individual ...
The datasets contributed by 30+ organizations do a wonderful job of tallying the violence that was observed—but they don’t account for the violence that nobody witnessed or documented.
Excerpt from the article: The estimate is based on reports from four organizations investigating deaths in Syria from March 15, 2011, to December, 31, 2015. From those cases, the Human Rights Data Analysis Group identified 12,270 cases with sufficient information to confirm the person was killed in detention. Using a statistical method to estimate how many victims they do not yet know about, the group came up with 17,723 cases.