619 results for search: %EC%98%A8%EB%9D%BC%EC%9D%B8%ED%99%8D%EB%B3%B4%E2%99%AC%ED%86%A1adgogo%E2%99%AC%EC%A7%80%EC%82%AC%EB%A9%B4%EC%84%B1%EC%9D%B8%E3%84%93%EC%98%A8%EB%9D%BC%EC%9D%B8%E2%95%8A%ED%99%8D%EB%B3%B4%EF%BC%A0%EC%A7%80%EC%82%AC%EB%A9%B4%E6%99%B9%EC%84%B1%EC%9D%B8%E4%AF%9Apaperclip/feed/rss2/copyright
Learning Day by Day: Quantitative Research at the AHPN
Working at the Historic Archive of the National Police (AHPN) of Guatemala, there are many skills I learned on the job. My many years of work on the team that studies the recovered documents have been like a custom-made course in how to do quantitative research.
The Archive documents I study are the result of 36 years of creation during civil war (1960 to 1996). Many of these documents are simply administrative—but we are able to use them to understand patterns that occurred during the conflict, to get a sense of what mattered to the National Police and what didn’t. Our quantitative research shows us the Police behavior in broad strokes. ...
Frequently Asked Questions
Multiple Systems Estimation
What is MSE?
What do you mean by statistical inference?
What is an overlap, and how do we know when lists overlap?
How does MSE find the total number of violations?
How was MSE originally developed?
How does the Benetech Human Rights Program use MSE?
1. What is MSE?
A: Multiple Systems Estimation, or MSE, is a family of techniques for statistical inference. MSE uses the overlaps between several incomplete lists of human rights violations to determine the total number of violations.
Return to Top
2. What do you mean by statistical inference?
A: ...
Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab - Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents." The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
Ayyub Ibrahim, Huy Dao, and Tarak Shah (2024). “Innocence Discovery Lab – Harnessing Large Language Models to Surface Data Buried in Wrongful Conviction Case Documents.” The Wrongful Conviction Law Review 5 (1):103-25. https://doi.org/10.29173/wclawr112. 31 May, 2024. Copyright (c) 2024 Ayyub Ibrahim, Huy Dao, Tarak Shah. Creative Commons Attribution 4.0 International License.
HRDAG is hiring – technical lead
If this could be you, let us know. Also, please feel free to pass on this link to great people.
Job Title. Technical lead with a hacker's heart
Location. A cool office in SOMA, San Francisco. You need to be on-site with us.
What we do. The Human Rights Data Analysis Group (HRDAG) develops statistical techniques to measure human rights atrocities. Our work helps bring dictators to justice through data analysis of human rights atrocities around the world. Over more than 20 years, our small team has developed technology and statistical techniques to take disjoint, incomplete, and inaccurate information from conflict zones and process it to identify ...
‘Bias deep inside the code’: the problem with AI ‘ethics’ in Silicon Valley
Kristian Lum, the lead statistician at the Human Rights Data Analysis Group, and an expert on algorithmic bias, said she hoped Stanford’s stumble made the institution think more deeply about representation.
“This type of oversight makes me worried that their stated commitment to the other important values and goals – like taking seriously creating AI to serve the ‘collective needs of humanity’ – is also empty PR spin and this will be nothing more than a vanity project for those attached to it,” she wrote in an email.
Kosovo
During the conflict between NATO and Yugoslavia in early 1999, hundreds of thousands of people fled Kosovo, and thousands more were killed. Who were the perpetrators? Statistical analysis helped answer this question.
While at the American Association for the Advancement of Science (AAAS), members of the HRDAG team wrote several reports on the conflict. With partners at ABA CEELI (American Bar Association/Central European and Eurasian Law Initiative), HRDAG submitted an expert report that was used in the trial of former Yugoslav president Slobodan Milošević at the ICTY (International Criminal Tribunal for the Former Yugoslavia) in The Hague, ...
HRDAG Names New Board Member William Isaac
William Isaac joins HRDAG's Advisory Board, bringing expertise in fairness and artificial intelligence.
Reflections: Minding the Gap
How might we learn what we don’t know? HRDAG associate Christine Grillo hits the wayback machine and recalls her first exposure to People Against Bad Things, ideas about bias and correlation versus causation, and truth.
Update on Work in Guatemala and the AHPN
HRDAG has sampled and analyzed documents at Guatemala's AHPN and has testified against war criminals based on that analysis.
Using MSE to Estimate Unobserved Events
At HRDAG, we worry about what we don't know. Specifically, we worry about how we can use statistical techniques to estimate homicides that are not observed by human rights groups. Based on what we've seen studying many conflicts over the last 25 years, what we don't know is often quite different from what we do know.
The technique we use most often to estimate what we don't know is called "multiple systems estimation." In this medium-technical post, I explain how to organize data and use three R packages to estimate unobserved events.
Click here for Computing Multiple Systems Estimation in R.
Remembering Scott Weikart
HRDAG’s core values all have a connection to Scott Weikart, 1951–2023.
Epidemiology has theories. We should study them.
With so many dashboards and shiny visualizations, how can an interested non-technical reader find good science among the noise?
Sri Lanka
Ten years after the war ended in Sri Lanka, we still don’t know to the nearest ten thousand how many people perished. The estimates for the death toll for the last five months of the war alone vary between 7000 and 147,000. In 2011, the UN said it thought approximately 40,000 civilians had died; then in 2012 an internal UN report estimated it was at least 70,000. Population data from World Bank and UN sources indicated that more than 100,000 Tamils living in the conflict areas in the north have not returned home after the war.
HRDAG has provided technical assistance to a broad range of non-governmental human rights organizations in Sri ...
The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
Anjana Samant, Noam Shemtov, Kath Xu, Sophie Beiers, Marissa Gerchick, Ana Gutierrez, Aaron Horowitz, Tobi Jegede, Tarak Shah (2023). The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool. ACLU. Summer 2023.
500 Tamils disappeared in Army custody — New Study
The Sri Lankan army must explain to the families of the disappeared and missing what happened to an estimated 500 Tamils who disappeared in their custody at the war end on/around 18 May 2009, said two international NGOs who have been collating and analysing lists of names.
Sri Lanka has one of the largest numbers in the world of enforced disappearances but these 500 represent the largest number of disappearances all in one place and time in the country. For a detailed account of the process of estimating the 500 please see: “How many people disappeared on 17-19 May 2009 in Sri Lanka?” .
The impact of overbooking on a pre-trial risk assessment tool
Kristian Lum, Chesa Boudin and Megan Price (2020). The impact of overbooking on a pre-trial risk assessment tool. FAT* '20: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. January 2020. Pages 482–491. https://doi.org/10.1145/3351095.3372846 ©ACM, Inc., 2020.
Kristian Lum, Chesa Boudin and Megan Price (2020). The impact of overbooking on a pre-trial risk assessment tool. FAT* ’20: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. January 2020. Pages 482–491. https://doi.org/10.1145/3351095.3372846 ©ACM, Inc., 2020.
Kosovo 1999 – Using MSE to Examine Political Claims
Patrick Ball expanded his use of multiple systems estimation (MSE) to clarify the history of a deadly conflict in Kosovo. The violence began in 1989 when Serbian President Slobodan Milošević revoked Kosovo's autonomous status within the Republic of Serbia triggering fighting between Kosovar Albanians and the Yugoslav government. Allegations of widespread and systematic human rights violations were made against Serbian forces and NATO intervened to repel Serb forces from Kosovo. Ball and Scheuren gathered data from Albanian border crossings and other sources in the region. They used this information to examine the claim by the Yugoslav government ...
Data Archaeology for Human Rights in Central America: HRDAG Collaborates with UWCHR
Patrick Ball is kicking himself for a decision he made almost 25 years ago. “I was clever, but I wasn’t smart,” he says ruefully, as he considers the labyrinth of tables and ASCII-encoded keystrings he used to design a database of human rights violations for the pioneering Salvadoran non-governmental Human Rights Commission (CDHES). Now I’m sitting in his office in San Francisco’s Mission District watching over his shoulder, and trying to keep up, as he bangs out code to decipher the priceless data contained in these old files. Created in 1991 and 1992, during the last days of El Salvador’s internal armed conflict, the files detail ...
Liberia 2009 – Coding Testimony to Determine Accountability for War Crimes
In July 2009, HRDAG concluded a three-year project with the Liberian Truth and Reconciliation Commission (TRC) to help clarify Liberia’s violent history and hold perpetrators accountable. A military coup in 1979 sparked 24 years of civil war in Liberia where warring factions subjected civilians to severe human rights abuses. The TRC sought to determine whether these violations represented a systematic pattern or policy. This chapter describes how HRDAG developed a statistical analysis of the more than 17,000 victim and witness statements collected by the TRC and applied Ball’s “Who Did What To Whom?” methodology. HRDAG scientist Kristen ...