125 results for search: %EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD - %EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD-%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD-%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD %EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD %EF%BF%BD%EF%BF%BD %EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD%EF%BF%BD Skype:amt777
Privacy Policy
Mailing List Subscription
We use Mailchimp to help us keep track of community members who want to stay informed about what HRDAG is doing and thinking. If you self-subscribe to our list, we will never share your contact information. We will never subscribe anyone who does not explicitly agree to a subscription.
Over the course of a year, we mail quarterly letters and fundraising letters, as well as one or two updates as events demand. If, during the course of a fundraising campaign, you make a donation, we will do our best to remove you from the remainder of fundraising mailings that year. We may use your contact information to invite you to ...
Reflections: A Meaningful Partnership between HRDAG and Benetech
I joined the Benetech Human Rights Program at essentially the same time that HRDAG did, coming to Benetech from years of analyzing data for large companies in the transportation, hospitality and retail industries. But the data that HRDAG dealt with was not like the data I was familiar with, and I was fascinated to learn about how they used the data to determine "who did what to whom." Although some of the methodologies were similar to what I had experience with in the for-profit sector, the goals and beneficiaries of the analyses were very different.
At Benetech, I was initially predominantly focused on product management for Martus, a free ...
Multiple Systems Estimation: The Matching Process
<<Previous post: Collection, Cleaning, and Canonicalization of Data
Q8. What do you mean by "overlap," and why are overlaps important?
Q9. [In depth] Why is automated matching so important, and what process do you use to match records?
Q8. What do you mean by "overlap," and why are overlaps important?
MSE estimates the total number of violations by comparing the size of the overlap(s) between lists of human rights violations to the sizes of the lists themselves. By "overlap," we mean the set of incidents, such as deaths, that appear on more than one list of human rights violations. Accurately and efficiently identifying overlaps between ...
Trips to and from Guatemala
HRDAG has been working with the Historic Archive of the National Police in Guatemala (hereafter, the Archive) for the past seven years. The Archive contains a treasure trove of data recorded and kept by the Guatemalan National Police over the past century. When the Archive was first discovered in 2005, researchers there immediately recognized both the value and fragility of the tens of millions of documents. As a result, they reached out to HRDAG, and we reached out to volunteers at Westat to devise a plan to estimate the contents of the entire Archive as quickly as possible in case the documents were destroyed or access to them was limited. ...
Guatemala 2011 – Developing Sampling Methods to Help Convict Perpetrators
During 36 years of internal armed conflict, which ended in 1996, an estimated 200,000 Guatemalans were killed or disappeared. HRDAG researchers returned to Guatemala in 2006 to analyze a sample of the estimated 46 million records discovered in the archive of the now disbanded Guatemalan National Police. HRDAG statisticians Daniel Guzmán, Romesh Silva, Patrick Ball and Tamy Guberek, together with Paul Zador and Gary Shapiro of the American Statistical Association, developed a multi-stage random sample of the archive to get a clearer picture of its contents. Sampled documents shed light on the disappearance of Guatemalan union leader Edgar Fernando ...
BJS Report on Arrest-Related Deaths: True Number Likely Much Greater
(This post is co-authored by Patrick Ball and Kristian Lum.)
Today the Bureau of Justice Statistics (BJS) released a report on their effort to document “all deaths that occur during the process of arrest in the United States.” The analysis estimates that the Arrest-Related Deaths (ARD) program covers only 34-49% of these deaths. A parallel program by the FBI (the Supplementary Homicide Reports, SHR) is estimated to cover approximately the same proportion of deaths. Even taking into consideration both programs, 28% of all police homicides remain unreported.
In order to estimate the total number of homicides that appear on neither the ARD or ...
Tech Corner
The HRDAG Tech Corner is where we collect the deeper and geekier content that we create for the website. Click the accordion blocks below to reveal each of the Tech Corner entries.
Sifting Massive Datasets with Machine Learning
Principled Data Processing
An Award for Anita Gohdes
On November 26, HRDAG colleague Anita Gohdes was awarded the German Dissertation Prize for the Social Sciences. The patron of the prize is the President of the German Parliament, Norbert Lammert, who presented Anita with the award.
Anita’s dissertation, “Repression 2.0: The Internet in the War Arsenal of Modern Dictators,” investigates the role played by social media networks in modern dictatorships, such as President Assad’s regime in Syria. On one hand, Anita argues, social media can help opposition groups to organize more effectively, but on the other hand, the same networks allow regimes to monitor and manipulate the population. ...
Rapid response to: Civilian deaths from weapons used in the Syrian conflict
On November 4, 2015, the BMJ published our "Rapid Response" to Civilian deaths from weapons used in the Syrian conflict (BMJ 2015;351:h4736). The response was co-authored by Megan Price, Anita Gohdes, Jay Aronson (Carnegie Mellon University, Center for Human Rights Science), and Christopher McNaboe (Carter Center, Syria Conflict Mapping Project).
We have three concerns about this article. First, the article apportions responsibility for casualties to particular perpetrator organizations based on a single snapshot of territorial control that ignores the numerous (and well-documented) changes in this phenomenon over time. Second, combining Syrian ...
Ten Years and Counting in Guatemala
We have accomplished so much in the last 10 years at the Historical Archive of the National Police. And yet, despite the efforts, dedication, and commitment of each person who since 2006 has worked in the AHPN, we still can not say “mission accomplished.”
In 10 years the environment at the Archive has changed so much and become so full of life. Where the building once sheltered unknown stories, over time some of those stories have been revealed. But Guatemala has a long way to go in letting the world get to know more deeply about the secrets within the documents stored there.
Guatemalans and the rest of the world have a very important ...
When Data Doesn’t Tell the Whole Story
This blog is a part of International Justice Monitor’s technology for truth series, which focuses on the use of technology for evidence and features views from key proponents in the field.
As highlighted by other posts in this series, emerging technology is increasing the amount and type of information available, in some contexts, to criminal and other investigations. Much of what is produced by these emerging technologies (Facebook posts, tweets, YouTube videos, text messages) falls in the category we refer to as “found” data. By “found” data we mean data not generated for a specific investigation, but instead, that is generated for ...
How We Choose Projects
For more than 20 years, HRDAG has been carving out a niche in the international human rights movement. We know what we’re good at and what we’re not qualified to do. We know what quantitative questions we think are important for the community, and we know what we like to do. These preferences guide us as we consider whether to take on a project. We’re scientists, so our priorities will come as no surprise. We like to stick to science (not ideology), avoid advocacy, answer quantifiable questions, and increase our scientific understanding.
While we have no hard-and-fast rules about what projects to take on, we organize our deliberation ...
How many police homicides in the US? A reconsideration
(This post is co-authored by Patrick Ball and Kristian Lum.)
In early March, the Bureau of Justice Statistics published a report that estimated that in the period 2003-2009 and 2011, there were approximately 7427 homicides committed by police in the US. We responded that the method the analysts used, capture-recapture with two databases, is vulnerable to underestimation if the databases exhibit positive dependence. We conduct a thorough sensitivity analysis on the original independence model as applied to the police homicides databases. We used information from several other countries where our partners created multiple databases of homicides. We ...
HRDAG Retreat 2015
I look at the beach and then at the table surrounded by nerds, deep in thought and conversation about Dirichlet priors, matching algorithms, and armed conflicts. This peculiar (in the best way) environment catalyzes a moment of reflection: how did I get here?
Four years ago, as a second-year statistics PhD student, I watched "Guatemala: The Secret Files" on PBS Frontline World. I listened to stories of family members who disappeared without answers or justice. Then the story shifted to the work being done by archivists and data experts at Guatemala's Historic Archive of the National Police. The scientists' pursuit of the truth energized me. I ...
The Great Lessons in Research at the Archive
Doing an investigation on the contents of the Archive brought with it three major lessons. The first big lesson was the constant movement (nothing was static), The second great lesson was that everything evolved (the changes were a constant). The third major lesson was to discover how two institutions can work together while geographically far apart.
The constant movement
As there were other processes being carried out at the Archive, everything was in constant movement. In other words, one day the documents were in X location and tomorrow they may be in location Y or dispersed in multiple locations. This made it impossible to know with certai...
HRDAG and the Digital Commons
One of the three main goals of HRDAG is education and outreach, and to that end we use Creative Commons licenses for all of our blogposts and, whenever possible, for our publications. Using a Creative Commons license makes it clear that educators are free to use HRDAG's publications, in their entirety, and with the peace of mind that they are doing so with our blessing.
Also, the use of the Creative Commons license allows us to participate in and encourage the creation of a digital commons, which we feel helps to advance another one of our goals, the creation of knowledge. We feel that it’s important to offer up our publications for use and reuse ...
Data Mining for Good: Thoreau Center Lunch + Learn
At the Thoreau Center for Sustainability's “Lunch and Learn,” Patrick Ball spoke about “Data Mining for Good.” The talk included a discussion of how HRDAG uses random sampling, entity resolution, communications metadata, and statistical modeling to assist prosecutions of human rights violators. With an introduction by John DeCock, Chief Operating and Outreach Officer, Bioneers.
The Thoreau Center for Sustainability
Lunch and Learn
October 23, 2014
San Francisco, California
Back to Talks
The AHPN: Home of Stories Old and New
Access to the records contained in archives is a concern shared by many. Archives support memory and free access to them strengthens democratic processes. Everyone should be allowed to see first-hand the records contained in an archive and be free to interpret them as needed.
Access to archives can increase knowledge on various topics and opens opportunities for different fields of knowledge. (more…)
Why Collecting Data In Conflict Zones Is Invaluable—And Nearly Impossible
HRDAG's work in Kosovo and in the Guatemalan trial of General José Efraín Ríos Montt is discussed in this article. Megan Price, HRDAG's director of research, is quoted. “There is a wide variety of things that could be considered data,” she says.
From the story:
Price’s main data analysis tool requires fitting a model to the data that ends up in her lap. That way, she can see whether there are gaps in the data and what more needs to be included. The method, called multiple systems estimation analysis, lets Price look at patterns across lists of data, for example, lists of victims. The resulting model reveals how much data is missing, to a ...
Using Data and Statistics to Bring Down Dictators
In this story, Guerrini discusses the impact of HRDAG's work in Guatemala, especially the trials of General José Efraín Ríos Montt and Colonel Héctor Bol de la Cruz, as well as work in El Salvador, Syria, Kosovo, and Timor-Leste. Multiple systems estimation and the perils of using raw data to draw conclusions are also addressed.
Megan Price and Patrick Ball are quoted, especially in regard to how to use raw data.
“From our perspective,” Price says, “the solution to that is both to stay very close to the data, to be very conservative in your interpretation of it and to be very clear about where the data came from, how it was collected, what ...